Search Results

The ARIES® Group A Strep Assay is a real-time polymerase chain reaction (PCR) based qualitative in vitro diagnostic test for the direct detection of Streptococus pyogenes (Group A beta-hemolytic Streptococcus) in throat swab specimens from patients with signs and symptoms of pharyngitis.

The ARIES® Group A Strep Assay can be used as an aid in the diagnosis of Group A Streptococcal pharyngitis. The assay is not intended to monitor treatment for Group A Streptococcus infections.

The ARIES® Group A Strep Assay is indicated for use with ARIES® Systems.

The ARIES® Group A Strep Assay is a polymerase chain reaction (PCR)-based qualitative in vitro diagnostic test system that consists of the ARIES® System or the ARIES® M1 System with their included ARIES® Software, an assay-specific cassette, and an assay-specific protocol file. The ARIES® Group A Strep Assay cassette is a disposable, single-use cassette containing nucleic acid purification reagents, internal sample process control (SPC), and an assay-specific master mix capable of performing the designated assay on one sample. The ARIES® Group A Strep Assay cassette directly detects Streptococcus pyoqenes (Group A ß-hemolytic Streptococcus) in throat swab specimens collected from the surface of human tonsils and posterior pharyngeal wall.

Throat swab specimens are collected from patients using a commercially available Liquid Amies based transport system (Nylon Flocked Swab with 1 mL modified Liquid Amies (ESwab™). The specimen is then transported to the laboratory for testing.

The specimen is lysed and nucleic acid is extracted using an ARIES® System. An extractable sample processing control (SPC) target is present in the ARIES® Group A Strep Assay cassette and is processed with the specimen. The SPC controls for recovery of extracted nucleic acid, the presence of inhibitory substances and for PCR reagent and instrument integrity. The Ct value of the SPC is designed to verify nucleic acid extraction, to identify PCR inhibition, if any, and verify proper function of the extraction system and real-time instrument. The Tm value of the SPC is used as a reference for determining the target Tm.

The extracted nucleic acid and SPC are transferred via magnetic beads through the cassette to the ARIES® Group A Strep Assay lyophilized PCR reagents in the PCR tube that contains primer pairs specific to the S. pyogenes DNaseB (sdaB) gene and the SPC sequence. Each of the primer pairs is labeled with a distinct fluorophore and detected in distinct channels of the ARIES® Systems. PCR amplification is performed and assay fluorescence is monitored. Incorporation of a quencher-labeled nucleotide results in a decrease in fluorescence for the associated primer pair. Following amplification, the reaction is slowly heated to separate the fluorescent-labeled strand from the quencher-labeled strand, a process that results in an increase in the fluorescence signal. The reaction fluorescence is measured during this process and the temperature at which the change in fluorescence is the maximum is the T ,, of the amplicon. The instrument fluorescence output is analyzed and test results are determined using the ARIES® System software and the ARIES® Group A Strep Assay protocol and run files. ARIES® Group A Strep Assay results may be reported from the ARIES® Software or from the optional SYNCT® Software.

Here's a breakdown of the acceptance criteria and the study details for the ARIES® Group A Strep Assay, based on the provided document:

1. Table of Acceptance Criteria and Reported Device Performance

Note: For Lot-to-Lot Reproducibility (Low Positive) and Within-Laboratory Precision/Repeatability (Low Positive), additional replicates were tested to achieve an overall positivity >94%, indicating acceptable performance at the LoD.

2. Sample Size Used for the Test Set and Data Provenance

• Sample Size for Clinical Performance (Test Set): A total of 618 unique specimens were available for analysis in the clinical performance study. Initially, 735 specimens were collected, but 112 were excluded due to various reasons (protocol non-compliance, insufficient volume, incorrect device, etc.).
• Data Provenance: The data was prospectively collected from patients suspected of pharyngitis in four geographically distinct clinical sites within the United States.

3. Number of Experts Used to Establish Ground Truth for the Test Set and Qualifications of Those Experts

The document does not explicitly state the "number of experts" or their specific "qualifications" (e.g., "Radiologist with 10 years of experience") for establishing the ground truth of the clinical test set.

However, the ground truth for the clinical test set was established by a "reference method (bacterial culture followed by organism identification by Matrix-Assisted Laser Desorption/Ionization - Time-of-Flight Mass Spectrometry (MALDI-TOF MS))". This work was "performed at a centralized testing facility." It is implied that trained laboratory personnel and microbiologists conducted these reference tests, as is standard practice for such methods, but their specific experience levels are not detailed.

4. Adjudication Method for the Test Set

The document describes a robust "ground truth" establishment process using a reference laboratory technique (bacterial culture + MALDI-TOF MS). For specimens where the ARIES assay and the reference method disagreed, an adjudication method was employed:

• Bidirectional sequencing analysis using analytically validated primers that targeted genomic regions distinct from the ARIES Group A Strep Assay was used.
  • For 2 false negative ARIES results (ARIES negative, culture positive), sequencing showed them to be GAS negative.
  • For 7 false positive ARIES results (ARIES positive, culture negative), sequencing showed them to be GAS positive.
    This indicates a method similar to "Truth by Consensus" with an expert-level tie-breaker (sequencing), effectively refining the ground truth against discrepancies.

5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

No, a Multi-Reader Multi-Case (MRMC) comparative effectiveness study was not done. This device is an in vitro diagnostic (IVD) assay that machine-interprets results (qualitative PCR). It does not involve human "readers" assessing images or data in a way that would be "assisted" by AI, hence the concept of a human reader improvement effect size does not apply.

6. If a Standalone (i.e. algorithm only without human-in-the-loop performance) was done

Yes, a standalone performance evaluation was done. The ARIES® Group A Strep Assay is an automated qualitative in vitro diagnostic test system. The clinical performance study directly assessed the agreement of the ARIES® Group A Strep Assay (algorithm only within the ARIES® Systems) against the established reference method, without human interpretation of the assay's raw output. The results (Positive, Negative, Invalid) are determined by the ARIES® System software.

7. The Type of Ground Truth Used (expert consensus, pathology, outcomes data, etc)

The ground truth used for the clinical performance study was primarily bacterial culture followed by organism identification by Matrix-Assisted Laser Desorption/Ionization - Time-of-Flight Mass Spectrometry (MALDI-TOF MS). In cases of discordance with the assay, bidirectional sequencing analysis was used as a confirmatory "higher truth" method. This can be considered a form of expert consensus/gold standard laboratory method.

8. The Sample Size for the Training Set

The document does not explicitly state a sample size for a training set. The ARIES® Group A Strep Assay is a PCR-based diagnostic test, where the "training" typically involves empirical optimization of assay parameters (primers, probes, reaction conditions, and cut-offs) during product development and internal verification studies, rather than machine learning on a distinct "training set" of patient data. The "Initial Assay Protocol File parameters were set during internal optimization studies" and "The final Assay Protocol File parameters were then established during internal verification studies." So, the optimization and verification process served a similar function to "training" for machine learning algorithms.

9. How the Ground Truth for the Training Set Was Established

As noted in point 8, a traditional "training set" with separate ground truth establishment isn't described in the context of a PCR assay. Instead, the "ground truth" for optimizing the assay protocol file parameters (Ct cut-off, Tm window, Tm Peak Threshold) was established through internal optimization and verification studies. These studies likely involved testing known positive and negative S. pyogenes samples (e.g., well-characterized strains, spiked samples) to define the optimal performance characteristics of the assay before clinical validation.

Ask a specific question about this device