(80 days)
The Cepheid® Xpert® MRSA/SA Blood Culture Assay, performed on the GeneXpert® Instrument Systems, is a qualitative in vitro diagnostic test intended for the detection of Staphylococcus aureus (SA) and methicillin-resistant Staphylococcus aureus (MRSA) DNA directly from positive blood cultures. The assay utilizes automated real-time polymerase chain reaction (PCR) for the amplification of MRSA/SA specific DNA targets and fluorogenic target-specific hybridization probes for the real-time detection of the amplified DNA. The assay is performed directly on positive blood culture samples from BD BACTEC™ Plus Aerobic/F, BacT/ALERT® SA (Standard Aerobic) or VersaTREK REDOX 1® (aerobic) blood culture bottles that are determined by Gram Stain as Gram Positive Cocci in Clusters (GPCC) or as Gram Positive Cocci in singles (GPC). The Xpert MRSA/SA Blood Culture Assay is indicated for use in conjunction with other laboratory tests, such as culture, and clinical data available to the clinician as an aid in the detection of MRSA/SA from positive blood cultures. Subculturing of positive blood cultures is necessary to recover organisms for susceptibility testing or for epidemiological typing. The Cepheid Xpert MRSA/SA Blood Culture Assay is not intended to monitor treatment for MRSA/SA infections.
The Cepheid Xpert® MRSA/SA Blood Culture Assay (Xpert MRSA/SA Blood Culture Assay) is a rapid, automated DNA test for the simultaneous qualitative detection of MRSA and SA DNA directly from blood culture bottle specimens that are detected as positive for microbial growth and shown to contain Gram Positive Cocci by Gram stain. The primers and probes in the Xpert MRSA/SA Assay detect nucleic acid sequences of the staphylococcal protein A (spa), the gene for methicillin/oxacillin resistance (mecA), and staphylococcal cassette chromosome (SCCmec) inserted in the SA chromosomal attB site.
The test includes a Sample Processing Control (SPC) to control for adequate processing of the target bacteria and to monitor the presence of inhibitor(s) in the PCR assay. The Probe Check Control (PCC) verifies reagent rehydration, PCR tube filling in the cartridge, probe integrity, and dye stability.
The specimen for testing with the Xpert MRSA/SA Blood Culture Assay consists of an aliquot taken from a positive blood culture bottle. Using one of the disposable fixed 50 µL volume transfer pipettes provided with the test kit, an aliquot of the positive blood culture is transferred into a single-use tube of Elution Reagent, also provided with the kit. The Elution Reagent is briefly vortexed and the entire content is transferred to the "S" chamber of the disposable fluidic cartridge (the Xpert MRSA/SA Blood Culture Assay cartridge), after which the cartridge is ready to place on the instrument.
The assay is performed on the Cepheid GeneXpert Instrument Systems, which automate and integrate sample purification, nucleic acid amplification of the target sequences in simple or complex samples using real-time PCR. The systems consist of an instrument, personal computer, and preloaded software for running the tests and viewing the results. The GeneXpert Instrument Systems require the use of single-use disposable cartridges that hold the PCR reagents and host the PCR process. Because the cartridges are self-contained, crosscontamination between samples is minimized. In this platform, additional sample preparation, amplification, and real-time detection are all fully-automated and completely integrated. The Xpert MRSA/SA Blood Culture Assay performed on the GeneXpert Instrument Systems provides results in approximately 60 minutes.
The GeneXpert Instrument Systems, comprised of the GeneXpert Dx Systems and the GeneXpert Infinity Systems, have 1 to 80 randomly accessible modules, depending upon the instrument, that are each capable of performing separate sample preparation and real-time PCR tests. Each module contains a syringe drive for dispensing fluids (i.e., the syringe drive activates the plunger that works in concert with the rotary valve in the cartridge to move fluids between chambers), an ultrasonic horn for lysing cells or spores, and a proprietary I-CORE® thermocycler for performing real-time PCR and detection.
Here's a breakdown of the acceptance criteria and study details for the Cepheid Xpert® MRSA/SA Blood Culture Assay:
Acceptance Criteria and Reported Device Performance
| Acceptance Criteria | Reported Device Performance |
|---|---|
| Clinical Performance | |
| MRSA Positive % Agreement (PPA) | 98.1% (103/105, 95% CI: 93.3-99.8) |
| MRSA Negative % Agreement (NPA) | 99.6% (684/687, 95% CI: 98.7-99.9) |
| SA Positive % Agreement (PPA) | 99.6% (235/236, 95% CI: 97.7-99.9) |
| SA Negative % Agreement (NPA) | 99.5% (553/556, 95% CI: 98.4-99.9) |
| Limit of Detection (LoD) (95% confidence) | |
| SA | 300 CFU/test (in 50 µL aliquot) |
| MRSA | 400 CFU/test (in 50 µL aliquot) |
| Analytical Specificity (Exclusivity) | 100% (no detection of 101 non-SA/MRSA strains) |
| Inclusivity (Reactivity) | All but 1 out of 250 SA strains correctly identified (1 SA strain with novel mecA not detected as MRSA) |
| Assay Success Rate | 99.6% (792/795) |
| Reproducibility | |
| MRSA-1 low pos: 100% agreement | |
| MRSA-1 mod pos: 100% agreement | |
| MRSA-2 low pos: 100% agreement | |
| MRSA-2 mod pos: 100% agreement | |
| MSSA low pos: 97.8% agreement | |
| MSSA mod pos: 100% agreement | |
| Negative-1: 100% agreement | |
| Negative-2: 100% agreement |
Study Details
-
Sample size used for the test set and the data provenance:
- Sample Size: A total of 792 specimens were tested for MRSA and SA.
- Data Provenance: The data was collected from a multi-site prospective study at eight US institutions.
-
Number of experts used to establish the ground truth for the test set and the qualifications of those experts:
- The document does not explicitly state the number of experts or their specific qualifications for establishing ground truth within the clinical comparison study.
- The ground truth was established by reference culture results and susceptibility testing, which are standard laboratory practices and would generally involve trained microbiologists or laboratory technicians rather than individual "experts" in the context of interpretation. Susceptibility testing was performed in accordance with CLSI documents M2-A11 and M100-S22, using cefoxitin disc as a surrogate for methicillin/oxacillin resistance, indicating reliance on established guidelines.
-
Adjudication method for the test set:
- The document does not specify an explicit adjudication method (like 2+1 or 3+1). The ground truth was determined by comparing the device's results to "reference culture results and susceptibility testing (the current standard of care)." This implies a direct comparison to established laboratory methods, rather than an expert consensus process for adjudication of conflicting results between readers.
-
If a multi-reader multi-case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:
- No, a multi-reader multi-case (MRMC) comparative effectiveness study was not done. This device is a Nucleic Acid Amplification Test (NAAT), which is an automated molecular diagnostic test producing a definitive positive/negative result, not an imaging-based AI system that would assist human readers in interpretation. Therefore, the concept of human readers improving with or without AI assistance is not applicable here.
-
If a standalone (i.e. algorithm only without human-in-the-loop performance) was done:
- Yes, a standalone performance study was done. The entire clinical comparison study (792 specimens) directly evaluated the performance of the Xpert MRSA/SA Blood Culture Assay (an automated DNA test) against reference culture methods. The device's output is a definitive positive or negative result for MRSA and SA, generated automatically by the instrument system without human interpretive input for each individual test result.
-
The type of ground truth used (expert consensus, pathology, outcomes data, etc):
- The ground truth used was reference culture results and susceptibility testing. This represents established laboratory diagnostic methods considered the "standard of care" for identifying and characterizing Staphylococcus aureus and Methicillin-resistant Staphylococcus aureus.
-
The sample size for the training set:
- The document focuses on the validation or test set performance rather than detailing a specific "training set" in the context of machine learning. The device is a NAAT, meaning its "learning" or development process involved analytical studies (inclusivity, LoD, specificity, etc.) and wet-lab experiments during its development, rather than observational data-driven machine learning.
- For analytical inclusivity (reactivity), 250 SA strains (47 MSSA and 203 MRSA) from multiple sources were tested. This could be considered part of the development/training of the assay's target detection capabilities, but it's not a "training set" in the common AI/ML sense.
-
How the ground truth for the training set was established:
- As noted above, a "training set" in the machine learning sense is not directly applicable. For the analytical studies that inform the assay's design and performance claims:
- Analytical Inclusivity (Reactivity): Strains were characterized by methods like pulsed-field gel electrophoresis (PFGE) to confirm their USA types and classifications (e.g., USA100, USA300, USA400). The document also mentions a SA strain (LGA251) with a novel mecA gene (SCCmec type XI) which was incorrectly identified, implying that the ground truth for these strains was established through advanced genomic and microbiological characterization.
- Limit of Detection (LoD): Ground truth was established by precise quantification of bacterial cells (CFU/mL, then CFU/test) using plate counts in triplicate.
- Analytical Specificity (Exclusivity): Organisms were identified as Gram positive, Gram negative, or yeast, and specifically classified (e.g., methicillin-sensitive, coagulase negative Staphylococcus) based on standard microbiological techniques and sourced from reputable culture collections (ATCC, CCUG, NCTC, NARSA).
- As noted above, a "training set" in the machine learning sense is not directly applicable. For the analytical studies that inform the assay's design and performance claims:
§ 866.1640 Antimicrobial susceptibility test powder.
(a)
Identification. An antimicrobial susceptibility test powder is a device that consists of an antimicrobial drug powder packaged in vials in specified amounts and intended for use in clinical laboratories for determining in vitro susceptibility of bacterial pathogens to these therapeutic agents. Test results are used to determine the antimicrobial agent of choice in the treatment of bacterial diseases.(b)
Classification. Class II (performance standards).