Search Results
Found 3 results
510(k) Data Aggregation
(90 days)
Xpert Carba-R
The Xpert® Carba-R Assay, performed on the GeneXpert® Instrument Systems, is a qualitative in vitro diagnostic test designed for the detection and differentiation of the blakes, blaypy, blaxx -8, and blang gene sequences associated with carbapenem-non-susceptibility. The test utilizes automated real-time polymerase chain reaction (PCR).
The Xpert Carba-R Assay is intended as an aid to infection of carbapenem-non-susceptible bacteria that colonize patients in healthcare settings. A negative Xpert Carba-R Assay result does not preclude the presence of other resistance mechanisms.
The Xpert Carba R-Assay is for use with the following sample types:
Pure Colonies
The assay is performed on carbapentible pure colonies of Enterobacteriaceae. Acinetobacter baumannii. or Pseudomonas aeruginosa, when grown on blood agar or MacConkey agar. For testing pure colonies, the Xpert Carba-R Assay should be used in conjunction with other laboratory tests including phenotypic antimicrobial susceptibility testing.
The identification of a blawy, blayin metallo-beta-lactamase gene (i.e., the genes that encode the INP, NDM, and VIM metallo-beta-lactamases, respectively) may be used as an aid to clinicians in determining appropriate therapeutic strategies for patients with known or suspected carbapenem-non- susceptible bacterial infections.
Rectal and Perirectal Swab Specimens
The assay is performed on rectal swab specimens from patients at risk for intestinal colonization with carbapenem-non-susceptible bacteria. Concomitant cultures are necessary to recover organisms for epidemiological typing, antimicrobial susceptibility testing, and for further confirmatory bacterial identification.
The Xpert Carba-R Assay, when performed on rectal and perirectal swab specimens, is not intended to guide or monitor treatment for carbapenem-non-susceptible bacterial infections or to determine infection from carbapenem-nonsusceptible bacteria.
The Xpert Carba-R Assay is an automated real-time polymerase chain reaction (PCR) in vitro diagnostic test for qualitative detection of the blakpo, blaymy, blavny, blaoxa-as, and blamp gene sequences from rectal or perirectal swab specimens or isolates of pure cultures of carbapenem-non-susceptibility gram-negative bacteria. The Xpert Carba-R Assay is intended as an aid for infection control for monitoring the spread of carbapenem-non-susceptible organisms in healthcare settings.
The Xpert Carba-R Assay is performed on the Cepheid GeneXpert® Instrument Systems (GeneXpert Dx, GeneXpert Infinity-48, GeneXpert Infinity-48s, and GeneXpert Infinity-80 systems). The GeneXpert Instrument System platform automates sample preparation, amplification and real-time detection.
The GeneXpert Instrument Systems require the use of single-use, disposable cartridges (the Xpert Carba-R cartridges) that hold the PCR reagents and host the PCR process. Because the cartridges are self-contained and specimens never come into contact with working parts of the instrument modules, cross-contamination between samples is minimized.
The Xpert Carba-R Assay cartridges contain reagents for the detection of blaxpy blayDM blaym, blacks, and blandp gene sequences. A Sample Processing Control (SPC) and a Probe Check Control (PCC) are controls utilized by the GeneXpert Instrument System platform. The SPC is present to control for adequate processing of the target bacteria and to monitor the presence of inhibitors in the real-time PCR reaction to reduce the possibility of false negative results. The PCC verifies reagent rehydration, real-time PCR tube filling in the cartridge, probe integrity, and dye stability.
The single-use, multi-chambered fluidic cartridges are designed to complete sample preparation and real-time PCR for the detection of the blakpc, blaNDM, blagxA-48 and blamp gene sequences from rectal or perirectal swab specimens or isolates of pure cultures of carbapenem-non- susceptibility gram-negative bacteria in approximately 50 minutes. The GeneXpert Instrument Systems, comprised of the GeneXpert Dx Systems and the GeneXpert Infinity Systems, have 1 to 80 randomly accessible modules, depending upon the instrument, that are each capable of performing separate sample processing and real-time PCR and RT- PCR tests. Each module contains a syringe drive for dispensing fluids (i.e., the syringe drive activates the plunger that works in concert with the rotary valve in the cartridge to move fluids between chambers), an ultrasonic horn for lysing cells or spores, and a proprietary I-CORE® thermocycler for performing real-time PCR and RT-PCR and detection.
Rectal or perirectal swab specimens or bacterial isolates from culture are placed into a sample reagent. The sample is transferred to the sample chamber of the disposable fluidic cartridge (the Xpert Carba-R cartridge). The user initiates a test from the system user interface and places the cartridge into the GeneXpert instrument platform, which performs hands-off real-time, multiplex PCR for detection of the blakers, blayDM blaym, blacks, and blamp gene sequences. The results are automatically generated at the end of the process in a report that can be viewed and printed.
Here's an analysis of the provided text, focusing on the acceptance criteria and the study that proves the device meets them, structured according to your request.
Device Name: Xpert® Carba-R Assay
1. Acceptance Criteria and Reported Device Performance
The document doesn't explicitly state "acceptance criteria" in a numbered or bulleted list with corresponding performance numbers for each criterion, as would be ideal in a formal acceptance criteria table. However, based on the non-clinical and clinical studies presented, we can infer the acceptance criteria and the device's performance against them, particularly focusing on the clinical performance as that's often tied to regulatory acceptance.
The primary measure of clinical performance for this diagnostic device is Positive Percent Agreement (PPA) and Negative Percent Agreement (NPA) against a reference method. Analytical criteria include Limit of Detection (LoD), inclusivity (analytical reactivity), and analytical specificity (cross-reactivity).
Inferred Acceptance Criteria and Reported Device Performance (with direct performance data as provided):
Criterion Type | Specific Criterion | Acceptance Threshold (Inferred) | Reported Device Performance (Test Set) | Basis for Performance (Study type, section) |
---|---|---|---|---|
Clinical Performance | PPA vs. Reference Method (Prospective) | High (e.g., >95%) | IMP: N/A (0 TP) | |
VIM: N/A (0 TP) | ||||
NDM: 100% (95% CI: 20.7-100) | ||||
KPC: 100% (95% CI: 34.2-100) | ||||
OXA-48: 100% (95% CI: 20.7-100) | Clinical Studies - Prospective Perirectal Specimens (Table 8-11) | |||
NPA vs. Reference Method (Prospective) | High (e.g., >95%) | IMP: 100% (95% CI: 99.6-100) | ||
VIM: 100% (95% CI: 99.6-100) | ||||
NDM: 100% (95% CI: 99.6-100) | ||||
KPC: 99.6% (95% CI: 98.9-99.8) | ||||
OXA-48: 99.9% (95% CI: 99.4-100) | Clinical Studies - Prospective Perirectal Specimens (Table 8-11) | |||
PPA vs. Reference Method (Contrived) | 100% | IMP: 100% (95% CI: 95.4-100) | ||
VIM: 100% (95% CI: 95.5-100) | ||||
NDM: 100% (95% CI: 95.4-100) | ||||
KPC: 100% (95% CI: 95.4-100) | ||||
OXA-48: 100% (95% CI: 95.4-100) | Clinical Studies - Contrived Specimen Results (Table 8-14) | |||
NPA vs. Reference Method (Contrived) | 100% | IMP: 100% (95% CI: 98.9-100) | ||
VIM: 100% (95% CI: 98.9-100) | ||||
NDM: 100% (95% CI: 98.9-100) | ||||
KPC: 100% (95% CI: 98.9-100) | ||||
OXA-48: 100% (95% CI: 98.9-100) | Clinical Studies - Contrived Specimen Results (Table 8-14) | |||
Perirectal vs. Rectal Swab Equivalence (PPA) | High (e.g., >90%) | 94.7% (95% CI: 75.4-99.1) | Clinical Studies - Perirectal Swab and Rectal Swab Equivalence Study (Table 8-15) | |
Perirectal vs. Rectal Swab Equivalence (NPA) | High (e.g., >90%) | 97.8% (95% CI: 94.5-99.1) | Clinical Studies - Perirectal Swab and Rectal Swab Equivalence Study (Table 8-15) | |
Analytical Studies | Limit of Detection (LoD) | Low CFU/swab | See Table 8-2 (ranges from 56 to 1303 CFU/swab depending on target) | Non-Clinical Studies - Analytical Sensitivity (Table 8-2) |
Analytical Reactivity (Inclusivity) | Detection of broad panel | 69 of 72 carbapenemase-producing bacterial strains detected (IMP-4 detected at higher conc, 3 strains not detected) | Non-Clinical Studies - Analytical Reactivity (Table 8-3) | |
Analytical Specificity (Cross-reactivity) | 100% Specificity (no cross-react.) | 100% (No cross-reaction with 94 potentially cross-reactive organisms/nucleic acids) | Non-Clinical Studies - Analytical Specificity | |
Reproducibility | High Agreement (e.g., >90%) | Overall % Agreement by Sample ranges from 92.4% (VIM Low Pos) to 100% (Neg, Mod Pos, NDM Low Pos) | Non-Clinical Studies - Reproducibility Study (Table 8-16) | |
Carry-Over Contamination | No detectable contamination | All 50 positive samples correctly reported DETECTED; all 52 negative samples correctly reported NOT DETECTED. | Non-Clinical Studies - Carry-Over Contamination | |
Competitive Interference | No significant inhibition | No inhibitory effect observed at 4x LoD for NDM and IMP. Inhibition observed at original low concentration (2X LoD) for NDM and IMP. | Non-Clinical Studies - Competitive Interference | |
Potentially Interfering Substances | No significant interference | 22 of 24 substances correctly identified. Interference with Barium Sulfate (>0.1% w/v) and Pepto-Bismol (>0.025% w/v) observed. | Non-Clinical Studies - Potentially Interfering Substances |
(Note: "N/A" for PPA signifies no True Positives were observed in the prospective study for IMP and VIM, which is reflected in the CI. The acceptance threshold is inferred based on typical diagnostic performance expectations for such devices.)
2. Sample Size and Data Provenance
-
Test Set Sample Sizes:
- Prospective Clinical Study (Perirectal Swab Specimens): 924 eligible specimens (from an initial 963 enrolled).
- Contrived Clinical Study (Perirectal Swab Matrix): 432 specimens.
- Perirectal vs. Rectal Swab Equivalence Study: 201 eligible specimens (from an initial 207 enrolled).
- Analytical Sensitivity (LoD): 20 replicates for each target (10 carbapenemase-producing organisms) at each concentration level, tested over 4 days, then 10 verification replicates at each estimated LoD.
- Analytical Reactivity (Inclusivity): 72 samples, tested in triplicate at approximately 3X LoD.
- Analytical Specificity (Cross-reactivity): 62 carbapenem-susceptible/non-susceptible bacterial strains, 24 commensal bacterial strains/enteric microorganisms, human cells. Tested in triplicate.
- Carry-Over Contamination: 102 tests (50 high positive, 52 negative).
- Competitive Interference: Replicates of eight for each combination.
- Potentially Interfering Substances: 8 replicates of positive samples and 8 replicates of negative samples tested per substance (24 substances).
- Reproducibility: 11 samples x 4 replicates/day x 6 days x 2 operators x 3 sites = 1584 total tests (though 144 replicates per sample type for analysis).
-
Data Provenance:
- Prospective Clinical Study: "Five geographically diverse sites" collected specimens. This implies a multi-center study, likely in the US, given the FDA submission. The study involved patient samples ("subjects who were hospitalized or in a long-term care facility"). This is prospective data collection.
- Contrived Clinical Study: Prepared in perirectal matrix, likely laboratory-based data using spiked samples. This is non-clinical/laboratory data.
- Perirectal vs. Rectal Swab Equivalence Study: "one site enrolling fresh prospectively collected rectal and perirectal swab specimens from consented subjects who were hospitalized in-patients." This is prospective data collection, from a single center.
- Other non-clinical studies (Analytical, Reproducibility, etc.) are laboratory-based and generated data, not patient-derived.
3. Number of Experts and Qualifications (for Ground Truth)
The document does not explicitly state the number of experts or their specific qualifications (e.g., "radiologist with 10 years of experience") used for establishing the ground truth.
For the clinical studies, the reference method involved:
- Culturing the MacConkey enrichment broth.
- Screening for carbapenem-non-susceptible organisms.
- Confirmation by disk diffusion method (per CLSI document M02 and M100).
- DNA extraction, quantification, and amplification with specific primers.
- Confirmation of amplicon size on Agilent 2100 Bioanalyzer.
- For positive cases, sending the amplicon to an independent laboratory for reference bi-directional sequencing analysis, which was validated for detection of the five targets.
While "experts" are implicitly involved in performing and interpreting these complex laboratory procedures, their specific number, roles, and detailed qualifications are not detailed.
4. Adjudication Method for the Test Set
The document mentions discordant analysis for the prospective clinical study.
- "For specimens with discordant results (the Xpert Carba-R Assay was positive for a target gene but a carbapenem-non-susceptible organism was not isolated by reference culture), discordant analysis was performed using bi-directional sequencing on DNA extracted directly from the MacConkey enrichment broth."
- This indicates a process of re-evaluation of discrepancies, but it's not a formal multi-reader, consensus-based adjudication process for initial ground truth establishment. It's a method for clarifying "false positive" results by seeking further molecular evidence in the original sample. No mention of 2+1 or 3+1 for human readers or direct adjudication of AI outputs is present.
5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study
No, a Multi-Reader Multi-Case (MRMC) comparative effectiveness study was not done. This device is a diagnostic assay (molecular test), not an AI system assisting human readers with interpreting images or other data. Therefore, the concept of "how much human readers improve with AI vs without AI assistance" is not applicable here.
6. Standalone Performance
Yes, the studies primarily evaluate the standalone performance of the Xpert Carba-R Assay. The device is a "qualitative in vitro diagnostic test designed for the detection and differentiation of gene sequences." Its performance metrics (PPA, NPA, LoD, specificity, reproducibility) are reported for the device itself, not in conjunction with human interpretation of its results, beyond the clinical correlation implied by its "aid to infection control" indication. It's an "algorithm only" in the sense that it provides a direct qualitative result (DETECTED/NOT DETECTED) based on its PCR analysis.
7. Type of Ground Truth Used
The ground truth for the clinical studies (prospective and contrived) was established by a reference method combination of:
- Culture: MacConkey enrichment broth culture followed by disk diffusion method (per CLSI M02/M100) to confirm carbapenem non-susceptibility.
- DNA Sequencing: Bi-directional DNA sequence analysis of purified and amplified DNA from isolated colonies or, in discordant cases, directly from the MacConkey enrichment broth.
For the analytical studies, the ground truth was established by precise laboratory preparations (e.g., known concentrations of bacterial strains for LoD, well-characterized strains for reactivity and specificity).
8. Sample Size for the Training Set
The document describes premarket clinical trials and analytical studies for testing and validation. There is no mention of a separate "training set" or "training data" in the context of machine learning or AI models. This device is a molecular diagnostic assay (PCR-based), not an AI algorithm that undergoes data-driven training. The development of such a device involves assay design, optimization, and then extensive analytical and clinical validation, but not "training" in the AI sense.
9. How the Ground Truth for the Training Set was Established
As noted above, there is no mention of a "training set" for an AI model. For the development and validation of the PCR assay itself, ground truth for optimization and development would implicitly have been established through a combination of:
- Known Reference Strains: Using well-characterized bacterial strains with confirmed genetic markers.
- Synthetic Oligonucleotides: Designing and testing probes and primers against known sequences.
- Internal Laboratory Experiments: Repeated testing and refinement to achieve desired assay performance characteristics before formal validation studies.
These are common practices in the development of molecular diagnostic assays, but they are not described as AI-style "training" with a dedicated "training set."
Ask a specific question about this device
(89 days)
Xpert Carba-R
The Xpert® Carba-R Assay, performed on the GeneXpert® Instrument Systems, is a qualitative in vitro diagnostic test designed for the detection and differentiation of the blaker, blaNDM, blayIM, blackA-48, and blanny gene sequences associated with carbapenem-non-susceptibility. The test utilizes automated real-time polymerase chain reaction (PCR),
The Xpert Carba-R Assay is intended as an aid to infection of carbapenem-non- susceptible bacteria that colonize patients in healthcare settings. The Xpert Carba-R Assay is not intended to guide or monitor treatmannon-susceptible bacterial infections. A negative Xpert Carba-R Assay result does not preclude the presence of other resistance mechanisms.
The Xpert Carba-R Assay is for use with the following sample types:
Rectal Swab Specimens
The assay is performed on rectal swab specimens at risk for intestinal colonization with carbapenem-non-susceptible bacteria. Concomitant cultures are necessary to reanisms for epidemiological typing, antimicrobial susceptibility testing, and for further confirmatory bacterial identification.
Pure Colonies
The assay is performed on carbapenen-non-susceptible pure colonies of Enterobacter baumanni, or Pseudomonas aeruginosa, when grown on blood agar or MacConkey agar. For testing pure colonies, the Xpert Carba-R Assay should be used in conjunction with other laboratory tests including phenotypic antimicrobial susceptibility testing.
The Xpert Carba-R Assay is an automated real-time polymerase chain reaction (PCR) in vitro diagnostic test for qualitative detection of the blaxpc, blaym, blaoxa-a8, and blamp gene sequences from rectal swab specimens. The Xpert Carba-R Assay is intended as an aid for infection control for monitoring the spread of carbapenem-nonsusceptible organisms in healthcare settings.
The Xpert Carba-R Assay is performed on the Cepheid GeneXpert® Instrument Systems (GeneXpert Dx, GeneXpert Infinity-48, GeneXpert Infinity-48s, and GeneXpert Infinity-80 systems). The GeneXpert Instrument System platform automates sample preparation. amplification and real-time detection.
The GeneXpert Instrument Systems require the use of single-use, disposable cartridges (the Xpert Carba-R cartridges) that hold the PCR reagents and host the PCR process. Because the cartridges are self-contained and specimens never come into contact with working parts of the instrument modules, cross-contamination between samples is minimized.
The Xpert Carba-R Assay cartridges contain reagents for the detection of blakec, blanDM, blaym, blaox 8-8, and blance gene sequences. A Sample Processing Control (SPC) and a Probe Check Control (PCC) are controls utilized by the GeneXpert Instrument System platform. The SPC is present to control for adequate processing of the target bacteria and to monitor the presence of inhibitors in the real-time PCR reaction to reduce the possibility of false negative results. The PCC verifies reagent rehydration, real-time PCR tube filling in the cartridge, probe integrity, and dye stability.
The single-use, multi-chambered fluidic cartridges are designed to complete sample preparation and real-time PCR for the detection of the blaker, blanny, blaoxA-48. and blank gene sequences from rectal swab specimens in approximately 50 minutes. The GeneXpert Instrument Systems, comprised of the GeneXpert Dx Systems and the GeneXpert Infinity Systems, have 1 to 80 randomly accessible modules, depending upon the instrument, that are each capable of performing separate sample processing and realtime PCR and RT- PCR tests. Each module contains a syringe drive for dispensing fluids (i.e., the syringe drive activates the plunger that works in concert with the rotary valve in the cartridge to move fluids between chambers), an ultrasonic horn for lysing cells or spores, and a proprietary I-CORE® thermocycler for performing real-time PCR and RT-PCR and detection.
Rectal swab specimens are placed into a sample reagent. The sample is transferred to the sample chamber of the disposable fluidic cartridge (the Xpert Carba-R cartridge). The user initiates a test from the system user interface and places the cartridge into the GeneXpert instrument platform, which performs hands-off real-time, multiplex PCR for detection of the blaker, blaypy, blaym, blaoxy-48, and blane gene sequences. The results are automatically generated at the end of the process in a report that can be viewed and printed.
Here’s a summary of the acceptance criteria and the study that proves the device meets them, based on the provided text:
Device: Xpert® Carba-R Assay
Indications for Use: Qualitative in vitro diagnostic test for the detection and differentiation of blaKPC
, blaNDM
, blaVIM
, blaOXA-48
, and blaIMP
gene sequences associated with carbapenem-non-susceptibility. Intended as an aid to infection control for detecting carbapenem-non-susceptible bacteria colonizing patients in healthcare settings (rectal swab specimens). Also for use with carbapenem-non-susceptible pure colonies of Enterobacteriaceae, Acinetobacter baumannii, or Pseudomonas aeruginosa.
1. Table of Acceptance Criteria and Reported Device Performance
The document does not explicitly state "acceptance criteria" for the clinical performance in a separate, clear table. However, the reported performance metrics in the clinical study can be considered as the evidence demonstrating the device meets an implicit acceptance level for regulatory approval. Regulatory bodies typically look for high Positive Percent Agreement (PPA) and Negative Percent Agreement (NPA). Based on the "Prospective Specimen Results" section (Table 5-11), here are the key performance metrics:
Target Gene | PPA (%) (95% CI) | NPA (%) (95% CI) |
---|---|---|
IMP | N/A (0 TP found) | 99.9% (99.3-100.0) |
VIM | 60.0% (31.3-83.2) | 98.9% (97.9-99.5) |
NDM | 100.0% (64.6-100.0) | 99.6% (98.8-99.9) |
KPC | 100.0% (88.3-100.0) | 99.2% (98.2-99.6) |
OXA-48 | 96.7% (83.3-99.4) | 98.6% (97.5-99.2) |
Note on IMP PPA: The PPA for IMP is "N/A" with 0 True Positives (TP) among the prospective specimens, which indicates a very low prevalence of this target in the prospective cohort.
Contrived Specimen Performance (Table 5-14):
Target Gene | PPA (%) (95% CI) | NPA (%) (95% CI) |
---|---|---|
IMP | 95.0% (87.8-98.0) | 100.0% (98.9-100.0) |
VIM | 98.8% (93.4-99.8) | 100.0% (98.9-100.0) |
NDM | 100.0% (95.4-100.0) | 100.0% (98.9-100.0) |
KPC | 100.0% (95.4-100.0) | 100.0% (98.9-100.0) |
OXA-48 | 98.8% (93.3-99.8) | 100.0% (98.9-100.0) |
The reproducibility study (Table 5-15) shows high overall agreement, typically 100% for negative and moderate positive samples, and ranging from 86.1% to 97.2% for low positive samples, indicating consistent performance across sites and operators.
2. Sample Size Used for the Test Set and Data Provenance
- Prospective Clinical Study:
- Initial Enrollment: 802 rectal swab specimens.
- Eligible for Inclusion: 785 specimens.
- Final Dataset: 755 specimens after exclusions (including 16 Stenotrophomonas maltophilia due to intrinsic resistance).
- Provenance: Five geographically diverse sites (three across the United States and two in Europe). Data was collected prospectively from subjects hospitalized or in long-term care facilities.
- Contrived Clinical Study:
- Sample Size: 432 contrived specimens prepared in rectal swab matrix.
- Provenance: This data is laboratory-generated, not from human subjects.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications
The document refers to a "reference culture laboratory" and an "independent laboratory for reference bi-directional sequencing analysis" for establishing ground truth. It does not explicitly state the number of experts or their specific qualifications (e.g., "radiologist with 10 years of experience"). However, the methodologies employed (culture, disk diffusion, CLSI document standards, PCR, and bi-directional DNA sequencing) imply the involvement of qualified laboratory professionals and molecular biologists.
4. Adjudication Method for the Test Set
For prospective specimens:
- The Xpert Carba-R Assay was evaluated against a reference method consisting of:
- Culture: MacConkey enrichment broth.
- Confirmation of carbapenem non-susceptibility: Disk diffusion method (per CLSI document M02 and M100) on isolated colonies.
- Molecular Confirmation: DNA extracted from non-susceptible isolates was purified, quantified, amplified with primers specific to the 5 target genes, and confirmed for appropriate amplicon size on an Agilent 2100 Bioanalyzer.
- Sequencing: If bands corresponded to expected amplicon sizes, the amplicon was sent to an independent laboratory for reference bi-directional sequencing analysis, which was validated for detecting the five targets.
- Discordant Analysis: For specimens where the Xpert Carba-R Assay was positive but a carbapenem-non-susceptible organism was not isolated by reference culture (False Positives based on initial reference), bi-directional sequencing on DNA extracted directly from the MacConkey enrichment broth was performed to confirm the presence of the gene sequences. This acts as an adjudication step.
5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study
No MRMC comparative effectiveness study was mentioned in this document. The device is an automated in vitro diagnostic test, so there is no "human reader" component in its direct output or interpretation in the way an imaging AI system would interact with a radiologist. Therefore, improvement of human readers with AI assistance is not applicable to this device.
6. Standalone (Algorithm Only) Performance Study
Yes, a standalone study was performed. The clinical studies (both prospective and contrived) directly evaluated the performance of the Xpert Carba-R Assay (the algorithm/device) against the reference method without human intervention in the interpretation of the Xpert Carba-R results. The reported PPA and NPA values represent the standalone performance of the device.
7. Type of Ground Truth Used
The ground truth for the test set was established using a multi-faceted approach:
- Expert Reference Method: A combination of culture (MacConkey enrichment broth followed by plating and disk diffusion based on CLSI standards) and molecular methods (PCR for specific gene amplification and bi-directional DNA sequence analysis).
- Outcomes Data: Not directly applicable here; the ground truth is based on the presence or absence of specific gene sequences and organism characteristics.
- Expert Consensus: While not explicitly stated as "expert consensus," the use of a multi-step reference method involving culture, phenotypic susceptibility testing, and sequencing performed by specialized laboratories implies a high standard of expert-driven verification. The discordant analysis further indicates a rigorous process to resolve discrepancies against the initial reference standard.
8. Sample Size for the Training Set
The document does not explicitly state the sample size of a "training set" for the Xpert Carba-R Assay. This is typical for in vitro diagnostic devices that are based on established molecular biology principles (like PCR) and analytical validation (LoD, reactivity, specificity) rather than machine learning models that require distinct training sets. The development process would involve extensive analytical testing to optimize primers and probes, which could be considered an iterative development phase but not a formal "training set" in the AI/ML sense.
9. How the Ground Truth for the Training Set Was Established
As no explicit "training set" is described in the context of an AI/ML model, the establishment of ground truth for a training set is not detailed. However, for a PCR-based assay, the development process would involve establishing the analytical robustness of the assay, including:
- Analytical Sensitivity (Limit of Detection - LoD): Determined by using carbapenemase-producing organisms seeded into negative human rectal swab matrix at varying concentrations and verified with known positive and negative replicates.
- Analytical Reactivity (Inclusivity): Evaluated against a panel of 72 well-characterized bacterial strains with known resistance markers in rectal swab matrix, tested at concentrations (e.g., 3x LoD).
- Analytical Specificity (Cross-reactivity): Evaluated against a panel of 62 carbapenem-susceptible bacteria with other resistance mechanisms, 24 commensal/enteric microorganisms, and human cells at defined concentrations.
These analytical studies use panels with known characteristics (verified through methods like individual PCR assays, DNA sequence analysis, or Check-Points array) to ensure the assay correctly identifies targets and avoids off-target detection. This rigorous analytical characterization serves a similar purpose to "ground truth establishment" for refining a diagnostic assay's performance.
Ask a specific question about this device
(175 days)
Xpert Carba-R
The Xpert® Carba-R Assay, performed on the GeneXpert® Instrument Systems, is a qualitative in vitro diagnostic test for the detection and differentiation of the blaKPC, blaNDM, blaVIM, blaOXA-48, and blaIMP gene sequences associated with carbapenem-non-susceptible pure colonies of Enterobacteriaceae, Acinetobacter baumannii, or Pseudomonas aeruginosa grown on blood agar or MacConkey agar. The test utilizes automated real-time polymerase chain reaction (PCR).
A negative Xpert Carba-R Assay result does not preclude the presence of other resistance mechanisms. The Xpert Carba-R Assay should be used in conjunction with other laboratory tests including phenotypic antimicrobial susceptibility testing. The Xpert Carba-R Assay is intended as an aid for infection control in detecting and differentiating genetic markers of resistance to monitor the spread of carbapenem-non-susceptible organisms in healthcare settings. The Xpert Carba-R Assay is not intended to guide or monitor treatment for carbapenem-non-susceptible bacterial infections.
The Xpert Carba-R Assay is an automated real-time polymerase chain reaction (PCR) in vitro diagnostic test for qualitative detection of the blaKPC, blaNDM, blaVIM, blaOXA-48, and blaIMP gene sequences from isolates of pure cultures of carbapenem-non-susceptibility gram-negative bacteria. The Xpert Carba-R Assay is intended as an aid for infection control for monitoring the spread of carbapenem-non-susceptible organisms in healthcare settings.
The Xpert Carba-R Assay is performed on the Cepheid GeneXpert® Instrument Systems (GeneXpert Dx, GeneXpert Infinity-48, GeneXpert Infinity-48s, and GeneXpert Infinity-80 systems). The GeneXpert Instrument System platform automates sample preparation, amplification and real-time detection.
The GeneXpert Instrument Systems require the use of single-use, disposable cartridges (the Xpert Carba-R cartridges) that hold the PCR reagents and host the PCR process. Because the cartridges are self-contained and specimens never come into contact with working parts of the instrument modules, cross-contamination between samples is minimized.
The Xpert Carba-R Assay cartridges contain reagents for the detection of blaKPC, blaNDM, blaVIM, blaOXA-48, and blaIMP gene sequences. A Sample Processing Control (SPC) and a Probe Check Control (PCC) are controls utilized by the GeneXpert Instrument System platform. The SPC is present to control for adequate processing of the target bacteria and to monitor the presence of inhibitors in the real-time PCR reaction to reduce the possibility of false negative results. The PCC verifies reagent rehydration, real-time PCR tube filling in the cartridge, probe integrity, and dye stability.
The single-use, multi-chambered fluidic cartridges are designed to complete sample preparation and real-time PCR for the detection of the blaKPC, blaNDM, blaVIM, blaOXA-48, and blaIMP gene sequences from isolates of pure cultures of carbapenem-nonsusceptibility gram-negative bacteria in approximately 50 minutes. The GeneXpert Instrument Systems, comprised of the GeneXpert Dx Systems and the GeneXpert Infinity Systems, have 1 to 80 randomly accessible modules, depending upon the instrument, that are each capable of performing separate sample processing and real-time PCR and RT-PCR tests. Each module contains a syringe drive for dispensing fluids (i.e., the syringe drive activates the plunger that works in concert with the rotary valve in the cartridge to move fluids between chambers), an ultrasonic horn for lysing cells or spores, and a proprietary I-CORE® thermocycler for performing real-time PCR and RT-PCR and detection.
The bacterial isolates from culture are placed into a sample reagent. The sample is transferred to the sample chamber of the disposable fluidic cartridge (the Xpert Carba-R cartridge). The user initiates a test from the system user interface and places the cartridge into the GeneXpert instrument platform, which performs hands-off real-time, multiplex PCR for detection of the blaKPC, blaNDM, blaVIM, blaOXA-48, and blaIMP gene sequences. The results are automatically generated at the end of the process in a report that can be viewed and printed.
Here's a summary of the acceptance criteria and study findings for the Xpert Carba-R Assay, based on the provided document:
1. Table of Acceptance Criteria and Reported Device Performance
The document does not explicitly state pre-defined acceptance criteria (e.g., "Sensitivity must be >90%"). Instead, it presents the results of the clinical study as evidence of the device's performance. For clarity, I will interpret the observed performance as the de facto acceptance criteria demonstrated by the study.
Metric (Target) | Acceptance Criteria (from study results) | Reported Device Performance (Blood Agar) | Reported Device Performance (MacConkey Agar) |
---|---|---|---|
Overall Sensitivity (per isolate) | 100.0% (interpreted from 99.0-100% CI) | 100.0% (95% CI: 99.0-100) | 100% (95% CI: 99.0-100) |
Overall Specificity (per isolate) | 98.1% (interpreted from 93.2-99.5% CI) | 98.1% (95% CI: 93.2-99.5) | 97.1% (95% CI: 91.8-99.0) |
IMP Sensitivity (per target) | 100% (interpreted from 91.2-100% CI) | 100% (95% CI: 91.2-100) | 100% (95% CI: 91.2-100) |
IMP Specificity (per target) | 99.8% (interpreted from 98.7-100% CI) | 99.8% (95% CI: 98.7-100) | 99.8% (95% CI: 98.7-100) |
VIM Sensitivity (per target) | 100% (interpreted from 95.5-100% CI) | 100% (95% CI: 95.5-100) | 100% (95% CI: 95.5-100) |
VIM Specificity (per target) | 99.7% (interpreted from 98.5-100% CI) | 99.7% (95% CI: 98.5-100) | 99.7% (95% CI: 98.5-100) |
NDM Sensitivity (per target) | 100% (interpreted from 95.3-100% CI) | 100% (95% CI: 95.3-100) | 100% (95% CI: 95.3-100) |
NDM Specificity (per target) | 100% (interpreted from 99.0-100% CI) | 100% (95% CI: 99.0-100) | 99.7% (95% CI: 98.6-100) |
KPC Sensitivity (per target) | 100% (interpreted from 95.6-100% CI) | 100% (95% CI: 95.6-100) | 100% (95% CI: 95.6-100) |
KPC Specificity (per target) | 99.7% (interpreted from 98.5-100% CI) | 99.7% (95% CI: 98.5-100) | 100% (95% CI: 99.0-100) |
OXA-48 Sensitivity (per target) | 100% (interpreted from 95.9-100% CI) | 100% (95% CI: 95.9-100) | 100% (95% CI: 95.9-100) |
OXA-48 Specificity (per target) | 100% (interpreted from 99.0-100% CI) | 100% (95% CI: 99.0-100) | 100% (95% CI: 99.0-100) |
Analytical Specificity (Cross-reactivity) | 100% against non-target organisms | 100% | 100% |
Valid Reporting Rate | 100% (interpreted from 934/934) | 100% (934/934) | 100% (934/934) |
Reproducibility (Total Agreement by Sample) | Generally >98-100% | Ranges from 98.6% to 100% depending on the specific target/sample. | Ranges from 98.6% to 100% depending on the specific target/sample. |
2. Sample Size Used for the Test Set and Data Provenance
- Sample Size (Clinical Study Test Set): A total of 467 eligible isolates were included in the final dataset for clinical performance analysis. These consisted of 410 clinical stock isolates and 57 fresh isolates.
- Data Provenance: The isolates were sourced from a multi-site investigational study. The document does not specify the country of origin of the data, but the context of an FDA submission suggests it could be primarily US-based or from international sites participating in studies for FDA clearance. The study used both retrospective (clinical stock isolates) and prospective (fresh isolates) data.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and the Qualifications of Those Experts
The document does not explicitly state the "number of experts" or their specific "qualifications" for establishing ground truth. Instead, the ground truth for the clinical study was established by reference bi-directional sequencing of the amplified DNA target, which is a highly standardized and objective molecular method. For discordant results, discrepant testing was performed using the same bi-directional sequencing method. This means the "ground truth" relies on robust analytical methods rather than subjective expert consensus.
4. Adjudication Method for the Test Set
The document describes the following adjudication method:
- For isolates with discordant results between the Xpert Carba-R Assay and initial reference sequencing (performed locally), discrepant testing was performed using bi-directional sequencing on isolates from MacConkey agar plates, and the results are footnoted in the performance tables.
- For the initial reference sequencing, if "no bands were shown on the Bioanalyzer for any of the five target genes," the isolate was "not sent for sequence analysis and the reference method result was considered negative for the five target genes." If bands were shown, the amplicon was sent to an independent laboratory for reference bi-directional sequencing analysis.
This implies a hierarchical adjudication where the primary reference method is bi-directional sequencing, with a secondary review/confirmation using the same method for discordant results.
5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done, If So, What Was the Effect Size of How Much Human Readers Improve with AI vs. Without AI Assistance
This question is not applicable to this device. The Xpert Carba-R Assay is an automated in vitro diagnostic test for detecting genetic sequences. It is a standalone algorithm (molecular assay) that provides a qualitative result (DETECTED/NOT DETECTED) and does not involve human readers interpreting images or data that an AI might assist with. Therefore, an MRMC comparative effectiveness study involving human readers and AI assistance was not performed.
6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) Was Done
Yes, a standalone study was done. The entire clinical performance evaluation described compares the Xpert Carba-R Assay's automated results directly against the reference standard (bi-directional sequencing). The device itself is designed for "hands-off real-time, multiplex PCR" with "results automatically generated." This inherently means its performance was evaluated as a standalone algorithm without human intervention in the result generation or interpretation phase beyond the initial sample preparation.
7. The Type of Ground Truth Used (Expert Consensus, Pathology, Outcomes Data, etc.)
The primary type of ground truth used for the clinical performance study was molecular reference sequencing (bi-directional DNA sequencing) of the amplified DNA target. This is a highly objective and analytical method to determine the presence or absence of the target gene sequences.
8. The Sample Size for the Training Set
The document does not explicitly describe a separate "training set" for an algorithm in the way machine learning algorithms typically use them. This is a molecular diagnostic assay, not an AI/machine learning model. The initial development and optimization of the assay would have involved various analytical studies (e.g., analytical reactivity, analytical specificity, limit of detection, etc.) using numerous characterized strains, but these are not typically referred to as a "training set" in the context of molecular assays as they are for AI algorithms. The "Analytical Reactivity (Inclusivity)" study used a panel of 71 well-characterized bacterial strains.
9. How the Ground Truth for the Training Set Was Established
As noted above, a traditional "training set" in the AI sense is not applicable here. For the analytical studies and assay development:
- Analytical Reactivity (Inclusivity): The ground truth for the 71 bacterial strains tested was established by their "well-characterized" nature and "variant information," likely through prior molecular characterization (e.g., sequencing) to confirm the presence and type of resistance markers.
- Analytical Specificity (Cross-reactivity): The ground truth for the 62 non-target bacterial strains and 24 commensal/enteric microorganisms was established by "Confirmed Resistance Mechanisms" (determined by individual PCR assays, DNA sequence analysis, or Check-Points array version CT102) or their known carbapenem susceptibility/resistance profiles.
These methods ensure the accurate molecular identification of the strains used in the analytical performance evaluations during the assay's development and validation.
Ask a specific question about this device
Page 1 of 1