Search Results

The ID Biomedical Velogene™ Rapid MRSA Identification Assay is intended as a qualitative assay for the definitive identification of methicillin resistance in presumptively identified cultures of Staphylococcus aureus by detecting the presence of the mecA gene. The presence of the mecA gene confers resistance to methicillin.

The Velogene™ Rapid MRSA Identification Assay is a DNA probe based diagnostic device that is based on Cycling Probe™ Technology (CPT) to generate spectrophotometric or visual results. The assay consists of two reagent kits, MRSA Lysis/Cycle Kit and MRSA Microwell Detection Kit.

Here's a breakdown of the acceptance criteria and study details for the Velogene™ Rapid MRSA Identification Assay, based on the provided text:

Acceptance Criteria and Device Performance

The primary acceptance criterion is substantial equivalence to the predicate device, the Oxacillin Screen Agar (NCCLS approved test for MRSA detection). This substantial equivalence is demonstrated through high agreement in identifying methicillin resistance in S. aureus samples.

Study Details

2. Sample size used for the test set and the data provenance:

• Clinical Test Set:

  • Sample Size: 423 coagulase-positive S. aureus samples.
  • Data Provenance: Routinely submitted samples for microbiological identification at 4 geographically distributed U.S. sites. This indicates a prospective collection of real-world clinical samples.

• Reproducibility Panel:

  • Sample Size: 800 samples (10 isolates in a panel, 2 replicates per panel member, 5 days, 2 lots, 4 clinical sites; 10 * 2 * 5 * 2 * 4 = 800).
  • Data Provenance: Tested at 4 clinical sites.

• Challenge Panel:

  • Sample Size: 75 isolates (49 homoresistant/heteroresistant MRSA, 25 MSSA, 1 BORSA).
  • Data Provenance: Tested by each of the 4 clinical sites.

• BORSA Panel:

  • Sample Size: 32 samples (8 samples per site across 4 clinical sites).
  • Data Provenance: Tested across 4 clinical sites.

3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts:

The text does not explicitly state the number or qualifications of experts used to establish the initial ground truth for S. aureus classification prior to testing with the predicate device. However, the ground truth for discrepant isolates was established by nuc/mecA PCR, which is a molecular, objective gold standard.

4. Adjudication method for the test set:

For the initial comparison, the "ground truth" was largely established by the predicate device (Oxacillin Screen Agar). For the 3 discrepant isolates between the Velogene™ assay and the Oxacillin Screen Agar, the adjudication method was nuc/mecA PCR. This serves as a definitive molecular gold standard to resolve discrepancies.

5. If a multi-reader multi-case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:

No, this is not an MRMC comparative effectiveness study in the context of human readers and AI assistance. This study evaluates a diagnostic assay's performance against a predicate device. The "readers" are the methods of interpretation (spectrophotometer vs. visual) of the Velogene™ assay, and its comparison is against a growth-based culture method. There's no AI involved.

6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done:

The Velogene™ Rapid MRSA Identification Assay can be interpreted visually or using a spectrophotometer. While the spectrophotometer provides an objective reading (OD650 ≤ 0.18 or > 0.18) similar to an "algorithm only" interpretation, visual interpretation is also an option, implying a human-in-the-loop component for some results. However, the performance data presents both spectrophotometric and visual results as highly concordant, suggesting objective interpretation is a primary mode. The PCR results validating discrepancies are also a standalone, objective measure.

7. The type of ground truth used:

• Primary Ground Truth for Clinical Comparison: The Oxacillin Screen Agar (a NCCLS approved test for MRSA detection) served as the primary comparative ground truth.
• Definitive Ground Truth for Discrepancy Resolution: nuc/mecA PCR was used as the definitive ground truth for the 3 discrepant isolates, confirming the presence or absence of the mecA gene. This is a molecular/pathology-based ground truth.
• Analytical Sensitivity/Specificity/Reproducibility: Used defined control strains (S. aureus ATCC 29213 - mecA negative, S. aureus ATCC 33592 - mecA positive) and specific isolates for analytical specificity testing. These are laboratory-defined ground truths.

8. The sample size for the training set:

The document describes performance evaluation studies and does not explicitly mention a dedicated training set or its sample size. This is common for traditional diagnostic assays where performance is validated against established methods and/or molecular gold standards, rather than "trained" like machine learning models. The study focuses on validation of the assay.

9. How the ground truth for the training set was established:

As no explicit training set is described, this question is not applicable. The assay's principles are based on known molecular biology (detection of the mecA gene).

Ask a specific question about this device