Search Results
Found 25 results
510(k) Data Aggregation
(569 days)
LLH
The SensiTox C. difficile Toxin Test is an immunofluorescence assay intended for the qualitative detection of Clostridioides difficile toxins A and/or B in human stool specimens. The test is intended as an aid in the diagnosis of C. difficile infection (CDI) in patients exhibiting symptoms of CDI. Negative results do not preclude toxigenic C. difficile infection. The SensiTox C. difficile Toxin Test should not be used as the sole basis for treatment or other management decisions. The test can only be used with the MultiPath platform.
The SensiTox C. difficile Toxin Test detects toxins A and B in stool samples using an immunofluorescence assay and the proprietary MultiPath detection technology. The assay is performed on the proprietary MultiPath Analyzer. A stool sample is added to Stool Specimen Diluent, processed through a spin column, and the filtrate is added to the SensiTox C. difficile Cartridge. The Cartridge is loaded onto the MultiPath Analyzer for processing. The Analyzer reads barcodes, heats the cartridge, splits the sample into aliquots, mixes with antibody conjugated fluorescent and magnetic particles, and incubates. Magnetic particles and tethered fluorescent particles are drawn to the bottom imaging surface by magnets and imaged and quantified using non-magnified digital imaging. Results are interpreted by the MultiPath applications software.
Here's a breakdown of the acceptance criteria and the study proving the device meets them, based on the provided text:
Device: SensiTox C. difficile Toxin Test
1. Table of Acceptance Criteria and Reported Device Performance
The acceptance criteria are implied by the performance metrics reported, as these are the benchmarks the device aims to meet.
Performance Metric | Acceptance Criteria (Implied) | Reported Device Performance |
---|---|---|
Limit of Detection (LoD) | Detection rate ≥95% at specified concentrations for Toxins A and B | Toxin A LoD: 3.5 ng/mL |
Toxin B LoD: 50 ng/mL | ||
Reproducibility (Overall) | High reproducibility (implied by 99.2% accuracy reported) | 99.2% (373 correct results out of 376 total samples) |
Reproducibility (Negative Samples) | High accuracy for negative samples | 98.9% (89/90 correct) |
Reproducibility (Low Positive Samples) | High accuracy for low positive samples | 98.9% (89/90 correct) |
Reproducibility (Moderate Positive Samples) | High accuracy for moderate positive samples | 98.9% (89/90 correct) |
Reproducibility (High Positive Samples) | High accuracy for high positive samples | 100% (100/100 correct) |
Analytical Reactivity (Inclusivity) | Ability to detect multiple ribotypes of toxins A and B | All 6 tested toxin A ribotypes detected |
All 8 tested toxin B ribotypes detected | ||
Analytical Specificity | No cross-reactivity with common organisms; no negative interference from common organisms on toxin detection | None of 31 tested organisms cross-reacted. |
None of 31 tested organisms interfered with toxin A/B detection (except Vancomycin at 50 mg/mL). | ||
Interfering Substances | No negative impact on performance from specified substances at tested concentrations | None of 13 tested substances negatively impact performance at specified concentrations (except Vancomycin at 50 mg/mL). |
Clinical Sensitivity | High sensitivity (benchmark not explicitly stated, but 90.6% is achieved) | 90.6% [95% CI: 83.1% - 95.0%] |
Clinical Specificity | High specificity (benchmark not explicitly stated, but 95.7% is achieved) | 95.7% [95% CI: 94.2% - 96.8%] |
Positive Predictive Value (PPV) | (Benchmark not explicitly stated) | 68.0% [95% CI: 59.5% - 75.4%] |
Negative Predictive Value (NPV) | (Benchmark not explicitly stated) | 99.0% [95% CI: 98.1% - 99.5%] |
2. Sample Size Used for the Test Set and Data Provenance
- Clinical Study Test Set Sample Size: 1046 human stool specimens.
- Data Provenance: Prospective clinical study performed at three geographically diverse sites in the US. The samples were "left over de-identified, unpreserved, stool specimens from patients suspected of having C. difficile infection." This indicates a prospective collection for the purpose of the study, though using "left over" specimens.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts
This information is not provided in the document. The ground truth for the clinical study was established by the Cellular Cytotoxicity Neutralization Assay (CCNA), which is a laboratory method, not human expert interpretation.
4. Adjudication Method for the Test Set
This information is not applicable as the ground truth was established by a laboratory assay (CCNA), not by human adjudication of clinical images or interpretations.
5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done, If So, What Was the Effect Size of How Much Human Readers Improve with AI vs Without AI Assistance
This information is not applicable. The SensiTox C. difficile Toxin Test is an in vitro diagnostic device that directly detects toxins in stool samples using an immunofluorescence assay run on an automated analyzer. It is not an AI-assisted imaging device or a tool that directly assists human readers/interpreters in a diagnostic workflow where their performance would be measured with and without AI.
6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) Was Done
Yes, the performance data presented is for the device operating in a standalone capacity (algorithm only). The MultiPath Analyzer interprets the results using its applications software, reporting "toxin detected" or "toxin not detected" automatically. There is no human interpretative step described for the SensiTox C. difficile Toxin Test's output.
7. The Type of Ground Truth Used
- Bench Studies (LoD, Reproducibility, Analytical Reactivity, Analytical Specificity, Interfering Substances): The ground truth was established using known spiked samples (purified toxins, cultured organisms, interfering substances) in negative pooled stool.
- Clinical Performance Evaluation: The ground truth was established by the Cellular Cytotoxicity Neutralization Assay (CCNA). CCNA is a traditional laboratory method for detecting C. difficile toxins and is considered a gold standard for toxin activity.
8. The Sample Size for the Training Set
This information is not provided in the document. The document describes a "test set" for clinical performance evaluation but does not specify a separate "training set" with its sample size for the development of the device's analytical interpretation software. Given this is an in vitro diagnostic device, the "training" would likely involve optimizing the assay chemistry and the MultiPath Analyzer's ability to detect the fluorescent signals, rather than a machine learning model trained on a large dataset of patient samples.
9. How the Ground Truth for the Training Set Was Established
Since the document does not mention a distinct "training set" in the context of machine learning, the establishment of ground truth for any internal development or optimization of the device would implicitly involve the same methods used for the bench studies: controlled experiments with known concentrations of purified toxins and known negative samples, and potentially comparisons to established laboratory methods like CCNA during early development. The document focuses on the validation studies, not necessarily the development phase details.
Ask a specific question about this device
(134 days)
LLH
The OSOM C. difficile Toxin A/B Test is an immunochromatographic assay intended for the qualitative detection of Clostridium difficile toxins A and/or B in human stool samples. This test is intended as an aid in the diagnosis of C. difficile-associated disease (CDAD) in patients with symptoms of CDAD.
The OSOM C. difficile Toxin A/B Test is a rapid test which can detect the presence of Clostridium difficile toxins A and B in human stool samples. A test kit contains 25 OSOM test stick devices and 25 disposable pipettes. The OSOM C. difficile Toxin A/B Test is a qualitative assay that employs immunochromatographic, dipstick technology. The test format is a sandwich immunoassay, with a single test zone on the nitrocellulose dipstick to detect Toxin A and/or Toxin B ("blue/gray" line) and a single control line zone to indicate proper sample flow ("red" line). The test procedure involves binding of C. difficile Toxin A and/or Toxin B from a patient stool sample to blue colored latex particles conjugated to a monoclonal antibody against Toxin B or a polyclonal antibody against Toxin A. When Toxin A and/or B is present in the sample, it will form a partial immune complex with the antibody-conjugated colored particles. The OSOM C. difficile Toxin A/B Test stick, when placed in the sample mixture, initiates sample migration along the nitrocellulose membrane. If C. difficile toxin A or toxin B is present, a blue/gray line will appear in the test line region indicating a positive result. A red control line must appear for the results to be valid. If C. difficile toxins are not present, only the red control line will appear. An invalid test occurs when no control line appears.
Here's a breakdown of the acceptance criteria and the study that proves the device meets them, based on the provided text:
Acceptance Criteria and Reported Device Performance
Performance Metric | Acceptance Criteria (Implicit) | Reported Device Performance |
---|---|---|
Clinical Study 1 (Overall) | Adequate sensitivity, specificity, and agreement compared to cytotoxicity assay for diagnostic aid. | |
Sensitivity | Sufficiently high to detect positive cases. | 88.2% (95% CI, 80.5 - 93.1%) |
Specificity | Sufficiently high to correctly identify negative cases. | 96.8% (95% CI, 95.7 - 97.7%) |
Agreement | Overall high agreement with the reference method. | 96.2% (95% CI, 95.1 - 96.9%) |
Clinical Study 2 (Comparison to Predicate) | Performance of the new device should be comparable to or better than the predicate device. | |
OSOM Sensitivity | Comparable to predicate. | 87.5% (95% CI, 75.3 - 94.1%) |
OSOM Specificity | Comparable to predicate. | 90.1% (95% CI, 85.2 - 93.5%) |
Predicate Sensitivity | Baseline for comparison. | 70.8% (95% CI, 56.8 - 81.8%) |
Predicate Specificity | Baseline for comparison. | 97.5% (95% Cl, 94.3 - 98.9%) |
Analytical Sensitivity | Ability to detect C. difficile toxins at specified concentrations. | Detected 15 ng/mL for Toxin A and 40 ng/mL for Toxin B. |
Cross-Reactivity | No false positives with common bacteria and viruses typically found in clinical samples. | All listed bacteria and viruses gave negative responses. |
Interfering Substances | No effect on performance from common substances found in stool or used by patients. | No effect from the 11 tested substances. |
Reproducibility | Consistent results across different operators, sites, and testing days. | Expected result 99.2% (357/360) of the time. |
Study Details
-
Sample sizes used for the test set and the data provenance:
- Clinical Study 1 (Overall performance): 1274 de-identified excess loose or watery stool specimens.
- Provenanc: Obtained from patients at five sites in the United States.
- Nature: Retrospective (specimens submitted for CDAD testing).
- Clinical Study 2 (Comparison to Predicate): 250 paired sample results (OSOM and Predicate Device).
- Provenance: Not explicitly stated, but implies from a clinical trial site, likely within the US given the overall study context.
- Nature: Retrospective (using existing clinical trial samples).
- Analytical Sensitivity: Not reported as a sample size, but involved serial dilutions prepared from purified toxins.
- Cross-Reactivity: Not reported as a numerical sample size, but tested against a panel of 28 bacterial isolates and 6 viral isolates.
- Interfering Substances: Not reported as a numerical sample size, but tested against 11 potential interferents.
- Reproducibility: 360 total test results (12 samples x 2 operators/day x 5 days x 3 sites = 360)
- Clinical Study 1 (Overall performance): 1274 de-identified excess loose or watery stool specimens.
-
Number of experts used to establish the ground truth for the test set and the qualifications of those experts:
- The ground truth for the clinical studies was established using a cytotoxicity assay. The text does not specify the number of experts or their qualifications for performing this assay, beyond stating it was "performed at Genzyme using a standard C. difficile toxin cytotoxicity assay." It notes that "Those performing the cytotoxicity assay testing were blinded to the OSOM test results," which indicates an effort to reduce bias.
-
Adjudication method for the test set:
- No explicit adjudication method is described for the primary clinical study. The cytotoxicity assay served as the direct reference standard.
- Discrepant testing was performed for some cases:
- 12 cytotoxin positive, OSOM negative cases were tested with PCR for tcdB gene.
- 37 cytotoxin negative, OSOM positive cases were tested with PCR for tcdB gene (one sample not available).
- This suggests a form of post-hoc analysis for discordant results, but not a formal adjudication process to establish the initial ground truth for all samples.
-
If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:
- No. This study is not an MRMC comparative effectiveness study involving human readers and AI. It is a study comparing an immunoassay device (OSOM C. difficile Toxin A/B Test) to a laboratory reference method (cytotoxicity assay) and a predicate device.
-
If a standalone (i.e. algorithm only without human-in-the loop performance) was done:
- Yes, for the OSOM C. difficile Toxin A/B Test. The study evaluates the performance of the OSOM C. difficile Toxin A/B Test, which is a rapid immunochromatographic assay device, as a standalone diagnostic tool. Its performance is assessed directly against the ground truth (cytotoxicity assay) without human interpretation in a human-in-the-loop scenario. The device itself produces the qualitative "positive" or "negative" result.
-
The type of ground truth used:
- The primary ground truth used for the clinical studies was a cytotoxicity assay, which detects biologically active C. difficile toxins.
- For discrepant analysis, a PCR-based molecular method (tcdB gene detection) was used as a secondary reference.
-
The sample size for the training set:
- The document does not report a separate training set size. This is common for traditional in vitro diagnostic (IVD) devices like this immunochromatographic assay, which are based on biochemical reactions and antibody binding, rather than machine learning algorithms that typically require extensive training data. The "training" in this context would be the development and optimization of the assay itself.
-
How the ground truth for the training set was established:
- As there is no explicit "training set" in the context of machine learning, there's no ground truth established for it. The assay's performance characteristics (e.g., analytical sensitivity, cross-reactivity) are established using purified toxins or cultured microorganisms, which serve as known positive and negative controls during the assay development and validation phases.
Ask a specific question about this device
(84 days)
LLH
The Cepheid Xpert® C. difficile Assay, performed on the Cepheid GeneXpert® Dx System, is a qualitative in vitro diagnostic test for rapid detection of toxin B gene sequences from unformed (liquid or soft) stool specimens collected from patients suspected of having Clostridium difficile infection (CDI). The test utilizes automated real-time polymerase chain reaction (PCR) to detect toxin gene sequences associated with toxin producing C. difficile. The Xpert C. difficile Assay is intended as an aid in the diagnosis of CDI. Concomitant culture is necessary only if further typing or organism recovery is required.
The Cepheid Xpert C. difficile Assay is a rapid, automated in vitro diagnostic test for qualitative detection of Clostridium difficile directly from unformed (liquid or soft) stool specimens of patients suspected of having Clostridium difficile infection (CDI). The assay detects the toxin B gene (tcdB), and is performed on the Cepheid GeneXpert Dx System.
The Xpert C. difficile Assay system performs sample preparation and real-time, multiplex polymerase chain reaction (PCR) for detection of target-specific DNA.
The GeneXpert Dx System consists of a GeneXpert® instrument, personal computer, and disposable fluidic cartridges. Each instrument contains 1-16 randomly accessible modules that are each capable of performing separate sample preparation and real-time PCR tests for detection of C. difficile toxin B gene sequences in less than 45 minutes. Each module contains a syringe drive for dispensing fluids, an ultrasonic horn for lysing cells or spores, and I-CORE® thermocycler for performing real-time PCR and detection.
A swab is inserted into the stool specimen and then is placed in a tube containing elution reagent. Following brief vortexing, the eluted material and two single-use reagents (Reagent 1 and Reagent 2) that are provided with the Assay are transferred to different, uniquely-labeled chambers of the disposable fluidic cartridge (the Xpert C. difficile cartridge). The user initiates a test from the system user interface and places the cartridge into the GeneXpert® Dx System instrument platform, which performs hands-off realtime, multiplex polymerase chain reaction (PCR) for detection of DNA. In this platform, additional sample preparation, amplification, and real-time detection are all fullyautomated and completely integrated.
The Xpert C. difficile Assay includes reagents for the detection of toxin B gene (tcdB). In addition, the assay reagents include an internal sample processing control (SPC) to ensure adequate processing of the target bacteria and to monitor the presence of inhibitor(s) in the PCR Assay. The SPC also ensures that the PCR conditions (temperature and time) are appropriate for the amplification reaction and that the PCR reagents are functional. The Probe Check Control (PCC) verifies reagent rehydration, PCR tube filling in the cartridge, probe integrity, and dye stability.
Here's a summary of the acceptance criteria and the study details for the Cepheid Xpert C. difficile Assay, based on the provided document:
1. Table of Acceptance Criteria and Reported Device Performance:
The document doesn't explicitly state "acceptance criteria" with numerical thresholds in a dedicated table format. Instead, it describes the performance observed in various studies. Based on the "Overall Results" and "Performance vs. Reference Culture" sections of the clinical study, the following can be inferred as the key performance metrics evaluated and achieved:
Acceptance Criteria (Implied) | Reported Device Performance (Xpert C. difficile Assay vs. Reference Culture) |
---|---|
High Sensitivity for Toxigenic C. difficile | 93.49% |
High Specificity for Toxigenic C. difficile | 94.02% |
High Accuracy for Toxigenic C. difficile | 93.95% |
Acceptable Positive Predictive Value (PPV) for Toxigenic C. difficile | 72.98% |
High Negative Predictive Value (NPV) for Toxigenic C. difficile | 98.82% |
Reproducible Results (Total Agreement) | 98.1% (across 3 sites, all samples; for specific low positive samples, it was 90.0% and 96.7%) |
Analytical Inclusivity (detection of diverse C. difficile strains) | 100% (all 13 tested toxinotypes correctly identified) |
Analytical Sensitivity / Limit of Detection (LoD) | Positively detects C. difficile 95% of the time with 95% confidence for a fecal sample containing 460 CFU. Lower LoD observed for specific toxinotypes (e.g., 23 CFU/swab for LUMC-1). |
Analytical Specificity (no cross-reactivity) | 100% (all 55 non-C. difficile strains/species correctly reported as negative) |
No significant interference from common substances | 19 tested substances showed no detectable interference |
2. Sample Size Used for the Test Set and Data Provenance:
- Sample Size for the Clinical Study (Test Set): A total of 2296 specimens were tested.
- Data Provenance: The study was a "multisite prospective investigation study at seven US and Canadian institutions." This indicates a prospective design with data collected from multiple locations across the US and Canada.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications:
The document describes the ground truth for the clinical study as "reference culture followed by cell cytotoxicity testing on the isolates." It does not explicitly mention the number of experts or their specific qualifications (e.g., "radiologist with 10 years of experience") involved in performing and interpreting these reference methods. The reference culture and cytotoxin B isolate testing would typically be performed and interpreted by trained laboratory personnel or microbiologists.
4. Adjudication Method for the Test Set:
The document does not describe a formal "adjudication method" involving multiple expert readers for the ground truth. The ground truth was established by the "reference culture method followed by cell cytotoxicity testing on the isolates." This implies a definitive laboratory result rather than a subjective interpretation requiring adjudication among human readers.
5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was done, and its effect size:
No, a Multi-Reader Multi-Case (MRMC) comparative effectiveness study was not done. This study compared the device (Xpert C. difficile Assay) directly against a laboratory reference standard (culture and cytotoxicity testing), not against human readers with and without AI assistance.
6. If a Standalone (i.e. algorithm only without human-in-the-loop performance) was done:
Yes, the studies described are standalone performance evaluations of the Xpert C. difficile Assay. The device is a "qualitative in vitro diagnostic test for rapid detection of toxin B gene sequences... The test utilizes automated real-time polymerase chain reaction (PCR) to detect toxin gene sequences." The results presented (sensitivity, specificity, LoD, etc.) reflect the performance of the automated algorithm and system without human interpretation as part of the primary diagnostic output. Human involvement is limited to specimen collection, preparation (swab elution, reagent transfer), and initiating the test on the GeneXpert Dx System.
7. The Type of Ground Truth Used:
The primary ground truth used for the clinical comparison study was:
- Reference culture method followed by cell cytotoxicity testing on the isolates.
Specifically:
- Stool specimens were inoculated onto CCFA-D and CCMB-TAL.
- If C. difficile was isolated from CCFA-D and positive by cell cytotoxicity assay, it was classified as "toxigenic C. difficile positive."
- If not, further analysis was done on CCFA-E (subcultured from CCMB-TAL).
- If CCFA-E was positive for C. difficile and the isolate positive for cell cytotoxicity assay, it was classified as "toxigenic C. difficile positive."
- Otherwise, it was reported as "negative."
8. The Sample Size for the Training Set:
The document does not explicitly mention a separate "training set" or its sample size. The focus is on the analytical and clinical validation of the device. Diagnostic PCR assays typically do not have a "training set" in the same way machine learning algorithms do. Instead, they are developed and optimized (which could be considered analogous to training) using various strains and concentrations during the research and development phase. The analytical inclusivity, sensitivity (LoD), and specificity studies describe the validation of the device's ability to detect different strains and concentrations.
9. How the Ground Truth for the Training Set was Established:
As there is no explicitly defined "training set" in the context of this document, there's no description of how its ground truth was established. For the analytical studies, the ground truth was established by:
- Known characteristics of bacterial strains: Analytical inclusivity used 13 C. difficile strains of different toxinotypes, with their toxinotype status being the known ground truth.
- Known concentrations: Analytical sensitivity (LoD) involved preparing C. difficile at known CFU concentrations in a fecal matrix, with these known concentrations serving as the ground truth.
- Confirmed identity of microorganisms: Analytical specificity used 55 strains (including non-toxigenic C. difficile and other Clostridium species) whose identities were confirmed from reputable culture collections or institutions, acting as the ground truth for their presence or absence.
Ask a specific question about this device
(73 days)
LLH
The ProGastro™ Cd Assay is a Real Time PCR in vitro diagnostic test for the qualitative detection of toxigenic Clostridium difficile nucleic acids isolated and purified from liquid or soft stool specimens obtained from symptomatic patients. This test targets the Clostridium difficile toxin B gene (tcdB) and is intended for use to aid in the diagnosis of toxigenic Clostridium difficile infections.
The ProGastro Cd Assay detects toxigenic Clostridium difficile and an Internal Control by a process of nucleic acid extraction from patient specimens followed by PCR amplification and detection. Following collection of a soft or liquid stool sample from a symptomatic patient, a portion of the sample is diluted in Stool Transport and Recovery (S.T.A.R.) Buffer and the solids separated via centrifugation (Stool Clarification). The Internal Control is added to the sample prior to extraction to monitor for PCR inhibitors that may be present. The nucleic acids from the sample are extracted and purified using the bioMérieux NucliSENS easyMAG automated extractor. Nucleic acids are added to the C. diff Mix for subsequent PCR amplification and detection using the Cepheid SmartCycler II.
The C. diff Mix contains oligonucleotide primers and probes that target the tcdB gene of toxigenic strains of C. diff. The probes are dual-labeled with a reporter dye attached to the 5'-end and a quencher dye attached to the 3'-end (see table below). During PCR amplification the primers and probes anneal to the template (if present) followed by primer extension and template amplification. The 5'-3' exonuclease activity of the Taq polymerase cleaves the probe thus separating the reporter dye from the quencher and generating an increase in fluorescent signal. The amount of fluorescence at any given cycle is dependent on the amount of amplification product present. The SmartCycler II instrument and software monitors the process, interprets the data, and presents a report upon completion.
Here’s a breakdown of the acceptance criteria and the study proving the ProGastro Cd Assay meets them, based on the provided document:
1. Acceptance Criteria and Reported Device Performance
The document does not explicitly state pre-defined acceptance criteria for Sensitivity and Specificity in a table format. However, the reported performance against the reference method (Tissue Culture Cytotoxin Assay - CTA) implies an expectation of high diagnostic accuracy. For reproducibility, a high percentage of agreement with expected results across sites and operators is an implicit criterion.
Based on the provided data, we can infer the following:
Performance Metric | Acceptance Criteria (Implied) | Reported Device Performance |
---|---|---|
Clinical Study | ||
Sensitivity | High sensitivity (e.g., >80-90%) compared to CTA | 91.7% (95% CI: 83.0% - 96.1%) |
Specificity | High specificity (e.g., >90%) compared to CTA | 94.7% (95% CI: 92.8% - 96.1%) |
Reproducibility | ||
Overall Agreement | High overall agreement with expected results (e.g., >95%) | 99.0% (95% CI: 97.1% - 99.7%) for primary reproducibility study |
Agreement for Intermediate Samples | Expected to be in a specific range (e.g., 5-95% positive) due to low concentration | 42.2% (95% CI: 32.5% - 52.5%) for intermediate concentration |
2. Sample Size and Data Provenance
- Sample Size for Test Set: A total of 771 raw stool samples were tested in the clinical performance study.
- Data Provenance: The study was a prospective study conducted at 3 U.S. clinical laboratories from July through October 2008. The samples were "leftover raw stool specimens that were collected for routine Clostridium difficile testing from patients over two years of age by each site." This indicates real-world clinical samples from a U.S. patient population.
3. Number of Experts and Qualifications for Ground Truth
The document does not specify the number of experts used or their qualifications for establishing the initial ground truth (Tissue Culture Cytotoxin Assay - CTA). CTA is a laboratory-based method, and its interpretation would typically be performed by trained laboratory personnel.
4. Adjudication Method for the Test Set
A discrepant analysis was performed for samples where the ProGastro Cd Assay and CTA results disagreed. This involved a predetermined algorithm including:
- A molecular (PCR) test targeting a different region of the tcdB gene.
- Bidirectional genetic sequencing.
- Enzyme Immunoassay (EIA).
- Culture followed by PCR and bidirectional sequencing.
This constitutes a form of adjudication where additional, more definitive tests are used to resolve disagreements between the device and the primary reference method.
5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study
No MRMC comparative effectiveness study was done. This study evaluates an in vitro diagnostic (IVD) test, where the "reader" is essentially the instrument and the assay, not a human interpreter of an image or signal. Therefore, assessing how human readers improve with AI vs. without AI assistance is not applicable here.
6. Standalone (Algorithm-Only) Performance
The entire clinical performance study report (Sensitivity, Specificity) evaluates the standalone performance of the ProGastro Cd Assay. The assay is an in vitro diagnostic test for the qualitative detection of C. difficile nucleic acids, which runs entirely on the Cepheid SmartCycler II instrument and software for amplification, detection, and data interpretation. There is no human-in-the-loop component for the result generation itself.
7. Type of Ground Truth Used
The primary reference method used to establish ground truth for the clinical performance study was the Tissue Culture Cytotoxin Assay (CTA). For discrepant analysis, additional molecular tests (PCR, sequencing), EIA, and culture were used to refine the ground truth. This combines a gold standard (CTA) with a more comprehensive "adjudicated" gold standard for discordant results.
8. Sample Size for the Training Set
The document does not provide information about a specific training set or its sample size. This is typical for 510(k) submissions for diagnostic assays, where the focus is on the performance of the finalized device rather than the development process involving training data for algorithms. The "assay" itself, like most IVDs, is developed and validated, but does not typically undergo a 'training' phase with a specific dataset in the same way a machine learning algorithm would.
9. How Ground Truth for the Training Set Was Established
As no specific training set information is provided, the method for establishing its ground truth is also not described.
Ask a specific question about this device
(209 days)
LLH
The C. DIFF QUIK CHEK COMPLETE™ test is a rapid membrane enzyme immunoassay for the simultaneous detection of Clostridium difficile glutamate dehydrogenase antigen and toxins A and B in a single reaction well. The test detects C. difficile antigen, glutamate dehydrogenase, as a screen for the presence of C. difficile and confirms the presence of toxigenic C. difficile by detecting toxins A and B in fecal specimens from persons suspected of having C. difficile disease. The test is to be used as an aid in the diagnosis of C. difficile disease. As with other C. difficile tests, results should be considered in conjunction with the patient history. FOR IN VITRO DIAGNOSTIC USE.
The C. DIFF QUIK CHEK COMPLETE™ test uses antibodies specific for qlutamate dehydrogenase (GDH) and Toxins A and B of C. difficile. The device contains a Reaction Window with two solid lines and a dotted line of immobilized antibodies. The Antigen line ("Ag") contains antibodies against C. difficile GDH. The Toxin line ("Tox") contains antibodies against C. difficile toxins A and B. The dotted line, representing a control line ("C"), contains anti-HRP antibodies. The Conjugate consists of antibodies to GDH, toxin A, and toxin B coupled to horseradish peroxidase. To perform the test, the fecal specimen is diluted with Diluent, and Conjugate is added to the diluted sample. The diluted sample-conjugate mixture is added to the Sample Well and the device is allowed to incubate at room temperature for 15 minutes. During the incubation, any GDH, toxin A or toxin B in the sample binds to the corresponding antibody-peroxidase conjugate. The antigen-antibody complexes migrate through a filter pad to a membrane where they are captured by the immobilized anti-GDH, anti-toxin A or Anti-toxin B antibody in the line. The Reaction Window is subsequently washed with Wash Buffer, followed by the addition of Substrate. After a 10-minute incubation, the "Ag" and "Tox" reaction is examined visually for the appearance of a blue line. A blue line indicates a positive test. A positive "C" reaction, indicated by a blue dotted line, confirms that sample and all reagents were added in proper sequence and volume, that reagents were active at the time of performing the assay, and that proper sample migration occurred.
Here's a breakdown of the acceptance criteria and the study details for the C. DIFF QUIK CHEK COMPLETE™ device, based on the provided text:
Acceptance Criteria and Reported Device Performance
The document provides performance metrics rather than explicitly stated "acceptance criteria" in the format of pass/fail thresholds. However, the reported performance data can be interpreted as the device meeting the implicit acceptance criteria by demonstrating adequate clinical accuracy compared to established reference methods.
Metric (GDH Antigen) | Acceptance Criteria (Implicit) | Reported Device Performance (vs. Bacterial Culture) | Reported Device Performance (vs. Tissue Culture Assay – for positive samples) |
---|---|---|---|
Sensitivity | High (demonstrate effective detection of true positives) | 90.5% (95% CI: 85.7 - 93.9) | N/A (compared differently) |
Specificity | High (demonstrate effective identification of true negatives) | 93.1% (95% CI: 91.2 - 94.7) | N/A (compared differently) |
Predictive Positive Value | High (ensure positive results are reliable) | 76.4% (95% CI: 70.7 - 81.3) | N/A (compared differently) |
Predictive Negative Value | High (ensure negative results are reliable) | 97.6% (95% CI: 96.2 - 98.4) | N/A (compared differently) |
Correlation/Overall Agreement | High (demonstrate strong agreement with reference method) | 92.6% (95% CI: 91.8 - 93.4) | 90.1% (95% CI: 89.0 - 91.1) |
Percent Positive Agreement | High (demonstrates agreement for positive results, especially against a gold standard for positive detection, like tissue culture for toxigenic C. difficile) | N/A (compared differently) | 98.7% (95% CI: 95.0 - 99.8) |
Percent Negative Agreement | High (demonstrates agreement for negative results) | N/A (compared differently) | 88.8% (95% CI: 86.6 - 90.6) |
Metric (Toxins A and B) | Acceptance Criteria (Implicit) | Reported Device Performance (vs. Tissue Culture Assay) |
---|---|---|
Sensitivity | High (demonstrate effective detection of true positives) | 87.8% (95% CI: 81.4 - 92.3) |
Specificity | High (demonstrate effective identification of true negatives) | 99.4% (95% CI: 98.6 - 99.7) |
Predictive Positive Value | High (ensure positive results are reliable) | 95.8% (95% CI: 90.7 - 98.3) |
Predictive Negative Value | High (ensure negative results are reliable) | 98.1% (95% CI: 96.9 - 98.8) |
Correlation | High (demonstrate strong agreement with reference method) | 97.8% (95% CI: 97.6 - 98.0) |
Study Information
-
Sample Size Used for the Test Set and Data Provenance:
- Test Set Sample Size: n = 1126 clinical samples.
- Data Provenance: The study was conducted at 3 clinical sites. The document does not specify the country of origin, but given the FDA 510(k) submission, it is highly likely to be within the United States. The nature of comparing with "tissue culture assay" and "bacterial culture" suggests these are prospectively collected clinical samples, though the document does not explicitly state "prospective" or "retrospective." However, the wording "results from all 3 clinical sites are included in the summary" typically indicates a prospective collection for a clinical trial or evaluation.
-
Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts:
The document does not provide details on the number or qualifications of experts. However, the ground truth was established by laboratory methods (bacterial culture and tissue culture assay) and further resolved by commercial ELISA tests. These methods are typically performed by trained laboratory personnel. -
Adjudication Method for the Test Set:
- GDH Antigen: Discrepant samples between the C. DIFF QUIK CHEK COMPLETE™ test and bacterial culture were resolved using the C. DIFFICILE CHEK™ - 60 ELISA (which detects GDH antigen).
- Toxins A and B: Discrepant results between the C. DIFF QUIK CHEK COMPLETE™ test and tissue culture assay were analyzed by either the C. DIFFICILE TOX A/B I/™ test or a "second commercially available Toxin A&B test."
-
If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was Done, What was the Effect Size of How Much Human Readers Improve with AI vs. Without AI Assistance:
This device is a rapid membrane enzyme immunoassay (a diagnostic test kit), not an AI-powered image analysis or diagnostic system. Therefore, an MRMC comparative effectiveness study involving human readers with/without AI assistance is not applicable to this device. The results are read visually for the appearance of a blue line, which is a direct interpretation of the assay's chemical reaction, not a complex image requiring human expert interpretation in the way AI systems are typically evaluated in MRMC studies. -
If a Standalone (i.e., algorithm only without human-in-the-loop performance) was Done:
Yes, a standalone performance was done. The results presented for sensitivity, specificity, predictive values, and agreement are directly comparing the device's output (positive/negative blue line) to the ground truth established by the reference methods (bacterial culture and tissue culture assay). There is no explicit "human-in-the-loop" aspect being evaluated in these performance metrics beyond the visual reading of the test result itself, which is integral to the device's function. -
The Type of Ground Truth Used:
- For GDH antigen:
- Primary reference: Bacterial Culture (for overall presence of C. difficile organism).
- Secondary/Discrepant resolution: C. DIFFICILE CHEK™ - 60 ELISA (an established GDH antigen detection assay).
- A separate comparison was also made against Tissue Culture Assay (presumably for toxigenic C. difficile, as it usually detects toxin production), specifically looking at the GDH antigen portion of the C. DIFF QUIK CHEK COMPLETE™.
- For Toxins A and B:
- Primary reference: Tissue Culture Assay (the gold standard for detecting toxigenic C. difficile).
- Secondary/Discrepant resolution: C. DIFFICILE TOX A/B I/™ test or a "second commercially available Toxin A&B test."
- For GDH antigen:
-
The Sample Size for the Training Set:
The document does not specify a separate "training set" size for the clinical accuracy evaluation. The n=1126 samples are referred to as the clinical performance evaluation set. This device is an immunoassay kit, which typically does not involve machine learning or AI algorithms that require distinct training and test sets in the same manner as software devices. Any "training" would have been part of the assay development and optimization phases, not explicitly quantified as a clinical "training set" in this context. -
How the Ground Truth for the Training Set Was Established:
As there's no explicitly defined "training set" in the context of clinical accuracy for this type of device mentioned in the document, this question is not directly applicable. The methods used to establish ground truth for the evaluation set (bacterial culture and tissue culture assay with ELISA for discrepancy resolution) would be the standard reference methods used in the development and validation of similar assays.
Ask a specific question about this device
(169 days)
LLH
The BD GeneOhm™ Cdiff Assay is a rapid in vitro diagnostic test for the direct, qualitative detection of C. difficile toxin B gene (todB) in human liquid or soft stool specimens from patients suspected of having Clostridium difficile-associated disease (CDAD). The test, based on real-time PCR, is intended for use as an aid in diagnosis of CDAD. The test is performed directly on the specimen, utilizing polymerase chain reaction (PCR) for the amplification of specific targets and fluorogenic target-specific hybridization probes for the detection of the amplified DNA.
The BD GeneOhm™ Cdiff Assay is a rapid in vitro diagnostic test for the direct, qualitative detection of C. difficile toxin B gene (todB) in human liquid or soft stool specimens from patients suspected of having Clostridium difficile-associated disease (CDAD). The test, based on real-time PCR, is intended for use as an aid in diagnosis of CDAD. The test is performed directly on the specimen, utilizing polymerase chain reaction (PCR) for the amplification of specific targets and fluorogenic target-specific hybridization probes for the detection of the amplified DNA.
A liquid or soft stool specimen is collected and transported to the laboratory. A sterile dry swab is dipped into the liquid or soft stool material and processed. For testing, the swab is eluted in sample buffer and the specimen is lysed. An aliquot of the lysate is added to PCR readents which contain the tcdB specific primers used to amplify the genetic target of Clostridium difficile, if present. The assay also includes an internal control (IC) to detect PCR inhibited specimens and to confirm the integrity of assay reagents. Amplified targets are detected with hybridization probes labelled with quenched fluorophores (molecular beacons). The amplification, detection and interpretation of the signals are done automatically by the Cepheid SmartCycler® software. The entire procedure takes about 75 to 90 minutes, depending on the number of specimens processed.
Here's a breakdown of the acceptance criteria and the study details for the BD GeneOhm™ Cdiff Assay, based on the provided 510(k) summary:
Acceptance Criteria and Device Performance
The acceptance criteria are implied by the reported performance metrics. The device needed to demonstrate sufficient sensitivity, specificity, and reproducibility compared to a recognized reference method to be considered substantially equivalent.
Performance Metric | Acceptance Criteria (Implied) | Reported Device Performance (Overall) - Fresh Samples | Reported Device Performance (Overall) - Frozen Samples |
---|---|---|---|
Sensitivity | High (e.g., >90%) | 93.8% (95% CI: 86.2% - 98.0%) | 100.0% (95% CI: 89.7% - 100%) |
Specificity | High (e.g., >95%) | 95.5% (95% CI: 93.8% - 96.9%) | 97.7% (95% CI: 94.8% - 99.3%) |
Negative Predictive Value (NPV) | High (e.g., >95%) | 99.1% | 99.2% |
Positive Predictive Value (PPV) | Reasonably High | 67.3% | 81.5% |
Unresolved Rate (Overall) | Low (e.g., 95%) | Site-to-Site: 96.7%, Lot-to-Lot: 100.0% | Not explicitly broken down for frozen/fresh |
Reproducibility (Moderate Positive Agreement) | High (e.g., >95%) | Site-to-Site: 100%, Lot-to-Lot: 97.8% | Not explicitly broken down for frozen/fresh |
Reproducibility (Negative Agreement) | High (e.g., >95%) | Site-to-Site: 100%, Lot-to-Lot: 100.0% | Not explicitly broken down for frozen/fresh |
Interfering Substances | No detectable interference | Most tested substances showed no interference (NI = No Interference) | Not applicable (qualitative) |
Details of the Study
- Sample Size and Data Provenance:
- Clinical Study (Test Set):
- Total Specimens Tested: 1108
- Reportable Results: 1090
- Fresh Specimens (First Dataset): 835 specimens
- Frozen Specimens (Second Dataset): 255 specimens (retested from aliquots of original stool specimens after an issue with the reference assay at one site)
- Data Provenance: Multi-site prospective investigational study conducted at four medical centers (two in Canada and two in the United States).
- Clinical Study (Test Set):
- Number of Experts and Qualifications for Ground Truth (Clinical Study):
- The document does not specify the number of experts used or their qualifications for establishing the ground truth directly. It refers to the "Reference Cytotoxicity Assay" as the comparator method.
- Adjudication Method (Clinical Study):
- The document does not explicitly describe an adjudication method for discrepancies between the device and the reference assay in the clinical study. It notes that for 21 out of 34 samples that were positive by the reference assay and negative by the BD GeneOhm™ Cdiff Assay, further testing (Cytotoxicity Assay on isolated strains, standard PCR with alternative primers, and bi-directional sequencing) was performed to verify the presence of toxigenic C. difficile. This implies a form of ad-hoc adjudication for discordant results rather than a pre-defined process for all cases.
- Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study:
- No, an MRMC comparative effectiveness study involving human readers with and without AI assistance was not performed. This device is an in vitro diagnostic (IVD) assay, not an AI-assisted diagnostic tool for human interpretation. The "interpretation of the signals are done automatically by the Cepheid SmartCycler® software."
- Standalone Performance:
- Yes, the performance characteristics reported (sensitivity, specificity, NPV, PPV) are for the device (BD GeneOhm™ Cdiff Assay) in standalone mode, directly compared against the reference method. There is no human-in-the-loop performance described for the primary clinical effectiveness assessment.
- Type of Ground Truth Used (Clinical Study):
- The primary ground truth for the clinical study was the Reference Cytotoxicity Assay on liquid or soft stool specimens. For discordant results, further molecular testing (standard PCR with alternative primers and bi-directional sequencing) was used to verify the presence of the tcdB gene or toxigenic C. difficile. This indicates a combination of phenotypic (cytotoxicity) and genotypic (molecular) methods to establish the most accurate ground truth.
- Sample Size for the Training Set:
- The document describes performance characteristics of a completed assay rather than an algorithm trained on a dataset. Therefore, there is no explicit "training set" sample size mentioned in the context of machine learning model development. The analytical studies (specificity, sensitivity, reproducibility) served to characterize the assay's performance against known samples.
- How Ground Truth for the Training Set Was Established:
- As there's no explicitly defined "training set" in the context of a machine learning algorithm, this question is not directly applicable. For the analytical studies:
- Analytical Specificity: Strains were identified and confirmed as non-target organisms or C. difficile lacking the tcdB gene. The "neg" result indicates the absence of the target gene.
- Analytical Sensitivity (LOD): Used a specific C. difficile strain (ATCC 43255) with known concentrations (DNA copies/CFU) and confirmed with other toxigenic strains. This involved careful preparation and quantification of known positive samples.
- Reproducibility: Involved simulated specimens, with "low positive," "moderate positive," and "negative" categories established by inoculating known quantities of C. difficile (ATCC 43255) into simulated bowel flora.
- As there's no explicitly defined "training set" in the context of a machine learning algorithm, this question is not directly applicable. For the analytical studies:
Ask a specific question about this device
(70 days)
LLH
VIDAS® C. difficile Toxin A & B (CDAB) assay is an automated test for use on the VIDAS instruments for the qualitative detection of Clostridium difficile toxin A and toxin B in stool specimens using the ELFA technique (Enzyme-Linked Flurorescent Assay). The VIDAS C. difficile toxin A & toxin B (CDAB) assay is an aid for diagnosing Clostridium difficile associated disease (CDAD).
VIDAS® C. difficile Toxin A & B (CDAB) assay is an automated test for use on the VIDAS instruments for the qualitative detection of Clostridium difficile toxin A and toxin B in stool specimens using the ELFA technique (Enzyme-Linked Fluorescent Assay). The assay principle combines a two-step enzyme immunoassay sandwich method with a final fluorescent detection (ELFA). The Solid Phase Receptacle (SPR), a pipette tip-like device, serves as the solid phase as well as the pipetting device for the assay. The assay reagents are ready-to-use and pre-dispensed in the sealed reagent strips (STRs). Each of the four reaction steps are performed automatically by the VIDAS instrument. The reaction medium (sample/conjugate mixture) is cycled in and out of the SPR several times. Each step is followed by a wash cycle which eliminates unbound components. At the end of the VIDAS CDAB assay, results are automatically calculated by the VIDAS instrument. A test value as well as the qualitative result (positive, negative or equivocal) are provided on the result sheet for each sample.
Here's a breakdown of the acceptance criteria and study information for the VIDAS® CDAB Assay based on the provided text, structured according to your request:
1. Table of Acceptance Criteria and Reported Device Performance
The provided document describes a 510(k) submission for a device claim extension of the VIDAS® CDAB Assay, not an initial submission where acceptance criteria would be explicitly detailed. Therefore, explicit "acceptance criteria" for the new claim extension are not clearly laid out as distinct pass/fail thresholds in the document.
Instead, the performance data is presented comparatively against a predicate device (the original VIDAS CDAB Assay, K072138, and Premier Toxins A&B) and a "gold standard" (CTA - Cytotoxicity Assay). The implication is that the new claim extension is acceptable if its performance is comparable to or better than the predicate and clinically acceptable as an aid in diagnosis.
Given this, I will infer the "acceptance criteria" from the predicate device's performance, as the purpose of a 510(k) is to demonstrate substantial equivalence.
Performance Metric | Acceptance Criteria (Inferred from Predicate/Clinical Acceptability) | Reported Device Performance (VIDAS® CDAB Assay) |
---|---|---|
Non-clinical/Analytical | ||
Precision/Reproducibility | Comparable to predicate | Total precision: 7.4 – 37.6% CV |
Inter-assay precision: 6.8 – 26.8% CV | ||
Intra-assay precision: 2.9 – 26.3% CV | ||
C. difficile strain types (A+/B+) | 100% detection for A+/B+ strains | 100% (23/23) |
C. difficile strain types (A-/B+) | High detection rate for A-/B+ strains | 83% (15/18*) *Note: 3 equivocal results |
Limit of Detection (stool) | Comparable to predicate | Toxin A at ≥ 7.73 ng/mL; Toxin B at ≥ 4.55 ng/mL |
Drug Interference | No significant interference from common drugs | Evaluated (Vancomycin, Metronidazole, Loperamide, Bismuth subsalicylate, Salicylate, Barium sulfate, Imodium, Pepto-Bismol) - specific results not quantified/detailed in summary |
Clinical Studies (vs. CTA) | ||
Sensitivity | Clinically acceptable for diagnostic aid (e.g., >80-85%) | 88.3%; 95% CI: 81.2 – 93.5% |
Specificity | High (e.g., >95-98%) | 99.8%; 95% CI: 99.2 – 99.9% |
Positive Predictive Value (PPV) | High (e.g., >90%) | 98.1%; 95% CI: 93.5 – 99.8% |
Negative Predictive Value (NPV) | High (e.g., >90%) | 98.4%; 95% CI: 97.3 – 99.1% |
Clinical Studies (vs. Predicate) | ||
Positive Agreement | High agreement with predicate (e.g., >80%) | 81.3%; 95% CI: 73.4 – 87.6% |
Negative Agreement | Very high agreement with predicate (e.g., >95%) | 99.5%; 95% CI: 98.8 – 99.9% |
Global Agreement | High overall agreement with predicate (e.g., >90%) | 97.1%; 95% CI: 95.9 – 98.1% |
Additional Site Performance | ||
Sensitivity (vs. CTA) | Clinically acceptable | 88.0%; 95% CI: 68.8 – 97.5% |
Specificity (vs. CTA) | High | 95.1%; 95% CI: 86.3 – 99.0% |
Total Agreement (vs. CTA) | High | 93.0%; 95% CI: 85.4 – 97.4% |
2. Sample Size Used for the Test Set and Data Provenance
- Sample Size for Test Set: 1011 specimens
- Data Provenance: Clinical study conducted in the USA and Europe. The document states it's a "summary of the non-clinical and clinical test results," implying that these are the results from the specific studies conducted to support the device. The term "retrospective or prospective" is not explicitly stated, but clinical studies for diagnostic devices typically involve prospective sample collection or the use of remnant/archived samples. Given the nature of a 510(k) for a claim extension, it's highly likely to be a combination, potentially including data from the original submission (K072138) and new data for the extension, though this is not explicitly clarified.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts
The ground truth for the clinical studies was primarily established using a "CTA" (Cytotoxicity Assay). This is a laboratory-based method, not dependent on human expert interpretation in the same way as, for example, a radiologist reading an image. Therefore, information about the "number of experts" or their specific "qualifications" for establishing this type of ground truth is not applicable and not provided in the document.
4. Adjudication Method for the Test Set
Not applicable. The ground truth (CTA) is a laboratory assay result, not subject to human interpretation discrepancies that would require an adjudication method.
5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study
No, a multi-reader multi-case (MRMC) comparative effectiveness study was not done. This type of study is more common for imaging diagnostics where human interpretation is a primary component of the diagnostic process. The VIDAS® CDAB Assay is an automated immunoassay.
6. Standalone (Algorithm Only) Performance
Yes, the performance data presented (Sensitivity, Specificity, PPV, NPV, and agreement rates) is the standalone performance of the VIDAS® CDAB Assay. It's an automated test, meaning its output is directly compared to the ground truth (CTA) without human intervention in its result generation or interpretation for the purpose of primary performance calculation. The "aid in diagnosing" phrasing implies a human-in-the-loop for final clinical decision-making, but the performance metrics themselves are standalone.
7. Type of Ground Truth Used
The primary ground truth used for the clinical studies was the Cytotoxicity Assay (CTA). This is a laboratory-based assay considered a reference standard for detecting C. difficile toxins.
8. Sample Size for the Training Set
The document does not explicitly mention "training set" or "validation set" sizes, which are typically associated with machine learning or algorithmic development. For an immunoassay like VIDAS, the "development" or "optimization" process involves various analytical studies (e.g., reagent optimization, buffer formulations) and may use smaller, targeted panels of positive and negative samples, but these are not typically referred to as a "training set" in the context of large-scale clinical data for algorithmic learning. The clinical performance data presented refers to the test set used for validation.
9. How the Ground Truth for the Training Set Was Established
Since an explicit "training set" is not mentioned in the context of an algorithm or machine learning for this immunoassay device, the method for establishing its ground truth is not applicable. The device's underlying principles are based on biochemical reactions (ELFA) and not learned from large datasets in the same way an AI algorithm would be.
Ask a specific question about this device
(141 days)
LLH
VIDAS® C. difficile Toxin A & B (CDAB) assay is an automated test for use on the VIDAS instruments for the qualitative detection of Clostridium difficile toxin A and toxin B in stool specimens using the ELFA technique (Enzyme-Linked Flurorescent Assay).
VIDAS® C. difficile Toxin A & B (CDAB) assay is an automated test for use on the VIDAS instruments for the qualitative detection of Clostridium difficile toxin A and toxin B in stool specimens using the ELFA technique (Enzyme-Linked Fluorescent Assay). The assay principle combines a two-step enzyme immunoassay sandwich method with a final fluorescent detection (ELFA). The Solid Phase Receptacle (SPR), a pipette tip-like device, serves as the solid phase as well as the pipetting device for the assay. The assay reagents are ready-to-use and pre-dispensed in the sealed reagent strips (STRs). Each of the four reaction steps are performed automatically by the VIDAS instrument. The reaction medium (sample/conjugate mixture) is cycled in and out of the SPR several times. Each step is followed by a wash cycle which eliminates unbound components. At the end of the VIDAS CDAB assay, results are automatically calculated by the VIDAS instrument. A test value as well as the qualitative result (positive, negative or equivocal) are provided on the result sheet for each sample.
This document describes the regulatory submission for the VIDAS® CDAB Assay, a device for detecting Clostridium difficile toxins.
1. Table of Acceptance Criteria and Reported Device Performance:
The document doesn't explicitly state "acceptance criteria" as pass/fail thresholds for numerical values. Instead, it presents performance data used to demonstrate substantial equivalence to a predicate device. The performance data is as follows:
Item | Device [VIDAS CDAB] Performance | Predicate [Premier Toxins A&B] Performance (for comparison) |
---|---|---|
Non-clinical (Analytical) Comparison | ||
Precision/Reproducibility | Total precision: 7.4 – 37.6% CV | |
Inter-assay precision: 6.8 – 26.8% CV | ||
Intra-assay precision: 2.9 – 26.3% CV | Within run: 4.1 – 28.9% CV | |
Between run: 6.2 – 31.7% CV | ||
C. difficile strain types | A+/B+: 100% (23/23) | |
A-/B+: 83% (15/18*) |
- 3 of the A-/B+ strains gave equivocal results | A+/B+: 100% (25/25)
A-/B+: 100% (3/3) |
| Limit of Detection (stool) | Toxin A: ≥ 7.73 ng/mL
Toxin B: ≥ 4.55 ng/mL | Toxin A: ≥ 1.4 ng/mL
Toxin B: ≥ 2.4 ng/mL |
| Clinical Studies Comparison | | |
| Positive Agreement (vs Predicate) | 81.3% (95% CI: 73.4–87.6%) | N/A (Predicate is the comparator) |
| Negative Agreement (vs Predicate) | 99.5% (95% CI: 98.8 – 99.9%) | N/A |
| Global Agreement (vs Predicate) | 97.1% (95% CI: 95.9–98.1%) | N/A |
The acceptance criterion, though not quantitatively defined in a table as a "pass/fail" value, is implied by the conclusion of "substantial equivalence" to the predicate device. This suggests that the reported device performance was deemed acceptably similar or competitive to the predicate's performance across these metrics.
2. Sample Size Used for the Test Set and Data Provenance:
- Sample Size for Clinical Studies: 1011 specimens.
- Data Provenance: The clinical studies were conducted in the US and Europe. The document does not explicitly state whether the data was retrospective or prospective. Given the typical nature of device submissions, it is likely a mix or primarily prospective collection for the clinical comparison, but this is not explicitly stated.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts:
The document does not mention the use of experts to establish a "ground truth" for the test set in the context of human interpretation of results. The clinical study performance is evaluated as "agreement versus Predicate," meaning the results of the VIDAS CDAB assay are compared directly against the results obtained from the Meridian Premier Toxins A&B assay (the predicate device). Therefore, the predicate device's results implicitly serve as the comparative standard here, rather than a separate expert-adjudicated ground truth.
4. Adjudication Method for the Test Set:
Not applicable. As noted above, the VIDAS CDAB assay's performance was compared against the predicate device (Meridian Premier Toxins A&B assay), rather than an expert-adjudicated ground truth.
5. If a Multi Reader Multi Case (MRMC) Comparative Effectiveness Study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:
This is not applicable. The VIDAS® CDAB Assay is an automated in-vitro diagnostic device for the qualitative detection of Clostridium difficile toxins, not an AI-powered diagnostic tool requiring human interpretation or assistance. Therefore, an MRMC study with human readers and AI assistance would not be relevant.
6. If a Standalone (i.e. algorithm only without human-in-the-loop performance) was done:
Yes, this was a standalone performance study. The VIDAS® CDAB assay is described as an "automated test" that "automatically calculated by the VIDAS instrument." Its performance metrics (precision, strain detection, limit of detection, and agreement with the predicate) are inherently standalone without human intervention in the result determination.
7. The Type of Ground Truth Used:
For the clinical studies, the "ground truth" was effectively the results obtained from the predicate device (Meridian Premier Toxins A&B). The study's aim was to demonstrate substantial equivalence by comparing the VIDAS CDAB assay's output to the predicate's output.
For the analytical studies (precision, strain types, limit of detection), the ground truth would be based on characterized samples and known concentrations/strains used in the laboratory setting.
8. The Sample Size for the Training Set:
The document does not provide information regarding a separate "training set" for the VIDAS® CDAB assay. Given that it's described as an immunoassay (ELFA technique) rather than a machine learning or AI-driven algorithm, a distinct "training set" in the context of algorithm development is not typically applicable in the same way. The assay development would involve extensive R&D and optimization, but not generally a discrete "training set" as understood in AI/ML.
9. How the Ground Truth for the Training Set was Established:
Not applicable, as a discrete training set for an algorithm is not described or implied for this immunoassay device. The "ground truth" during the development and optimization phases would be based on well-characterized laboratory samples with known C. difficile toxin presence and concentrations, similar to how analytical performance metrics are established.
Ask a specific question about this device
(108 days)
LLH
The TOX A/B QUIK CHEK™ test is a rapid immunoassay for detecting Clostridium difficile toxins A and B in fecal specimens from persons suspected of having C. difficile disease. The test is to be used as an aid in the diagnosis of C. difficile disease and results should be considered in conjunction with the patient history. FOR IN VITRO DIAGNOSTIC USE.
The TOX A/B QUIK CHEK™ test uses antibodies specific for toxins A and B of C. difficile. The device contains a Reaction Window with two lines of immobilized antibodies. The test line ("T") contains antibodies against C. difficile toxins A and B. The other, representing a control line ("C"), contains anti-IgG antibodies. The Conjugate consists of antibodies to toxins A and B coupled to horseradish peroxidase. To perform the test, the fecal specimen is diluted with Diluent, and Conjugate is added to the diluted sample. The diluted sample-conjugate mixture is added to the Sample Well and the device is allowed to incubate at room temperature for 15 minutes. During the incubation, any toxin A and toxin B in the sample bind to anti-toxin antibody-peroxidase conjugate. The toxin-antibody complexes migrate through a filter pad to a membrage where they are captured by the immobilized anti-toxin antibodies in the line. The Reaction Well is subsequently washed with Wash Buffer, followed by the addition of Substrate. After up to a 10 minute incubation, the "T" reaction is examined visually for the appearance of a blue line. A blue line indicates a positive test. A positive "C" reaction, indicated by a blue line, onfirms that sample and all reagents were added in proper sequence and volume, that reagents were active at the time of performing the assay, and that proper sample migration occurred.
TOX A/B QUIK CHEK™ 510(k) Summary
This document describes the acceptance criteria and the studies that demonstrate the TOX A/B QUIK CHEK™ device meets these criteria for detecting Clostridium difficile toxins A and B in fecal specimens.
1. Acceptance Criteria and Reported Device Performance
The acceptance criteria for the TOX A/B QUIK CHEK™ device are not explicitly stated as numerical targets in the provided text. However, based on the Summary of Performance Data, the reported device performance is presented as follows, which can be inferred as the criteria the device met for clearance.
Metric | Acceptance Criteria (Inferred) | Reported Device Performance |
---|---|---|
Sensitivity | High (for diagnostic aid) | 90.2% (95% CI: 84.1 - 94.2) |
Specificity | High (for diagnostic aid) | 99.7% (95% CI: 98.8 - 99.9) |
Predictive Positive Value (PPV) | High (for diagnostic aid) | 98.6% (95% CI: 94.4 - 99.8) |
Predictive Negative Value (PNV) | High (for diagnostic aid) | 97.9% (95% CI: 96.4 - 98.7) |
Correlation | High (for diagnostic aid) | 98.0% (95% CI: 97.8 - 98.2) |
Cross-Reactivity | Minimal with non-C. difficile | Only C. sordellii VPI 9048 reacted among tested common intestinal bacteria and pathogens. No cross-reactivity with tested viruses or interfering substances. |
Analytical Sensitivity | Ability to detect low concentrations of toxins | Consistently positive at 0.63 ng/mL for toxin A and 1.25 ng/mL for toxin B. |
Reproducibility | Consistent results across sites and days | 100% agreement with expected results in a 3-site, 3-day study. |
2. Sample Size and Data Provenance for the Test Set
- Sample Size for Test Set: 842 fecal specimens.
- Data Provenance: The study was a "clinical performance" study, including "5 studies (2 in-house studies and 3 on-site studies)". The country of origin is not explicitly stated. The nature of the studies (in-house and on-site) suggests these were prospective or a combination of prospective and retrospective collections for clinical validation. It is not explicitly stated whether the data was retrospective or prospective, but clinical performance studies typically involve prospective data collection or a mix of archived and newly collected specimens.
3. Number of Experts and Qualifications for Ground Truth
The document does not explicitly state the number of experts used or their specific qualifications (e.g., radiologist with 10 years of experience) for establishing the ground truth.
4. Adjudication Method for the Test Set
The document does not describe any specific adjudication method (e.g., 2+1, 3+1, none) for the test set.
5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study
No Multi-Reader Multi-Case (MRMC) comparative effectiveness study was mentioned. The device is a rapid immunoassay, which typically does not involve human readers interpreting complex images or data in a comparative effectiveness study format.
6. Standalone Performance Study
Yes, a standalone performance study was done. The "Summary of clinical performance" section directly compares the "TOX A/B QUIK CHEK™ test" results against the "tissue culture assay" as the ground truth. This evaluates the algorithm-only performance.
7. Type of Ground Truth Used
The ground truth used for the clinical accuracy evaluation was a tissue culture assay. Specifically, for the comparative performance table, "Tissue culture assay" results were used as the reference standard (Tiss Cult pos/neg).
8. Sample Size for the Training Set
The document does not explicitly state a separate "training set" or its sample size. For an immunoassay, the development and optimization of antibodies and assay conditions (analytical sensitivity, cross-reactivity, interfering substances) would involve internal studies that serve a similar function to a training set in machine learning. The clinical performance data presented here is typically considered the validation or test set for regulatory submission.
9. How the Ground Truth for the Training Set Was Established
As no explicit training set is mentioned in the context of clinical accuracy, the ground truth establishment for a training set is not detailed. However, the comprehensive analytical studies (analytical sensitivity, cross-reactivity, interfering substances) would have relied on established laboratory reference methods and defined concentrations of toxins or specific organisms to characterize the device's behavior during its development phase.
Ask a specific question about this device
(118 days)
LLH
REMEL's Xpect™ Clostridium difficile Toxin A/B is a rapid in vitro immunochromatographic test for the direct, qualitative detection of Clostridium difficile Toxin A and/or B in human fecal specimens from patients suspected of having Clostridium difficile-associated disease (CDAD). The test is intended for use as an aid in diagnosis of CDAD. The test can also be used for confirmation of toxigenic Clostridium difficile from Brain Heart Infusion (BHI) broth culture.
The Xpect™ Clostridium difficile Toxin A/B test is a qualitative immunochromatographic assay that detects C. difficile Toxin A and Toxin B in stool specimens or cultures of toxigenic C. difficile. In performing the test, a specimen is first diluted with Specimen Diluent to help solubilize the toxins. A portion of the diluted sample is then mixed with a volume of Conjugate 1 containing antibodies to Toxin A and Toxin B coupled to colored microparticles, plus a volume of Conjugate 2 containing biotinylated antibodies to Toxin A and Toxin B. A volume of this mixture is transferred to a test device having immobilized streptavidin as a test line and goat antiimmunoqlobulin antibody a as a control line. Immunocomplexes of toxin and conjugated antibodies form a visible band as they flow across the test line. Excess colored particle conjugates form a visible band at the control line to document that the test is functioning properly.
Here is a summary of the acceptance criteria and the study that proves the device meets them, based on the provided text:
1. Table of Acceptance Criteria and Reported Device Performance
The acceptance criteria are not explicitly stated as distinct numerical targets in the provided text. However, they can be inferred from the reported performance results and the comparison to the predicate device and other commercially available assays. The primary implied acceptance criteria revolve around achieving competitive or superior sensitivity, specificity, and agreement compared to established methods for diagnosing C. difficile-associated disease (CDAD).
Performance Metric | Acceptance Criteria (Implied) | Reported Device Performance (Xpect™ C. difficile Toxin A/B) |
---|---|---|
Clinical Accuracy | ||
Sensitivity | Comparable to or better than predicate/other methods (e.g., CTA) | 86.3% (95% CI = 79.8-91.3%) |
Specificity | Comparable to or better than predicate/other methods (e.g., CTA) | 96.2% (95% CI = 94.5-97.5%) |
Positive Predictive Value | Not explicitly defined, but good | 84.1% (95% CI = 77.4-89.4%) |
Negative Predictive Value | Not explicitly defined, but good | 96.8% (95% CI = 95.2=98.0%) |
% Correlation (Agreement) | Comparable to or better than predicate/other methods (e.g., CTA) | 94.4% (95% CI = 92.5-95.8%) |
BHI Broth Culture Performance | High agreement with expected values of known strains | 94.7% (54/57) agreement with expected values |
Analytical Sensitivity | Detection of Toxins A and B at low concentrations | Toxin A: ≥ 6.25 ng/ml; Toxin B: ≥ 40.0 ng/ml |
Cross-Reactivity | No cross-reactivity with common microorganisms | No cross-reactivity observed with 54 microorganisms |
Interfering Substances | No interference from common substances found in fecal specimens | No interference observed from 10 tested substances |
Reproducibility | High consistency of results across sites and samples | 98.6% (71/72) of samples produced expected result |
2. Sample Size Used for the Test Set and Data Provenance
- Sample Size (Clinical Accuracy): A total of 815 specimens were tested.
- Data Provenance: The study was conducted at four geographically diverse regions of the United States, suggesting a prospective collection or at least a multi-site prospective analysis of collected samples. The text does not explicitly state if the samples were collected retrospectively or prospectively, but the term "evaluated at" suggests prospective evaluation over a period of time.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts
The ground truth for the clinical accuracy study was established using the cytotoxin assay (CTA). This is a laboratory-based assay and does not involve human experts in the same way, for example, a radiologist reads images. Therefore, the concept of "number of experts" and "qualifications of experts" does not directly apply to the primary ground truth method used here. The CTA is considered a gold standard for C. difficile toxin detection.
For discordant results, further investigation involved "toxigenic culture and microwell enzyme immunoassay." Again, these are laboratory methods, not expert human review.
4. Adjudication Method for the Test Set
There was a form of adjudication for discordant results.
- "Discordant results were further investigated by toxigenic culture and microwell enzyme immunoassay that detects both Toxin A and B."
- This suggests that when the Xpect™ test result and the CTA result did not agree, additional, more definitive laboratory tests (toxigenic culture and a different EIA) were used to ascertain the true status of the sample. This acts as an "adjudication" in a laboratory context, where a more definitive test is used to resolve discrepancies between the index test and the primary reference standard.
5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance
This is not applicable to this device. The Xpect™ Clostridium difficile Toxin A/B test is an in-vitro diagnostic (IVD) assay, not an AI-powered image analysis or diagnostic support tool for human readers. It directly detects bacterial toxins in a specimen. Therefore, there are no "human readers" in the context of interpreting the device's output, nor is there any AI assistance involved.
6. If a Standalone (i.e. algorithm only without human-in-the-loop performance) was done
This is not applicable to this device. As an IVD assay, the Xpect™ test inherently operates in a "standalone" fashion in terms of its direct detection mechanism (immunochromatography). It produces a visible line without requiring human interpretation other than observing the presence or absence of the line. The performance data presented (sensitivity, specificity) reflects this standalone performance.
7. The Type of Ground Truth Used
The primary ground truth for the clinical accuracy study was the Cytotoxin Assay (CTA). For discordant results, Toxigenic Culture and Microwell Enzyme Immunoassay (EIA) were used as further confirmatory ground truth methods.
8. The Sample Size for the Training Set
The document does not explicitly mention a distinct "training set" for the clinical accuracy study in the traditional sense of machine learning. For traditional IVD assays, optimization and initial validation (which could be considered analogous to training/development) would occur internally during product development, prior to the formal clinical performance study described. The clinical performance study (n=815) serves as the primary validation of the device's performance against the established ground truth.
9. How the Ground Truth for the Training Set Was Established
As no specific "training set" is identified, this question is not directly applicable. However, the ground truth for any internal development or optimization would likely have been established using the same (or similar) gold standard methods as the clinical validation, i.e., Cytotoxin Assay and/or Toxigenic Culture.
Ask a specific question about this device
Page 1 of 3