Search Filters

Search Results

Found 3 results

510(k) Data Aggregation

    K Number
    K242877
    Date Cleared
    2025-01-10

    (109 days)

    Product Code
    Regulation Number
    866.3990
    Reference & Predicate Devices
    Why did this record match?
    Device Name :

    BioCode Gastrointestinal Pathogen Panel (GPP)

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The BioCode Gastrointestinal Pathogen Panel (GPP) is a qualitative multiplexed in vitro diagnostic test intended for use with the BioCode MDx 3000 Instrument. The BioCode GPP is capable of the simultaneous detection of nucleic acids from multiple bacteria, viruses, and parasites extracted directly from unpreserved in Cary-Blair transport medium obtained from individuals with simptoms of gastrointestinal infection. The following bacteria, parasites, and viruses are identified using the BioCode Gastrointestinal Pathogen Panel:

    • . Campylobacter (C. jejuni/C. coli)
    • Clostridium difficile (C. difficile) toxin A/B (Fresh samples only)
    • l Salmonella spp
    • Vibrio (V. parahaemolyticus/V. vulnificus/ V. cholerae), including specific identification of Vibrio parahaemolyticus .
    • . Yersinia enterocolitica
    • . Enteroaggregative Escherichia coli (EAEC)
    • Enterotoxigenic Escherichia coli (ETEC) lt/st
    • E. coli 0157 serogroup
    • Shiga-like toxin-producing Escherichia coli (STEC) stx1/stx2
    • Shigella/ Enteroinvasive Escherichia coli (EIEC)
    • Cryptosporidium spp (C. parvum/C. hominis)
    • Entamoeba histolytica
    • Giardia lamblia (also known as G. intestinalis and G. duodenalis)
    • . Adenovirus F 40/41
    • Norovirus GI/GII ■
    • . Rotavirus A

    The BioCode GPP is indicated as an aid in the diagnosis of gastrointestinal illness and results are meant to be used in conjunction with other clinical, laboratory, and epidemiological data. For In Vitro Diagnostic Use Only. For Prescription Use Only.

    Positive results do not rule out co-infection with organisms not included in the BioCode GPP. The agent detected may not be the definite cause of the disease. Negative results in the setting of clinical illness compatible with gastroenteriis may be due to infection by pathogens that are not detected by this test or non-infectious causes such as ulcerative colitis, irritable bowel syndrome, or Crohn's disease. Concomitant culture is necessary for organism recovery and further typing of bacterial agents. This device is not intended to monitor or guide treatment for C. difficile infection.

    Due to the small number of positive specimens collected for certain organisms during the prospective clinical study, performance characteristics for Adenovinus 40/41, Campylobacter, E. coli 0157, Shigella(EIEC, Yersinia enterocolitica, and Giardia lamblia were established additionally with retrospective clinical specimens. Performance characteristica, Giardia lamblia, Yersinia enterocolitica and Vibrio (V. parahaemolyticus, V. cholerae) were established primarily using contrived clinical specimens.

    Device Description

    The BioCode® Gastrointestinal Pathogen Panel (GPP) is a multiplexed nucleic acid-based test designed to be used with the BioCode MDx-3000 system. The BioCode MDx-3000 is an automated system that integrates PCR amplification, target capture, signal generation and optical detection for multiple gastrointestinal pathogens from a single stool specimen, either unpreserved or in Cary Blair. Stool specimens are processed, and nucleic acids extracted with easyMAG, MagNA Pure 96, KingFisher Flex and KingFisher Apex Dx. Once the PCR plate is set up and sealed, all other operations are automated on MDx-3000. The BioCode MDx-3000 Gastrointestinal Infection Panel simultaneously tests for 17 pathogens (see table below) from unpreserved stool specimens or stool collected in Cary-Blair transport medium. Results from the BioCode Gastrointestinal Pathogen Panel (GPP) test are available within less than 4 hours.

    AI/ML Overview

    The provided text describes the BioCode Gastrointestinal Pathogen Panel (GPP), a diagnostic test for gastrointestinal pathogens, and a study to demonstrate its substantial equivalence to a predicate device.

    Here's an analysis of the acceptance criteria and study data:


    1. Acceptance Criteria and Reported Device Performance

    The acceptance criteria for each pathogen are implied by the reported Positive Percent Agreement (PPA) and Negative Percent Agreement (NPA) compared to the easyMAG extraction method (used with the predicate device) for each extraction system (KingFisher Flex and KingFisher Apex Dx). While explicit pre-defined acceptance criteria values are not stated, the tables present the achieved performance with 95% Confidence Intervals. Generally, a high PPA and NPA (typically >90-95%) with narrow confidence intervals are expected for substantial equivalence for diagnostic tests.

    Here's a summary of the reported performance for the BioCode GPP using KingFisher Flex and KingFisher Apex Dx, focusing on the "All Archived" data as it covers a larger sample size for each target. Targets with PPA

    Ask a Question

    Ask a specific question about this device

    K Number
    K190585
    Date Cleared
    2019-06-05

    (91 days)

    Product Code
    Regulation Number
    866.3990
    Reference & Predicate Devices
    Why did this record match?
    Device Name :

    Biocode Gastrointestinal Pathogen Panel (GPP)

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The BioCode Gastrointestinal Pathogen Panel (GPP) is a qualitative multiplexed nucleic acid-based in vitro diagnostic test intended for use with the BioCode MDx 3000 Instrument. The BioCode GPP is capable of the simultaneous detection and identification of nucleic acids from multiple bacteria, viruses, and parasites extracted directly from unpreserved stool samples or stool preserved in Cary-Blair transport medium obtained from individuals with signs and/or symptoms of gastrointestinal infection. The following bacteria, parasites, and viruses are identified using the BioCode Gastrointestinal Pathogen Panel:

    • · Campylobacter (C. jejuni/C. coli)
    • · Clostridium difficile (C. difficile) toxin A/B (Fresh samples only)
    • · Salmonella spp
    • · Vibrio (V. parahaemolyticus/V. vulnificus/ V. cholerae), including specific identification of Vibrio parahaemolyticus
    • · Yersinia enterocolitica
    • · Enteroaggregative Escherichia coli (EAEC)
    • · Enterotoxigenic Escherichia coli (ETEC) lt/st
    • · E. coli 0157 serogroup
    • Shiga-like toxin-producing Escherichia coli (STEC) stx1/stx2
    • Shigella/ Enteroinvasive Escherichia coli (EIEC)
    • · Cryptosporidium spp (C. parvum/C. hominis)
    • Entamoeba histolytica
    • · Giardia lamblia (also known as G. intestinalis and G. duodenalis)
    • Adenovirus F 40/41
    • Norovirus GI/GII
    • Rotavirus A

    The BioCode GPP is indicated as an aid in the diagnosis of gastrointestinal illness and results are meant to be used in conjunction with other clinical, laboratory, and epidemiological data.

    Positive results do not rule out co-infection with organisms not included in the BioCode GPP. The agent detected may not be the definite cause of the disease. Negative results in the setting of clinical illness compatible with gastroenteritis may be due to infection by pathogens that are not detected by this test or non-infectious causes such as ulcerative colitis, irritable bowel syndrome, or Crohn's disease.

    Concomitant culture is necessary for organism recovery and further typing of bacterial agents.

    This device is not intended to monitor or guide treatment for C. difficile infection.

    Due to the small number of positive specimens collected for certain organisms during the prospective clinical study, performance characteristics for Adenovirus 40/41, Campylobacter, E. coli 0157, Shigella/EIEC, Yersinia enterocolitica, and Giardia lamblia were established additionally with retrospective clinical specimens. Performance characteristics for Entamoeba histolytica, Giardia lamblia, Yersinia enterocolitica and Vibrio (V. parahaemolyticus, V. vulnificus, and V. cholerae) were established primarily using contrived clinical specimens.

    Device Description

    The BioCode Gastrointestinal Pathogen Panel (GPP) is a multiplexed nucleic acid-based test designed to be used with the BioCode MDx 3000 system. The BioCode MDx 3000 is an automated system that integrates PCR amplification, target capture, signal generation and optical detection for multiple gastrointestinal pathogens from a single stool specimen, either unpreserved or in Cary Blair. Stool specimens are processed and nucleic acids extracted with the easyMAG and MagNa Pure. Once the PCR plate is set up and sealed, all other operations are automated on MDx 3000. The BioCode MDx 3000 Gastrointestinal Infection Panel simultaneously tests for 17 pathogens (see table below) from unpreserved stool specimens or stool collected in Cary-Blair transport medium. Results from the BioCode Gastrointestinal Pathogen Panel (GPP) test are available within less than 4 hours.

    AI/ML Overview

    Here's a breakdown of the acceptance criteria and study information for the BioCode Gastrointestinal Pathogen Panel (GPP) as described in the provided document:

    Acceptance Criteria and Device Performance for BioCode GPP (with MagNA Pure 96 extraction)

    The document focuses on demonstrating the substantial equivalence of the BioCode GPP when used with the MagNA Pure 96 extraction system, compared to its previously cleared version with the easyMAG extraction system (K180041, the predicate device). Therefore, the acceptance criteria and performance are largely derived from the comparison to the existing predicate and the analytical studies.

    General Acceptance Criteria (Implied from Clinical Performance Tables):
    The acceptance criteria are generally implied to be high positive agreement (PPA) and negative agreement (NPA) with reference methods, typically in the range of 80-100% for PPA and 90-100% for NPA, within a 95% Confidence Interval. For analytical studies, reproducibility is expected to be high (>95%), and the limit of detection (LoD) should be comparable between extraction methods.

    Table of Acceptance Criteria and Reported Device Performance (Summary):

    Target Pathogen/ToxinSpecimen TypeAcceptance Criteria (Implied) - PPA (95% CI)Acceptance Criteria (Implied) - NPA (95% CI)Reported Device Performance (MP96) - PPA (95% CI)Reported Device Performance (MP96) - NPA (95% CI)
    Clinical Performance (Archived Specimens - N=464)
    Campylobacter spp.Inoculated/Cary-BlairHigh (>90%)High (>90%)95.65% (79.0–99.2)98.20% (94.9–99.4)
    Unpreserved (Frozen)High (>90%)High (>90%)100% (87.5-100)98.80% (96.5-99.6)
    All ArchivedHigh (>90%)High (>90%)98.0% (89.5-99.6)98.60% (96.9–99.3)
    Clostridium difficileInoculated/Cary-BlairHigh (>90%)High (>90%)90.91% (62.3–98.4)99.44% (96.9–99.9)
    Unpreserved (Frozen)High (>90%)High (>90%)95.45% (78.2–99.2)99.20% (97.2–99.8)
    All ArchivedHigh (>90%)High (>90%)93.94% (80.4-98.3)99.30% (98.0-99.8)
    E. coli O157Inoculated/Cary-BlairHigh (100%)High (100%)100% (43.9-100)100% (98.0-100)
    Unpreserved (Frozen)High (100%)High (100%)100% (78.5-100)100% (98.5-100)
    All ArchivedHigh (100%)High (100%)100% (81.6-100)100% (99.1-100)
    Enteroaggregative E. coli (EAEC)Inoculated/Cary-BlairHigh (>85%)High (>95%)88.24% (65.7-96.7)98.8% (95.9-99.7)
    Unpreserved (Frozen)High (>95%)High (>95%)100% (88.3-100)99.59% (97.7-99.9)
    All ArchivedHigh (>90%)High (>95%)95.65% (85.5-98.8)99.50% (98.3-99.9)
    Enterotoxigenic E. coli (ETEC)Inoculated/Cary-BlairModerate (>60%)High (100%)60.00% (23.1-88.2)100% (98.0-100)
    Unpreserved (Frozen)High (100%)High (100%)100% (77.2-100)100% (98.5-100)
    All ArchivedHigh (>85%)High (100%)88.89% (67.2-96.9)100% (99.1-100)
    Shiga toxin-producing E. coli (STEC)Inoculated/Cary-BlairHigh (>90%)High (100%)92.31% (66.7-98.6)100% (97.9-100)
    Unpreserved (Frozen)High (>95%)High (>95%)96.67% (83.3-99.4)99.60% (97.7-99.9)
    All ArchivedHigh (>90%)High (>95%)95.35% (84.5-98.7)99.80% (98.7-100)
    Salmonella spp.Inoculated/Cary-BlairHigh (100%)High (>95%)100% (81.6-100)97.70% (94.2-99.1)
    Unpreserved (Fresh)High (>90%)High (>95%)92.59% (76.6-97.9)99.60% (97.7-99.9)
    All ArchivedHigh (>90%)High (>95%)95.45% (84.9-98.7)98.80% (97.2-99.5)
    Shigella/EIECInoculated/Cary-BlairHigh (100%)High (100%)100% (70.1-100)100% (97.9-100)
    Unpreserved (Frozen)High (>90%)High (100%)90.91% (72.2-97.5)100% (98.5-100)
    All ArchivedHigh (>90%)High (100%)93.55% (79.3-98.2)100% (99.1-100)
    Vibrio parahaemolyticusInoculated/Cary-BlairHigh (100%)High (100%)100% (20.7-100)100% (98.0-100)
    Unpreserved (Frozen)High (100%)High (>99%)100% (20.7-100)99.6% (98.0-99.9)
    All ArchivedHigh (100%)High (>99%)100% (34.2-100)99.8% (99.8-100)
    Vibrio spp. (not parahaemolyticus)Inoculated/Cary-BlairN/AHigh (100%)N/A100% (98.0-100)
    Unpreserved (Frozen)Low (0%)High (>99%)0% (N/A)99.6% (N/A)
    All ArchivedLow (0%)High (>99%)0% (N/A)99.8% (98.8-100)
    Yersinia enterocoliticaInoculated/Cary-BlairHigh (100%)High (100%)100% (43.9-100)100% (98.0-100)
    Unpreserved (Frozen)High (100%)High (>99%)100% (43.9-100)99.26% (97.3-99.8)
    All ArchivedHigh (100%)High (>99%)100% (61.0-100)99.6% (98.4-99.9)
    Cryptosporidium spp.Inoculated/Cary-BlairHigh (>90%)High (100%)91.67% (64.6-98.5)100% (97.9-100)
    Unpreserved (Frozen)High (>90%)High (>99%)91.67% (74.2-97.7)99.20% (97.1-99.8)
    All ArchivedHigh (>90%)High (>99%)91.67% (78.2-97.1)99.5% (98.3-99.9)
    Entamoeba histolyticaInoculated/Cary-BlairN/AHigh (100%)N/A100% (98.0-100)
    Unpreserved (Frozen)N/AHigh (100%)N/A100% (98.6-100)
    All ArchivedN/AHigh (100%)N/A100% (99.2-100)
    Giardia lambliaInoculated/Cary-BlairHigh (100%)High (100%)100% (43.90-100)100% (98.0-100)
    Unpreserved (Frozen)High (100%)High (>98%)100% (78.5-100)98.1% (95.6-99.2)
    All ArchivedHigh (100%)High (>98%)100% (81.6-100)98.9% (97.4-99.5)
    Adenovirus 40/41Inoculated/Cary-BlairModerate (>70%)High (>98%)70.00% (39.7-89.2)98.32% (95.2-99.4)
    Unpreserved (Frozen)Moderate (>75%)High (>96%)78.60% (52.4-92.4)96.90% (94.0-98.4)
    All ArchivedModerate (>85%)High (>97%)87.50% (69.0-95.7)97.5% (95.6-98.6)
    Norovirus (GI/GII)Inoculated/Cary-BlairHigh (100%)High (>98%)100% (83.2-100)98.20% (95.0-99.4)
    Unpreserved (Frozen)High (>95%)High (>98%)95.45% (78.2-99.2)98.40% (96.0-99.4)
    All ArchivedHigh (>90%)High (>98%)90.24% (77.5-96.1)98.3% (96.6-99.2)
    Rotavirus AInoculated/Cary-BlairHigh (>90%)High (>99%)92.31% (66.7-98.6)99.44% (96.9-99.9)
    Unpreserved (Frozen)High (100%)High (>98%)100% (79.6-100)98.5% (96.1-99.4)
    All ArchivedHigh (>95%)High (>98%)96.43% (82.3-99.4)98.9% (97.3-99.5)
    Clinical Performance (Fresh Specimens - N=53)
    Clostridium difficileUnpreserved (Fresh)High (100%)High (100%)100% (88.6-100)100% (85.1-100)
    Salmonella spp.Unpreserved (Fresh)High (100%)High (100%)100% (20.7-100)100% (92.3-100)
    Shigella/EIECUnpreserved (Fresh)High (100%)High (100%)100% (20.7-100)100% (92.3-100)
    Norovirus (GI/GII)Unpreserved (Fresh)High (100%)High (100%)100% (20.7-100)100% (92.3-100)
    Analytical Performance (Reproducibility)
    All targets (various concentrations)In Vitro>95% agreement with expectedN/A>99% (most 100%)N/A

    2. Sample Size for the Test Set and Data Provenance:

    • Clinical Test Set:

      • Archived Samples: 466 leftover, de-identified samples (275 frozen unpreserved and 191 inoculated Cary-Blair).
        • Provenance: Prospectively collected for the clinical study that resulted in the K180041 BioCode GPP clearance. This suggests the samples were originally collected for diagnostic purposes in a real-world setting, then archived and de-identified for the current study. The country of origin is not explicitly stated but is implied to be within the scope of previous FDA clearance.
      • Fresh Samples: 53 freshly collected leftover samples (specifically for C. difficile testing initially, but used for other targets as well).
        • Provenance: Freshly collected, though the specific clinical sites or countries are not mentioned.
      • Contrived Samples: 120 samples
        • Provenance: Primarily used to establish performance characteristics for Entamoeba histolytica, Giardia lamblia, Yersinia enterocolitica and Vibrio (V. parahaemolyticus, V. vulnificus, and V. cholerae) due to small numbers of naturally positive clinical specimens. These are laboratory-prepared samples.
    • Analytical Test Set (Reproducibility Study): Consisted of 7 contrived samples, with combinations of 12 representative targets at 1.5x LoD (Low) and 3x LoD (Medium). Each sample was extracted in triplicate and assayed in singlet. This involved testing across 3 instruments by 3 operators, 2 runs per day for 5 days (total of 30 runs).

    • Analytical Test Set (LoD Study):

      • Initial screening: 4 replicates of each concentration (near LoD) in negative stool and Cary-Blair, extracted on both easyMAG and MagNA Pure 96, and tested in singlet.
      • Confirmation: 20 replicates of each sample type/extraction method, tested in singlet, at or near presumptive LoD.
      • Norovirus GI and GII LoD used positive clinical specimens with serial dilutions.

    3. Number of Experts Used to Establish Ground Truth for the Test Set and Qualifications:

    The document mentions "Reference methods" which include culture, FDA cleared NAT, PCR/sequencing, and enrichment culture/cleared antigen test. While reference methods are used, the document does not explicitly state the number of experts used to establish the ground truth or their qualifications. It refers to "historical Reference results (K180041)" and "Reference assay". This implies that the ground truth was established by laboratory testing using established diagnostic methods, rather than clinical experts' consensus.

    4. Adjudication Method for the Test Set:

    The document describes discordant analysis for clinical samples. Specifically, "Sixty-four (64) archived samples with discordant results were retested twice with both easyMag and/or MagNA Pure 96 systems." The retesting appears to be the primary adjudication method. There is no mention of a particular adjudication method like 2+1 or 3+1 involving human experts. The "Comment" section for discordant results often indicates further molecular testing (PCR/Seq) to resolve discrepancies.

    5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done, and Effect Size:

    No, an MRMC comparative effectiveness study was not done. This device is an in vitro diagnostic test that provides qualitative detection of pathogens. Its performance is evaluated based on its agreement (sensitivity and specificity) with established reference methods, not on how it assists human readers in interpreting images or making diagnoses. Therefore, there is no discussion of human reader improvement with or without AI assistance.

    6. If a Standalone (Algorithm Only Without Human-in-the Loop Performance) Was Done:

    Yes, the studies are standalone performance evaluations of the BioCode GPP diagnostic test. The device itself is an automated system that performs nucleic acid extraction, amplification, detection, and decoding to provide qualitative results. The "Clinical Performance" and "Analytical Performance" sections directly assess the accuracy of the device's output against reference methods. There is no human-in-the-loop component in the direct operation or interpretation of the assay results in the way it would apply to, for example, an AI-powered image analysis tool. The results are interpreted by the MDx 3000 system.

    7. The Type of Ground Truth Used:

    The ground truth for the clinical studies was established using reference laboratory methods, including:

    • Culture: For Campylobacter (C. jejuni, C. coli), Escherichia coli (E. coli) 0157, Salmonella, Shigella, Vibrio spp., Yersinia enterocolitica.
    • FDA cleared NAT (Nucleic Acid Test): For Clostridium difficile toxin A/B.
    • PCR/sequencing: For Adenovirus 40/41, Cryptosporidium (C. parvum, C. hominis), Entamoeba histolytica, Enteropathogenic E. coli (EPEC), Enterotoxigenic E. coli (ETEC) LT/ST, Enteroaggregative E. coli (EAEC), Giardia lamblia /intestinalis, Norovirus GI/GII, Rotavirus A.
    • Enrichment culture/cleared antigen test: For Shiga-like Toxin producing E. coli (STEC) stx1/stx2.

    Some ground truth for less common organisms (Entamoeba histolytica, Giardia lamblia, Yersinia enterocolitica and Vibrio) was established with contrived clinical specimens, where the pathogen presence and concentration are precisely known.

    8. The Sample Size for the Training Set:

    The document does not explicitly mention a "training set" in the context of machine learning for an AI device. This is a molecular diagnostic assay, not an AI/ML algorithm that requires training data in the typical sense. The studies presented are primarily for validation and verification of the device's performance. The "K180041 BioCode GPP clearance" mentioned as the source of archived samples suggests previous validation, but that wouldn't necessarily be considered a "training set" for the current device.

    9. How the Ground Truth for the Training Set Was Established:

    Since there is no explicit "training set" for an AI/ML algorithm mentioned, this question is not directly applicable. The performance is validated against clinical and analytical studies using reference methods as described in point 7.

    Ask a Question

    Ask a specific question about this device

    K Number
    K180041
    Date Cleared
    2018-09-28

    (266 days)

    Product Code
    Regulation Number
    866.3990
    Reference & Predicate Devices
    Why did this record match?
    Device Name :

    BioCode Gastrointestinal Pathogen Panel (GPP)

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The BioCode Gastrointestinal Pathogen Panel (GPP) is a qualitative, gastrointestinal microorganism multiplexed nucleic acid-based assay capable of detecting of nucleic acids from the following organisms in unpreserved stool and Cary-Blair media:

    • Adenovirus 40/41 ●
    • Campylobacter (C. jejuni, C. coli) ●
    • Clostridium difficile (C. difficile) toxin A/B (from fresh specimens only) ●
    • Cryptosporidium (C. parvum, C. hominis) 0
    • Entamoeba histolytica ●
    • Escherichia coli (E. coli) 0157 ●
    • Enterotoxigenic E. coli (ETEC) LT/ST ●
    • Enteroaggregative E. coli (EAEC) 0
    • Giardia lamblia (also known as G. intestinalis and G. duodenalis) ●
    • Norovirus GI/GII ●
    • Rotavirus A ●
    • Salmonella spp. .
    • Shiga-like Toxin producing E. coli (STEC) stx1/stx2 ●
    • Shigella (S. boydii, S. sonnei, S. flexneri, S. dysenteriae)/EIEC ●
    • Vibrio spp. (V. cholerae, V. parahaemolyticus, V. vulnificus), specific identification of V. ● parahaemolyticus
    • Yersinia enterocolitica

    The BioCode Gastrointestinal Pathogen Panel (GPP) is indicated as an aid in the diagnosis of specific agents of gastrointestinal illness and results are meant to be used in conjunction with other clinical, laboratory, and epidemiological data. Positive results do not rule out co-infection with organisms not included in the BioCode Gastrointestinal Pathogen Panel (GPP). The agent detected may not be the cause of patient illness. Negative results in the setting of clinical illness compatible with gastroenteritis may be due to infection by pathogens that are not detected by this test or non-infectious causes such as ulcerative colitis, irritable bowel syndrome, or Crohn's disease.

    Concomitant culture is necessary for organism recovery and further typing of bacterial agents. This device is not intended to monitor or guide treatment for C. difficile infection.

    Due to the small number of positive specimens collected for certain organisms during the prospective clinical study, performance characteristics for Campylobacter spp., E. coli 0157, Shigella/EIEC, Yersinia enterocolitica, and Adenovirus 40/41 were established primarily with retrospective clinical specimens.

    Performance characteristics for Entamoeba histolytica, and Vibrio spp. (V. parahaemolyticus, V. vulnificus, and Vibrio cholerae) were established primarily using contrived clinical specimens.

    Device Description

    The BioCode Gastrointestinal Pathogen Panel (GPP) is a multiplex nucleic acid test designed to be used with the BioCode MDx 300 system. The BioCode MDx 3000 is an automated system that integrates PCR amplification, target capture, signal generation and optical detection for nultiple gastrointestinal pathogens from a single stool speciment or in Cary Blair. Stool specimens are processed and nucleic acids extracted with easyMAG, an automated system. Once the PCR plate is set up and sealed, all other operations are automated on MDx 3000. The BioCode Gastrointestinal Pathogen Panel simultaneously tests for 17 pathogens (see table below) from unpreserved stool specimens or stool collected in Cary-Blair transport medium. Results from the BioCode Gastrointestinal Pathogen Panel test are available within less than 5 hours.

    AI/ML Overview

    Here's a breakdown of the acceptance criteria and study details for the BioCode Gastrointestinal Pathogen Panel (GPP) based on the provided document:

    1. Table of Acceptance Criteria and Reported Device Performance

    The document does not explicitly state pre-defined acceptance criteria for the clinical performance metrics (PPA and NPA). Instead, it presents the calculated agreement rates and their 95% confidence intervals from the clinical study. The reproducibility study, however, does have clear acceptance criteria defined (>= 95% detection for positive targets, and >= 95% non-detection for negative targets).

    Here's a table summarizing the reported clinical performance. Note that "Acceptance Criteria" for clinical performance are inferred based on general expectations for diagnostic assays submitted to the FDA; explicit numerical targets were not provided in the text for these. The Reproducibility section does state explicit criteria.

    CategoryTarget (General)Acceptance Criteria (Explicit if available, otherwise inferred)Reported Device Performance
    Clinical PerformancePositive Percent Agreement (PPA)Generally high agreement (e.g., >80-90% for most targets)See tables on pages 14-17 for specific organism PPAs and 95% CIs.
    Negative Percent Agreement (NPA)Generally high agreement (e.g., >95% for most targets)See tables on pages 14-17 for specific organism NPAs and 95% CIs.
    Reproducibility StudyDetection of positive targets (1.5x LoD and 3x LoD)>= 95% detectionAll specified targets at both concentrations achieved 100% detection, except STEC (98.89% at Low). All >95%. (pg 32)
    Non-detection of negative targets (for negative control)>= 95% non-detectionGiardia lamblia: 99.78% non-detection. All others 100%. All >95%. (pg 32)
    Limit of DetectionLowest concentration with >=95% detection for 20 replicates>= 95% detection (19/20) at specified LoD (for 20 replicates)All targets met 20/20 or 19/20 detection at their determined LoD for 20 replicates across both unpreserved and Cary-Blair stool. (pg 35-36)
    Fresh vs. Frozen Stability95% replicates for positive targets should be valid and detected (>=60/63)63/63 replicates for positive targets were valid and detected. (pg 50)
    95% of negative targets should be valid and not detected (>=60/63)63/63 replicates for negative targets were valid and not detected (one was detected but invalid for RNA IC). (pg 50)
    Interfering Substances/MicrobesNo inhibition or unexpected resultsNo inhibition or unexpected results observed, with some exceptions/details noted for specific cross-reactivity findings (Vibrio spp., Yersinia enterocolitica, Shigella dysenteriae, Rotavirus vaccines, C. meleagridis). (pg 37-38)
    Analytical Reactivity/InclusivityDetection of diverse strains at 3X LoDDetection at 3X LoD for most strains; higher if not.All organisms were detected at the indicated concentrations. (pg 38-45)
    Analytical Specificity/Cross-ReactivityNo cross-reactivity with common commensals/pathogensNo cross-reactivity observed/predicted with list of organisms, with some exceptions/details noted. (pg 46-48)
    Competitive InhibitionNo competitive inhibition observedNo competitive inhibition observed. (pg 48)
    Cross Contamination/Sample CarryoverAbsence of carryover or cross-contaminationNo cross-contamination was observed. (pg 50)

    2. Sample Sizes and Data Provenance

    • Clinical Study (Prospective):

      • Sample Size: 1558 leftover, de-identified samples.
      • Data Provenance: Prospectively collected from patients in the United States (Baltimore, MD; Tampa, FL; Memphis, TN; Los Angeles, CA). Samples collected between January 2015 and August 2017.
      • Specimen Breakdown:
        • Unpreserved (Fresh): 237 samples
        • Unpreserved (Frozen): 960 samples
        • Cary-Blair (Fresh): 361 samples
      • Inoculated Cary-Blair Samples: 400 unpreserved stool samples from Sites 1 and 2 were thawed and inoculated into Cary-Blair to supplement numbers for specific analytes (pg 21).
    • Pre-selected Archived Specimens (Category III):

      • Sample Size: 260 preselected archived specimens.
      • Data Provenance: Archived clinical specimens that were previously tested positive by different methods (retrospective). These were spiked with known positives and randomized with negative specimens. (pg 23)
    • Contrived Specimens (Category IV):

      • Sample Size: 612 samples total, with 485 positive samples.
      • Data Provenance: Prepared using specimens previously tested negative for all BioCode GPP analytes, then spiked at levels of up to 3X LOD or greater. (pg 25)
    • Asymptomatic Volunteers (Clinical Specificity):

      • Sample Size: 125 clinical stool samples.
      • Data Provenance: Collected from healthy asymptomatic donors from Tampa General Hospital and University of Maryland. (pg 30-31)
    • Reproducibility Study:

      • Sample Size: 7 contrived samples (6 positive, 1 negative control) extracted in triplicate and each assayed in singlet over 10 runs per site. Total 90 replicates per target. (pg 32)
      • Data Provenance: Performed at 3 sites. (pg 32)
    • Limit of Detection (LoD):

      • Sample Size: 20 replicates for each tested organism and sample type (unpreserved stool and Cary-Blair). (pg 35)
    • Interfering Substances:

      • Each sample extracted in triplicate and tested in singlet. (pg 37)
    • Cross Contamination/Sample Carryover:

      • Five complete runs in "checkerboard" pattern. (pg 50)

    3. Number of Experts and Qualifications for Ground Truth

    The document does not specify the number or qualifications of experts used to establish ground truth for the clinical test set. Instead, it relies on reference methods for clinical performance evaluation (pg 13).

    4. Adjudication Method for the Test Set

    The document does not describe an adjudication method involving human experts. For the clinical study, the reference method for each target pathogen was used as the ground truth. In some cases, discrepancies between the BioCode GPP and the initial reference method were subjected to bidirectional sequencing or additional rounds of sequencing for "confirmation" (e.g., footnotes on pages 14, 15, 17, 22), which can be considered a form of analytical adjudication to determine the true state of the specimen.

    5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

    No MRMC study was mentioned. The device is a "multiplex nucleic acid-based assay," indicating an automated laboratory test, not an imaging AI diagnostic that assists human readers. Therefore, the concept of "human readers improve with AI vs without AI assistance" does not apply here.

    6. Standalone (Algorithm Only Without Human-in-the-Loop Performance)

    Yes, the studies presented are for the standalone performance of the BioCode Gastrointestinal Pathogen Panel (GPP) system, without human interpretation or assistance beyond typical laboratory operational procedures. The results, as quantitative fluorescence intensity (MFI) values, are processed by the BioCode MDx 3000 system to determine positive or negative results.

    7. Type of Ground Truth Used

    • Clinical Study (Prospective):

      • Reference standard methods: Culture, FDA-cleared NAAT (Nucleic Acid Amplification Test), or Composite results of two PCR/sequencing assays (pg 13).
      • For discrepancies, bidirectional sequencing or additional rounds of sequencing were used as further confirmation/adjudication (e.g., footnotes on pages 14, 15, 17, 22).
    • Archived Specimens: Previously tested positive by different methods, and verified using analyte-specific PCR followed by bi-directional sequencing performed by Applied BioCode, Inc. (pg 23).

    • Contrived Specimens: Known concentrations of quantified bacteria, viruses, or parasites spiked into negative clinical matrix. (pg 25)

    8. Sample Size for the Training Set

    The document does not explicitly mention a "training set" in the context of machine learning. This device is a molecular diagnostic assay, not a machine learning algorithm that is trained on a dataset. The studies described are performance validation studies for an established assay.

    9. How the Ground Truth for the Training Set Was Established

    Since this is not a machine learning device trained on a "training set," this question is not applicable. The device's probes and primers for detecting targets are designed based on known genetic sequences, not through a data-driven training process like that used for AI/ML.

    Ask a Question

    Ask a specific question about this device

    Page 1 of 1