Search Filters

Search Results

Found 1 results

510(k) Data Aggregation

    K Number
    DEN160025

    Validate with FDA (Live)

    Date Cleared
    2017-08-18

    (417 days)

    Product Code
    Regulation Number
    866.3367
    Type
    Direct
    Age Range
    All
    Reference & Predicate Devices
    N/A
    Predicate For
    N/A
    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticPediatricDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    ID-FISH Plasmodium Genus Test Kit (PlasG) and ID-FISH Plasmodium falciparum and P. vivax Combo Test Kit (PlasFV) are intended for in vitro diagnostic use in the clinical laboratory for detection of Plasmodium species in human venous whole blood (EDTA) samples from patients suspected of Plasmodium infection. The test kits are intended to aid in the diagnosis of malaria and to aid in the differential diagnosis of P. falciparum and P. vivax infection. The test kits should be used only on samples from patients with a clinical history, signs and symptoms consistent with malaria, and are not intended as a screen for asymptomatic patients.

    The ID-FISH Plasmodium Genus Test Kit is a qualitative test for detection of malaria parasites in blood smears. Positive results should be supplemented with the Plasmodium species specific test kit, ID-FISH Plasmodium falciparum and P. vivax Combo Test Kit for identification and differentiation of Plasmodium falciparum and Plasmodium vivax. The results of these test kits should be used in conjunction with other diagnostic test results. Clinical performance has not been established for P. ovale, P. malariae, or P. knowlesi.

    Device Description

    The ID-FISH Plasmodium Genus Test Kit (PlasG) and ID-FISH Plasmodium falciparum and P. vivax Combo Test Kit (PlasFV) are fluorescence in situ hybridization (FISH) assays to detect Plasmodium spp. or P. falciparum or P. vivax parasites in thin film blood smears prepared from EDTA venous whole blood samples.

    AI/ML Overview

    Here's a breakdown of the acceptance criteria and the study proving the device meets them, based on the provided text:

    Acceptance Criteria and Reported Device Performance

    Acceptance Criteria CategorySpecific Criteria/MetricTarget Performance (Implicit from study results)Reported Device Performance (PlasG)Reported Device Performance (PlasFV - P. falciparum)Reported Device Performance (PlasFV - P. vivax)
    ReproducibilityNegative AgreementHigh agreement (e.g., >95%)99.4% (178/179)99.4% (178/179)N/A (Kit differentiates species)
    Positive Agreement (Low P.f.)100%100% (178/178)99.4% (177/178)N/A
    Positive Agreement (Mod P.f.)100%100% (180/180)100% (180/180)N/A
    Positive Agreement (Low P.v.)100%100% (180/180)N/A100% (180/180)
    Positive Agreement (Mod P.v.)100%100% (180/180)N/A100% (180/180)
    Limit of Detection (LoD)Detection Rate>= 95% at specified concentration143 parasites/uL (P.f.), 126 parasites/uL (P.v.)143 parasites/uL (P.f.), 126 parasites/uL (P.v.)143 parasites/uL (P.f.), 126 parasites/uL (P.v.)
    Analytical Reactivity (Inclusivity)Detection of Plasmodium speciesAll Plasmodium positive samples detectedAll 11 Plasmodium positive samples detectedP. falciparum and P. vivax positive samples correctly identifiedP. falciparum and P. vivax positive samples correctly identified
    Analytical Specificity (Cross-Reactivity)No false positive results0 false positivesNo false positives with 29 pathogens/76 non-malarial blood samplesNo false positives with 29 pathogens/76 non-malarial blood samples (for respective probes)No false positives with 29 pathogens/76 non-malarial blood samples (for respective probes)
    Interfering SubstancesNo false positives/negativesNo impact on resultsNo false positives, expected results for positive samplesNo false positives, expected results for positive samplesNo false positives, expected results for positive samples
    Specimen StabilityStable for 5 years (fixed slides storage)No noticeable reduction in staining intensity, expected resultAll samples produced expected resultsAll samples produced expected resultsAll samples produced expected results
    Clinical Performance (Endemic Regions - All Comers)Sensitivity (Plasmodium spp.)>95% (lower bound 95% CI >90%)95.7% (95% CI 93.0% - 97.4%)N/AN/A
    Specificity (Plasmodium spp.)High specificity, PCR confirmation for "false positives"92.6% (95% CI 89.5% - 94.9%) - improved by PCRN/AN/A
    Sensitivity (P. falciparum)High sensitivityN/A97.4% (95% CI 93.6% - 99.0%)N/A
    Specificity (P. falciparum)High specificity, PCR confirmation for "false positives"N/A96.1% (95% CI 94.1% - 97.4%) - improved by PCRN/A
    Sensitivity (P. vivax)High sensitivityN/AN/A91.2% (95% CI 86.0% - 94.6%)
    Specificity (P. vivax)High specificity, PCR confirmation for "false positives"N/AN/A98.3% (95% CI 96.8% - 99.1%) - improved by PCR
    Clinical Performance (Non-Endemic Regions)Specificity (Plasmodium spp.)High specificity100% (150/150)100% (150/150)100% (150/150)
    Clinical Performance (Low Parasitemia)Sensitivity (Plasmodium spp. <100/µL)N/A (but reported)71.9% (23/32)N/AN/A
    Sensitivity (P. falciparum <100/µL)N/A (but reported)N/A84.6% (11/13)N/A
    Sensitivity (P. vivax <100/µL)N/A (but reported)N/AN/A63.2% (12/19)

    Study Details Proving Device Meets Acceptance Criteria

    1. Sample Size and Data Provenance:

      • Reproducibility Test Samples: A panel of 5 contrived samples (1 negative, 2 low positive P.f., 1 moderate positive P.f., 1 low positive P.v., 1 moderate positive P.v.) were used. 180 replicate slides (with 2 smears per slide) were prepared from each sample across two separate sites, totaling 900 slides.
      • Clinical Test Set:
        • Total: 1067 leftover venous whole blood (EDTA) samples.
        • Provenance:
          • Endemic Regions: 917 samples from India (300 sequential), Kenya (395 sequential from multiple sites), and Peru (222 selective enrollment). Patients had malaria-like symptoms.
          • Non-Endemic Region: 150 symptomatic patient samples from the United States.
        • Retrospective/Prospective: Samples were generally collected between 2013 and 2015. The collection method for endemic regions involved "sequential samples (i.e. all comers meeting inclusion criteria)" for India and Kenya, which implies a prospective component for real-world representation, although the term "leftover" suggests they were archived for study. Peru samples were "selectively enrolled" which indicates a retrospective design for balancing positive/negative cases. Non-endemic samples were "all comers," implying a prospective or representative collection.
    2. Number of Experts and Qualifications for Ground Truth:

      • Giemsa Microscopy (Comparator/Ground Truth): "pre-defined, expert adjudication by up to three microscopists."
      • Qualifications: The document does not explicitly state the qualifications (e.g., years of experience, board certification) of these microscopists. However, the term "expert adjudication" implies high proficiency.
    3. Adjudication Method for the Test Set:

      • Giemsa Microscopy: "pre-defined, expert adjudication by up to three microscopists." This suggests a consensus-based approach (e.g., majority rule, or final decision by a senior expert after initial reads), but the exact "pre-defined" method (e.g., 2+1, 3+1) is not explicitly detailed beyond "up to three."
      • Discrepant Analysis for Clinical Study: PCR testing followed by bi-directional sequencing was used for discrepant analysis between the device results and Giemsa microscopy. This serves as a molecular "tie-breaker" for cases where the human expert consensus diverges from the device.
    4. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study:

      • No MRMC comparative effectiveness study was explicitly described in the provided text. The study primarily compares the device's performance to human expert microscopy as a reference standard (standalone performance relative to ground truth), rather than comparing human reader performance with and without AI assistance. The device is a "kit" for performing a FISH assay, observed by operators through a microscope, not an AI interpreting images for humans. So, an MRMC study in the typical AI sense is not applicable here.
    5. Standalone Performance (Algorithm Only):

      • Yes, the core of the clinical study evaluates the standalone performance of the ID-FISH Plasmodium Genus Test Kit (PlasG) and the ID-FISH Plasmodium falciparum and P. vivax Combo Test Kit (PlasFV). These are diagnostic kits based on FISH technology, not an automated image analysis algorithm in the AI sense. The "algorithm" here is the chemical reaction and visual interpretation by a human operator, making the performance measurement of the kit itself (its ability to bind to target RNA) rather than an AI algorithm's interpretive accuracy. The results presented in Tables 10-26 directly show the kit's performance (sensitivity, specificity, PPA, NPA) against the Giemsa microscopy gold standard, followed by PCR for discrepant cases.
    6. Type of Ground Truth Used:

      • Primary Ground Truth: Expert consensus Giemsa thick and thin smear malaria microscopy.
      • Secondary/Discrepant Ground Truth: PCR testing followed by bi-directional sequencing for discrepant analysis between the device results and Giemsa microscopy. This acts as a higher-level confirmation for cases where the initial human reads and device results don't align.
    7. Sample Size for Training Set:

      • The document describes the analytical and clinical validation studies. There is no mention of a separate "training set" as would be typical for machine learning models. This is due to the nature of the device being a laboratory test kit (FISH assay) rather than an AI/ML diagnostic algorithm that requires a training phase. The studies described are for validation of the completed device.
    8. How Ground Truth for Training Set was Established:

      • As there's no explicitly mentioned "training set" in the context of an AI/ML model, this question is not directly applicable. If one considers the development of the FISH probes themselves, the "ground truth" would have been established through molecular biology techniques ensuring probe specificity and sensitivity to the target ribosomal RNA sequences. However, the document focuses on the validation of the final kit.
    Ask a Question

    Ask a specific question about this device

    Page 1 of 1