Search Filters

Search Results

Found 4 results

510(k) Data Aggregation

    Why did this record match?
    Reference Devices :

    K003557, K040274, K010841, K011672, K011730

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The Nano-Check™ DAT 5 Multi Drug Screening Test for Marijuana, Opiates, Cocaine, Methamphetamine and Phencyclidine is a rapid, self-controlled immunoassay for the qualitative detection of Cannabinoids (THC), Opiates (OPI), Benzoylecgonine (COC), Methamphetamine (mAMP) and Phencyclidine (PCP) compounds and their metabolites in human urine. The detection limits (cut-off concentrations) of this test are as follows: Cannabinoids at 50 ng/ml, Opiates at 2000 ng/ml, Cocaine at 300 ng/ml, Methamphetamine at 1000 ng/ml and Phencyclidine at 25 ng/ml. This assay is intended for Professional and Laboratory In-Vitro Use Only.

    Device Description

    The Nano-Check™ DAT 5M test is a one step, type II, competitive immuochromatographic assay for the qualitative detection of Cannabinoid, Opiate, Benzoylecgonine, Methamphetamine and Phencyclidine compounds and their metabolites in human urine. The Nano-Check™ DAT 5M test device contains a membrane strip on which either antibodies against drug or drug conjugate to protein are immobilized at each specific test line. The colored indicator antibody or antigen coupled with Gold colloidal particles is place at the end of membrane.

    The test is a single-use visually read cassette device in a plastic housing. It contains the test strip containing 5 test lines and 1 control line. Urine sample can be dropped onto sample well using plastic disposable dropper, which is provided. Drug positive urines will not show a colored band, while drug negative urine sample or urine sample containing drugs below cutoff level will generate red colored band.

    The device is sealed in a pouch desiccant and provided with instructions for use and a disposable sample dropper.

    AI/ML Overview

    The provided document describes the Nano-Check™ DAT 5 Multi Drug Screening Test for Cannabinoids (THC), Opiates (OPI), Cocaine (COC), Methamphetamine (mAMP), and Phencyclidine (PCP).

    Here's an analysis of the acceptance criteria and the study that proves the device meets them:

    1. Table of Acceptance Criteria and Reported Device Performance

    The document does not explicitly state acceptance criteria in terms of performance metrics (e.g., sensitivity, specificity, accuracy) with specific thresholds. Instead, it focuses on demonstrating substantial equivalence to predicate devices. The "acceptance criteria" can be inferred from the comparison table highlighting similarities and the successful outcome of the non-clinical tests. The primary performance characteristic mentioned is the detection limits (cut-off concentrations).

    Performance MetricAcceptance Criteria (Implicit from Predicate Devices)Reported Device Performance
    Cut-off ConcentrationTHC: 50 ng/mlTHC: 50 ng/ml
    OPI: 2000 ng/mlOPI: 2000 ng/ml
    COC: 300 ng/mlCOC: 300 ng/ml
    mAMP: 1000 ng/mlmAMP: 1000 ng/ml
    PCP: 25 ng/mlPCP: 25 ng/ml
    Test PrincipleImmunochromatographic, lateral-flow, competitive assaySame
    Type of testQualitativeSame
    Assay time10 minSame
    Sample typeHuman urineSame
    Intended useProfessional useSame

    2. Sample Size Used for the Test Set and Data Provenance

    The document explicitly states "Discussion of Clinical Tests Performed: Not Applicable." This indicates that no clinical test set with human subject samples was used for this submission. The evaluation was based on non-clinical tests performed to demonstrate analytical performance and comparison to predicate devices.

    Therefore:

    • Sample size for the test set: Not applicable (no clinical test set).
    • Data provenance: Not applicable (no clinical data).

    3. Number of Experts Used to Establish Ground Truth for the Test Set and Their Qualifications

    Since no clinical tests were performed and thus no clinical test set was used, there were no experts involved in establishing ground truth for a clinical test set.

    4. Adjudication Method for the Test Set

    As there was no clinical test set involved, there was no adjudication method applied.

    5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done

    No, an MRMC comparative effectiveness study was not done. The submission explicitly states "Discussion of Clinical Tests Performed: Not Applicable," and the performance evaluation was based on analytical characteristics and comparison to existing predicate devices.

    6. If a Standalone (Algorithm Only Without Human-in-the-Loop Performance) Was Done

    Yes, in a sense, a "standalone" performance was evaluated, though it's important to clarify the context. The device is a visually read cassette, meaning a human reads the results. However, the tests performed (analytical performance, detection limit, specificity, etc.) evaluate the device's intrinsic ability to detect the drugs at specified cut-off levels prior to human interpretation. The analytical performance data represents this standalone capability.

    7. The Type of Ground Truth Used

    The ground truth for the non-clinical tests would have been established by:

    • Known concentrations of drug analytes: For tests like precision/reproducibility, detection limit, and assay cut-off, spiked urine samples or controlled synthetic urine samples with precisely known concentrations of the target drugs and their metabolites would be used.
    • Known interfering substances: For analytical specificity, samples with known concentrations of potential interfering substances would be used.
    • Predicate device results: For method comparison studies, the results obtained from the predicate devices (ACON test strips) on the same samples would serve as a comparative "ground truth."

    8. The Sample Size for the Training Set

    The document does not mention a "training set" in the context of machine learning or AI. This device is an immunoassay, not an AI/ML device, so typical AI training sets do not apply. The development process would have involved internal validation and optimization, but not typically referred to as a "training set" in this manner.

    9. How the Ground Truth for the Training Set Was Established

    Since this is not an AI/ML device, the concept of a training set and its ground truth in that context is not applicable. The assay's parameters (e.g., antibody concentrations, membrane properties) would have been optimized during its development using controlled experiments with known concentrations of analytes, similar to the ground truth described in point 7.

    Ask a Question

    Ask a specific question about this device

    K Number
    K041743
    Date Cleared
    2004-09-09

    (73 days)

    Product Code
    Regulation Number
    862.3100
    Why did this record match?
    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The ACON TRI-fect™ Drug Screen Test Device is a rapid chromatographic immunoassay for the qualitative and simultaneous detection of Amphetamine, Barbiturates, Benzodiazepines, Cocaine, Marijuana, Methylenedioxymethamphetamine, Opiates, Oxycodone, Phencyclidine, Propoxyphene and Tricyclic Antidepressants in human urine at cut-off concentrations:

    • 1,000 ng/mL Amphetamine 300 ng/mL Barbiturates 300 ng/mL Benzodiazepines 300 ng/mL Cocaine 50 ng/mL Marijuana 500 ng/mL Methylenedioxymethamphetamine 300 ng/mL Opiates 100 ng/mL Oxycodone 25 ng/mL Phencyclidine 300 ng/mL Propoxyphene 1,000 ng/mL Tricyclic Antidepressants
      They are intended for healthcare professional use only including professionals at the point of care sites.
    Device Description

    The ACON TRI-fect" Drug Screen Test Device is a competitive binding, lateral flow immunochromatographic assay for the qualitative and simultaneous detection of Amphetamine, Barbiturates, Benzodiazepines, Cocaine, Marijuana, Methylenedioxymethamphetamine, Opiates, Oxycodone, Phencyclidine, Propoxyphene and Tricyclic Antidepressants in human urine.

    The test is based on the principle of antigen-antibody immunochemistry. It utilizes mouse monoclonal antibodies to selectively detect elevated levels of Amphetamine, Barbiturates, Benzodiazepines. Cocaine. Marijuana. Methylenedioxymethamphetamine, Opiates, Oxycodone, Phencyclidine, Propoxyphene and Tricyclic Antidepressants in human urine. These tests can be performed without the use of an instrument.

    A drug-positive urine specimen will not generate a colored-line for the specific drug tested in the designated test region. A negative urine specimen or a urine specimen containing the drug concentration below the cut-off level will generate a colored-line in the designated test region for the drug. To serve as a procedural control, a colored line will always appear at the control region (CTL), indicating that sufficient volume of specimen applied and proper membrane wicking occurred. If a control line fails to develop during testing, the test becomes invalid.

    AI/ML Overview

    Acceptance Criteria and Study for ACON TRI-fect™ Drug Screen Test Device

    1. Table of Acceptance Criteria and Reported Device Performance:

    The acceptance criteria for the ACON TRI-fect™ Drug Screen Test Device are implied by the "substantial equivalency" determination to previously FDA-cleared predicate devices and comparison to GC/MS analysis. The reported device performance is presented as Positive Agreement, Negative Agreement, and Overall Agreement with GC/MS analysis. While specific numerical acceptance thresholds are not explicitly stated in this document (e.g., "must be >95%"), the reported performance is expected to demonstrate high agreement for all analytes.

    Here is the table summarizing the device performance against the gold standard (GC/MS):

    AnalyteCut-off Concentration (ng/mL)Positive Agreement (95% CI)Negative Agreement (95% CI)Overall Agreement (95% CI)
    Amphetamine (AMP)1,00099% (95% - 99%)98% (96% - 99%)98% (97% - 99%)
    Barbiturates (BAR)30098% (93% - 99%)99% (97% - 99%)99% (97% - 99%)
    Benzodiazepines (BZO)30096% (92% - 99%)>99% (98% - 99%)98% (97% - 99%)
    Cocaine (COC)300>99% (97% - 99%)95% (92% - 97%)96% (94% - 98%)
    Marijuana (THC)5096% (91% - 99%)95% (92% - 97%)95% (93% - 97%)
    Methylenedioxymethamphetamine (MDMA)500>99% (96% - 99%)99% (97% - 99%)99% (97% - 99%)
    Opiates (OPI)300>99% (97% - 99%)97% (95% - 99%)98% (96% - 99%)
    Oxycodone (OXY)10099% (96% - 99%)99% (97% - 99%)99% (98% - 99%)
    Phencyclidine (PCP)2599% (94% - 99%)99% (97% - 99%)99% (97% - 99%)
    Propoxyphene (PPX)300>99% (96% - 99%)>99% (99% - 99%)>99% (99% - 99%)
    Tricyclic Antidepressants (TCA)1,000>99% (89% - 99%)93% (90% - 96%)94% (91% - 96%)

    Note: For entries like ">99%", the document clarifies this indicates a 97.5% confidence interval since the proportion cannot go above 100%.

    2. Sample size used for the test set and the data provenance:

    • Sample Size for Test Set: 1,704 clinical urine specimens.
    • Data Provenance: The document states "clinical evaluation was conducted using clinical urine specimens." The country of origin is not specified, but the submission is from ACON Laboratories, Inc. in San Diego, California, USA. The data is retrospective as it uses existing "clinical urine specimens" compared against previously obtained GC/MS data and previously FDA-cleared single drug tests.

    3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts:

    The ground truth was established by Gas Chromatography/Mass Spectrometry (GC/MS) analysis. This is an analytical chemical method and does not typically involve human "experts" in the same way clinical adjudication does. GC/MS results are considered the definitive chemical confirmation for drug presence and concentration. Therefore, the concept of "number of experts" and their "qualifications" for establishing ground truth via GC/MS is not applicable in this context.

    4. Adjudication method for the test set:

    The adjudication method was a direct comparison of the ACON TRI-fect™ Drug Screen Test Device results against GC/MS analysis data. Discrepancies (e.g., presumptive positive by device, negative by GC/MS, or vice-versa) would be noted and reported in the agreement percentages, but the GC/MS result served as the final arbiter for ground truth. There is no mention of a human expert adjudication process (e.g., 2+1) in this document.

    5. If a multi-reader multi-case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:

    No, a multi-reader multi-case (MRMC) comparative effectiveness study was not done. This device is an immunoassay for drug detection, not an AI-assisted diagnostic device interpreted by human readers. Therefore, the concept of human reader improvement with/without AI assistance and effect size is not applicable.

    6. If a standalone (i.e. algorithm only without human-in-the loop performance) was done:

    Yes, a standalone performance evaluation was done. The ACON TRI-fect™ Drug Screen Test Device is itself a rapid immunoassay test kit that provides a qualitative result (presence/absence of a line) without the need for human interpretation beyond reading the visual result. Its performance was directly compared against the GC/MS ground truth, which represents its standalone accuracy.

    7. The type of ground truth used:

    The primary ground truth used was Gas Chromatography/Mass Spectrometry (GC/MS) analysis. This is a highly accurate and widely accepted method for confirming the presence and concentration of drugs in biological samples.

    8. The sample size for the training set:

    The document does not explicitly state a separate "training set" or its sample size. The description pertains to a "clinical evaluation" which typically refers to a validation or test set for an already developed device. Immunoassays like this generally do not involve a traditional "training set" in the machine learning sense, as they are based on specific antigen-antibody reactions, not learned algorithms.

    9. How the ground truth for the training set was established:

    As no separate training set is explicitly mentioned or relevant in the context of this immunoassay device, the method for establishing its ground truth is not applicable. The development of such devices relies on chemical principles and validation against known concentrations and external comparators.

    Ask a Question

    Ask a specific question about this device

    K Number
    K040327
    Date Cleared
    2004-04-19

    (69 days)

    Product Code
    Regulation Number
    N/A
    Reference & Predicate Devices
    Why did this record match?
    Reference Devices :

    K003557, K020313

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The Accu-Stat™ Home Drug Test for Marijuana (THC) is a screening test for the rapid detection of THC and its metabolites in human urine at a cut-off level of 50 ng/ml. The test is intended for over-the-counter (OTC) consumer use as the first step in a two step process to provide consumers with information concerning the presence or absence of THC or its metabolites in a urine sample. Information, along with the materials for shipping a portion of the urine specimen to the laboratory for confirmation testing of a preliminary positive result, the second step in the process, is provided.

    The Accu-Stat™ Home Drug Tcst for Marijuana and Cocaine (THC, COC) is a screening test for the rapid detection of THC and/or COC and its metabolites in human urine at a cut-off level of 50 ng/ml for THC and 300 ng/ml for COC. The test is intended for over-the-counter (OTC) consumer use as the first step in a two step process to provide consumers with information concerning the presence or absence of either THC, COC (or their metabolites) in a urine sample. Information, along with the materials for shipping a portion of the urine specimen to the laboratory for confirmation testing of a preliminary positive result, the second step in the process, is provided.

    Device Description

    The Accu-Stat™ Home Drug Test for Marijuana (THC) and the Accu-Stat™ Home Drug Test for Marijuana & Cocaine (THC, COC), like other commercially available drug screening tests, qualitatively measures the presence or absence of THC and COC and their metabolites in urine, using a one step, rapid chromatographic immunoassay which operates under the principle of competitive binding. Drugs, which may be present in the urine specimen, compete against the drug conjugate for binding sites on the antibody. During testing, a urine specimen migrates upward by capillary action. Marijuana, if present in the urine specimen below 50 ng/ml, and Cocaine, if present in the urine specimen below 300 ng/ml, will not saturate the binding sites of the antibody coated particles in the test device. The antibody coated particles will then be captured by immobilized marijuana or cocaine conjugate and a visible colored line will show up in the test line region. The colored line will not form in the test line region if the marijuana level is above 50 ng/ml because it will saturate all the binding sites of anti-marijuana antibodies. The same holds true for cocaine if the level is above 300 ng/ml. It will saturate all the binding sites of anti-cocaine antibodies and therefore the colored line will not form in the test region. A drug-positive urine specimen will not generate a colored line in the test line region because of drug competition, while a drug-negative urine specimen will generate a line in the test region because of the absence of a drug competition. To serve as a procedural control, a colored line will always appear at the control line region if the test has been performed properly.

    AI/ML Overview

    The provided text describes two devices, the Accu-Stat™ Home Drug Test for Marijuana (THC) and the Accu-Stat™ Home Drug Test for Marijuana & Cocaine (THC, COC). It outlines their intended use and claims substantial equivalence to predicate devices, but does not include a detailed study with acceptance criteria and specific performance metrics for the Accu-Stat™ devices themselves.

    Instead, the submission states that "The consumer studies using the Accu-Stat™ Home Drug Test for Marijuana (THC) and the Accu-Stat™ Home Drug Test for Marijuana & Cocaine (THC, COC) demonstrates that the test exhibits excellent overall performance in the hands of lay users. The data supports the conclusion that the consumer can use the Accu-Stat™ Home Drug Tests to obtain immediate, preliminary information regarding the possible use of THC and COC."

    It further argues for safety and effectiveness by claiming the devices are "identical to the ACON Laboratories One Step Marijuana Test Device and the Multi-Drug Multi-Line Device that is legally marketed under K003557 and K020313 respectively for professional use." This suggests reliance on the predicate devices' performance rather than a new, independent study with specific acceptance criteria reported in this document for the Accu-Stat™ devices.

    Therefore, I cannot populate all the requested fields with specific, quantifiable data directly from this document regarding the Accu-Stat™ devices' performance against explicit acceptance criteria. The document claims substantial equivalence and mentions "consumer studies" but does not detail their methodology, results, or the acceptance criteria used.

    Based on the provided text, here's what can be extracted and what cannot:


    1. A table of acceptance criteria and the reported device performance

    • Acceptance Criteria: Not explicitly stated for the Accu-Stat™ devices in this document. The document refers to cut-off levels as part of the device's mechanism: "Marijuana, if present in the urine specimen below 50 ng/ml... and Cocaine, if present in the urine specimen below 300 ng/ml, will not saturate the binding sites..." This describes the functional threshold rather than an acceptance criterion for accuracy or precision.
    • Reported Device Performance: The document offers a qualitative statement: "demonstrates that the test exhibits excellent overall performance in the hands of lay users. The data supports the conclusion that the consumer can use the Accu-Stat™ Home Drug Tests to obtain immediate, preliminary information regarding the possible use of THC and COC." No specific numerical performance metrics (e.g., sensitivity, specificity, accuracy percentages) are provided in this text for the Accu-Stat™ devices themselves.
    Acceptance CriterionReported Device Performance (Accu-Stat™ Home Drug Test)Notes
    Not explicitly stated in the provided text."Excellent overall performance in the hands of lay users."This is a qualitative statement, no specific metrics (e.g., sensitivity, specificity, accuracy) are provided for the Accu-Stat™ devices in this submission.
    Functional Cut-off for THCDevice detects THC at a cut-off level of 50 ng/ml.This is an operational characteristic, not a performance metric and associated acceptance criterion.
    Functional Cut-off for COCDevice detects COC at a cut-off level of 300 ng/ml.This is an operational characteristic, not a performance metric and associated acceptance criterion.

    2. Sample sized used for the test set and the data provenance (e.g. country of origin of the data, retrospective or prospective)

    • Sample Size: Not specified. The document mentions "consumer studies" but does not quantify the sample size.
    • Data Provenance: Not specified (e.g., country of origin, retrospective or prospective).

    3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g. radiologist with 10 years of experience)

    • Not specified. The document does not describe the establishment of a ground truth for a test set for these specific devices, only mentions that they are "screening tests" and preliminary, requiring confirmation testing.

    4. Adjudication method (e.g. 2+1, 3+1, none) for the test set

    • Not applicable as the details of a specific test set study for these devices (beyond "consumer studies") are not provided.

    5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

    • Not applicable. This device is a rapid immunoassay for drug detection, not an AI-assisted diagnostic device, nor does the document describe a study of human readers.

    6. If a standalone (i.e., algorithm only without human-in-the-loop performance) was done

    • The device is a standalone immunoassay kit intended for "lay users" (consumers) at home without professional human-in-the-loop involvement for initial screening. However, the performance data for such standalone use (e.g., accuracy against a gold standard) is not detailed in this document. The instructions advise a second step of confirmation testing by a lab for positive results.

    7. The type of ground truth used (expert consensus, pathology, outcomes data, etc.)

    • Not specified for the "consumer studies." Given the nature of a drug test, a typical ground truth would be laboratory confirmation using a highly accurate method like GC/MS (Gas Chromatography/Mass Spectrometry). The document only states that the device is the "first step in a two-step process to provide over-the-counter (OTC) consumers... with information regarding the presence of THC or COC and their metabolites in a urine sample. Information regarding the second step, confirmation testing, is provided." This implies that the device offers a preliminary result rather than a definitive ground truth.

    8. The sample size for the training set

    • Not applicable. This device is an immunoassay, not a machine learning or AI-based system that would typically have a "training set."

    9. How the ground truth for the training set was established

    • Not applicable for the same reason as above.
    Ask a Question

    Ask a specific question about this device

    Why did this record match?
    Reference Devices :

    K011673, K011672, K010841, K011353, K003557, K011730

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The ACON® One Step Multi-Drug Multi-Line Screen Test Card and Test Device are rapid chromatographic immunoassays for the qualitative and simultaneous detection of two to six drugs in a variety of combinations in human urine. The designated cut-off concentrations for these drugs are as follows: Amphetamine at 1,000 ng/ml, Cocaine at 300 ng/ml, Methamphetamine at 1,000 ng/ml, Opiates at 2,000 ng/ml, Marijuana at 50 ng/ml and Phencyclidine at 25 ng/ml. They are intended for healthcare professionals including professionals at the point of care sites.

    Device Description

    The ACON One Step Multi-Drug Multi-Line Screen Test Card and Test Device are competitive binding, lateral flow immunochromatographic assays for the qualitative and simultaneous detection of Amphetamine, Cocaine, Methamphetamine, Opiates, Marijuana, and Phencyclidine in urine samples. The test is based on the principle of antigen-antibody immunochemistry. It utilizes mouse monoclonal antibodies to selectively detect elevated levels of Amphetamine, Methamphetamine, Cocaine, Opiates, THC and PCP in urine at the cut-off concentrations of 1,000 ng/ml (AMP), 1,000 ng/ml (mAMP), 300 ng/mL (COC), 2,000 ng/ml (OPI), 50 ng/ml (THC) and 25 ng/ml (PCP). These tests can be performed without the use of an instrument.

    A positive urine specimen will not generate a colored-line for the specific drug tested in the designated test region. A negative urine specimen or a urine specimen containing of Amphetamine, Cocaine, Methamphetamine, Opiates, Marijuana, and Phencyclidine at the concentrations below the designated cut-off levels will generate a colored-line in the designated test region for the drug. To serve as a procedural control, a colored-line will always appear at the control region, indicating that proper volume of specimen has been added and membrane wicking has occurred.

    AI/ML Overview

    Here's an analysis of the acceptance criteria and study details for the ACON One Step Multi-Drug Multi-Line Screen Test Card and Test Device, based on the provided text:

    1. Table of Acceptance Criteria and Reported Device Performance

    The acceptance criteria for the ACON One Step Multi-Drug Multi-Line Screen Test Card and Test Device appear to be based on achieving high agreement rates (positive, negative, and overall) with both previously FDA-cleared single drug tests and Gas Chromatography/Mass Spectrometry (GC/MS) analysis. While specific numeric acceptance thresholds are not explicitly stated as "acceptance criteria," the consistently high percentage agreements demonstrated in the results (mostly 95% and above, often 99%) with narrow confidence intervals imply that such high agreement was the de facto criterion for acceptance.

    Device Performance vs. Predicate Device (ACON Single Tests):

    DrugDeviceAcceptance Criteria (Implied: High Agreement)Reported Performance (Positive Agreement)Reported Performance (Negative Agreement)Reported Performance (Overall Agreement)
    AMPTest CardHigh Agreement (>95% for all)99% (97% - 99%)>99% (98% - 99%)>99% (98% - 99%)
    COCTest CardHigh Agreement (>95% for all)>99% (97% - 99%)99% (97% - 99%)99% (98% - 99%)
    mAMPTest CardHigh Agreement (>95% for all)99% (96% - 99%)>99% (98% - 99%)99% (98% - 99%)
    OPITest CardHigh Agreement (>95% for all)98% (95% - 99%)>99% (98% - 99%)>99% (97% - 99%)
    THCTest CardHigh Agreement (>95% for all)>99% (97% - 99%)99% (97% - 99%)99% (98% - 99%)
    PCPTest CardHigh Agreement (>95% for all)99% (93% - 99%)>99% (98% - 99%)99% (97% - 99%)
    AMPTest DeviceHigh Agreement (>95% for all)>99% (97% - 99%)>99% (98% - 99%)>99% (98% - 99%)
    COCTest DeviceHigh Agreement (>95% for all)>99% (97% - 99%)>99% (97% - 99%)>99% (98% - 99%)
    mAMPTest DeviceHigh Agreement (>95% for all)>99% (97% - 99%)>99% (98% - 99%)>99% (98% - 99%)
    OPITest DeviceHigh Agreement (>95% for all)>99% (96% - 99%)>99% (98% - 99%)>99% (98% - 99%)
    THCTest DeviceHigh Agreement (>95% for all)>99% (97% - 99%)>99% (98% - 99%)>99% (98% - 99%)
    PCPTest DeviceHigh Agreement (>95% for all)99% (95% - 99%)>99% (98% - 99%)99% (97% - 99%)

    Device Performance vs. GC/MS Analysis:

    DrugDeviceAcceptance Criteria (Implied: High Agreement)Reported Performance (Positive Agreement)Reported Performance (Negative Agreement)Reported Performance (Overall Agreement)
    AMPTest CardHigh Agreement (>90% generally)95% (90% - 98%)99% (97% - 99%)97% (95% - 99%)
    COCTest CardHigh Agreement (>90% generally)95% (89% - 98%)99% (97% - 99%)98% (95% - 99%)
    mAMPTest CardHigh Agreement (>90% generally)90% (84% - 94%)>99% (98% - 100%)96% (93% - 98%)
    OPITest CardHigh Agreement (>90% generally)99% (96% - 99%)99% (96% - 99%)99% (97% - 99%)
    THCTest CardHigh Agreement (>90% generally)95% (90% - 98%)95% (91% - 98%)95% (92% - 97%)
    PCPTest CardHigh Agreement (>90% generally)90% (81% - 95%)99% (96% - 99%)96% (93% - 98%)
    AMPTest DeviceHigh Agreement (>90% generally)94% (89% - 97%)99% (97% - 99%)97% (94% - 99%)
    COCTest DeviceHigh Agreement (>90% generally)95% (89% - 98%)99% (97% - 99%)98% (95% - 99%)
    mAMPTest DeviceHigh Agreement (>90% generally)90% (83% - 94%)>99% (98% - 100%)95% (92% - 97%)
    OPITest DeviceHigh Agreement (>90% generally)99% (96% - 100%)99% (96% - 99%)99% (97% - 99%)
    THCTest DeviceHigh Agreement (>90% generally)95% (90% - 98%)96% (91% - 98%)95% (92% - 97%)
    PCPTest DeviceHigh Agreement (>90% generally)90% (81% - 95%)99% (96% - 99%)96% (92% - 98%)

    2. Sample Size Used for the Test Set and Data Provenance

    • Sample Size: Over 1,000 clinical urine specimens were employed. Approximately 10% of these samples had drug concentrations in the -25% to +25% cut-off range.
    • Data Provenance: The data is described as "clinical urine specimens," implying they were collected from real-world patients. The country of origin is not explicitly stated, but the submission is to the FDA (USA), suggesting the data is relevant to US clinical settings, though not necessarily collected in the US. The study is retrospective, as it uses existing clinical specimens to compare the new device against established methods.

    3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts

    The document does not explicitly state the number or qualifications of experts used to establish the ground truth.

    • For the comparison with predicate devices, the "ground truth" seems to be the result from the previously FDA-cleared ACON single drug tests. These are also immunochromatographic tests.
    • For the comparison with GC/MS analysis, the GC/MS result is considered the gold standard "ground truth." GC/MS analysis is a laboratory-based method. The qualifications of the personnel performing or interpreting the GC/MS results are not specified, although it is a recognized analytical standard in toxicology.

    4. Adjudication Method for the Test Set

    The document does not describe any specific adjudication method (e.g., 2+1, 3+1). The comparison is direct: the new device's result is compared to the predicate device's result and to the GC/MS result. Discrepancies are noted in the agreement percentages, but a formal adjudication process for discordant results is not detailed.

    5. If a Multi-reader Multi-case (MRMC) Comparative Effectiveness Study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

    • No MRMC Study: This is not an AI-assisted diagnostic device. It is a rapid diagnostic test (immunochromatographic assay) designed for qualitative, visual interpretation. Therefore, a multi-reader multi-case (MRMC) comparative effectiveness study as typically understood for AI in medical imaging, and the concept of human readers improving with AI assistance, is not applicable here.

    6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) was done

    • Not applicable as this is a physical immunoassay device, not an algorithm. The interpretation of the test result (presence or absence of a colored line) is inherently human-in-the-loop, though it's a straightforward visual inspection, not a complex diagnostic image interpretation task. The "standalone" performance here refers to the device's ability to produce a result that aligns with the ground truth when interpreted as intended. The performance tables do represent the standalone performance of the device when read by a human.

    7. The type of ground truth used (expert consensus, pathology, outcomes data, etc.)

    Two types of ground truth were used:

    1. Predicate Device Results: The results from previously FDA-cleared ACON single drug test strips.
    2. GC/MS Analysis (Gas Chromatography/Mass Spectrometry): This is a highly accurate and widely accepted laboratory analytical method for drug detection and quantification in toxicology, considered the "gold standard" for this application.

    8. The Sample Size for the Training Set

    • The document does not mention a training set. This is because the device is a chemical/immunological assay, not a machine learning or AI algorithm that requires training data. The development of such devices relies on chemical formulation, antibody specificity, and physical design, not data training in the AI sense.

    9. How the Ground Truth for the Training Set was Established

    • As there is no training set in the context of an AI/ML algorithm, this question is not applicable. The device's design and performance are established through laboratory R&D and then validated using clinical samples against established methods (predicate device and GC/MS) as described above.
    Ask a Question

    Ask a specific question about this device

    Page 1 of 1