Search Results

The UCP Multi-Drug Test Key Cups are rapid tests for preliminary detection of the following drugs in human urine: Amphetamine, Barbiturates, Benzodiazepines, Buprenorphine, Cocaine, Marijuana, Methadone, Methamphetamine, MDMA, Morphine, Opiates 2000, Oxycodone, Phencyclidine, Propoxyphene, Tricyclic Antidepressant. The test configuration comes with a single drug screening test or any combinations of multiple drug screening tests. The test is intended for over-the-counter (OTC) users as the first step in a two step process to provide consumers with information concerning the presence or absence of the above stated drugs in a urine sample. The second step is to send preliminary positive samples for confirmation testing by GCMS. The test is not intended to distinguish between prescription use or abuse of the following drugs: Barbiturates, Benzodiazepines, Buprenorphine, Oxycodone, Propoxyphene, Tricyclic Antidepressants. There are no uniformly recognized cutoff concentration levels for Barbiturate, Benzodiazepines, Buprenorphine, Oxyodone, Propxyphene, Tricyclic Antidepressant in urine. Clinical considerations and professional judgment should be applied to any drug of abuse test results, particularly when preliminary positive results are indicated. For Over-The-Counter (OTC) use For In Vitro Diagnostics only

UCP Multi-Drug Test Key Cups are competitive binding, lateral flow immunochromatographic assays for qualitatively the detection of Amphetamine, Barbiturates, Benzodiapines, Buprenorphine, Cocaines, Marijuana, Methamphetamine, MDMA, Methadone, Opiates, Opiates 300, Oxycodone, Phencyclidine, Propoxyphene, Tricyclic Antidepressants at the cut-off levels as indicated. The tests can be performed without the use of an instrument.

Here's a breakdown of the acceptance criteria and study information for the UCP Multi-Drug Test Key Cups, based on the provided text:

1. Table of Acceptance Criteria and Reported Device Performance

The acceptance criteria for the UCP Multi-Drug Test Key Cups are defined by the agreement rates with reference methods (GC/MS or HPLC) and the predicate device. The performance of the device is then measured against these criteria.

2. Sample Sizes and Data Provenance

• Test Set (Clinical Samples for Accuracy Studies):
  • Sample Size: Total 80 clinical urine samples per one drug test. (Since there are 15 distinct drug tests listed, the total number of clinical samples used across all drug types would be 15 * 80 = 1200 samples).
  • Data Provenance: The clinical samples were obtained from "reference laboratories." It is not explicitly stated which country, but it is implied to be relevant to the US regulatory context (given the FDA submission). The data is retrospective, as the samples were "obtained" and then tested.
• Test Set (Consumer Studies):
  • Sample Size: 115 lay persons participated. The number of urine samples used per person or per drug is not specified, but the samples were prepared to contain various drug concentrations (strong negative, weak negatives, weak positives, high positive).
  • Data Provenance: Not explicitly stated, but the study was conducted "among 115 lay persons in three geographic regions." This suggests a prospective study specifically designed for the consumer evaluation.

3. Number of Experts and Qualifications for Ground Truth

• Clinical Sample Ground Truth: The ground truth for the clinical samples was established by "reference laboratories." The text states that "all clinical urine samples including drug negative urine samples and drug positive urine samples were tested by the reference method GC/MS, except TCA. The TCA positive urine samples were tested by HPLC method." This indicates that GC/MS and HPLC are the expert-level reference methods providing the ground truth, rather than human experts adjudicating individual cases. The qualifications of the personnel performing these reference methods are not specified, but it's implied they are qualified laboratory professionals.
• Consumer Study Ground Truth: The ground truth for the urine samples used in the consumer study was also established by objective analytical methods: "the final drug concentrations in each urine sample were confirmed by GC/MS but TCA, TCA concentrations in the urine samples was confirmed by HPLC."

4. Adjudication Method for the Test Set

• Clinical Sample Studies: There was no human adjudication method described. The comparison was directly between the device's results and the objective results from the reference methods (GC/MS and HPLC).
• Consumer Studies: There was no human adjudication method described. The comparison was directly between the lay users' interpretations of the device's results and the objective results from the reference methods (GC/MS and HPLC).

5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

• No, a MRMC comparative effectiveness study was not explicitly mentioned or described in the provided text. The studies focused on device accuracy against reference methods and lay user performance.

6. Standalone (Algorithm Only Without Human-in-the-Loop) Performance

• Yes, a standalone performance study was conducted. The "Accuracy Studies" directly compare the UCP Multi-Drug Test Key Cups (device only, without human interpretation as part of the accuracy measure) against established reference methods. The "Consumer Studies" also have a standalone component, as the device itself is producing a result that the lay users then interpret. The reported agreement rates of the device with GC/MS/HPLC in both types of studies represent its standalone performance in terms of detecting the target substances.

7. Type of Ground Truth Used

• The primary type of ground truth used was objective analytical methods/pathology, specifically:
  • Gas Chromatography/Mass Spectrometry (GC/MS) for most drug classes.
  • High-Performance Liquid Chromatography (HPLC) for Tricyclic Antidepressants (TCA).

8. Sample Size for the Training Set

• The text does not explicitly state a sample size for a training set. This is common for lateral flow immunochromatographic assays like the UCP Multi-Drug Test Key Cups, which are typically developed and validated rather than "trained" in the machine learning sense. The performance characteristics were established through precision, sensitivity, specificity, cross-reactivity, interference, and stability studies, but these do not typically involve a "training set" in the same way an AI/ML model would.

9. How the Ground Truth for the Training Set Was Established

• As a training set is not explicitly referred to in the context of this device's development or the provided studies, the method for establishing its ground truth is not applicable from the given information. The ground truth for the test sets (clinical and consumer samples) was established using GC/MS and HPLC, as detailed in point 7.

Ask a specific question about this device

The UCP Home Drug Screening Test Cards, UCP Home Drug Screening Test Cups are rapid, qualitative, competitive binding immunoassays for the detection of the following drugs and their metabolites in human urine: Amphetamine, Barbiturates, Benzodiazepines, Buprenorphine, Cocaine, Marijuana, Methadone, Methamphetamine, MDMA, Morphine, Opiates 2000, Oxycodone, Phencyclidine, Propoxyphene, Tricyclic Antidepressant. The test configuration comes with single drug screening test or any combinations of multiple drug screening tests. The tests are intended for over-the-counter (OTC) users as the first step in a two step process to provide consumers, with information concerning the presence or absence of the above stated drugs or their metabolites in a urine sample. Information regarding confirmatory testing - the second step in the process, along with the materials for shipping the urine specimen to the laboratory, is provided. The test is also intended for prescription use. The tests will yield preliminary positive results when the prescription drugs Barbiturates, Benzodiazepines, Buprenorphine, Oxycodone, Propoxyphene, Tricyclic Antidepressants are ingested, even at or above therapeutic doses. There are no uniformly recognized drug levels for Barbiturate, Benzodiazepines, Buprenorphine, Oxycodone, Propoxyphene, Tricyclic Antidepressant in urine. The tests provide only preliminary data, which should be confirmed by other methods such as gas chromatography/mass spectrometry (GC/MS). Clinical considerations and professional judgment should be applied to any drug of abuse test results, particularly when preliminary positive results are indicated. The tests are not intended to be used in monitoring drug levels. For Over-The-Counter (OTC) use and prescription use For In Vitro Diagnostics only.

UCP Home Drug Screening Tests are competitive binding, lateral flow immunochromatographic assays for qualitatively the detection of Amphetamine, Barbiturates, Benzodiapines, Buprenorphine, Cocaines, Marijuana, Methamphetamine, MDMA, Methadone, Opiates, Opiates 300, Oxycodone, Phencyclidine, Propoxyphene, Tricyclic Antidepressants and their metabolites at the cut-off levels as indicated. The tests can be performed without the use of an instrument.

The UCP Home™ Drug Screening Test Cards and Cups are rapid, qualitative, competitive binding immunoassays for the detection of drugs and their metabolites in human urine. The acceptance criteria for this device are based on its ability to correctly identify the presence or absence of various drugs at specific cut-off levels, with a high agreement rate with GC/MS results.

Here's an breakdown of the information requested:

1. Table of Acceptance Criteria and Reported Device Performance

The device is intended to provide preliminary positive results when drug concentrations are at or above the specified cut-off levels. The performance is measured by the agreement rate with confirmatory laboratory methods.

2. Sample Size Used for the Test Set and Data Provenance

The consumer study, which evaluates the device's performance when used by lay persons, involved 115 lay persons.
The urine samples for this study were prepared with various drug concentrations (strong negative, very weak negative, weak negative, very weak positive, weak positive, high positive) by spiking pure drugs or metabolites into drug-free human urine. This suggests the data provenance is prospective as samples were specifically prepared for the study. The country of origin of the data is not explicitly stated, but given the US FDA submission, it is likely the study was conducted in the United States.

3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts

The ground truth for the test set (urine samples with various drug concentrations) was established by Gas Chromatography/Mass Spectrometry (GC/MS) for all drugs except Tricyclic Antidepressants (TCA), for which High-Performance Liquid Chromatography (HPLC) was used. This indicates laboratory methods, not human visual experts, established the ground truth for drug concentrations.

4. Adjudication Method for the Test Set

The document does not describe an explicit adjudication method for the comparison between the device results and the GC/MS/HPLC ground truth. The comparison appears to be a direct assessment of agreement between the device's qualitative results and the quantitative ground truth.

5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

This is not applicable. The UCP Home™ Drug Screening Test Cards and Cups are in-vitro diagnostic devices designed for direct user interpretation (either by lay users or healthcare professionals). There is no "AI assistance" component to improve human reader performance in this type of qualitative chemical assay. The consumer study evaluated the human user's ability to interpret the test and instructions, not their diagnostic performance with or without AI.

6. If a Standalone (i.e. algorithm only without human-in-the loop performance) was done

This is not explicitly applicable in the typical sense of a "standalone algorithm" for image analysis or similar AI applications. However, the device itself, when used by a lay person, functions as a standalone qualitative test. The "performance studies" mentioned (method comparison, specificity, cut-off study) assess the inherent chemical performance of the device itself, independent of user interpretation, through comparison with GC/MS/HPLC. The results for these studies demonstrated the device "performs satisfactorily when used according to the package inserts."

7. The Type of Ground Truth Used

The ground truth used was laboratory gold standard methods:

• Gas Chromatography/Mass Spectrometry (GC/MS) for Amphetamine, Barbiturates, Benzodiazepines, Buprenorphine, Cocaine, Marijuana, Methadone, Methamphetamine, MDMA, Morphine, Opiates 2000, Oxycodone, Phencyclidine, Propoxyphene.
• High-Performance Liquid Chromatography (HPLC) for Tricyclic Antidepressants (TCA).

8. The Sample Size for the Training Set

The document does not explicitly mention a "training set" in the context of machine learning or AI. This device is an immunoassay, not a software algorithm that requires a training set. The performance studies used prepared urine samples to evaluate the device's analytical performance across different concentrations.

9. How the Ground Truth for the Training Set Was Established

As there is no distinct "training set" in the AI sense, this question is not applicable. The chemical properties and performance of the immunoassay are inherent to its design and manufacturing. The cut-off levels are predefined. The "ground truth" for evaluating its performance (as described in point 7) was established through established laboratory analytical techniques (GC/MS, HPLC).

Ask a specific question about this device

The UCP Home Drug Screening Test Cups are rapid, qualitative, competitive binding immunoassays for the detection the following drugs and their metabolites in human urine: Amphetamine, Barbiturates, Benzodiazepines, Cocaine, Marijuana, Methadone, Methamphetamine, MDMA, Morphine, Opiates 2000, Oxycodone, Phencyclidine, Tricyclic Antidepressant. The test configuration comes with single drug screening test or any combinations of multiple drug screening tests. The test is intended for over-the-counter (OTC) users as the first step in a two step process to provide consumers, with information concerning the presence or absence of the above stated drugs or their metabolites in a urine sample. Information regarding confirmatory testing - the second step in the process, along with the materials for shipping the urine specimen to the laboratory, is provided. The test is also intended for health care professional users. The tests will yield preliminary positive results when the prescription drugs Barbiturates, Benzodiazepines, Oxycodone, Tricyclic Antidepressants are ingested, even at or above therapeutic doses. There are no uniformly recognized drug levels for Barbiturate, Benzodiazepines, Oxycodone, Tricyclic Antidepressant in urine. The tests provide only preliminary data, which should be confirmed by other methods such as gas chromatography/mass spectrometry (GC/MS). Clinical considerations and professional judgment should be applied to any drug of abuse test results, particularly when preliminary positive results are indicated. The tests are not intended to be used in monitoring drug levels.

UCP Home Drug Screening Test Cups are competitive binding, lateral flow immunochromatographic assays for qualitatively the detection of Amphetamine, Barbiturates, Benzodiapines, Cocaines, Marijuana, Methamphetamine, MDMA, Methadone, Opiates, Opiates 300, Oxycodone, Phencyclidine, Tricyclic Antidepressants and their metabolites at the cut-off levels as indicated. The tests can be performed without the use of an instrument.

Acceptance Criteria and Study Summary for UCP Home™ Drug Screening Test Cups

1. Acceptance Criteria and Reported Device Performance

The acceptance criteria for the UCP Home™ Drug Screening Test Cups are implicitly defined by the agreement rates obtained in the consumer study against GC/MS (or HPLC for TCA) reference method. While explicit numerical acceptance criteria (e.g., "must achieve >95% agreement") are not stated, the reported performance of "97% or above agreement rate with GC/MS results" indicates that this level of performance was deemed acceptable for market clearance.

Note: An "Accuracy Study" comparing the device to predicate devices and reference methods (GC/MS/HPLC) also demonstrated "100% agreements between the candidate device and the predicate device" and "over 97.5% agreement between the candidate devices and the reference method GC/MS." This suggests that the internal accuracy criteria were met for healthcare professional use. However, for OTC clearance, the consumer study is the primary focus for usability and interpretability by lay users.

2. Sample Size and Data Provenance

Test Set (Consumer Study):

• Sample Size: 115 lay persons participated.
• Data Provenance: The study was conducted in "three geographic regions" within the United States. The data is prospective as participants performed the tests during the study.

Test Set (Accuracy Study):

• Sample Size: "Total 120 clinical urine samples per one drug test were included." (e.g., 120 samples for Marijuana, 120 for Cocaine, etc., implying multiple sets of 120 samples for each drug tested).
• Data Provenance: Clinical urine samples were obtained from "reference laboratories." The document does not specify the country of origin of these laboratories or whether the collection was retrospective or prospective, but the context of a 510(k) submission generally implies samples are relevant to the US population.

3. Number of Experts and Qualifications for Ground Truth

• Accuracy Study (Reference Method Confirmation): The reference method for confirming drug concentrations was GC/MS (Gas Chromatography/Mass Spectrometry), except for TCA which used HPLC (High-Performance Liquid Chromatography). These are instrumental methods that do not rely on human "experts" in the traditional sense of clinical interpretations. The "experts" would be the skilled technicians or analysts operating and interpreting the results from these analytical instruments. No specific number or qualification of these individuals is provided.
• Consumer Study (Reference Method Confirmation): Similar to the accuracy study, GC/MS (or HPLC for TCA) was used to confirm the final drug concentrations in the prepared urine samples.

4. Adjudication Method for the Test Set

The document does not describe an adjudication method for reconciling discrepancies between interpretations by multiple human readers (e.g., 2+1, 3+1). Instead:

• Accuracy Study: The device's results were directly compared against the objective reference methods (GC/MS/HPLC).
• Consumer Study: The lay users' interpretations of the device results were compared against the confirmed GC/MS/HPLC concentrations of the spiked urine samples.

5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

No MRMC comparative effectiveness study was done. The study mainly focused on:

1. The device's accuracy against a gold standard (GC/MS/HPLC), simulating healthcare professional use.
2. Lay user's ability to correctly perform and interpret the test according to instructions (consumer study).
   There is no mention of human readers improving with or without AI assistance, as this is a qualitative immunoassay device, not an AI-powered diagnostic tool requiring human interpretation of complex images or data.

6. Standalone Performance Study

Yes, a standalone performance study was done for the device itself.

• Accuracy Study: This study directly assessed the device's performance (results from the test cups as interpreted by trained professionals or objectively read) against the reference methods (GC/MS/HPLC). This represents the algorithm's (or device's intrinsic chemistry's) performance.
• Consumer Study: While involving lay users, the core assessment was whether the device's output could be correctly interpreted by them, thereby confirming the standalone performance as read by its intended (lay) user.

7. Type of Ground Truth Used for the Test Set

The ground truth used for both the accuracy study and the consumer study was objective chemical analysis:

• Gas Chromatography/Mass Spectrometry (GC/MS) for most drugs.
• High-Performance Liquid Chromatography (HPLC) for Tricyclic Antidepressants (TCA).
  This provides a highly accurate and quantifiable measure of the drug and metabolite concentrations in the urine samples.

8. Sample Size for the Training Set

The document does not provide information on a specific "training set" or sample size for training. This type of immunoassay device typically relies on established chemical and biological principles, and its performance characteristics are determined through analytical validation rather than machine learning training. The "training" in this context refers to the development and optimization of the assay components and parameters, which is not usually quantified by a "training set sample size" in regulatory submissions for such devices.

9. How Ground Truth for the Training Set Was Established

As noted above, a distinct "training set" in the context of machine learning is not applicable here. The ground truth for the development and validation of the assay (analogous to how a training set informs an algorithm) would have been established through well-controlled laboratory experiments using known concentrations of drugs and their metabolites, confirmed by highly accurate analytical methods like GC/MS or HPLC. This iterative development and refinement process ensures the device's antibodies and reagents react appropriately to the target analytes at specified cut-off levels.

Ask a specific question about this device