Search Results
Found 1 results
510(k) Data Aggregation
(117 days)
AssureTech Panel Dip Test, AssureTech Quick Cup Test
AssureTech Panel Dip Tests and AssureTech Quick Cup Tests are competitive binding, lateral flow immunochromatographic assays for qualitative and simultaneous detection of Amphetamine, Oxazepam, Cocaine, Cannabinoids, Methamphetamine, Oxycodone, Secobarbital, Buprenorphine, Methylenedioxymethamphetamine. Phencyclidine and Methadone in human urine at the cutoff concentrations of.
The tests are intended for over-the-counter and for prescription use.
The AssureTech Panel Dip Tests and AssureTech Quick Cup Tests are immunochromatographic assays that use a lateral flow system for the qualitative detection of Amphetamine, Oxazepam, Cocaine, Marijuana, Methamphetamine, Morphine, Oxycodone, Secobarbital, Buprenorphine, Methylenedioxy-methamphetamine, Phencyclidine and Methadone (target analytes) in human urine. The tests are the first step in a two-step process. The second step is to send the sample for laboratory testing if preliminary positive results are obtained.
The AssureTech Panel Dip Tests comprise two items, a urine collection cup and the dip card with a plastic casing as the lateral flow device. The AssureTech Quick Cup Tests comprise a urine collection cup and a quick cup test with a lateral flow device that will start when the cap is screwed onto cup.
The provided text describes the performance characteristics and acceptance criteria for the AssureTech Panel Dip Tests and AssureTech Quick Cup Tests, which are qualitative drug screening devices.
Here's a breakdown of the requested information:
1. Table of Acceptance Criteria and Reported Device Performance
The acceptance criteria for qualitative drug tests are typically defined by the performance at and around the cutoff concentration. The data presented shows excellent performance for samples well below and well above the cutoff, with some expected variability around the cutoff.
The tables provide the raw results rather than a single aggregated performance metric (like accuracy, sensitivity, or specificity relative to a cutoff for the entire dataset). However, we can infer the performance based on these results. For samples significantly below the cutoff, the device should consistently report negative results. For samples significantly above the cutoff, it should consistently report positive results. Near the cutoff, there's a transition zone where both positive and negative results are expected, and the reported numbers reflect this.
Let's illustrate with an example for Oxazepam (-25% cutoff, which is 225 ng/mL). The "Panel Dip" table shows for Lot 1: 9-/41+ (9 negative, 41 positive out of 50 samples). This means 41 samples with concentrations at 225 ng/mL were correctly identified as positive (or transitioning to positive). Similarly, for +25% cut off (375 ng/mL), it's 50+/0- (50 positive, 0 negative), indicating consistent positive detection.
Here's a summary table derived from the provided precision data for Oxazepam, Methylenedioxy-methamphetamine, and Morphine, illustrating the device performance relative to the acceptance criteria (consistent results at extremes, transition near cutoff). The "acceptance criteria" for these qualitative tests at different concentration levels are implied by the expected outcome (all negative for greatly reduced concentrations, all positive for greatly increased concentrations, and a mix near the cutoff).
Inferred Acceptance Criteria vs. Reported Performance (from Precision Studies)
Drug Analyte | Concentration Relative to Cut-off | Inferred Acceptance Criteria (Expected Outcome) | Reported Performance (Combined Across 3 Lots, Sample Size 150) |
---|---|---|---|
Oxazepam | -100% cut off | 100% Negative (150-/0+) | Panel Dip: 150-/0+ |
Quick Cup: 150-/0+ | |||
-75% cut off | 100% Negative (150-/0+) | Panel Dip: 150-/0+ | |
Quick Cup: 150-/0+ | |||
-50% cut off | 100% Negative (150-/0+) | Panel Dip: 150-/0+ | |
Quick Cup: 150-/0+ | |||
-25% cut off | Predominantly Negative, some Positive (Transition Zone) | Panel Dip: 29-/121+ | |
Quick Cup: 28-/122+ | |||
+25% cut off | Predominantly Positive, some Negative (Transition Zone) | Panel Dip: 150+/0- | |
Quick Cup: 150+/0- | |||
+50% cut off | 100% Positive (150+/0-) | Panel Dip: 150+/0- | |
Quick Cup: 150+/0- | |||
+75% cut off | 100% Positive (150+/0-) | Panel Dip: 150+/0- | |
Quick Cup: 150+/0- | |||
+100% cut off | 100% Positive (150+/0-) | Panel Dip: 150+/0- | |
Quick Cup: 150+/0- | |||
Methylenedioxy-methamphetamine | -100% cut off | 100% Negative (150-/0+) | Panel Dip: 150-/0+ |
Quick Cup: 150-/0+ | |||
-75% cut off | 100% Negative (150-/0+) | Panel Dip: 150-/0+ | |
Quick Cup: 150-/0+ | |||
-50% cut off | 100% Negative (150-/0+) | Panel Dip: 150-/0+ | |
Quick Cup: 150-/0+ | |||
-25% cut off | Predominantly Negative, some Positive (Transition Zone) | Panel Dip: 150-/0+ | |
Quick Cup: 150-/0+ | |||
Cut off (0%) | Transition Zone | Panel Dip: 35-/115+ | |
Quick Cup: 32-/118+ | |||
+25% cut off | Predominantly Positive, some Negative (Transition Zone) | Panel Dip: 150+/0- | |
Quick Cup: 150+/0- | |||
+50% cut off | 100% Positive (150+/0-) | Panel Dip: 150+/0- | |
Quick Cup: 150+/0- | |||
+75% cut off | 100% Positive (150+/0-) | Panel Dip: 150+/0- | |
Quick Cup: 150+/0- | |||
+100% cut off | 100% Positive (150+/0-) | Panel Dip: 150+/0- | |
Quick Cup: 150+/0- | |||
Morphine (300 ng/mL Cut-off) | -100% cut off | 100% Negative (150-/0+) | Panel Dip: 150-/0+ |
Quick Cup: 150-/0+ | |||
-75% cut off | 100% Negative (150-/0+) | Panel Dip: 150-/0+ | |
Quick Cup: 150-/0+ | |||
-50% cut off | 100% Negative (150-/0+) | Panel Dip: 150-/0+ | |
Quick Cup: 150-/0+ | |||
-25% cut off | Predominantly Negative, some Positive (Transition Zone) | Panel Dip: 150-/0+ | |
Quick Cup: 150-/0+ | |||
Cut off (0%) | Transition Zone | Panel Dip: 33-/117+ | |
Quick Cup: 26-/114+ | |||
+25% cut off | Predominantly Positive, some Negative (Transition Zone) | Panel Dip: 150+/0- | |
Quick Cup: 150+/0- | |||
+50% cut off | 100% Positive (150+/0-) | Panel Dip: 150+/0- | |
Quick Cup: 150+/0- | |||
+75% cut off | 100% Positive (150+/0-) | Panel Dip: 150+/0- | |
Quick Cup: 150+/0- | |||
+100% cut off | 100% Positive (150+/0-) | Panel Dip: 150+/0- | |
Quick Cup: 150+/0- |
Note on Acceptance Criteria: For qualitative tests like these, the acceptance criteria are generally that samples significantly below the cutoff (e.g., -50% to -100% of cutoff) should consistently yield negative results and samples significantly above the cutoff (e.g., +50% to +100% of cutoff) should consistently yield positive results. Around the cutoff (e.g., +/- 25% of cutoff), a mix of positive and negative results is expected, demonstrating the device's ability to discriminate at the threshold. The reported data generally supports this behavior.
2. Sample Size Used for the Test Set and Data Provenance
-
Precision Studies (Test Set):
- For each drug and each concentration point (-100%, -75%, -50%, -25%, +25%, +50%, +75%, +100% cut off), and for each device (Panel Dip, Quick Cup), 50 samples per lot (2 runs per day for 25 days) for 3 lots were tested.
- Total samples per drug/concentration point/device: 50 samples/lot * 3 lots = 150 samples.
- Data Provenance: Samples were prepared by spiking drug in negative urine samples, and concentrations were confirmed by LC/MS. "In-house" studies are mentioned for comparison studies, suggesting the data was generated within the company or a collaborating lab. The document does not specify the country of origin of the data or whether the studies were retrospective or prospective, though the precision studies appear prospective due to the controlled spiking and testing regimen.
-
Comparison Studies (Test Set):
- For each drug and each device (Panel Dip, Quick Cup): 80 unaltered clinical samples (40 negative and 40 positive).
- Data Provenance: "In-house" studies. Samples were "unaltered clinical samples", meaning they were real patient samples, and were blind labeled. The origin (country/retrospective/prospective) is not explicitly stated.
-
Lay-user Study (Test Set):
- For each device format (Panel Dip, Quick Cup): 280 lay persons per device format participated.
- Urine samples were prepared at various concentrations (-100% Cutoff, -75% Cutoff, -50% Cutoff, -25% Cutoff, +25% Cutoff, +50% Cutoff, +75% Cutoff). The sample count varies for each concentration, but the total across all concentrations sums to 280 (e.g., 20+20+140+20+20+40+20 = 280) for each drug.
- Data Provenance: "Lay users" at "three intended user sites." The data was generated in a controlled manner (spiking drugs into pooled urine, blind labeling, LC/MS confirmation). The document does not specify country.
3. Number of Experts Used to Establish Ground Truth for the Test Set and Qualifications
- Precision Studies: Ground truth was established by LC/MS (Liquid Chromatography/Mass Spectrometry), which is an analytical method used for confirming drug concentrations. This is a highly accurate chemical method, not human expert consensus for visual interpretation.
- Comparison Studies: Ground truth was established by LC/MS results.
- Lay-user Study: Ground truth for sample concentrations was established by LC/MS.
No human experts were used to establish the ground truth in terms of visual interpretation for these studies as the ground truth was based on quantitative chemical analysis.
4. Adjudication Method for the Test Set
- Precision, Comparison, and Lay-user Studies: The ground truth for the spiked samples was determined by LC/MS. For the comparison studies, the "unaltered clinical samples" were also compared to "LC/MS results" as the ground truth.
- In the comparison studies, three laboratory assistants observed the results. The discordant results (where the viewer's result differed from the LC/MS) are listed in tables.
- No explicit "adjudication method" among human viewers (like 2+1 or 3+1 consensus) is described, as the ultimate ground truth was LC/MS. The individual viewer results are presented and compared against this gold standard.
5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was done, and effect size
- No, a typical MRMC comparative effectiveness study, which usually involves multiple human readers interpreting medical images or data with and without AI assistance to measure improvement, was not performed.
- This device is a qualitative drug screening test, where the result is a visible line (or absence of a line). The "readers" in the "Comparison Studies" are "laboratory assistants" observing these lines, not interpreting complex medical images. The study's focus is on the device's accuracy against a chemical gold standard, not human reader performance improvement with AI.
6. If a Standalone (i.e. algorithm only without human-in-the loop performance) was done
- Yes, for all studies (Precision, Comparison, Lay-user), the device operates in a standalone manner. The "human-in-the-loop" is simply reading the visual indicator (lines) produced by the device, not an "algorithm" making a diagnostic prediction that is then confirmed or refined by a human. The device itself is the "algorithm" in that it performs the chemical assay. The comparison data shows the device's inherent ability to produce the correct qualitative result based on the chemical content, which is then visually interpreted.
7. The Type of Ground Truth Used
- The primary type of ground truth used for all performance evaluations (precision, specificity, interference, comparison, and lay-user studies) was quantitative chemical analysis, specifically Liquid Chromatography/Mass Spectrometry (LC/MS). For the precision studies, concentrations were confirmed by LC/MS, and for the comparison studies, clinical samples were compared to LC/MS results.
8. The Sample Size for the Training Set
- This document describes a 510(k) submission for a diagnostic device. Such devices are typically developed, manufactured, and validated based on established chemical and immunological principles. They do not involve "training sets" in the context of machine learning or AI models.
- The "training" for such devices is in the design, formulation, and manufacturing process to ensure consistent chemical reactivity. There is no explicit "training set" of data points in the same sense as for an AI/ML algorithm.
9. How the Ground Truth for the Training Set was Established
- As stated above, there is no "training set" in the AI/ML sense for this type of device. The "ground truth" for developing the device would involve chemical principles, experimental optimization of reagents and concentrations, and quality control measures during manufacturing. This is a traditional immunoassay, not an AI/ML product.
Ask a specific question about this device
Page 1 of 1