Search Results

The 25-Hydroxy Vitamin DS EIA assay is intended for the quantitative determination of 25-hydroxyvitamin D [25(OH)D] and other hydroxylated metabolites in human serum or plasma. Results are to be used in conjunction with other clinical and laboratory data to assist the clinician in the assessment of vitamin D sufficiency in an adult population.

The 25-Hydroxy Vitamin De EIA is a manual assay test and does not require the use of an automated system. The whole assay is performed in a microtitre plate and requires a user to perform each step. The 25-Hydroxy Vitamin De assay is an enzymeimmunoassay for the quantitation of 25(OH)D and other hydroxylated metabolites in serum or plasma. 25uL of each calibrators, controls and samples are diluted with biotin labelled 25(OH)D. The diluted samples are incubated in microtitre wells which are coated with a highly specific sheep 25(OH)D at room temperature before aspiration and washing. Enzyme (horseradish peroxidase) labelled avidin, is added and binds selectively to complexed biotin and, following a further wash step, colour is developed using a chromogenic substrate (TMB). The absorbance of the stopped reaction mixtures are read in a microtitre plate reader, colour intensity developed being inversely proportional to the concentration of 25(OH)D.

The provided document describes the performance characteristics of the 25-Hydroxy Vitamin D EIA assay, but it focuses on analytical and comparative performance rather than a study proving the device meets general acceptance criteria in a clinical setting with human readers. The document is for an in-vitro diagnostic (IVD) device, so the criteria and studies described are relevant to laboratory performance.

Here's an analysis of the acceptance criteria and supporting studies based on the provided text, adapted for an IVD context where appropriate:

1. A table of acceptance criteria and the reported device performance

For IVD devices, "acceptance criteria" are usually internal performance goals set by the manufacturer to demonstrate analytical and clinical performance required for regulatory clearance. The document lists several performance characteristics and provides the corresponding measurements for the candidate device and, in some cases, the predicate device.

2. Sample sized used for the test set and the data provenance (e.g. country of origin of the data, retrospective or prospective)

• Precision/Reproducibility: 10 serum samples, assayed using 3 lots of reagents in duplicate, twice per day for a minimum of 20 days (n ≥ 80 replicates per sample). The origin of these samples is not specified.
• Linearity/Assay Reportable Range: Samples containing varying concentrations of 25-hydroxyvitamin D were assayed in replicate of four. The number of unique samples for this study is not explicitly stated, but they were patient samples (high patient sample diluted with a low patient sample). Origin not specified.
• Analytical Specificity (Cross-reactivity): Vitamin D serum samples were spiked with various cross-reactants. Number of samples not specified. Not specified if retrospective or prospective. Origin not specified.
• Analytical Specificity (Interference): Substances spiked into the assay. Number of samples/experiments not specified. Not specified if retrospective or prospective. Origin not specified.
• Method Comparison (vs. Predicate Device):
  • Sample Size: n = 195 (patient samples).
  • Provenance: Not specified (country/retrospective/prospective).
• Method Comparison (vs. Reference Measurement Procedure - RMP):
  • Sample Size: n = 109 independent native serum samples.
  • Provenance: Samples were value assigned by the Ghent reference method procedure. Not specified if retrospective or prospective, or country of origin for the samples themselves.
• Matrix Comparison:
  • Sample Sizes: SST (n=28), EDTA plasma (n=38), Sodium Heparin plasma (n=28), Lithium Heparin plasma (n=28), Citrate plasma (n=28).
  • Provenance: Not specified (country/retrospective/prospective).
• Expected Values/Reference Range:
  • Sample Size: 280 apparently healthy adult individuals.
  • Provenance: Retrospective. Individuals were "living in geographical diverse regions of the United States to represent a broad spectrum of UV light exposure".

3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g. radiologist with 10 years of experience)

For this IVD device (25-Hydroxy Vitamin D EIA assay), the "ground truth" is established by reference methods or the true concentration of the analyte, not typically by expert interpretation from medical images or clinical judgment directly.

• Method Comparison (vs. Reference Measurement Procedure): The "ground truth" for this comparison was established by the Ghent reference method procedure for 25-Hydroxy Vitamin D, and the assay is traceable to the isotope dilution-liquid chromatography/tandem mass spectrometry (ID-LCMS/MS) 25(OH) Vitamin D reference method procedure (RMP) which was used in assigning the target value for the Vitamin D Standardization Program (VDSP single donor human serum panel, itself traceable to NIST SRM 2972). This indicates a highly standardized and validated analytical method, which serves as the "expert" or definitive reference for concentration. The "experts" are the developers and maintainers of these reference methods, typically highly qualified analytical chemists or metrologists, not clinical experts for interpreting results in a diagnostic imaging sense.
• Other studies: For precision, linearity, and specificity, the "ground truth" is inherent to the prepared samples or known concentrations, not established by human experts.

4. Adjudication method (e.g. 2+1, 3+1, none) for the test set

Adjudication methods like "2+1" or "3+1" are typically used in studies involving human interpretation (e.g., radiology reads) where disagreements need to be resolved. This is not applicable to the analytical performance studies of an IVD assay where quantitative results are compared to a reference method or known values. Therefore, none was used in the sense of clinical expert adjudication.

5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

No MRMC study was done, as this device is an in-vitro diagnostic assay for quantitative laboratory measurement, not an AI-assisted diagnostic imaging tool that involves human readers interpreting images.

6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done

This device is a standalone assay. It provides a numerical result for 25-Hydroxy Vitamin D concentration. The performance studies detailed (precision, linearity, LoD, LoQ, method comparisons, interference, cross-reactivity) are all evaluations of this standalone analytical performance, quantifying its accuracy and reliability in measuring the analyte in patient samples. There is no "human-in-the-loop" once the sample is processed by the assay; a user performs the assay steps, but the result generated is direct from the assay's chemical reactions and spectrophotometric reading.

7. The type of ground truth used (expert consensus, pathology, outcomes data, etc.)

The ground truth used primarily consists of:

• Reference Measurement Procedures (RMP): Specifically, the ID-LCMS/MS method (traceable to NIST SRM 2972) and the Ghent reference method procedure. These are highly accurate and standardized analytical methods for determining the true concentration of 25-Hydroxy Vitamin D.
• Known Concentrations: For studies like linearity, LoB, LoD, LoQ, interference, and cross-reactivity, ground truth is established by preparing samples with known, precise concentrations of the analyte or interfering substances.

8. The sample size for the training set

This document describes a premarket notification (510(k)) for a medical device (an in-vitro diagnostic assay). The concept of a "training set" is typically associated with machine learning or AI models. For an IVD assay, raw materials and assay design are developed through R&D, and then validated with studies like those described. There isn't a "training set" in the sense of data used to train an algorithm. The development and optimization of the assay's components (e.g., antibodies) would occur during the manufacturing process, but the document doesn't provide details on sample sizes used during that phase.

9. How the ground truth for the training set was established

As there isn't a "training set" in the AI/ML context for this IVD assay, this question is not directly applicable. The "ground truth" for the analytical performance studies (as described in point 7) was established using reference measurement procedures and known concentrations.

Ask a specific question about this device