Search Results

The IDS iSYS 25 VilD assay is intended for the quantitative determination of total 25-hydroxyvitamin D (125(OH)D) in hyman serum or plasma on the IDS iSYS Multi-Discipline Automated System. Results are to be used in conjunction with other clinical and laboratory data to assist the clinician in the assessment of vitamin D sufficiency in an adult population.

The IDS-iSYS 25 VitD Control Set is used for quality control of the IDS-iSYS 25 VitD assay on the IDS-iSYS Multi-Discipline Automated System.

The IDS-iSYS 25 VitDs reagent kit consists of one (1) Immunoassay Cartridge, one (1) vial each of 2 concentration Calibrator levels and a mini-CD containing the Instructions For Use (IFU), CRY files and Certificate of Analysis.

IDS-iSYS 25 VitDS Cartridge, sufficient for 100 tests, consists of reagents provided in individual compartment within a plastic container called the Cartridge. IDS-iSYS 25 VitDS Cartridge contains the following ready to use reagents:

• Magnetic particles coated with streptavidin in a phosphate . buffer containing sodium azide.
• . Sodium hydroxide solution.
• . 25(OH)D labelled with an acridinium ester derivative, in buffer containing bovine serum albumin with sodium azide.
• . Anti-25(OH)D sheep polyclonal antibody labelled with an biotin, in buffer containing bovine, sheep and mouse proteins and sodium azide.
• . Assay buffer containing proprietary displacing compounds, methanol and sodium azide.

The IDS-iSYS 25 VitD® Calibrators are included in the reagent kit. The ready to use calibrators contains human serum buffer matrix with two defined concentrations of 25(OH)D and sodium azide as preservative (<0.1 %), 1 bottle per concentration level.

The IDS-iSYS 25VitDe Control Set contains human serum in a buffer matrix with two defined concentrations of 25(OH)D and sodium azide as a preservative; 3 bottles per concentration level.

The provided document describes the IDS-iSYS 25VitD8 assay, a device for the quantitative determination of total 25-hydroxyvitamin D [25(OH)D] in human serum or plasma. Below is an analysis of its acceptance criteria and the studies performed.

1. Table of Acceptance Criteria and Reported Device Performance

The document does not explicitly state formal "acceptance criteria" for all performance characteristics in a single, consolidated table. However, it presents performance data for various analytical characteristics, and in some cases, implicitly defines acceptable ranges or desired outcomes for these studies. For instance, in the specificity study, an acceptance criterion of "<10% bias between the test and control samples" is stated.

Based on the provided information, a table can be constructed to show the reported device performance and implicitly derived or explicitly stated acceptance criteria.

2. Sample Size Used for the Test Set and Data Provenance

• Precision/Reproducibility: Nine serum-based samples at different 25(OH)D concentration levels were used. Each sample was likely tested multiple times over several days and systems (as indicated by the methodology for LoB/LoD/LoQ, which involved 3 batches, multiple runs, and operators, though precision specifics aren't identical).
• Linearity: One high and one low human serum sample were used, along with 9 evenly spaced dilutions created by mixing them. (Total of 11 unique concentrations tested).
• Detection Limits (LoB, LoD, LoQ):
  • LoB: 3 manufacturing batches (MB1, MB2B, MB3). Each batch ran 6 assays over 4-5 days, with 2 duplicates per assay. Total 60 replicates per batch.
  • LoD: 6 very low 25(OH)D samples. Each batch ran 6 assays over 3-5 days, with 2 duplicates per assay. Total 72 replicates for each manufacture batch.
  • LoQ: 10 low 25(OH)D samples. Each batch ran 6 assays over 3-5 days, with 2 duplicates per assay. Total 120 replicates for each manufacture batch (118 for MB1 due to mislabeling).
• Analytical Specificity (Interference): Two serum samples at two different 25(OH)D concentrations for each interferent tested. Each condition tested with 26 replicates (spiked vs. control).
• Analytical Specificity (Cross-reactivity): Samples spiked with relevant cross-reactants. Specific numbers of replicates or distinct samples are not detailed for each cross-reactant. Endogenous cross-reactants were tested with samples having established ID-LC-MS/MS values.
• Method Comparison: A total of 136 human serum samples with a wide range of 25(OH)D concentrations (5.6 to 110 ng/mL).
• Expected Values/Reference Range: 392 apparently healthy donors (200 males, 192 females) from three diverse regions of the United States (North, Central, South), sampled in the winter.
• Matrix Comparison: 57 native samples plus 10 treated (spiked or diluted) samples, covering a range of 4.8 to 108 ng/mL from serum without additives, compared across various tube types.

Data Provenance:

• For the Expected Values/Reference Range study, data was collected from the United States (North, Central, South regions).
• For other studies (Precision, Linearity, Detection Limits, Specificity, Method Comparison, Matrix Comparison), the country of origin is not explicitly stated, but given Immunodiagnostic Systems Limited is based in the UK, it is plausible some studies might have been conducted there or in collaboration with international labs. The method comparison refers to NIST/Ghent ID-LC-MS/MS, suggesting international standards and potentially international lab involvement. Based on the 510(k) submission, the studies were conducted by the manufacturer for the purpose of demonstrating substantial equivalence to a US-marketed device. All data is retrospective as it was collected before the submission for marketing clearance.

3. Number of Experts Used to Establish Ground Truth for the Test Set and Qualifications of Those Experts

There were no experts used to establish ground truth in the traditional sense for these studies. This device is an in vitro diagnostic (IVD) for quantitative measurement. The "ground truth" for the test set was established by:

• Reference Methods: The primary ground truth for the Method Comparison study was the NIST/Ghent ID-LC-MS/MS 25(OH) Vitamin D Reference Method Procedure. This is a highly accurate and standardized analytical method, not a human expert.
• Known Concentrations/Spiked Samples: For studies like linearity, detection limits, analytical specificity, and cross-reactivity, ground truth was based on:
  • Known concentrations of analytes (e.g., purified 25(OH)D, interferents, cross-reactants) used to spike samples.
  • Samples with established values from other validated methods, like ID-LC-MS/MS for endogenous cross-reactants.
• Population Studies: For Expected Values/Reference Range, the "ground truth" are the measured values from a characterized "apparently healthy" donor population, with outliers and specific exclusions defined.

4. Adjudication Method for the Test Set

There was no adjudication method for these studies in the context of expert review, as the ground truth was based on analytical reference methods or predefined sample concentrations, not subjective interpretations requiring consensus from multiple human readers.

5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done, If So, What Was the Effect Size of How Much Human Readers Improve With AI vs Without AI Assistance

No MRMC comparative effectiveness study was done. This device is an automated in vitro diagnostic (IVD) assay designed for quantitative measurement of a biomarker (25(OH)D). It does not involve human readers interpreting images or data that would be assisted by AI. The device directly yields a numerical result. Therefore, the concept of "human readers improve with AI vs without AI assistance" is not applicable here.

6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) Was Done

This device operates as a standalone algorithm (assay) in the sense that it performs the measurement without human intervention influencing the result of that specific measurement. The IDS-iSYS Multi-Discipline Automated System performs the assay automatically. The results are then used by clinicians in conjunction with other data, but the measurement itself is automated. The performance characteristics described (precision, linearity, detection limits, specificity, method comparison, matrix comparison) are all "standalone" performance metrics of the assay system itself.

7. The Type of Ground Truth Used

The ground truth used was primarily:

• Reference Method Data: Specifically, the isotope dilution-liquid chromatography/tandem mass spectrometry (ID-LC-MS/MS) 25(OH)D Reference Method Procedure (RMP), particularly for method comparison and traceability. This RMP is itself traceable to the National Institute of Standards and Technology (NIST) Standard Reference Material (SRM) 2972.
• Known/Assigned Concentrations: For stability, calibrator, and control value assignments, internal stock solutions, secondary standards (Internal Reference Calibrators, IRs), and manufactured kit calibrators/controls had values assigned back to the CDC VDSP aligned secondary standards or by using validated kit combinations over multiple instruments and runs.
• Spiked Samples: For linearity, analytical specificity (interference and cross-reactivity) studies, samples were spiked with known concentrations of analytes, interferents, or cross-reactants.

8. The Sample Size for the Training Set

The document does not explicitly mention a separate "training set" in the context of machine learning or AI development. This device is an immunoassay, not a machine learning model. The various studies described (precision, linearity, specificity, method comparison, etc.) are validation studies performed on the final assay formulation and instrument system.

However, the closest analogous concepts would be:

• Calibrator and Control Value Assignment: This involves multiple runs (minimum 20 assay runs for calibrators, minimum 21 assay runs for controls) and systems to establish and verify values. These essentially "train" the system by defining its response curve and quality control ranges.
• Assay Development: During the initial development of the assay, numerous samples and experiments would have been conducted to optimize reagents, conditions, and performance characteristics. This "development data" would serve a similar purpose to a training set but is not explicitly detailed as such in this 510(k) summary, which focuses on validation of the final device.

9. How the Ground Truth for the Training Set Was Established

As noted above, there's no explicit "training set" in the AI sense. For the closest analogous processes:

• Calibrator and Control Value Assignment:
  • Traceability: The assay is traceable to the ID-LC-MS/MS 25(OH)D Reference Method Procedure (RMP), which was used to assign target values for the Vitamin D Standardization Program (VDSP) samples. This RMP is further traceable to the NIST SRM 2972.
  • Internal Standards: An internal stock solution ("Top Dose") of 25-hydroxyvitamin D3 had its concentration assigned by performing dilutions and testing in approved, previously QC-released kits.
  • Secondary Standards (IRs): These were manufactured and value-assigned using the CDC VDSP aligned secondary standards.
  • Kit Calibrators: Tested as unknowns in a minimum of 20 assay runs on one IDS-iSYS instrument, using these secondary standards (IRs) to establish their values through Excel data reduction and Prism for curve parameters. Values were then verified over 3 assays.
  • Kit Controls: Tested as unknowns in a minimum of 21 assay runs using multiple systems and approved kit combinations, with values calculated using the IDS-iSYS instrument's on-board software. Values were then verified in a single assay.

Essentially, the "ground truth" for the calibrators and controls used to define the assay's operating curve and quality parameters is established through a hierarchical traceability chain leading back to NIST-traceable reference methods.

Ask a specific question about this device

IDS-iSYS 17-OH Progesterone Control Set
The IDS-iSYS 17-OH Progesterone Control Set is for in vitro diagnostic use, for the quality control of the IDS-iSYS 17-OH Progesterone on the IDS-iSYS Multi-Discipline Automated System.
Rx Only.

IDS-iSYS 17-OH Progesterone Calibration Verifiers
The IDS-iSYS 17-OH Progesterone Calibration Verifiers are an in vitro diagnostic device intended for medical purposes in the quantitative verification of assay calibration and measuring range of the IDS-iSYS 17-OH Progesterone assay, when performed on the IDS-iSYS Multi Discipline Automated System.
Rx Only.

The IDS-iSYS 17-OH Progesterone Control Set consists of Two sets of three vials, 1.0 mL each in liquid form. Human serum containing 17-OH Progesterone and sodium azide as a preservative (<0.1%), with three concentration levels.
The IDS-iSYS 17-OH Progesterone Calibration Verifiers consists of Four calibration verifier levels in liquid form (two 1.0mL vials for level 0 and one 1.0mL vial for levels 1, 2 & 3). Human serum containing 17-OH Progesterone and sodium azide as a preservative (<0.1%), with three concentration levels.

The provided text describes the acceptance criteria and supporting studies for two in vitro diagnostic devices: the IDS-iSYS 17-OH Progesterone Control Set and the IDS-iSYS 17-OH Progesterone Calibration Verifiers.

1. Table of acceptance criteria and the reported device performance:

2. Sample size used for the test set and the data provenance:

• IDS-iSYS 17-OH Progesterone Control Set - Value Assignment:
  • Sample Size: A minimum of 21 runs using cartridge batches (number of batches not specified) tested in triplicate on each of three IDS-iSYS Multi Discipline Automated Systems. Control solutions were prepared gravimetrically.
  • Data Provenance: Not explicitly stated as retrospective or prospective, nor country of origin. Given it's a device manufacturer's study to establish product characteristics, it's inherently prospective in nature.
• IDS-iSYS 17-OH Progesterone Control Set - Stability (All types):
  • Closed Vial (Real-time): Three lots of controls, tested in pentaplicate (5 replicates) at 2-month intervals for up to a minimum of 15 months. Each tested vial compared to reference material stored at -20°C.
  • Closed Vial (Accelerated): Performed according to CLSI guideline EP25-A.
  • Open Vial: Tested in duplicate at time points stated in the stability protocol (time points not detailed), against unopened vials.
  • On-Board: Three batches of controls, using three IDS-iSYS instruments. Tested at 0, 2, 4, 6, and 8 hours compared to a reference material at time 0.
  • Data Provenance: Same as above, likely prospective internal testing.
• IDS-iSYS 17-OH Progesterone Calibration Verifiers - Value Assignment:
  • Sample Size: Minimum of five runs for each cartridge batch (number of batches not specified) tested in triplicate on each of three IDS-iSYS Multi Discipline Automated Systems. Calibration Verifier solutions were prepared gravimetrically.
  • Data Provenance: Same as above, likely prospective internal testing.
• IDS-iSYS 17-OH Progesterone Calibration Verifiers - Stability (Closed Vial & On-Board):
  • Closed Vial (Real-time): Three lots of calibration verifiers, tested in pentaplicate (5 replicates) at 2-month intervals for up to a minimum of 15 months.
  • Closed Vial (Accelerated): Performed according to CLSI guideline EP25-A.
  • On-Board: Three batches of calibration verifiers, using three IDS-iSYS instruments. Tested at 0, 2, 4, 6, and 8 hours compared to a reference material at time 0.
  • Data Provenance: Same as above, likely prospective internal testing.

3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g., radiologist with 10 years of experience):

This device is an in vitro diagnostic (IVD) quality control material and calibration verifier for automated systems, not an imaging AI device. The "ground truth" here refers to the reference values established for the control and calibration materials themselves, rather than diagnosis or interpretation by human experts.

• Value Assignment: The "ground truth" (assigned target values) for both the control set and calibration verifiers is established by the mean of all runs from multiple tests on three IDS-iSYS Multi Discipline Automated Systems, using cartridge batches, and confirmed by immunologic analysis using the IDS-iSYS 17-OH Progesterone assay. The solutions themselves are prepared gravimetrically from intermediate stock solutions.
• There are no "experts" in the traditional sense (e.g., radiologists) involved in establishing the ground truth for this type of chemical/immunological assay. The ground truth relies on the precision and accuracy of the analytical methods and the instrument itself.

4. Adjudication method (e.g., 2+1, 3+1, none) for the test set:

Not applicable. This is not a study involving human interpretation or subjective assessment of data that would require an adjudication method. The device's performance is determined by quantitative measurements and statistical analysis against predefined criteria.

5. If a multi-reader multi-case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:

Not applicable. This device is an IVD quality control and calibration material, not an AI-powered diagnostic tool for human readers. No MRMC study was conducted or is relevant for this product.

6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done:

Yes, the studies are inherently standalone as they evaluate the performance of the control and calibration materials on the IDS-iSYS Multi-Discipline Automated System. The system/assay performs the measurements without human intervention in the interpretation of the control/verifier results themselves beyond setting up the experiment and analyzing statistical compliance. The performance reported (e.g., mean concentration, CV, percent recovery) is that of the material as measured by the automated system.

7. The type of ground truth used (expert consensus, pathology, outcomes data, etc.):

The ground truth used is based on:

• Gravimetric preparation: For the initial stock solutions and preparation of control/calibration verifier samples.
• Immunologic analysis: Confirmation of concentrations using the IDS-iSYS 17-OH Progesterone assay itself.
• Statistical averaging: The mean of multiple runs on multiple instruments to establish the assigned target values, treated as the reference ground truth for quality control and calibration verification.
• Reference material comparison: For stability studies, comparison to a reference control material stored under optimal conditions (-20°C).

This is a form of analytical ground truth derived from established quantitative laboratory methods and statistical analysis rather than clinical consensus or pathological diagnosis.

8. The sample size for the training set:

Not applicable. This is not an AI/machine learning device that requires a training set. The values and stability characteristics are determined through direct analytical testing, not model training.

9. How the ground truth for the training set was established:

Not applicable. As there is no training set for an AI/machine learning model, no ground truth needed to be established for it.

Ask a specific question about this device