Search Results

The NeoBase™ 2 Non-derivatized MSMS kit is intended for the measurement and evaluation of amino acid, succinylacetone, free carnitine, acylcarnitine, nucleoside and lysophospholipid concentrations (Table 1) with a tandem mass spectrometer from newborn heel prick blood specimens dried on filter paper. Quantitative analytis of these analytes and their relationship with each other is intended to provide analyte concentration profiles that may aid in screening newborns for metabolic disorders.

Not Found

The provided text describes the acceptance criteria and study results for the NeoBase 2 Non-derivatized MSMS kit.

1. Table of Acceptance Criteria and Reported Device Performance

The document does not explicitly state numerical acceptance criteria for the screening performance studies (e.g., minimum sensitivity or specificity targets). Instead, it states that "All verification studies were successfully concluded and met the respective study's predetermined acceptance criteria." The clinical studies for screening performance are presented as agreement between the new device (NeoBase 2) and the predicate device (NeoBase). The agreement is presented as contingency tables (e.g., "Screening positive" vs "Screening negative" for both devices).

The performance is demonstrated by the agreement between the NeoBase 2 Non-derivatized MSMS kit and the predicate device, NeoBase Non-derivatized MSMS kit, in detecting various metabolic disorders in newborn screening. The results are presented in terms of the number of positive and negative screens detected by each device, along with the number of confirmed positive specimens.

Summary of Device Performance (from Tables A, B, C, D):

2. Sample Size Used for the Test Set and Data Provenance

• Study 1 Sample Size:

  • Amino acid disorders, Fatty acid oxidation, Organic acid conditions: 1751 samples (for 99th and 99.5th percentile cut-offs) and 1737-1746 samples (for 1st and low percentile cut-offs).
  • ADA-SCID and X-ALD: 1738 samples.

• Study 2 Sample Size:

  • Amino acid disorders, Fatty acid oxidation, Organic acid conditions: 2631-2648 samples.
  • ADA-SCID and X-ALD: 2631 samples.

• Data Provenance: The data was obtained from "routine newborn screening" in "two CLIA-certified state laboratories." The confirmed positive specimens were described as "retrospective" for Study 2. This suggests a retrospective study design using existing samples and accompanying diagnostic information. The country of origin is not explicitly stated but is implied to be the US due to "CLIA-certified state laboratories."

3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts

The document does not specify the number or qualifications of experts used to establish the ground truth for the test set. It mentions "confirmed positive specimens," implying a definitive diagnostic process was followed to establish the true disease status of these samples, but details on the experts involved are not provided.

4. Adjudication Method for the Test Set

The document does not describe an adjudication method for the test set, such as 2+1 or 3+1. The acceptance is based on the agreement between the new device and the predicate device, using established cut-offs derived from routine newborn screening data.

5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

No MRMC comparative effectiveness study was done. This device is a diagnostic kit measuring analyte concentrations, not an AI system assisting human readers. Therefore, the concept of "how much human readers improve with AI vs without AI assistance" is not applicable.

6. Standalone (Algorithm Only Without Human-in-the-Loop Performance) Study

The study described is a comparison of the new device (NeoBase 2) to a predicate device (NeoBase) in obtaining analyte concentrations. While not explicitly stated as an "algorithm only" study, it's a standalone performance comparison of two test kits. The results (analyte concentrations and screening positive/negative classifications) are derived directly from the kit's operation with a tandem mass spectrometer, without human interpretation being part of the primary measurement process itself. The interpretation of the analyte profiles to aid in screening for metabolic disorders would typically involve medical professionals, but the performance data presented is on the analytical and classification output of the device.

7. Type of Ground Truth Used

The ground truth for the test set was based on "confirmed positive specimens." This implies that the true disease status of these specimens was established through clinical diagnosis and follow-up, which would typically involve a combination of clinical outcomes, biochemical testing, and/or genetic testing, ultimately confirmed by clinical experts. For ADA-SCID and X-ALD, it explicitly states "comparing the result... to the clinical condition."

8. Sample Size for the Training Set

The document does not explicitly mention a "training set" in the context of machine learning or AI. The term "cut-offs for both methods were determined by calculating the 99.5th and 99th percentile for all analytes" using "data from routine newborn screening." This large volume of routine newborn screening data could be considered analogous to a training or reference population used to establish the operating characteristics of the screening test. The specific sample size for this cut-off determination is not given, but it is implied to be a large dataset from the "two CLIA-certified state laboratories."

9. How the Ground Truth for the Training Set Was Established

As discussed in point 8, there isn't a traditional "training set" for an AI model. However, the cut-off values (e.g., 99th, 99.5th, 1st, 10th percentiles) used to define "screening positive" or "screening negative" were established using "data from routine newborn screening." This means the ground truth for establishing these cut-offs would inherently come from the statistical distribution of analyte levels in a large, presumably healthy and general newborn population, along with the understanding of what analyte levels are indicative of various metabolic disorders. The document states that the cut-off values "only apply to these studies."

Ask a specific question about this device

The NeoLSD MSMS Kit is intended for the quantitative measurement of the activity of the enzymes acid-pglucocerebrosidase (ABG), acid-sphingomyelinase (ASM), acid-a-glucosidase (GAA), B-galactocerebrosidase (GALC), α-galactosidase A (GLA) and α-L-iduronidase (IDUA) in dried blood spots (DBS) from newborn babies. The analysis of the enzymatic activity is intended as an aid in screening newborns for the following lysosomal storage disorders (LSD) respectively; Gaucher Disease, Nieman-Pick A/B Disease, Pompe Disease, Fabry Disease, and MPS I Disease.

The NeoLSD MSMS test system uses mass spectrometry to quantitatively measure the activity of six lysosomal enzymes simultaneously from a dried blood spot sample. The NeoLSD MSMS test system is comprised of:

1. NeoLSD MSMS kit, including substrates, internal standards, solutions and controls
2. Waters TQD MSMS instrument comprised of,
   a. Waters 1525 sample pump
   b. Waters 2777c autosampler
   c. Waters MassLynx v4.1 firmware C.
   d. Power cables, tubing, syringes, connection cables
3. Waters NeoLynx v4.1 software and computer with monitor
4. PerkinElmer MSMS Workstation Software

The NeoLSD MSMS kit evaluates enzyme activities by measuring the product generated when an enzyme reacts with a synthesized substrate to create a specific end product. The activities of the six lysosomal enzymes present in a 3.2 mm punch from a dried blood spot (DBS) are simultaneously measured by the NeoLSD MSMS kit. The punches are incubated with the assay reagent mixture which contains;
. six substrates, one corresponding to each lysosomal enzyme
. six stable-isotope mass-labeled internal standards (IS) each designed to chemically resemble each product generated
. a buffer to maintain the reaction pH, and to carry inhibitors to limit activity from competing enzymes if present and additives to enhance the targeted enzyme reactions.

The NeoLSD MSMS Kit is intended for the quantitative measurement of the activity of six lysosomal enzymes (acid-β-glucocerebrosidase (ABG), acid-sphingomyelinase (ASM), acid-α-glucosidase (GAA), β-galactocerebrosidase (GALC), α-galactosidase A (GLA), and α-L-iduronidase (IDUA)) in dried blood spots (DBS) from newborn babies. The analysis of enzymatic activity serves as an aid in screening newborns for Gaucher Disease, Niemann-Pick A/B Disease, Pompe Disease, Krabbe Disease, Fabry Disease, and MPS I Disease.

Here's an analysis of the acceptance criteria and the study that proves the device meets them:

1. Table of Acceptance Criteria and Reported Device Performance

The acceptance criteria are generally implied by the performance metrics reported, such as linearity ranges, precision (reproducibility %CV), and LoQ values. The screening performance, particularly sensitivity and specificity, are key for a screening tool.

Ask a specific question about this device

The EnLite™ Neonatal TREC Kit is an in vitro diagnostic device intended for the semiquantitative determination of TREC (T-cell receptor excision circle) DNA in blood specimens dried on filter paper. The test is for use on the VICTOR™ EnLite instrument. The test is indicated for use as an aid in screening newborns for severe combined immunodeficiency disorder (SCID).

This test is not intended for use as a diagnostic test or for screening of SCID-like Syndromes, such as DiGeorge Syndrome, or Omenn Syndrome. It is also not intended to screen for less acute SCID syndromes such as leaky-SCID or variant SCID.

The EnLite™ Neonatal TREC Kit is comprised of the EnLite™ Neonatal TREC Kit, the VICTOR™ EnLite instrument and the EnLite™ workstation software. The EnLite™ Neonatal TREC Kit contains reagents sufficient for 384 reactions or 1152 reactions, and multi-level, dried blood spot (DBS) calibrators and controls. The DBS calibrators and DBS controls have been prepared from porcine whole blood with a hematocrit value of 48-55%, and contain purified salmon-sperm, TREC, and beta-actin DNA.

The EnLite™ Neonatal TREC Kit is an in vitro diagnostic device for semi-quantitative determination of T-cell receptor excision circles (TRECs) in dried blood specimens, used as an aid in screening newborns for severe combined immunodeficiency disorder (SCID).

1. Acceptance Criteria and Reported Device Performance

The acceptance criteria for the EnLite™ Neonatal TREC Kit are outlined in the regulatory information, specifically within the "Special Controls" section (Section T, point 1(iii)). These criteria detail the required analytical and clinical performance characteristics for the device. The reported device performance is presented throughout the "Performance Characteristics" section (Section M).

Here's a table summarizing key acceptance criteria and reported performance, focusing on the clinical validation study as that directly addresses the intended use of screening:

Table of Acceptance Criteria and Reported Device Performance

A minimum of 10-15 confirmed positive specimens from more than one site, with relevant annotation, and SCID diagnosis by flow cytometry or clinically meaningful information regarding subject status at one year or beyond.

Additional specimens characterized by other disorders with low/absent TREC (e.g., other T-cell lymphopenic disorders) to supplement the range of results.

Pre-specified clinical decision point (cut-off) before studies.

Results summarized in tabular format comparing interpretation to reference method.

Point estimates and 95% CIs for PPA, NPA, and OPA.

Data must include retest rate, false positive rate before retest, final false positive rate, and false negative rate. | The primary clinical study objective was to demonstrate the EnLite™ Neonatal TREC Kit's screening performance in the intended use population and its ability to discriminate between normal and SCID cases. The study was conducted retrospectively.

SCID Positive Specimens: 17 archived confirmed SCID positive DBS specimens were obtained from newborn screening laboratories in the US. All 17 were confirmed for SCID by flow cytometry. These enriched the study due to the low incidence of SCID.

Other Low TREC Specimens: An additional 9 DBS specimens from babies with low TREC values (0 to 20 TREC Copies/uL) were included.

Comparator: For routine clinical study specimens, the comparator was the clinical assessment from medical records at one year of age or older (365 days), confirming the newborn was not identified with SCID, was not deceased from SCID-related complications, and was apparently healthy. For confirmed SCID cases, the comparator was the reference tests results for SCID confirmation.

Pre-specified Cut-off: The cut-off for TREC was pre-determined to be 36 copies/uL and for beta-actin as 56 copies/uL, based on the 2.5th percentile of normal distribution data from a separate cut-off confirmation study using 2846 archived, retrospective newborn specimens from the Danish Newborn Screening Biobank.

Retest Rate: The retest rate was 1.9%.

False Positive Rate: The false positive rate using the cut-off of 36 in the first round of testing was 1.5%. After repeat testing on follow-up cases, the final false positive rate was 0.5%.

False Negative Rate: The clinical data indicates 0 false negative results among the 16 confirmed SCID positives classified after the final testing round (Table 14).

Performance (from Table 14, excluding invalid results):
- Overall Percent Agreement (OPA): 99.7% (95% CI: 99.4% to 99.8%)
- Positive Percent Agreement (PPA): 100% (95% CI: 79.4% to 100%)
- Negative Percent Agreement (NPA): 99.7% (95% CI: 99.4% to 99.8%)

Note: One SCID positive specimen in the clinical study was classified as an invalid result, leading to 16 confirmed SCID positives being used for final agreement calculations. |

2. Sample Sizes and Data Provenance

• Test Set Sample Size:

  • Clinical Study: A total of 6,471 neonatal specimens were run, with 6,373 included in the final analysis. This included 6,389 routine Danish newborn screening biobanked newborn routine DBS samples and 82 enrichment samples (17 confirmed SCID positive samples, 9 confirmed low-level TREC specimens, and 56 samples used for blinding purposes). For the final agreement calculations, 5,454 specimens (after some exclusions and loss-to-follow-up) were used, specifically 5,442 after removing invalid results (16 confirmed SCID positives and 5,426 normal/presumptive normal).
  • Cut-off Establishment Study: 3,243 archived, retrospective newborn specimens initially, with 2,846 included in the analysis after exclusions.
  • Analytical Performance Studies (Examples):
    • Reproducibility (Site-to-Site): 90 measurements per sample (6 unique TREC levels, 10 runs x 3 laboratories x 3 replicates/sample).
    • Precision: 27 runs performed over 20 days. For TREC precision, 10 samples were assessed with 4 replicates/sample. For beta-actin, 7 samples were used.
    • LoB/LoD/LoQ: 5 samples for LoB (60 results per sample); 5 samples for LoD/LoQ (108 results per sample).

• Data Provenance:

  • Clinical Study & Cut-off Establishment:
    • Country of Origin: Denmark (samples from the Danish Newborn Screening Biobank, comprising the Danish population).
    • Retrospective/Prospective: All samples were archived, retrospective.
  • SCID Enrichment Samples: 17 confirmed SCID positive DBS specimens were obtained from newborn screening laboratories in the US (retrospective).

3. Number of Experts and Qualifications for Ground Truth

The document does not explicitly state the number of experts used to establish the ground truth for the test set, nor their specific qualifications (e.g., "radiologist with 10 years of experience").

• However, the ground truth for the 17 confirmed SCID positive specimens was established by flow cytometry, which is a specialized laboratory test requiring expert interpretation, presumably by qualified clinical immunologists or pathologists.
• For the routine newborn specimens, the comparator for ground truth was the clinical assessment of the study subjects obtained from their medical records at one year of age or older (365 days), confirming they were not identified with SCID, were not deceased from SCID-related complications, and were apparently healthy. This clinical assessment would implicitly involve input from various medical professionals (pediatricians, specialists).
• The "expert" component primarily comes from the reference method (flow cytometry) for SCID diagnosis and the subsequent clinical follow-up for the larger cohort.

4. Adjudication Method for the Test Set

The adjudication method for the test set was not explicitly described as a multi-expert consensus process like "2+1" or "3+1" that is common in medical imaging studies. Instead, the ground truth for SCID confirmation was primarily based on:

• Laboratory Confirmation: Flow cytometry for the 17 confirmed SCID cases.
• Clinical Outcomes: Medical record review at one year of age or older for the large cohort of routine newborns to determine the absence of SCID.

The device itself has an internal retesting algorithm (Section P.4 and P.4, Figure 8). Initial results below the cut-off are "presumptive positive" and are retested in duplicate. This internal retesting acts as a form of "internal adjudication" for the device's own classification, but it's not external expert adjudication of the ground truth.

5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

No MRMC comparative effectiveness study was mentioned. This device is a laboratory diagnostic kit and not an AI-assisted diagnostic tool for human readers (like a CAD system for radiologists). Therefore, a study to measure how much human readers improve with AI vs. without AI assistance is not applicable to this type of device.

6. Standalone Performance

The study primarily assessed the standalone performance of the device/kit (EnLite™ Neonatal TREC Kit, VICTOR™ EnLite instrument, and EnLite™ workstation software) in classifying samples as "presumptive positive" or "normal" based on its quantitative TREC and beta-actin measurements and the predefined cut-offs. The results (PPA, NPA, OPA) reflect the performance of the integrated system in a laboratory setting, without direct human cognitive interpretation of raw data for diagnosis. The output from the device is a quantitative TREC value, which is then used with a hard cut-off.

7. Type of Ground Truth Used

The ground truth used was a combination of:

• Laboratory Test Confirmation: For the known SCID positive cases, flow cytometry was used to confirm SCID.
• Clinical Outcomes Data: For the large cohort of routine newborn screening samples, the absence of SCID was determined through medical record review (vaccination records, national patient registry, civil registration system) at one year of age or older, looking for signs of SCID or SCID-related complications/death.

8. Sample Size for the Training Set

The document describes the evaluation of an already developed device/kit, not a machine learning model. Therefore, there is no explicit "training set" in the context of machine learning model development. The data used for establishing the clinical cut-off (2,846 samples from the Danish Newborn Screening Biobank) could be considered analogous to a "development" or "calibration" dataset, which informed the final cut-off value used in the pivotal study (test set).

9. How the Ground Truth for the Training Set Was Established

As noted above, there isn't a "training set" for a machine learning model. For the dataset used to establish the clinical cut-off (2,846 samples):

• These were archived, retrospective newborn specimens from the Danish Newborn Screening Biobank.
• The ground truth in this context was based on the distribution of TREC and beta-actin values in this "normal newborn population". The 2.5 percentile of this distribution was then chosen as the clinical cut-off for TREC (36 copies/uL) and beta-actin (56 copies/uL). This is a statistical approach to defining "normal" for screening purposes, rather than a direct disease diagnosis for each individual sample.

Ask a specific question about this device

The GSP Neonatal Total Galactose kit is intended for the quantitative determination of total galactose (galactose and galactose-1-phosphate) concentrations in blood specimens dried on filter paper as an aid in screening newborns for galactosemia using the GSP® instrument.

The GSP Neonatal Total Galactose kit contains sufficient reagents to perform 1152 assays. The GSP Neonatal Total Galactose test system measures total galactose, i.e. both galactose and galactose-1-phosphate, using a fluorescent galactose oxidase method. The fluorescence is measured using an excitation wavelength of 505 nm and an emission wavelength of 580 nm. The kit contains Neonatal Total Galactose Assay Reagent 1, Neonatal Total Galactose Assay Reagent 2, Neonatal Total Galactose Assay Buffer, Neonatal Total Galactose Assay Reconstitution Solution, and Neonatal Extraction Solution. Calibrators and Controls are also included.

1. Table of Acceptance Criteria and Reported Device Performance

• Conjugated Bilirubin: Concentrations above 16.6 mg/dL caused a significant decrease (>15%) in measured total galactose. At 24.9 mg/dL and above, the decrease was 100% at some total galactose concentrations.
• Intralipid: Concentrations above 250 mg/dL (at 5 and 10 mg/dL total galactose) or 375 mg/dL (at 15 mg/dL total galactose) caused a significant increase (>15%) in measured total galactose. Maximum tested (1500 mg/dL) caused an increase of ~52-77%.
• Hemoglobin (with Bilirubin): Hemoglobin levels at 198 g/L and above in combination with an elevated bilirubin level of 15 mg/dL caused a significant increase (>15%) in measured total galactose at certain total galactose concentrations. For example, at 5 mg/dL total galactose, 198 g/L Hb led to a 26.3% increase.
• Non-Interfering Substances: Unconjugated bilirubin (20 mg/dL), ß-Nicotinamide adenine dinucleotide (100 µmol/L), Glutathione (3 mmol/L), Human Serum Albumin (30 mg/mL), Ascorbate (6 mg/dL), D-glucose (1000 mg/dL), D-mannose (100 mg/dL), D-fructose (18 mg/dL), Ampicillin (152 µmol/L), and Lithium heparin (0.375 mg/ml), and Hematocrit levels from 30% to 66% (102-230 g/L Hemoglobin) were found not to interfere. |
  | Screening Performance vs. Predicate (95th percentile) | Overall percent agreement = 96.0%
  Positive percent agreement = 63.6%
  Negative percent agreement = 97.9% |
  | Screening Performance vs. Predicate (99th percentile) | Overall percent agreement = 98.8%
  Positive percent agreement = 53.3%
  Negative percent agreement = 99.4% |

2. Sample Size Used for the Test Set and Data Provenance

• Sample Size for Precision Study: 7 samples, with 216 total measurements per sample (4 replicates per sample, in 27 runs over 21 days using 3 kit lots and 3 GSP instruments).
• Sample Size for LoD: 216 determinations of 4 low-level samples.
• Sample Size for LoB: 150 blank samples.
• Sample Size for Recovery: 3 contrived dried blood spot samples.
• Sample Size for Interference Studies: Not explicitly stated for each concentration, but involved various concentrations of interfering substances at three total galactose concentrations (5, 10, and 15 mg/dL).
• Sample Size for Internal Method Comparison: 141 routine screening and spiked blood spot specimens.
• Sample Size for Screening Performance Study: 2320 samples (6 confirmed positive samples and 2314 routine samples).
• Data Provenance: The screening performance study was conducted at "one newborn screening laboratory in the United States." Other non-clinical studies (precision, linearity, LoB/LoD/LoQ, recovery, interference) appear to be internal laboratory studies without specific geographic provenance mentioned, but presumably also conducted in the US or Finland (Wallac Oy headquarters). The studies were retrospective, using banked samples and contrived samples.

3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts

The document does not mention the use of experts to establish ground truth for the test set. For the screening performance study, "6 confirmed positive samples" are mentioned, implying prior clinical diagnosis as the ground truth. The qualifications of who confirmed these positive cases or how the "routine samples" were classified as normal are not specified.

4. Adjudication Method for the Test Set

Not applicable. The document does not describe any expert adjudication process for the test set. Ground truth for confirmed positive samples likely came from clinical diagnosis.

5. If a Multi Reader Multi Case (MRMC) Comparative Effectiveness Study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

Not applicable. This device is an in-vitro diagnostic test kit (laboratory assay) for quantitative determination, not an imaging device or AI-assisted diagnostic tool that would involve human readers interpreting results in a MRMC study.

6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done

This refers to the performance of the assay itself. The entire submission details the standalone performance of the GSP Neonatal Total Galactose kit (assay only) without human-in-the-loop interpretation beyond standard laboratory procedures and reporting. The "GSP® instrument" is automated, as stated in the comparison chart ("GSP instrument, automated").

7. The Type of Ground Truth Used

• For Analytical Performance (Precision, LoB, LoD, LoQ, Linearity, Recovery, Interference): Ground truth was established by preparing samples with known concentrations of total galactose or specific interfering substances. For example, for recovery, the "recovery of galactose, galactose-1-phosphate, and both combined was determined from three contrived dried blood spot samples," meaning these samples were prepared with known amounts.
• For Screening Performance Study: The ground truth for the 6 positive samples was "confirmed positive." This implies a clinical diagnosis of galactosemia, likely through follow-up diagnostic testing. The other 2314 samples are referred to as "routine samples" and classified as "normal" in the context of screening performance, likely based on either their negative predicate device result or their actual clinical status. The document also compares the new device's results against the predicate device's results as a reference for "Manual result."

8. The Sample Size for the Training Set

Not applicable in the conventional sense of machine learning training sets. This is a chemical assay, not an AI/ML device that requires a distinct training set for model development. The development and optimization of the assay would involve various experiments, but these are not referred to as "training sets" in this context.

9. How the Ground Truth for the Training Set Was Established

Not applicable, as there is no "training set" in the context of an AI/ML model for this chemical assay. The development of the calibrators and controls (which are prepared with known concentrations of galactose and galactose-1-phosphate) serves an analogous function in ensuring accuracy and consistency of the assay.

Ask a specific question about this device

The GSP Neonatal Biotinidase kit is intended for the quantitative in vitro determination of human biotinidase activity in blood specimens dried on filter paper as an aid in screening newborns for biotinidase deficiency using the GSP instrument.

The GSP Neonatal Biotinidase kit contains sufficient reagents to perform 1152 assays. The GSP Neonatal Biotinidase test system measures biotinidase activity, combining an enzyme reaction with a solid phase time-resolved immunofluorescence assay. The GSP Neonatal Biotinidase assay is based on the ability of the biotinidase enzyme to cleave the amide bond in Eu-labeled biotin. The enzyme reaction is stopped by addition of streptavidin which has high affinity for biotin (either Eu-labeled or free biotin). The streptavidin-biotin complexes are captured by the solid phase monoclonal antibody directed against streptavidin. DELFIA Inducer dissociates the molecules into the solution where the europium fluorescence is measured. The measured fluorescence is inversely proportional to the biotinidase activity of the sample.

Here's a breakdown of the acceptance criteria and the study that proves the device meets them, based on the provided text:

Acceptance Criteria and Device Performance

Study Details

1. Sample size used for the test set and the data provenance:

   • Clinical Study Test Set: 2008 specimens (1988 routine newborn screening specimens and 20 retrospective confirmed biotinidase deficiency specimens).
   • Provenance: This information is not explicitly stated, but it can be inferred that these are human blood specimens from newborn screening programs. The "retrospective confirmed biotinidase deficiency specimens" suggest historical data, implying a retrospective study design for these specific samples. The routine screening specimens would be prospective in nature from a screening program. No specific country of origin is mentioned.

2. Number of experts used to establish the ground truth for the test set and the qualifications of those experts:

   • The document does not explicitly state the number of experts or their qualifications for establishing the ground truth.
   • For the "retrospective confirmed biotinidase deficiency specimens," the ground truth is implied to be established through confirmation methods for biotinidase deficiency, but no details on expert involvement are provided.

3. Adjudication method (e.g. 2+1, 3+1, none) for the test set:

   • The document does not describe any specific adjudication method for establishing the ground truth of the clinical test set. The term "confirmed biotinidase deficiency specimens" implies that a definitive diagnosis was reached, but the process is not detailed.
   • For the one discrepant clinical case, it was subjected to "multiple (4) repeat tests." This could be considered a form of internal adjudication/re-testing rather than external expert consensus.

4. If a multi-reader multi-case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:

   • No MRMC or human-in-the-loop study was conducted or described. This device is an in vitro diagnostic kit, meaning it is an automated assay, not an AI assisting human readers. The comparison is between the new automated device and a predicate manual method.

5. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done:

   • Yes, the core of the clinical study involved evaluating the performance of the GSP Neonatal Biotinidase kit (an automated instrument-based assay) as a standalone device in comparison to the existing manual predicate device. The results are reported as direct comparisons between the two methods on the same samples.

6. The type of ground truth used (expert consensus, pathology, outcomes data, etc.):

   • The ground truth for the clinical study was based on the classification of specimens as "biotinidase deficient" or "normal." For the 20 known deficient specimens, the ground truth was "retrospective confirmed biotinidase deficiency." For the routine screening specimens, it is implied that the predicate device's result (manual Neonatal Biotinidase method) served as a comparative reference, which itself would have a ground truth based on established clinical diagnostic criteria for biotinidase deficiency. The cut-offs used for both devices (0.5th percentile for GSP and 30% of mean + 2SD for the predicate) are tied to population distributions expected for the condition.

7. The sample size for the training set:

   • The document describes the GSP Neonatal Biotinidase kit as a diagnostic assay, and its development would typically involve internal validation and optimization data. The provided text, being a 510(k) summary, primarily focuses on the test set performance to demonstrate substantial equivalence.
   • There is no explicit mention of a separate "training set" in the context of machine learning or AI models, as this is an in vitro diagnostic kit based on an enzymatic reaction. The calibrators and controls used in the kit are standardized and prepared from human whole blood, aiding in the assay's calibration and ongoing quality control during operation.

8. How the ground truth for the training set was established:

   • Not applicable in the context of a "training set" for a traditional in vitro diagnostic assay.
   • For the calibrators, they were "calibrated against in-house primary calibrators (dried blood spots, stored at -80 to -60°C) prepared using adult human blood (endogenous biotinidase activity in serum) and washed red blood cells as blood matrices." This describes how the reference values for the assay's internal calibration curve are established.

Ask a specific question about this device

The AutoDELFIA Neonatal IRT kit is intended for the quantitative determination of human immunoreactive trypsin(ogen) (IRT) in blood specimens dried on filter paper as an aid in screening newborns for cystic fibrosis using the 1235 AutoDELFIA® automatic immunoassay system.

The AutoDELFIA Neonatal IRT assay is a solid phase, two-site fluoroimmunometric assay based on the direct sandwich technique in which two monoclonal antibodies (derived from mice) are directed against two separate antigenic determinants on the IRT molecule. Calibrators, controls and test specimens containing IRT are reacted simultaneously with immobilized monoclonal antibodies directed against a specific antigenic site on the IRT molecule and europium-labeled monoclonal antibodies (directed against a different antigenic site) in assay buffer. The assay buffer elutes IRT from the dried blood on filter paper disks. The complete assay requires only one incubation step. Enhancement Solution dissociates europium ions from the labeled antibody into solution where they form highly fluorescent chelates with components of the Enhancement Solution. The fluorescence in each well is then measured. The fluorescence of each sample is proportional to the concentration of IRT in the sample.

The provided text describes a 510(k) premarket notification for the AutoDELFIA Neonatal IRT kit. This submission focuses on demonstrating substantial equivalence to a predicate device, rather than providing a detailed study report with specific acceptance criteria and performance data in the format typically used for AI/ML device evaluations. As such, many of the requested fields for AI/ML device studies are not directly applicable or explicitly stated in this document.

However, I can extract information related to the device's analytical performance characteristics, which serve as a form of acceptance criteria for this type of in-vitro diagnostic device.

Here's an attempt to populate the table and answer the questions based on the provided text, indicating where information is not available.

1. Table of Acceptance Criteria and the Reported Device Performance

For this in-vitro diagnostic device, "acceptance criteria" are generally established by demonstrating performance characteristics that are comparable to or better than a legally marketed predicate device, and that meet the required analytical performance for its intended use.

Ask a specific question about this device

The GSP Neonatal Thyroxine (T4) kit is intended for the quantitative determination of human thyroxine (T4) in blood specimens dried on filter paper as an aid in screening newborns for congenital (neonatal) hypothyroidism using the GSP instrument.

The GSP Neonatal T4 assay is a solid phase time-resolved fluoroimmunoassay based on the competitive reaction between europium-labeled T4 and sample T4 for a limited amount of binding sites on T4 specific monoclonal antibodies (derived from mice). The use of 8-anilino-1-naphthalenesulfonic acid (ANS) and salicylate in the T4 Assay Buffer facilitates the release of T4 from the binding proteins. Thus the assay measures the total amount of T4 in the test specimen. A second antibody, directed against mouse IgG, is coated to the solid phase, and binds the IgG-thyroxine complex, giving convenient separation of the antibody-bound and free antigen. DELFIA Inducer dissociates europium ions from the labeled antibody into solution where they form highly fluorescent chelates with components of DELFIA Inducer. The fluorescence in each well is then measured. The fluorescence of each sample is inversely proportional to the concentration of T4 in the sample.

The provided text describes a 510(k) premarket notification for an in vitro diagnostic device, the GSP Neonatal Thyroxine (T4) kit. This type of submission focuses on demonstrating substantial equivalence to a legally marketed predicate device rather than conducting a full clinical study with specific acceptance criteria and ground truth for disease diagnosis in the same way an AI/ML powered device might.

Therefore, the requested information regarding "acceptance criteria" for an AI device, "sample size for the test set," "number of experts," "adjudication method," "MRMC study," "standalone performance," and "ground truth for training/testing" in the context of an AI/ML study does not directly apply to this submission.

However, I can extract the closest analogous information available within this document, focusing on the performance characteristics presented to demonstrate equivalence.

Here's an attempt to answer the questions based on the provided document, interpreting "acceptance criteria" as performance metrics for this diagnostic kit.

1. Table of Acceptance Criteria and Reported Device Performance

For an in-vitro diagnostic kit like this, "acceptance criteria" are typically defined by demonstrating that the new device performs comparably to or within acceptable ranges relative to a predicate device and established analytical performance specifications. The document provides a comparison of various features and performance characteristics between the new GSP Neonatal T4 kit and its predicate device, AutoDELFIA Neonatal T4 Kit.

• Intra-assay variation 14.9 %
• Inter-assay variation 10.0 %
• Total variation 18.0 %
  Control 2; 8.08 µg/dL serum
• Intra-assay variation 10.6 %
• Inter-assay variation 7.1 %
• Total variation 12.7 %
  Control 3; 18.2 µg/dL serum
• Intra-assay variation 8.2%
• Inter-assay variation 4.3%
• Total variation 9.3 % | Sample 1; 2.0 µg/dL
• Within run 1.0%
• Within lot 15.5%
• Total variation 15.8%
  Sample 2; 4.8 µg/dL
• Within run 7.3%
• Within lot 10.7%
• Total variation 11.4%
  Sample 3; 7.5 µg/dL
• Within run 6.5%
• Within lot 8.4%
• Total variation 8.6%
  Sample 4; 16.6 µg/dL
• Within run 4.5%
• Within lot 7.8%
• Total variation 8.5%
  Sample 5; 19.8 µg/dL
• Within run 7.2%
• Within lot 9.9%
• Total variation 10.3%
  Sample 6; 21.4 µg/dL
• Within run 7.1%
• Within lot 9.8%
• Total variation 10.1% |
  | Measuring Range | 1.5 µg/dL to the highest level calibrator | 1.6 to 30 µg/dL serum |
  | Limit of Blank (LoB) |

Ask a specific question about this device

The GSP Neonatal IRT kit is intended for the quantitative determination of IRT in blood specimens dried on filter paper as an aid in screening newborns for cystic fibrosis using the GSP® instrument.

The GSP Neonatal IRT assay is a solid phase, two-site fluoroimmunometric assay based on the direct sandwich technique in which two monoclonal antibodies (derived from mice) are directed against two separate antigenic determinants on the IRT molecule. Calibrators, controls or test specimens containing IRT are reacted simultaneously with immobilized monoclonal antibodies directed against a specific antigenic site on the IRT molecule and europium-labeled monoclonal antibodies (directed against a different antigenic site) in assay buffer. The assay buffer elutes IRT from dried blood on filter paper disks. The complete assay requires only one incubation step. DELFIA Inducer dissociates europium ions from the labeled antibody into solution where they form highly fluorescent chelates with components of the DELFIA Inducer. The fluorescence in each well is then measured. The fluorescence of each sample is proportional to the concentration of IRT in the sample.

The provided text describes the GSP Neonatal IRT kit, a device for screening newborns for cystic fibrosis. It compares the new device to a predicate device (AutoDELFIA Neonatal IRT kit) and presents information on its performance characteristics.

Here’s a breakdown of the acceptance criteria and study information:

1. Table of Acceptance Criteria and Reported Device Performance

Ask a specific question about this device

The GSP Neonatal 17α-OH-progesterone kit is intended for the quantitative determination of human 17α-OH-progesterone in blood specimens dried on filter paper as an aid in screening newborns for congenital adrenal hyperplasia (CAH) using the GSP™ instrument.

The GSP Neonatal 17x-OH-progesterone (17-OHP) assay is a solid phase, time-resolved fluoroimmunoassay based on the competitive reaction between europium-labeled 17-OHP and sample 17-OHP for a limited amount of binding sites on 17-OHP specific polyclonal antibodies (derived from rabbit). Danazol facilitates the release of 17-OHP from the binding proteins. A second antibody, directed against rabbit IgG, is coated to the solid phase, giving convenient separation of the antibody-bound and free antigen. DELFIA Inducer dissociates europium ions from the labeled antigen into solution where they form highly fluorescent chelates with components of DELFIA Inducer. The fluorescence in each well is then measured. The fluorescence of each sample is inversely proportional to the concentration of 17-OHP in the sample.

The provided text describes the GSP Neonatal 17α-OH-progesterone kit and its comparison to a predicate device, the AutoDELFIA Neonatal 17α-OH-progesterone kit. The primary study presented focuses on the "Screening Efficacy" of the new GSP kit by comparing its results to those of the predicate device using various percentile cut-offs.

Here's an analysis of the acceptance criteria and study information:

1. Table of Acceptance Criteria and Reported Device Performance

The document does not explicitly state formal "acceptance criteria" in a quantitative manner (e.g., "The device must achieve X% accuracy"). Instead, it demonstrates performance by comparing the new device (GSP kit) to the legally marketed predicate device (AutoDELFIA kit) and showing high agreement.

The screening efficacy tables (Tables 1-9) implicitly demonstrate the device's acceptable performance based on its agreement with the predicate device. For the purpose of this analysis, we will consider the "Overall percent agreement" with the predicate device as the key performance metric presented.

Ask a specific question about this device

The AutoDELFIA® Neonatal 17a-OH-progesterone kit is intended for the quantitative determination of human 17a-OH-progesterone in blood specimens dried on filter paper as an aid in screening newborns for congenital adrenal hyperplasia (CAH) using the 1235 AutoDELFIA® automatic immunoassay system.

The AutoDELFIA Neonatal 17α-OH-progesterone (17-OHP) assay is a solid phase, time-resolved fluoroimmunoassay based on the competitive reaction between europium-labeled 17-OHP and sample 17-OHP for a limited amount of binding sites on 17-OHP specific polyclonal antibodies (derived from rabbit). Danazol facilitates the release of 17-OHP from the binding proteins. A second antibody, directed against rabbit IgG, is coated to the solid phase, giving convenient separation of the antibody-bound and free antigen. Enhancement Solution dissociates europium ions from the labeled antigen into solution where they form highly fluorescent chelates with components of the Enhancement Solution. The fluorescence in each well is then measured. The fluorescence of each sample is inversely proportional to the concentration of 17-OHP in the sample.

Here's a summary of the acceptance criteria and the study that proves the device meets them, based on the provided text:

Device: AutoDELFIA® Neonatal 17α-OH-progesterone kit (B024)
Intended Use: Quantitative determination of human 17α-OH-progesterone in blood specimens dried on filter paper as an aid in screening newborns for congenital adrenal hyperplasia (CAH) using the 1235 AutoDELFIA® automatic immunoassay system.

1. Table of Acceptance Criteria and Reported Device Performance

The document describes the proposed device (B024) as substantially equivalent to a predicate device (K042425, B015) and highlights differences in performance characteristics. The acceptance criteria are implicitly defined by demonstrating similar or improved performance compared to the predicate device, especially regarding cross-reactivity and screening efficacy.

*In Study 1,

Ask a specific question about this device