Search Results
Found 471 results
510(k) Data Aggregation
(329 days)
Roche Diagnostics
Immunoassay for the in vitro quantitative determination of cortisol in human urine. The determination of cortisol is used for the recognition and treatment of functional disorders of the adrenal gland.
The electrochemiluminescence immunoassay "ECLIA" is intended for use on cobas e immunoassay analyzers.
The Elecsys Cortisol III immunoassay employs a competitive test principle using a cortisol-specific biotinylated monoclonal antibody and a cortisol-derivative labeled with a ruthenium complex. The Elecsys Cortisol III immunoassay is intended for the in vitro quantitative determination of cortisol in human urine. The determination of cortisol is used for the recognition and treatment of functional disorders of the adrenal gland on the cobas e immunoassay analyzers.
Results are determined via a calibration curve which is instrument-specifically generated by a two-point calibration and a master curve provided via the cobas link.
The Elecsys Cortisol III immunoassay reagent Rack Pack comprises the following:
M Streptavidin-coated microparticles (transparent cap), 1 bottle, 12.4 mL:
Streptavidin-coated microparticles 0.72 mg/mL; preservative.
R1 Anti-cortisol-Ab~biotin (gray cap), 1 bottle, 21.0 mL:
Biotinylated monoclonal anti-cortisol antibody (mouse) 18 ng/mL; danazol 20 μg/mL; MES buffer 100 mmol/L, pH 6.0; preservative.
R2 Cortisol-peptide~Ru(bpy) (black cap), 1 bottle, 21.0 mL:
Cortisol derivative (synthetic), labeled with ruthenium complex, 5 ng/mL; danazol 20 μg/mL; MES buffer 100 mmol/L, pH 6.0; preservative.
MES = 2-morpholino-ethane sulfonic acid
The provided 510(k) summary for the Elecsys Cortisol III device focuses primarily on non-clinical performance evaluations to demonstrate substantial equivalence to a predicate device. It does not describe a study to prove performance against specific acceptance criteria for diagnostic accuracy (e.g., sensitivity, specificity, or agreement with ground truth in a clinical context) with a test set of patient samples.
Here's an analysis of the available information:
1. Acceptance Criteria and Reported Device Performance
The document does not explicitly state "acceptance criteria" in the traditional sense for diagnostic performance metrics like sensitivity, specificity, or agreement against a clinical ground truth. Instead, it details performance specifications for various analytical aspects and states that these "met the predefined acceptance criteria." These are primarily related to the analytical performance of the assay itself.
Category | Acceptance Criteria (Not explicitly stated as clinical performance criteria, but implied as met from the document) | Reported Device Performance (Summary of findings) |
---|---|---|
Precision | Predefined acceptance criteria met. | Repeatability (cobas e 801 analyzer): CV ranges from 2.0% to 2.7% for human urine samples and controls. |
Intermediate Precision (cobas e 801 analyzer): CV ranges from 2.5% to 3.8% for human urine samples and controls. | ||
Reproducibility: Lot-to-lot reproducibility met predefined acceptance criteria. | ||
Analytical Sensitivity (LoB, LoD, LoQ) | Predefined acceptance criteria met. | LoB: 4.00 nmol/L (0.145 µg/dL) |
LoD: 7.50 nmol/L (0.272 µg/dL) | ||
LoQ: 10.0 nmol/L (0.363 µg/dL) | ||
Linearity/Assay Reportable Range | Predefined acceptance criteria met. | Reportable Range: 20.0 - 500 nmol/L (0.725 - 18.1 µg/dL) |
Human Anti-Mouse Antibodies (HAMA) | Predefined acceptance criteria met. | Differentiation between HAMA-negative and HAMA-positive samples assessed; data met acceptance criteria. |
Endogenous Interferences | No significant interference. | No significant interference observed for 13 endogenous substances (e.g., bilirubin, hemoglobin, intralipid, biotin, rheumatoid factor, various immunoglobulins, albumin, creatinine, glucose, NaCl, urea) up to the tested concentrations. |
Analytical Specificity/Cross-Reactivity | Expected cross-reactivity profiles. | Cross-reactivity % reported for various related steroids, with 11-Deoxycortisol (24.3%) and Allotetrahydrocortisol (11.3%) showing the highest cross-reactivity at the tested concentration. Many common steroids showed "n.d." (not detected) or very low cross-reactivity. |
Exogenous Interferences – Drugs | No interference with the assay at therapeutic concentrations for most drugs. | No interference found for 12 commonly used pharmaceuticals. Prednisolone and hydrocortisone caused elevated cortisol concentrations. No interference observed for 6 methylprednisolone ≤ 0.157 mg/dL. Additional special drugs tested (amlodipine, betamethasone, beclomethasone, etc.) showed no interference. |
Method Comparison | Predefined acceptance criteria met. | Data analyzed according to CLSI EP09-A3 and met all predefined acceptance criteria when compared to the predicate device (ARCHITECT Cortisol) using native 24-hour urine samples spanning the measuring range. |
Stability | Predefined acceptance criteria met. | Supports claims for unopened reagents at 2-8 °C up to the stated expiration date and 16 weeks on the analyzer. |
Reference Range | Established reference range for healthy population. | 2.5th percentile: 24.8 nmol/24h (8.98 µg/24h) |
97.5th percentile: 238 nmol/24h (86.2 µg/24h) for a healthy US population. |
2. Sample Size and Data Provenance for Test Set
- Precision (Repeatability & Intermediate Precision): Human urine samples (24-hour urine) and controls. Two replicates per run, two runs per day for 21 days for each of 4 human urine samples and 2 controls. (Total of $4 \text{ samples} \times 2 \text{ replicates/run} \times 2 \text{ runs/day} \times 21 \text{ days} = 336$ measurements for human urine, plus $2 \text{ controls} \times 2 \text{ replicates/run} \times 2 \text{ runs/day} \times 21 \text{ days} = 168$ measurements for controls. Or potentially 42 total runs for each sample/control).
- Analytical Sensitivity (LoB, LoD, LoQ): Not specified beyond "reagents and calibrators" likely being used.
- Linearity/Assay Reportable Range: Dilution series contained a minimum of 9 concentrations. Number of samples not explicitly stated but implies a set of samples specifically created to span the measuring range.
- HAMA: Not specified.
- Endogenous Interferences: Human urine samples (24-hour urine) were used. The number of samples is not explicitly stated.
- Analytical Specificity/Cross-Reactivity: Human urine (24-hour urine) samples. Specific numbers not provided beyond "samples were measured in the presence and absence of the potential cross-reactants."
- Exogenous Interferences – Drugs: In vitro tests performed on 12 commonly used pharmaceuticals and additional special drugs. This implies spiked samples rather than a "test set" of patient samples.
- Method Comparison: "Native 24 h urine samples" for comparison with the predicate device. The number of samples is not specified.
- Reference Range Study: Samples collected from an "apparently healthy population in the United States" across three study sites. The exact number of samples is not provided, but it's sufficient for establishing 2.5th and 97.5th percentiles (typically requires 120+ samples according to CLSI EP28-A3c).
Data Provenance: The document explicitly states "human urine samples (24-hour urine)" for most studies and for the reference range, "collected across three study sites... in the United States." This indicates prospective collection for the reference range study specifically for generating normal values applicable to the US population. For other analytical performance claims, the sample type (human urine) is generally mentioned, suggesting a similar provenance, likely for prospective testing within the manufacturer's lab or clinical sites.
3. Number of Experts and Qualifications for Ground Truth
Not applicable for the Elecsys Cortisol III. This is an in vitro diagnostic device (IVD) that quantitatively measures a biomarker (cortisol). The "ground truth" for such devices is typically established through recognized analytical standards, reference methods, and comparison to a legally marketed predicate device, rather than expert consensus on diagnostic images or clinical assessments. The closest to "ground truth" in this context would be the accuracy against a gold standard analytical method or purified cortisol standards. These details are not provided but are implicit in the validation that relies on CLSI guidelines.
4. Adjudication Method for the Test Set
Not applicable. As this is a quantitative IVD for a biomarker, diagnostic classification and adjudication by experts are not relevant to the described analytical studies. The performance is assessed by comparison to expected analytical results or a predicate device.
5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study
Not applicable. MRMC studies are typically for imaging devices or software that assist human readers in making a diagnosis. The Elecsys Cortisol III is an automated in vitro diagnostic immunoassay for quantitative measurement of cortisol in urine. It does not involve human readers interpreting cases with or without AI assistance.
6. Standalone Performance Study
Yes, the entire submission describes standalone performance. The Elecsys Cortisol III is an immunoassay designed to operate on cobas e immunoassay analyzers. All the performance data (precision, sensitivity, linearity, interference, cross-reactivity, method comparison) are generated directly from the device's measurement of cortisol in urine samples. The device itself performs the quantitative determination without human-in-the-loop interpretation impacting the measurement results. The method comparison study directly compares its quantitative output to the predicate device's quantitative output.
7. Type of Ground Truth Used
For an IVD like Elecsys Cortisol III, the "ground truth" for the test set is established by:
- Reference standards/Calibrators: For analytical sensitivity (LoB, LoD, LoQ) and linearity studies, known concentrations of cortisol (or materials traceable to them) are used.
- Predicate device comparison: For method comparison, the results from the Elecsys Cortisol III are compared to those obtained from the legally marketed ARCHITECT Cortisol (K062204), which serves as the established "truth" or benchmark for demonstrating substantial equivalence.
- Spiked samples/characterized samples: For interference and cross-reactivity studies, samples with known concentrations of interferents or cross-reactants are used to determine the device's accuracy in their presence.
- Clinically characterized healthy population samples: For the reference range study, samples from healthy individuals are used to establish normal ranges, though this isn't a "ground truth" for diagnostic accuracy.
8. Sample Size for the Training Set
The document does not mention "training set" in the context of an AI/ML algorithm. This device is an immunoassay, which relies on chemical reactions and optical detection, not an AI/ML model that requires a training set. The term "training set" is therefore not applicable here.
9. How the Ground Truth for the Training Set Was Established
Not applicable. As noted above, there is no AI/ML training set for this immunoassay device.
Ask a specific question about this device
(89 days)
Roche Diagnostics
Elecsys Anti-SARS-CoV-2 is an immunoassay intended for the in vitro qualitative detection of total antibodies to Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) in human serum and Li-heparin, K2-EDTA and K3-EDTA plasma collected on or after 15 days post-symptom onset. The test is intended as an aid in identifying individuals with an adaptive immune response to SARS-CoV-2, indicating recent or prior infection.
The electrochemiluminescence immunoassay "ECLIA" is intended for use on cobas e 601 immunoassay analyzer.
Elecsys Anti-SARS-CoV-2 is a qualitative, serological, double-antigen sandwich principle immunoassay to be used on the cobas e 601 analyzer with an 18-minute test time. Results are determined automatically by the software by comparing the electrochemiluminescence signal obtained from the reaction product of the sample with the signal of the cutoff value previously obtained by calibration. The Elecsys Anti‑SARS‑CoV-2 assay uses a recombinant protein representing the nucleocapsid (N) antigen for the determination of antibodies against SARS‑CoV‑2.
The reagent working solutions include: rackpack (kit placed on the analyzer)
- M Streptavidin-coated microparticles (transparent cap), 1 bottle, 12 mL: Streptavidin-coated microparticles 0.72 mg/mL; preservative.
- R1 SARS-CoV-2-Ag~biotin, (gray cap), 1 bottle, 16 mL: Biotinylated SARS‑CoV‑2‑specific recombinant antigen (E. coli)
The provided FDA 510(k) clearance letter and summary describe the acceptance criteria and the study that proves the device, Elecsys Anti-SARS-CoV-2, meets those criteria.
Here's the breakdown of the requested information:
1. Table of Acceptance Criteria and Reported Device Performance
The document doesn't explicitly state "acceptance criteria" as clear numerical targets for PPA and NPA prior to presenting the results. However, implied acceptance criteria for qualitative serology tests typically involve a high percentage of agreement. Based on the reported performance, we can infer the acceptance criteria were met by these results.
Performance Metric | Implied Acceptance Criteria (High Agreement) | Reported Device Performance |
---|---|---|
Negative Percent Agreement (NPA) | High (e.g., >99%) | 99.81% (95% CI: 99.70%) |
Positive Percent Agreement (PPA) (Traditional Clinical Study) | High (e.g., >95%) | 98.82% (95% CI: 96.59% - 99.60%) |
PPA (Real-World Data) | High (e.g., >95%) | 96.49% (95% CI: 93.66% - 98.08%) |
Additional Non-Clinical Acceptance Criteria (Met for all):
- Precision: Standard Deviation (SD) and Coefficient of Variance (CV) values within predetermined limits for repeatability, between-run, between-day, between-lot, and between-site precision.
- Hook Effect: No hook effect observed.
- Potential Interference (Endogenous Substances): Biotin tolerance $\le$ 1200 ng/mL; no interference within specification for Intralipid, Bilirubin, Hemoglobin, Rheumatoid Factor, IgG, IgM, IgA, human serum albumin, ANA, cholesterol, and triglycerides.
- Analytical Cutoff Sensitivity: Cutoff of 1.00 COI corresponds to 1.137 BAU/mL (demonstrated alignment with international standard).
- Analytical Specificity- Potential Cross-Reactivity: False positive rate for cross-reacting antibodies within acceptable limits (2 false positives out of 7 MERS-CoV glycoprotein samples observed, overall 1836 samples tested).
- Exogenous Interference: Results within specification for 17 common drugs and 18 special drugs (with the exception of Ritonavir, which was within specification at 1x daily dose).
- Matrix Comparison: Matrix equivalency demonstrated for serum, Li-Heparin, K2-EDTA, K3-EDTA plasma, and separation gel tubes.
- Reagent, Calibrator, and Control Stability: Met stated storage times and conditions (e.g., 28 days on-board reagent, 10 hours on-board PreciControl, 30 days refrigerator after first opening, 28 days after first opening for PreciControl, 25 days lot calibration stability, 7 days on-board calibration stability).
- Specimen Stability: Met stated storage times and conditions (e.g., 7 days at 15-25°C, 14 days at 2-8°C, 28 days at -20°C, 3 freeze-thaw cycles).
- Fresh/Frozen Study: All results within specification for fresh vs. frozen samples.
2. Sample Sizes Used for the Test Set and the Data Provenance
- Negative Percent Agreement (NPA):
- Sample Size: 9007 pre-pandemic specimens.
- Data Provenance: Not explicitly stated (e.g., country of origin), but implicitly "pre-pandemic" suggests samples collected before December 2019. This is retrospective data.
- Positive Percent Agreement (PPA) - Traditional Clinical Study:
- Sample Size: 254 specimens collected $\ge$ 15 days post symptom onset (DPSO), excluding COVID-19 vaccinated individuals and immunocompromised subjects.
- Data Provenance: Not explicitly stated (e.g., country of origin), but described as collected under "routine laboratory conditions." This is retrospective or potentially a mix of retrospective and prospective, reflecting real clinical samples.
- PPA - Real-World Data:
- Sample Size: 285 samples from non-immunocompromised subjects who did not receive the COVID-19 vaccine, collected $\ge$ 15 DPSO.
- Data Provenance: Collaborating institution in the United States, collected from March 2020 – March 2021. This is retrospective data.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and the Qualifications of Those Experts
For this serology test, the ground truth is established through laboratory methods, not by human expert readers in the way an imaging AI would be adjudicated.
- NPA: Ground truth was "presumed to be negative for anti-SARS-CoV-2 antibodies" based on collection before December 2019, prior to the widespread circulation of SARS-CoV-2.
- PPA (Traditional Clinical Study): Ground truth was established by a composite comparator method comprised of 3 SARS-CoV-2 serology assays (including the predicate assay). Seropositivity was determined by majority rule ($\ge$ 2 out of 3). Additionally, these individuals had a history of SARS-CoV-2 infection confirmed by a prior FDA authorized RT-PCR test.
- PPA (Real-World Data): Ground truth was established by PCR as the comparator. Data was collected from electronic medical records and laboratory information systems.
Qualifications of Experts: Not applicable in the context of serology ground truth determination as it relies on other laboratory assays.
4. Adjudication Method (e.g., 2+1, 3+1, none) for the Test Set
- NPA: No adjudication method as samples were "presumed negative" based on collection date.
- PPA (Traditional Clinical Study): A form of "majority rule" for the composite comparator method was used: $\ge$ 2 out of 3 serology assays. This is akin to a 2/3 agreement rule, but applied to the reference method rather than human readers adjudicating an AI's output. The confirmatory RT-PCR also served as a strong initial ground truth.
- PPA (Real-World Data): PCR was the direct comparator, so no explicit adjudication method beyond the result of the PCR test itself.
5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done, If So, What Was the Effect Size of How Much Human Readers Improve with AI vs Without AI Assistance
This is a clinical laboratory immunoassay (serology test), not an AI software intended for medical image interpretation or human-in-the-loop assistance. Therefore, an MRMC comparative effectiveness study involving human readers and AI assistance is not applicable and was not performed.
6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) Was Done
The device itself is a standalone immunoassay system (Elecsys Anti-SARS-CoV-2 on the cobas e 601 analyzer) that provides a qualitative result (positive/negative) automatically. The entire clinical performance evaluation section describes the standalone performance of this device against established ground truths. Thus, a standalone performance evaluation was indeed done.
7. The Type of Ground Truth Used (expert consensus, pathology, outcomes data, etc.)
- NPA: Pre-pandemic sample collection date (before December 2019), implying presumed negative status. This serves as a strong epidemiological ground truth for SARS-CoV-2 negativity.
- PPA (Traditional Clinical Study):
- Composite Comparator Method: Majority rule ($\ge$ 2 out of 3) of other FDA-de novo and EUA-authorized Anti-SARS-CoV-2 serology assays.
- Confirmatory RT-PCR: Individuals had a history of SARS-CoV-2 infection confirmed by a prior FDA authorized RT-PCR test.
- PPA (Real-World Data): FDA authorized RT-PCR test results from electronic medical records and laboratory information systems.
In summary, the ground truth primarily relies on a combination of other FDA-authorized laboratory tests (serology and RT-PCR) and epidemiological/temporal evidence.
8. The Sample Size for the Training Set
This document describes the validation of a serology immunoassay, not a machine learning or AI model. Therefore, there is no "training set" in the context of AI model development. The "training" for such an assay would typically involve analytical development and optimization of reagents and protocols, not a data-driven training set in the AI sense.
9. How the Ground Truth for the Training Set Was Established
As there is no AI training set described or applicable for this type of device, this question is not relevant to the provided information. The ground truth for performance evaluation was established as described in point 7.
Ask a specific question about this device
(261 days)
Roche Diagnostics
Immunoassays for the in vitro quantitative determination of the soluble fms like tyrosine kinase-1/placental growth factor (sFlt-1/PlGF) ratio in human serum.
The sFlt-1/PlGF ratio is indicated as an aid in the risk assessment of pregnant women, with a singleton pregnancy (23+0 to 34+6/7 weeks' gestation) hospitalized for hypertensive disorders of pregnancy (preeclampsia, chronic hypertension with or without superimposed preeclampsia, or gestational hypertension), to develop preeclampsia with severe features within two weeks from testing. The sFit-1/PlGF ratio should be used in conjunction with clinical assessment and routine laboratory testing.
The electrochemiluminescence immunoassay "ECLIA" is intended for use on cobas e immunoassay analyzers.
The Elecsys sFlt-1 and Elecsys PlGF assays employ a sandwich principle using electrochemiluminescence immunoassay "ECLIA" technology. The total duration of each assay is 18 minutes. Samples are incubated with biotinylated and ruthenium-labeled monoclonal antibodies specific to sFlt-1 or PlGF, forming a sandwich complex. Streptavidin-coated microparticles are added, binding the complex to the solid phase. The microparticles are magnetically captured, unbound substances are removed, and a voltage is applied to induce chemiluminescent emission, which is measured by a photomultiplier. Results are determined via a calibration curve generated by 2-point calibration and a master curve provided via the reagent barcode. The reagents for each assay are combined in a "rackpack".
Here's a breakdown of the acceptance criteria and study information for the Elecsys sFlt-1 and Elecsys PlGF assays, based on the provided document.
Acceptance Criteria and Device Performance
Acceptance Criteria Category | Specific Criteria | Reported Device Performance |
---|---|---|
Clinical Performance | Risk Assessment for Preeclampsia with Severe Features within two weeks from testing (Cutoff: >38): high Negative Predictive Value (NPV) and acceptable Positive Predictive Value (PPV) for pregnant women with singleton pregnancy (23+0 to 34+6/7 weeks' gestation) hospitalized for hypertensive disorders of pregnancy. | Overall Intended Use Population (N=556): |
- Sensitivity: 91.40% (95% CI: 86.41, 95.00)
- Specificity: 77.30% (95% CI: 72.68, 81.47)
- NPV (ratio ≤ 38): 94.70% (95% CI: 91.54, 96.94)
- PPV (ratio > 38): 66.93% (95% CI: 60.77, 72.68) |
| Non-Clinical Performance | Precision: Low coefficients of variation (CV) for repeatability (within-run) and intermediate precision (within-laboratory). | Elecsys PlGF (N=84 per sample type): - Repeatability CV: 1.0% - 5.7%
- Intermediate precision CV: 1.4% - 9.9%
Elecsys sFlt-1 (N=84 per sample type): - Repeatability CV: 0.9% - 2.4%
- Intermediate precision CV: 1.7% - 3.7%
Ratio (N=84 per sample type): - Repeatability CV: 1.1% - 4.9%
- Intermediate precision CV: 1.4% - 7.0% |
| | Linearity/Assay Reportable Range: Measurements are linear across the claimed measuring range. | - Elecsys sFlt-1: 80-85000 pg/mL (claimed range) - Elecsys PlGF: 10-5400 pg/mL (claimed range)
(Study concludes measurements are linear across these ranges) |
| | Limit of Blank (LoB): ≤ 2 pg/mL for PlGF and 26.4 mg/dL can cause up to 10% decrease in ratio. - Hemoglobin, Intralipid, Rheumatoid Factors, Biotin (up to 1200 ng/mL): No significant interference reported (implies within acceptable limits though quantitative data not listed).
- Common Drugs (15 tested): No interference.
- Additional Substances (13 tested): No interference.
- Heparin: Interference with Elecsys PlGF for concentrations > 500 U/L. |
| | Analytical Specificity/Cross-Reactivity: Highly specific for sFlt-1 and PlGF, with minimal cross-reactivity with related substances. | - sFlt-1 cross-reactivity:
Ask a specific question about this device
(268 days)
Roche Diagnostics Operations
The Tina-quant Lipoprotein (a) Gen.2 Molarity assay is an in vitro test for the quantitative determination of lipoprotein (a) [Lp(a]] in human serum and plasma on cobas c systems. The measurement of Lp(a) is useful in evaluating lipid metabolism disorders and assessing atherosclerotic cardiovascular disease risk, when used in conjunction with clinical evaluation and other lipoprotein tests.
The Tina-quant Lipoprotein (a) Gen.2 Molarity assay is an in vitro test for the quantitative determination of lipoprotein (a) [Lp(a)] in human serum and plasma on cobas c systems. The measurement of Lp(a) is useful in evaluating lipid metabolism disorders and assessing atherosclerotic cardiovascular disease risk, when used in conjunction with clinical evaluation and other lipoprotein tests.
Tina-quant Lipoprotein (a) Gen.2 Molarity assay quantifies lipoprotein (a) in human serum and plasma and reports the values in nmoVL with calibrator values traceable to the WHO/IFCC SRM2B reference material.
Reagents - working solutions
R1: Glycine buffer: 170 mmol/L. pH 7.0: stabilizers: BSA: rabbit serum 0.1 %, preservative
R3: Latex particles coated with polyclonal anti-human lipoprotein (a) antibodies (rabbit): 0.5 %; glycine buffer: 170 mmol/L, pH 7.3, BSA; preservative
Here's a breakdown of the acceptance criteria and study details for the Tina-quant Lipoprotein (a) Gen.2 Molarity assay, based on the provided document:
This device is an in vitro diagnostic (IVD) assay, not an AI/ML-driven device. Therefore, the concepts of human readers, multi-reader multi-case (MRMC) studies, ground truth establishment by experts for images, training sets, and adjudication methods are not directly applicable in the typical sense as they would be for an AI model that interprets medical images. The "acceptance criteria" here refer to the predefined performance specifications for an analytical assay.
Device Name: Tina-quant Lipoprotein (a) Gen.2 Molarity
1. Table of Acceptance Criteria and Reported Device Performance
The document states, "All acceptance criteria were met" for the non-clinical performance evaluation sections (Precision, Analytical Sensitivity, Linearity, Dilution, High Dose Hook Effect, Endogenous Interferences, Analytical Specificity/Cross-Reactivity, Sample Matrix Comparison, Method Comparison, and Stability). Specific pre-defined acceptance criteria are generally internal to the manufacturer's quality system and not explicitly listed in this 510(k) summary (which focuses on summarizing the results against those criteria). However, the reported device performance is provided, which demonstrates that the device met the manufacturer's internal criteria.
Performance Characteristic | Acceptance Criteria (Implied/General) | Reported Device Performance (as stated in document) |
---|---|---|
Precision (Repeatability) | Within pre-defined CV% limits | CV% between 0.4% and 2.1% (for various samples) |
Precision (Intermediate Precision) | Within pre-defined CV% limits | CV% between 0.7% and 2.6% (for various samples) |
Limit of Blank (LoB) | LoB should be ≤ 6 nmol/L | LoB = 6 nmol/L |
Limit of Detection (LoD) | LoD should be ≤ 7 nmol/L | LoD = 7 nmol/L |
Limit of Quantitation (LoQ) | LoQ should be ≤ 7 nmol/L | LoQ = 7 nmol/L |
Linearity/Assay Reportable Range | Linear within 7 – 240 nmol/L | Confirmed for the measuring range of 7 – 240 nmol/L |
Dilution | Accurate dilution of samples > measuring range (1:3 rerun function) | Confirmed, supporting 1:3 dilution for samples above measuring range |
High Dose Hook Effect | No false results up to a high concentration | Confirmed no false result up to 450 nmol/L |
Endogenous Interferences | No significant interference from tested substances (Icterus, Hemolysis, Lipemia, Rheumatoid factors) | All predefined acceptance criteria were met. Claims: Icterus up to I index 60, Hemolysis up to H index 1000, Lipemia up to L index 2000, Rheumatoid factors up to 1200 IU/mL. |
Analytical Specificity / Cross-Reactivity | No significant cross-reactivity from tested substances (Plasminogen, Apolipoprotein B) | No significant cross-reactivity in tested concentration ranges (Plasminogen up to 150 mg/dL, Apolipoprotein B up to 200 mg/dL). |
Exogenous Interferences | No significant interference from common drug panels | All predefined acceptance criteria were met for 15 listed drugs at specified concentrations. |
Sample Matrix Comparison | Acceptable performance across serum and different plasma types | All predefined acceptance criteria were met (Slope, Intercept, Correlation Coefficient for comparison of serum vs. serum with gel, Li-Heparin, K2-EDTA, K3-EDTA plasma). |
Method Comparison to Lp(a) ELISA reference method | Strong correlation with reference method | Sample size (n) = 126. Deming regression: y = 1.023x + 0.692 nmol/L, r = 0.992. Sample concentrations 8.70 - 234 nmol/L. |
Stability | Supports manufacturer's claims | Stability data supports Roche Diagnostic's claims as reported in the package labeling. |
2. Sample Sizes and Data Provenance
- Precision (Repeatability): n = 84 (number of individual measurements per sample level).
- Precision (Intermediate Precision): 2 aliquots per run, 2 runs per day, 21 days.
- LoB: One analyte-free sample measured with three reagent lots, 6 runs, 10-fold determination per run, distributed over >3 days.
- LoD: 5 serum samples with low analyte concentrations measured with three reagent lots, 2-fold determination per run, 6 runs distributed over 5 days.
- LoQ: 5 serum samples measured with three reagent lots, 5 runs distributed over 5 days.
- Linearity: 1 run using 3 reagent lots and 5 replicates per sample. A dilution series prepared from human serum (sample High) and NaCl 0.9% (sample Blank) to obtain 16 levels.
- Method Comparison (to Lp(a) ELISA): n = 126 native human serum samples.
- Sample Matrix Comparison: ≥ 50 samples.
- Reference Range Study:
- Caucasian/White: n = 425
- African-American/Black: n = 111
- Asian: n = 128
- Hispanic/Latino (among Caucasian/White): n = 110
- Non-Hispanic/Non-Latino (among Caucasian/White): n = 311
- Data Provenance for Reference Range Study: Samples from apparently healthy adults in the United States, with equal representation of males and females. This suggests prospective collection for the purpose of establishing reference ranges. Other studies (e.g., method comparison, precision) would typically use laboratory samples which could be retrospective or specifically prepared for the study. The document does not specify "retrospective" or "prospective" for all tests, but the nature of these analytical performance studies often involves controlled, prepared, or collected samples without a specific patient encounter context. The "native human serum samples" for method comparison generally implies biological samples.
3. Number of Experts and Qualifications for Ground Truth
For this in vitro diagnostic device, "ground truth" is established by reference methods or validated analytical measurements, not by human expert interpretation in the way it would be for an AI image analysis tool.
- Not Applicable in the traditional sense for AI/ML image analysis. The "ground truth" for analytical performance tests like precision, linearity, or interference is an established analytical value or the characteristic of the sample itself (e.g., known concentration, presence/absence of interfering substance). For "method comparison," the ground truth is provided by the designated "Lp(a) ELISA reference method."
4. Adjudication Method for the Test Set
- Not Applicable in the traditional sense for AI/ML image analysis. Adjudication is usually performed by multiple human experts reviewing a case. For an IVD, the "adjudication" is inherent in the rigorous analytical protocols, statistical methods (e.g., CLSI guidelines), and the use of reference methods or certified reference materials for traceability.
5. Multi Reader Multi Case (MRMC) Comparative Effectiveness Study
- Not Applicable. This is an in vitro diagnostic assay, not an AI-assisted diagnostic imaging system that would involve human readers interpreting cases.
6. Standalone (i.e. algorithm only without human-in-the loop performance) Performance
- Yes, implicitly. The performance studies (Precision, Analytical Sensitivity, Linearity, Interference, Method Comparison) evaluate the device (assay on the cobas c 503 analyzer) as a standalone system. There is no human intervention in the measurement or calculation of results once the sample is loaded. The device generates a quantitative value for Lp(a).
7. The Type of Ground Truth Used
- Reference Method/Analytical Standards:
- Precision, Sensitivity, Linearity, Interferences: Ground truth is based on known concentrations in control materials, spiked samples, or by using analyte-free samples, following standardized laboratory practices and CLSI guidelines (e.g., CLSI EP05-A3, EP17-A2, EP06-A-Ed2).
- Method Comparison: The "ground truth" or reference values were derived from the Lp(a) ELISA reference method.
- Traceability: The device's calibration values are traceable to the WHO/IFCC SRM2B reference material for nmol/L, indicating a standardized and accepted reference for accuracy.
8. The Sample Size for the Training Set
- Not applicable in the AI/ML sense. This is a traditional IVD assay, not an AI model that requires a "training set" to learn features. The assay is based on well-understood principles of immunoturbidimetry and does not involve machine learning training.
9. How the Ground Truth for the Training Set Was Established
- Not Applicable. As there is no AI/ML training set, this question is not relevant to this device. The assay's "knowledge" is built into its chemical reagents, optical detection system, and pre-programmed algorithms for calculating concentration from turbidity measurements, based on established analytical principles and calibration to reference materials.
Ask a specific question about this device
(266 days)
Roche Diagnostics
Binding assay for the in vitro quantitative determination of folate in erythrocytes (red blood cells, RBC). Folate measurements are used in the diagnosis and treatment of anemia. The electrochemiluminescence immunoassay "ECLIA" is intended for use on cobas e immunoassay analyzers.
Elecsys Folate III is a binding assay that makes use of a competitive test principle using a ruthenium labeled folate-binding assay.
Elecsys Folate III is a binding assay for the in vitro quantitative determination of folate in erythrocytes (red blood cells, RBC). Folate measurements are used in the diagnosis and treatment of anemia. The electrochemiluminescence immunoassay "ECLIA" is intended for use on cobas e immunoassay analyzers.
Whole blood treated with anticoagulants (heparin or EDTA) is mixed with ascorbic acid solution and incubated for approximately 90 minutes at 20-25 °C. Lysis of the erythrocytes takes place, with liberation and stabilization of the intracellular folate. The resulting hemolysate sample is then used for subsequent measurement.
Results are determined via a calibration curve, which is instrument-specifically generated by 2point calibration, and a master curve provided via the cobas link.
Here's a summary of the acceptance criteria and study details for the Elecsys Folate III device, based on the provided FDA 510(k) summary:
1. Table of Acceptance Criteria and Reported Device Performance
Performance Metric | Acceptance Criteria (Implied / Stated) | Reported Device Performance |
---|---|---|
Precision | "All predefined acceptance criteria was met for the precision experiments." (Specific numerical criteria not explicitly stated in this document but implied to be within acceptable limits as per CLSI guideline EP05-A3.) | Repeatability (within-run precision) & Intermediate Precision (within-laboratory precision) (cobas e 801 analyzer) |
Sample | Mean (ng/mL) | Repeatability SD (ng/mL) |
--------------- | -------------- | -------------------------- |
Hemolysate 1 | 152 | 5.73 |
Hemolysate 2 | 206 | 6.14 |
Hemolysate 3 | 252 | 6.70 |
Hemolysate 4 | 363 | 8.01 |
Hemolysate 5 | 605 | 10.7 |
Lot-to-lot Reproducibility: "All predefined acceptance criteria was met for the lot-to-lot reproducibility experiment." (Specific data not provided, but confirmed to meet criteria.) | ||
Analytical Sensitivity | Based on CLSI EP17-A2 guidelines for Limit of Blank (LoB), Limit of Detection (LoD), and Limit of Quantitation (LoQ). | LoB: 45 ng/mL |
LoD: 70 ng/mL | ||
LoQ: 120 ng/mL | ||
Linearity | Measurements across the claimed measuring range (120 - 620 ng/mL) must be linear as assessed per CLSI EP06-Ed2. | Linearity confirmed to support the measuring range of 120 - 620 ng/mL. |
Dilution | Data must support instruction for use for samples diluted 1:2. | Data supports instruction for use. |
Endogenous Interferences | "All predefined acceptance criteria were met" for various endogenous substances including Bilirubin, Intralipid, Biotin, Rheumatoid factors, IgG, IgA, IgM, at specified concentrations, confirming no significant interference. (Specific thresholds for non-interference not provided in text, but implied to be within acceptable limits). | No significant interference for: |
Bilirubin: ≤ 29 mg/dL | ||
Intralipid: ≤ 1500 mg/dL | ||
Biotin: ≤ 1200 ng/mL | ||
Rheumatoid factors: ≤ 1000 IU/mL | ||
IgG: ≤ 1.6 g/dL | ||
IgA: ≤ 0.4 g/dL | ||
IgM: ≤ 1 g/dL | ||
Analytical Specificity/Cross-Reactivity | Expected low cross-reactivity with specified compounds. (Specific thresholds for cross-reactivity not provided in text, but implied to be within acceptable limits). | Low cross-reactivity: |
Amethopterin: (750 ng/mL) 1.7% | ||
Aminopterin: (750 ng/mL) 2.0% | ||
Folinic acid: (750 ng/mL) 2.6% | ||
Exogenous Interferences | No interference from 17 commonly used pharmaceuticals and erythropoietin. (Specific thresholds for non-interference not provided in text, but implied to be within acceptable limits). | No interference found from 17 commonly and 1 specially used pharmaceutical (erythropoietin) compounds. |
Sample Matrix Comparison | Results within specification, supporting the use of hemolysate prepared from whole blood treated with Na-heparin or K3-EDTA. | Results were within specification and support the use of hemolysate prepared from whole blood and treated with Na-heparin or K3-EDTA. |
Method Comparison to Predicate | High correlation and agreement with the predicate device (Elecsys Folate RBC). | Number of samples: 119 (concentrations 132-618 ng/mL) |
Passing/Bablok: y = 1.04x - 14.6, τ = 0.913 | ||
Linear regression: y = 1.03x - 11.0, r = 0.991 | ||
Reagent Stability (On-board) | Reagent kits can be stored on-board for up to 16 weeks. | Tested on one cobas e 801 analyzer; Elecsys Folate III reagent kits can be stored on-board for up to 16 weeks. (Note: The product comparison table states "2 weeks" for predicate; this indicates an improvement for the candidate device.) |
Calibration Stability (Lot) | Calibration for a lot is recommended every 12 weeks; during this period, fresh kits of same lot can be used without re-calibration using the day 0 curve. | Tested on one cobas e 801 analyzer. Calibration of an Elecsys Folate III reagent lot is recommended every 12 weeks. |
Calibration Stability (On-board) | Reagent epacks can be stored on-board for up to 28 days without a new calibration. | Tested on one cobas e 801 analyzer. Elecsys Folate III epacks can be stored on board of the analyzers for up to 28 days without a new calibration. |
2. Sample Sizes and Data Provenance
- Precision (Repeatability & Intermediate Precision): Not explicitly stated, but typically involves multiple replicates over several days/runs with multiple instruments. Specific sample types are "Hemolysate 1" to "Hemolysate 5".
- Lot-to-lot Reproducibility: "three reagent lots" were used.
- Analytical Sensitivity (LoB, LoD, LoQ): Not explicitly stated, but determined according to CLSI EP17-A2, which involves specific numbers of blank and low-concentration samples.
- Linearity and Dilution: "At least seven concentrations using hemolysate samples" for linearity. Dilution study used "high concentration hemolysate samples".
- Endogenous Interferences: Not explicitly stated, but "various endogenous substances" were evaluated.
- Analytical Specificity/Cross-Reactivity: Not explicitly stated.
- Exogenous Interferences: "17 commonly and 1 specially used pharmaceutical" compounds.
- Sample Matrix Comparison: "Whole blood samples were drawn into Na-Heparin and K3-EDTA tubes." (Number not specified).
- Method Comparison to Predicate: 119 samples with concentrations between 132 and 618 ng/mL.
- Reagent Stability (On-board), Lot Calibration Stability, On-board Calibration Stability: Tested on "one cobas e 801 analyzer".
Data Provenance: The document states "NON-CLINICAL PERFORMANCE EVALUATION" and refers to CLSI (Clinical and Laboratory Standards Institute) guidelines, which are standard for in-vitro diagnostic device performance studies. The data is internal to Roche Diagnostics, a company with global operations. The specific country of origin for the studies is not stated, but given the submission is to the U.S. FDA, the studies are expected to meet international and U.S. regulatory standards. These are retrospective studies in the context of device development and validation.
3. Number of Experts and Qualifications for Ground Truth (Test Set)
This device is an in-vitro diagnostic (IVD) assay that produces quantitative measurements of folate. It does not involve human interpretation of images or other subjective data. Therefore, the "ground truth" for its performance is established by reference methods, calibrated standards, and accurate measurement principles, rather than human expert consensus. No human experts were used to establish ground truth in the way one would for an AI imaging device.
4. Adjudication Method (Test Set)
Not applicable, as this is an IVD device producing quantitative results, not an AI imaging device requiring expert adjudication.
5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study
Not applicable. This is an in-vitro diagnostic device, not an AI device assisting human readers with interpreting cases.
6. Standalone (Algorithm Only) Performance
Yes, the studies described are standalone performance evaluations of the Elecsys Folate III assay (the "algorithm" in a broad sense for an IVD) without human intervention in the measurement process. The device performs the quantitative determination of folate using its defined binding assay and electrochemiluminescence immunoassay (ECLIA) method.
7. Type of Ground Truth Used
The ground truth for evaluating the Elecsys Folate III's performance is established through:
- Reference materials/standards: For analytical sensitivity (LoB, LoD, LoQ) and linearity, where known concentrations are used.
- Performance against a predicate method: For method comparison, the results are compared to a previously cleared, established method (Elecsys Folate RBC).
- CLSI guidelines: Adherence to established scientific and statistical methodologies for validating assay performance, implying well-defined benchmarks for accuracy, precision, and interference.
8. Sample Size for the Training Set
Not explicitly stated. For an IVD like the Elecsys Folate III, a traditional "training set" as understood in machine learning is not directly applicable. The "training" for such a system would involve the development and optimization of the reagent formulations, assay parameters, and calibration curve algorithms, using various samples and experiments during the research and development phase. However, a specific training set size with corresponding ground truths is not documented in the same way as an AI algorithm.
9. How the Ground Truth for the Training Set was Established
As above, a formal "training set ground truth" isn't directly applicable in the machine learning sense. The "ground truth" during the development and optimization (analogous to training) would have been established through:
- Known concentrations: Using purified folate standards or spiked samples.
- Reference methods: Comparing early-stage assay performance against established, often more labor-intensive or gold-standard methods for folate determination.
- Clinical correlation: (Though "clinical testing" is marked Not Applicable for this 510(k), early development might involve correlation with clinical status or outcomes).
- Statistical optimization: Adjusting reagent ratios, incubation times, and instrument settings to achieve optimal analytical performance characteristics (sensitivity, specificity, precision, linearity) based on these known values and reference method comparisons.
Ask a specific question about this device
(816 days)
Roche Diagnostics
Ask a specific question about this device
(266 days)
Roche Diagnostics
Immunoassay for the in vitro quantitation of intact parathyroid hormone in human serum and plasma for the differential diagnosis of hypercalcemia and hypocalcemia. This assay can be used intraoperatively. The electrochemiluminescence immunoassay "ECLIA" is intended for use on cobas e immunoassay analyzers
Both the Elecsys PTH and Elecsys PTH STAT immunoassays make use of a sandwich test principle using a biotinylated monoclonal PTH-specific antibody labeled with a ruthenium complex. Both the Elecsys PTH and Elecsys PTH STAT immunoassays are intended for the in vitro quantitative determination of intact parathyroid hormone in human serum and plasma for the differential diagnosis of hypercalcemia and hypocalcemia. These assays can be used intraoperatively. They are intended for use on the cobas e immunoassay analyzers.
Results are determined via a calibration curve which is instrument-specifically generated by a two-point calibration and a master curve provided via the reagent barcode.
The reagent working solutions include: Rack Pack (kit placed on the analyzer)
- M Streptavidin coated microparticles (transparent cap), 1 bottle, 6.5 mL: Streptavidin . coated microparticles 0.72 mg/mL; preservative.
- . R1 Anti PTH Ab~biotin (gray cap), 1 bottle, 7 mL: Biotinylated monoclonal anti PTH antibody (mouse) 2.3 mg/L; phosphate buffer 100 mmol/L, pH 7.0; preservative.
- . R2 Anti PTH Ab~Ru(bpy) (black cap), 1 bottle, 7 mL: Monoclonal anti PTH antibody (mouse) labeled with ruthenium complex 2.0 mg/L; phosphate buffer 100 mmol/L, pH 7.0; preservative.
Unfortunately, the provided text does not describe a study involving an AI/Machine Learning powered medical device, nor does it contain information about typical acceptance criteria for such devices (e.g., sensitivity, specificity, AUC).
Instead, the document details a 510(k) premarket notification for Elecsys PTH and Elecsys PTH STAT, which are immunoassays for quantitative determination of intact parathyroid hormone. These are laboratory diagnostic tests, not AI-powered devices.
The document focuses on demonstrating substantial equivalence to a previously cleared predicate device (K070709) by:
- Comparing technological characteristics (Table 1 and Table 2).
- Providing non-clinical performance evaluations such as precision, analytical sensitivity (Limit of Blank, Limit of Detection, Limit of Quantitation), linearity, high dose hook effect, interference studies, and sample matrix comparison.
- Presenting a method comparison to the predicate devices.
- Reporting on stability and a reference range study.
Therefore, I cannot fulfill the request to describe the acceptance criteria and study that proves an AI device meets acceptance criteria based on this input. The information required for your questions (e.g., sample size for test set, data provenance, number of experts for ground truth, MRMC study, standalone performance, training set details) are specific to AI/ML device evaluations and are not present in this document about an immunoassay.
Ask a specific question about this device
(123 days)
Roche Diagnostics Operations
ONLINE TDM Methotrexate is an in vitro test for the quantitative determination of methotrexate in human serum and plasma on cobas c systems. The determination of methotrexate is used for monitoring levels of methotrexate to ensure appropriate therapy.
The ONLINE TDM Methotrexate assay is an in vitro test for the quantitative determination of methotrexate in human serum and plasma on cobas c systems. The determination of methotrexate is used for monitoring levels of methotrexate to ensure appropriate therapy.
The ONLINE TDM MTX assay is a two-reagent system used for the detection of methotrexate in serum and plasma. In this technology drug hapten attached to the enzyme glucose 6 phosphate dehydrogenase (G6PDH) serves as the binding partner to anti-methotrexate antibody. A competitive reaction to a limited amount of specific anti-methotrexate antibody takes place between the enzyme bound hapten and free methotrexate in the sample. Enzyme activity is reduced with bound antibody. Only active enzymes reduce NAD+ to NADH. The rate of NADH formation during the reaction correlates to the methotrexate concentration and is measured photometrically.
The ONLINE TDM MTX assay is a homogeneous enzyme-immunoassay.
Reagents - working solutions
R1: Anti-methotrexate antibody (rabbit monoclonal), 3 µg/mL; NAD, G6P, bovine serum albumin in water, pH 6.3; preservative
R3: Methotrexate hapten conjugated to G6PDH, 0.3 µg/mL; bovine serum albumin in buffer, pH 7.8; preservative
The provided document describes the analytical performance evaluation of the "ONLINE TDM Methotrexate" assay. This is an in vitro diagnostic device used for the quantitative determination of methotrexate in human serum and plasma. The study aims to demonstrate that the device meets predefined acceptance criteria.
Here's an analysis of the acceptance criteria and the study proving the device meets them:
1. Table of Acceptance Criteria & Reported Device Performance:
The document doesn't explicitly present a single table of "acceptance criteria" alongside "reported device performance" in a comparative format for all tests. Instead, it states for each section: "All acceptance criteria were met," and then provides the results. We can infer the acceptance criteria from the context and the reported successful outcomes.
Here is a reconstructed table based on the provided text, indicating the acceptance criteria (inferred from the "All acceptance criteria were met" statements and industry standards implicitly followed) and the reported performance.
Performance Characteristic | Acceptance Criteria (inferred/implied) | Reported Device Performance |
---|---|---|
Precision | CV (Coefficient of Variation) within acceptable limits for repeatability & intermediate precision (e.g., generally lower CVs for higher concentrations). | Repeatability: |
- Control 1 (0.0863 µmol/L): 4.4% CV
- Control 2 (0.485 µmol/L): 0.9% CV
- Control 3 (0.849 µmol/L): 0.7% CV
- Human Serum 1 (0.0872 µmol/L): 4.0% CV
- Human Serum 2 (0.526 µmol/L): 0.8% CV
- Human Serum 3 (0.889 µmol/L): 0.7% CV
- Human Serum 4 (4.85 µmol/L): 1.0% CV
- Human Serum 5 (44.2 µmol/L): 4.0% CV
- Human Serum 6 (449 µmol/L): 3.7% CV
- Human Serum 7 (1334 µmol/L): 3.1% CV
Intermediate Precision:
- Control 1 (0.0737 µmol/L): 10.9% CV
- Control 2 (0.487 µmol/L): 1.2% CV
- Control 3 (0.841 µmol/L): 0.8% CV
- Human Serum 1 (0.0752 µmol/L): 11.2% CV
- Human Serum 2 (0.526 µmol/L): 1.3% CV
- Human Serum 3 (0.889 µmol/L): 1.1% CV
- Human Serum 4 (4.91 µmol/L): 2.0% CV
- Human Serum 5 (44.2 µmol/L): 5.3% CV
- Human Serum 6 (449 µmol/L): 6.3% CV
- Human Serum 7 (1316 µmol/L): 5.1% CV
All stated to have met acceptance criteria. |
| Analytical Sensitivity | LoB, LoD, LoQ within predefined thresholds to ensure accurate measurement at low concentrations. | LoB: ≤ 0.0250 µmol/L (claim in labeling)
LoD:
Ask a specific question about this device
(458 days)
Roche Diagnostics
Immunoassay for the in vitro quantitative determination of thyroglobulin in human serum and plasma. Determination of Tg is used as an aid in monitoring for the presence of persistent or recurrent/metastatic disease in patients who have differentiated thyroid cancer (DTC) and have had thyroid surgery (with or without ablative therapy). The electrochemiluminescence immunoassay "ECLIA" is intended for use on cobas e immunoassay analyzers.
The Tg II immunoassay makes use of a two-step, double antigen sandwich principle using a biotinylated monoclonal Tg-specific antibody and monoclonal Tg-specific antibodies labeled with a ruthenium complex. The Tg II immunoassay is intended for the in vitro quantitative determination of thyroglobulin in human serum and plasma. Determination of Tg is used to aid in monitoring for the presence of persistent or recurrent/metastatic disease in patients who have differentiated thyroid cancer (DTC) and have had thyroid surgery (with or without ablative therapy). It is intended for use on the cobas e immunoassay analyzers. Results are determined via a calibration curve which is instrument-specifically generated by 2-point calibration and a master curve provided via the reagent barcode or e-barcode.
The Elecsys Tg II device is an immunoassay intended for the in vitro quantitative determination of thyroglobulin in human serum and plasma, used as an aid in monitoring for the presence of persistent or recurrent/metastatic disease in patients who have differentiated thyroid cancer (DTC) and have had thyroid surgery.
Here's an analysis of its acceptance criteria and the study that proves the device meets them:
1. Table of Acceptance Criteria and Reported Device Performance
The provided document doesn't explicitly list "acceptance criteria" for all performance measures in a comparative table against the reported performance. However, based on the studies conducted and their results, one can infer the implicit acceptance criteria by observing the measured performance and statements like "All deviations from linearity met the specification" or "Non-significant interferences were defined as %interferences within ± 10 %".
Below is a table summarizing the reported device performance, with inferred acceptance criteria where direct ones are not explicitly stated, but are implied by the reported "met specifications" or similar statements.
Performance Characteristic | Inferred Acceptance Criteria | Reported Device Performance |
---|---|---|
Clinical Performance | ||
Sensitivity | High sensitivity required for monitoring recurrent/metastatic disease (e.g., >90%). | 98.91% (91/92) with 95% CI: (94.10%; 99.81%) |
Specificity | Acceptable specificity for the intended use (the exact value is not explicitly stated as an initial acceptance criterion, but the reported value is presented as performance). | 53.42% (234/438) with 95% CI: (48.74%; 58.05%) |
Negative Predictive Value (NPV) | High NPV desired for ruling out disease (-ve result, truly -ve). | 99.89% with 95% CI: (99.42%; 99.98%) (calculated at 4.99% prevalence) |
Positive Predictive Value (PPV) | Acceptable PPV for the intended use. | 10.03% with 95% CI: (9.16%; 11.03%) (calculated at 4.99% prevalence) |
Analytical Performance | ||
Limit of Blank (LoB) | Must be very low (e.g., in the picogram/mL range) to detect low levels of Tg. No explicit criterion given, but the reported value is the outcome of the study designed to determine it. | 0.02 ng/mL (Determined according to CLSI EP17-A2) |
Limit of Detection (LoD) | Must be very low, enabling early detection of disease recurrence. No explicit criterion given, but the reported value is the outcome of the study designed to determine it. | 0.04 ng/mL (Determined according to CLSI EP17-A2) |
Limit of Quantitation (LoQ) | %CV of within-laboratory precision ≤ 20% and %bias within ±15%. | 0.1 ng/mL (%CV for samples around this level ranged from 7.56% to 4.00% for repeatability, and within-laboratory CVs were 9.34%, 8.75%, 5.67% for HS1, HS2, HS3 respectively, all below 20%. Bias not explicitly shown in summary table but met criteria.) |
Linearity | Deviations from linearity ≤ ±10% for values ≥0.3 ng/mL and within ±0.03 ng/mL for values |
Ask a specific question about this device
(382 days)
Roche Diagnostics
Immunoassay for the in vitro quantitative determination of antibodies to thyroglobulin in human serum and plasma. The anti-Tg autoantibodies determination is used as an aid in the detection of autoimmune thyroid diseases in conjunction with other laboratory and clinical findings.
The electrochemiluminescence immunoassay "ECLIA" is intended for use on the cobas e 411 immunoassay analyzer.
The Elecsys Anti-Tg immunoassay makes use of a competitive test principle using biotinylated human antigen and monoclonal human anti-Tg antibodies labeled with a ruthenium complex. The Elecsys Anti-Tg immunoassay is intended for the quantitative determination of antibodies to thyroglobulin in human serum and plasma. It is intended for use on the cobas e immunoassay analyzers.
Results are determined via a calibration curve which is instrument-specifically generated by 2 point calibration and a master curve provided via the reagent barcode or e barcode.
The provided text describes the performance evaluation of the Elecsys Anti-Tg immunoassay, a diagnostic device, and its acceptance criteria. Here's a breakdown of the requested information based on the text:
1. A table of acceptance criteria and the reported device performance
The document does not explicitly present a single table labeled "Acceptance Criteria" with corresponding "Reported Device Performance" in a direct side-by-side format. Instead, it describes various performance evaluations and states whether "All predefined acceptance criteria was met" for each. However, we can reconstruct a table based on the provided details for the non-clinical performance evaluation.
Performance Characteristic | Acceptance Criteria (Implied) | Reported Device Performance |
---|---|---|
Precision | All predefined acceptance criteria met (specific numerical criteria not detailed in this section for repeatability/intermediate precision and lot-to-lot reproducibility) | Repeatability (within-run precision) and Intermediate Precision (within-laboratory precision) measured according to CLSI guideline EP05-A3. Accepted for all samples. |
Lot-to-lot Reproducibility measured according to CLSI guideline EP05-A3 using three reagent lots. Accepted. | ||
Analytical Sensitivity | ||
Limit of Blank (LoB) | LoB claim in labeling set to 9 IU/mL (implied acceptance) | Determined according to CLSI EP17-A2. LoB claim in labeling will be set to 9 IU/mL. |
Limit of Detection (LoD) | LoD claim in labeling set to 10 IU/mL (implied acceptance) | Determined according to CLSI EP17-A2. LoD claim in labeling will be set to 10 IU/mL. |
Limit of Quantitation (LoQ) | LoQ claim in labeling set to 15 IU/mL (implied acceptance) | Determined according to CLSI EP17-A2. LoQ claim in labeling will be set to 15 IU/mL. |
Linearity | Confirmed to support the measuring range of 15 - 4000 IU/mL (implied acceptance) | Assessed according to CLSI EP06-Ed2, study design B, using weighted linear regression analysis. Linearity confirmed to support measuring range of 15 - 4000 IU/mL. |
Endogenous Interferences | All predefined acceptance criteria met (specific numerical criteria not detailed) | Evaluated for Biotin, Lipemia, Hemoglobin, Bilirubin, Rheumatoid Factor, Tg. All predefined acceptance criteria met. Proposed labeling claims: Biotin ≤ 1200 ng/mL, Lipemia ≤ 2000 mg/dL, Hemoglobin ≤ 600 mg/dL (for conc. ≤ 115 IU/mL), Bilirubin ≤ 66 mg/dL, Rheumatoid Factor ≤ 300 IU/mL, Tg ≤ 100 ng/mL. |
Analytical Specificity/Cross-Reactivity | No cross-reaction with Anti-TPO detected (implied acceptance) | Cross-reactivity study conducted with anti-TPO. No cross-reaction with Anti-TPO detected. |
Exogenous Interferences | All predefined acceptance criteria met for all drugs tested (implied acceptance) | Evaluated 17 commonly and 14 specially used pharmaceutical compounds. All predefined acceptance criteria met, and no interference observed. |
Sample Matrix Comparison | Results within specification and support use of specified matrices (implied acceptance) | Compared values from serum, K2-EDTA, and K3-EDTA plasma. Results were within specification and support the use of Serum (standard or separating gel), K2-EDTA, and K3-EDTA plasma. |
Method Comparison to Predicate | Not explicitly stated as pass/fail; presented as regression results | Compared to predicate device (K053426) using 129 human serum samples. |
Linear Regression: y = 0.905x + 48.0, r = 0.990 | ||
Passing Bablok: y = 0.974x + 1.72, τ = 0.930 | ||
Reagent Stability | ||
Reagent On-board Stability | 42 days (6 weeks) on-board (implied acceptance) | Tested on one cobas e 411 analyzer. Stable for up to 42 days (6 weeks). |
Reagent Stability After First Opening | 42 days (6 weeks) after first opening (implied acceptance) | Tested on one cobas e 411 analyzer. Stable for up to 42 days (6 weeks) when stored at 2-8°C. |
Calibration Stability | ||
Lot Calibration Stability | Calibration every 28 days (1 month) (implied acceptance) | Tested on one cobas e 411 analyzer. Recommended calibration frequency of every 28 days (1 month). |
On-board Calibration Stability | 7 days without new calibration (implied acceptance) | Tested on one cobas e 411 analyzer. Stable for up to 7 days without a new calibration. |
2. Sample sizes used for the test set and the data provenance (e.g. country of origin of the data, retrospective or prospective)
- Test Set Sample Sizes:
- Precision: Not explicitly stated, but includes "Human serum 1-5" and "PC THYRO1-2" (presumably replicates for each, as per CLSI EP05-A3 which requires sufficient replicates).
- Lot-to-lot Reproducibility: "three reagent lots" (number of samples per lot not specified).
- Analytical Sensitivity (LoB, LoD, LoQ): Not explicitly stated, determined according to CLSI EP17-A2 which has sample size recommendations.
- Linearity: "Six dilution series" using "native human serum samples and sample pools" (number of samples/pools not specified).
- Endogenous Interferences: Not explicitly stated per substance, but mentions "Six endogenous substances."
- Analytical Specificity/Cross-Reactivity: Not explicitly stated (for anti-TPO).
- Exogenous Interferences: "17 commonly and 14 specially used pharmaceutical compounds" (number of samples not stated).
- Sample Matrix Comparison: "blood from 13 donors" (tested across serum, K2-EDTA, K3-EDTA plasma, and serum separation tubes from 3 manufacturers).
- Method Comparison to Predicate: "total of 129 human serum samples."
- Data Provenance: The document does not specify the country of origin for the data or whether the studies were retrospective or prospective. It is a "510(k) Summary" for an FDA submission, reporting on laboratory performance studies. Given they are "non-clinical performance evaluation," these are typically controlled laboratory studies.
3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g. radiologist with 10 years of experience)
This device is an in-vitro diagnostic (IVD) immunoassay. The ground truth for such devices is established through analytical testing against reference materials, established methods, and clinical samples with known characteristics, not typically by expert consensus in the same way as an imaging AI. The "ground truth" here is the precise concentration or presence/absence of the analyte (thyroglobulin antibodies) as determined by the study's reference method or expected values for standards/controls.
4. Adjudication method (e.g. 2+1, 3+1, none) for the test set
Not applicable for this type of IVD analytical performance study. Adjudication methods like 2+1 or 3+1 are common in clinical trials or imaging studies where expert readers interpret results, but not for direct quantitative measurements from an immunoassay. The acceptance criteria are based on statistical analysis of quantitative results (e.g., precision, linearity, recovery, regression).
5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance
Not applicable. This is an immunoassay for determining antibody levels, not an imaging device or an AI intended to assist human readers. Hence, no MRMC study was performed, and human reader improvement with AI assistance is not relevant to this device's evaluation.
6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done
This entire non-clinical performance evaluation section (4. NON-CLINICAL PERFORMANCE EVALUATION
) describes the standalone performance of the Elecsys Anti-Tg immunoassay (a device, not an AI algorithm). The measurements are performed by the "cobas e 411 immunoassay analyzer," which acts as the "algorithm" or automated system. There's no human "in the loop" for the direct measurement results themselves, though human operators are involved in running the tests and interpreting the results in a clinical setting.
7. The type of ground truth used (expert consensus, pathology, outcomes data, etc)
The ground truth for the analytical performance studies (precision, linearity, sensitivity, interferences, stability) is based on:
- CLSI guidelines: The studies adhere to specific Clinical and Laboratory Standards Institute (CLSI) guidelines (e.g., EP05-A3, EP17-A2, EP06-Ed2), which define how such analytical characteristics are determined using reference materials, spiked samples, and statistical methods.
- Reference Standards/Materials: Implied in sections like "Traceability/Standardization" against the NIBSC 65/93 Standard, and the use of calibrators (Anti-Tg CalSet) and controls (PreciControl ThyroAB).
- Known Sample Characteristics: For linearity, samples with varying known concentrations are typically used. For interference studies, samples spiked with known interferents are used.
- Predicate Device Comparison: For method comparison, the predicate device's results serve as a comparative reference.
8. The sample size for the training set
Not applicable in the context of an immunoassay. This device is an in-vitro diagnostic test kit (reagents) used on an existing analyzer. It does not involve a "training set" in the machine learning sense. The "development" or "training" of such a diagnostic involves optimizing the chemical and biological components of the assay (reagents, antibodies, detection method) and calibrating the system across a range of known concentrations.
9. How the ground truth for the training set was established
As there is no "training set" in the AI/machine learning sense, this question is not applicable. The development process for an immunoassay involves extensive research and development to create reagents that accurately quantify the target analyte. Calibration is done using reference materials with assigned values, and the assay's performance characteristics (as detailed in section 4) are then rigorously validated.
Ask a specific question about this device
Page 1 of 48