Search Results
Found 5 results
510(k) Data Aggregation
(21 days)
Immunoassay for the in vitro quantitative determination of thyrotropin in human serum and plasma. Measurements of TSH are used in the diagnosis of thyroid and pituitary disorders.
The electrochemiluminescence immunoassay "ECLIA" is intended for use on cobas e immunoassay analyzers.
The Elecsys TSH immunoassay makes use of a sandwich test principle using monoclonal antibodies specifically directed against human TSH. The antibodies labeled with ruthenium complex) consist of a chimeric construct from human and mouse specific components. The Elecsys TSH immunoassay is used for the in vitro quantitative determination of thyroid stimulating hormone in human serum and plasma. It is intended for use on the cobas e immunoassay analyzers.
The Elecsys TSH device is an immunoassay for the in vitro quantitative determination of thyrotropin in human serum and plasma, used in the diagnosis of thyroid and pituitary disorders. It is an electrochemiluminescence immunoassay (ECLIA) intended for use on cobas e immunoassay analyzers. The key change in the updated device is a two-step approach to block biotin interference by adding an antibody to bind free biotin in the sample and changing the linker on the biotinylated capture antibody.
Here's an analysis of the acceptance criteria and the study that proves the device meets them:
1. A table of acceptance criteria and the reported device performance
The document provides performance data across various non-clinical studies. The acceptance criteria are generally implied by "All samples met the predetermined acceptance criterion" or "All lots met the predetermined acceptance criterion" for studies like precision, LoB, LoD, LoQ, and linearity. For interference studies, the "No interference seen up to" values represent the performance vs. a defined limit. For lot-to-lot reproducibility, the comparability of SDs and CVs implicitly confirms acceptance. For method comparison, the statistical results (slope, intercept, correlation coefficient, bias) are compared against internal acceptance criteria.
| Clinical / Technical Feature | Acceptance Criteria (Explicit or Implied) | Reported Device Performance |
|---|---|---|
| Repeatability & Intermediate Precision | All samples met the predetermined acceptance criterion. | CVs for repeatability ranged from 0.7% to 3.4%. CVs for intermediate precision ranged from 1.5% to 11.2%. |
| Lot-to-Lot Reproducibility | Calculated SDs and CVs for multiple lots comparable to single lot precision study. | Calculated SDs and CVs for multiple lots were comparable. |
| Limit of Blank (LoB) | All lots met the predetermined acceptance criterion. | 0.0025 µIU/mL |
| Limit of Detection (LoD) | All lots met the predetermined acceptance criterion. | 0.005 µIU/mL |
| Limit of Quantitation (LoQ) | All lots met the predetermined acceptance criterion. | 0.005 µIU/mL |
| Linearity/Assay Reportable Range | All deviations within predetermined acceptance criteria. | Linear in the range from 0.004 - 102 µIU/mL. |
| High Dose Hook Effect | No hook effect observed up to a specified concentration. | No hook effect up to 1000 µIU/mL TSH. |
| Biotin Interference (Endogenous) | Biotin interference not exceeding a specified threshold. | No biotin interference in serum concentrations up to 1200 ng/mL. (Previous limitation was ≤ 102 nmol/L or ≤ 25 ng/mL). |
| Lipemia (Intralipid) Interference | No interference seen up to 1500 mg/dL. | No interference seen up to 2000 mg/dL. |
| Hemoglobin Interference | No interference seen up to 1000 mg/dL. | No interference seen up to 1000 mg/dL. |
| Bilirubin Interference | No interference seen up to 41 mg/dL. | No interference seen up to 66 mg/dL. |
| Rheumatoid Factor (RF) Interference | No interference seen up to 1500 IU/mL. | No interference seen up to 1500 IU/mL. |
| Immunoglobulin (IgG) Interference | No interference seen up to 2 g/dL. | No interference seen up to 3.98 g/dL. |
| Immunoglobulin (IgM) Interference | No interference seen up to 0.5 g/dL. | No interference seen up to 0.72 g/dL. |
| Analytical Specificity (Cross-Reactivity) | All cross-reactivities met the predefined acceptance criterion at the specified concentration. | LH, FSH, hCG showed 0.000% cross-reactivity at high concentrations; hGH not detectable. |
| Exogenous Interferences (Drugs) | Each compound found to be non-interfering at the drug concentration. | All 30 tested drugs (commonly and specially used) showed no significant interference at concentrations at least 3x maximum daily doses (or 1x for some). |
| Sample Matrix Comparison | Regression analysis (Passing/Bablok) data consistent with acceptance criteria for various plasma types and different separating gels. | Slope (0.976 - 0.983), Intercept (-0.0006 - -0.021), Correlation (0.999 - 1.00) for serum vs. plasma. Recovery acceptable for PST/SST. |
| Method Comparison to Predicate | All data met predefined acceptance criteria for agreement between candidate (updated assay) and predicate (current assay). | Passing-Bablok: Slope 0.974, Intercept -0.0002, Correlation 0.999. Bias at 0.27 µIU/mL: -2.7%, Bias at 4.2 µIU/mL: -2.6%. |
| Stability | Pre-specified acceptance criteria were met. | Stability data supports Roche Diagnostic's claims as reported in package inserts. |
2. Sample size used for the test set and the data provenance (e.g. country of origin of the data, retrospective or prospective)
- Precision (Repeatability & Intermediate Precision): The test set involved 2 replicates per run for 21 days, across 2 runs per day, for PreciControl Universal, PC Thyro Sensitive, and 5 human serum samples. This is a prospective study design for precision. Sample types were native, single human donors as well as pools.
- Lot-to-Lot Reproducibility: 2 replicates of each of 5 human serum samples per run, 2 runs per day, for 21 days (7 days per lot, n=28 determinations per lot). Prospective design. Sample types were native, single human donors as well as pools.
- Limit of Blank (LoB): Five blank samples with two replicates each per run, for 6 runs on ≥ 3 days (total 60 determinations for analyte free samples). Prospective design.
- Limit of Detection (LoD): Five low analyte samples with two replicates each per run, for 6 runs on ≥ 3 days (total 60 replicates per sample per reagent lot). Prospective design.
- Limit of Quantitation (LoQ): 25 replicates per sample per reagent lot, over 5 days (1 run per day). Prospective design.
- Linearity/Assay Reportable Range: Three high analyte human serum samples were diluted and measured in 3-fold determination within a single run. Prospective design.
- High Dose Hook Effect: Three human serum samples spiked with analyte, dilution series performed, measured in one-fold determination. Prospective design.
- Endogenous Interference: Varied by interferent. For Biotin, Lipemia, Hemoglobin, Bilirubin, RF, IgG, IgM, samples were spiked with interfering substances and diluted into a dilution pool in 10% increments. The number of individual samples/pools is not explicitly stated but implies multiple. Prospective design.
- Analytical Specificity/Cross-Reactivity: A native human serum sample pool was used for each potential cross-reacting compound. Prospective design.
- Exogenous Interferences (Drugs): Two human serum samples (native serum pools) were used. Prospective design.
- Sample Matrix Comparison: A minimum of 56 serum/plasma pairs per sample material (Li-heparin, K2-EDTA, K3-EDTA plasma) were tested in singleton. For PST/SST, blood from five donors was used, measured in duplicate. Prospective design.
- Method Comparison to Predicate: 138 samples (129 native human serum samples and 9 diluted human serum samples, single donors as well as pools diluted) were measured in singleton. Prospective design.
Data Provenance: The document does not explicitly state the country of origin for the human serum and plasma samples. However, the manufacturer, Roche Diagnostics, operates globally with establishments in Mannheim and Penzberg, Germany, and Indianapolis, USA. The studies typically indicate the use of "human serum" or "human serum samples" without further geographic specification. All described studies appear to be prospective experimental designs conducted in a laboratory setting for device validation.
3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g. radiologist with 10 years of experience)
This device is an in vitro diagnostic immunoassay testing for a quantifiable biomarker (TSH), not an imaging device or a device requiring expert interpretation of complex clinical data to establish ground truth for its performance characteristics. The ground truth for such assays is established through analytical methods and reference standards (e.g., spectrophotometry for linearity, spiked samples for interference, reference materials for precision, comparison to a predicate device). No human experts are used to "establish primary ground truth" in the sense of clinical diagnosis for these analytical performance studies. The ground truth is the actual concentration of the analyte, or the known characteristics of the samples (e.g., spiked amount of interferent).
4. Adjudication method (e.g. 2+1, 3+1, none) for the test set
Not applicable. As described above, this is an in vitro diagnostic analytical performance study, not a clinical study requiring adjudication of diagnoses or interpretations by experts.
5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance
Not applicable. This device is an automated immunoassay, an in vitro diagnostic (IVD) test, not an imaging device or AI-driven diagnostic tool that would involve human "readers" or AI assistance.
6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done
Yes, the studies described are all standalone performance studies of the Elecsys TSH immunoassay system. It's an automated device (cobas e immunoassay analyzer) that provides quantitative results without human intervention in the measurement process itself, beyond sample loading and general operation/maintenance.
7. The type of ground truth used (expert consensus, pathology, outcomes data, etc)
The ground truth used for these analytical studies includes:
- Known concentrations: For LoB, LoD, LoQ, and linearity, the samples are either analyte-free, at known low concentrations, or dilutions from known high concentrations.
- Spiked samples: For interference studies (endogenous and exogenous), known amounts of interfering substances are added to samples.
- Reference materials/standards: For precision, controls with defined concentrations are used. Traceability is to the 2nd IRP WHO Reference Standard 80/558.
- Comparison to a legally marketed predicate device: For method comparison, the results of the new device are compared quantitatively to those of the predicate device.
- Clinical samples (native human serum/plasma): These are used to assess the device's performance across a range of physiological concentrations and in real-world matrices for studies like precision, linearity, and matrix comparison.
8. The sample size for the training set
This document describes a 510(k) submission for a revised immunoassay, not a machine learning or AI-based device. Therefore, there is no "training set" in the context of algorithm development. The development of the assay itself would have involved extensive R&D and analytical testing to optimize reagents and protocols, but this is distinct from training an AI model on a dataset.
9. How the ground truth for the training set was established
Not applicable, as there is no "training set" in the AI/ML context for this device. The assay's performance characteristics are established through the non-clinical studies detailed in the summary.
Ask a specific question about this device
(126 days)
cobas e 801 immunoassay analyzer is intended for the in-vitro determination of analytes in body fluids.
Elecsys TSH immunoasay is intended for the in vitro quantitative determination of thyrotropin in human serum and plasma. Measurements of TSH are used in the diagnosis of thyroid or pituitary disorders. The Elecsys TSH immunoassay is an electrochemiluminescence immunoasay 'ECLIA', which is intended for use on the cobas e immunoassay analyzers.
The cobas e 801 immunoassay analyzer is a fully automated, software controlled analyzer system for in vitro determination of analytes in human body fluids. It is part of the cobas 8000 modular analyzer series cleared under K100853. It uses electrochemiluminescent technology for signal generation and measurement.
Here's a breakdown of the acceptance criteria and study information for the Elecsys TSH assay on the Cobas e 801 immunoassay Analyzer, based on the provided document:
1. Table of Acceptance Criteria and Reported Device Performance
The document doesn't explicitly state "acceptance criteria" for each performance characteristic as pass/fail thresholds. Instead, it presents the results of various validation studies. I will present the reported performance, and where applicable, infer the implied acceptance based on the presentation of the results as successful.
| Performance Characteristic | Acceptance Criteria (Implied) | Reported Device Performance |
|---|---|---|
| Repeatability (CV%) | Low CV values, generally < 10% for low concentrations and < 5% for higher concentrations (common for immunoassays) | Human serum 1 (0.00851 µIU/mL): 7.1%Human serum 2 (0.209 µIU/mL): 1.6%Human serum 3 (1.88 µIU/mL): 1.4%Human serum 4 (51.8 µIU/mL): 1.3%Human serum 5 (90.0 µIU/mL): 1.4%PC Universal 1 (1.41 µIU/mL): 1.4%PC Universal 2 (8.18 µIU/mL): 1.6%PreciControl TS (0.184 µIU/mL): 1.8% |
| Intermediate Precision (CV%) | Low CV values, generally < 15% for low concentrations and < 10% for higher concentrations | Human serum 1 (0.00851 µIU/mL): 11.3%Human serum 2 (0.209 µIU/mL): 2.5%Human serum 3 (1.88 µIU/mL): 2.3%Human serum 4 (51.8 µIU/mL): 2.0%Human serum 5 (90.0 µIU/mL): 1.9%PC Universal 1 (1.41 µIU/mL): 2.1%PC Universal 2 (8.18 µIU/mL): 2.5%PreciControl TS (0.184 µIU/mL): 2.3% |
| Linearity (Pearson's r) | High correlation (e.g., > 0.99) and slope close to 1, intercept close to 0 across the measuring range | Serum 1: Pearson's r = 0.9994, slope = 0.963, intercept = -0.00155Serum 2: Pearson's r = 0.9992, slope = 0.958, intercept = -0.00193Serum 3: Pearson's r = 0.9986, slope = 0.952, intercept = -0.00272 |
| Limit of Blank (LoB) | Low value, typically indicative of assay's ability to distinguish analyte-free samples from those with very low levels. | 0.0025 µIU/mL |
| Limit of Detection (LoD) | Low value, indicating sensitivity to low analyte concentrations. Specific 95% probability is a common criterion. | 0.005 µIU/mL (detected with 95% probability) |
| Limit of Quantitation (LoQ) | Low value with acceptable precision (e.g., CV ≤ 20%) | 0.005 µIU/mL at a CV ≤ 20% |
| Endogenous Interferences | No significant interference at specified levels | No interference observed up to the indicated levels for Intralipid (2000 mg/dL), Biotin (56.0 ng/mL), Bilirubin (66.0 mg/dL), Hemoglobin (1000 mg/dL), Rheumatic Factor (1500 IU/mL), human IgG (2.80 g/dL), human IgM (0.500 g/dL). |
| Exogenous Interferences (Anticoagulants) | Values obtained from different sample types (serum, plasma with various anticoagulants) should be comparable. | Data supported the use of Serum, Li-Heparin, K2-EDTA, and K3-EDTA plasma tubes, evaluated using Passing/Bablok regression analysis comparing serum/plasma pairs. |
| Exogenous Interferences (Drugs) | No significant interference at specified drug concentrations | No interference found with 16 commonly used drugs and several special drugs (Amiodarone, Carbimazole, Fluocortolone, Hydrocortisone, Iodide, Levotyroxine, Liothyronine, Methimazole, Octreotide, Prednisolone, Propanolol, Propylthiouracil, Perchlorate) at tested concentrations. |
| Method Comparison (Correlation) | Strong correlation (e.g., Pearson's r > 0.98) and agreement (slope close to 1, intercept close to 0) with predicate device | N = 130 samplesPassing/Bablok: Slope = 0.936, Intercept = -0.003, Kendall ($\tau$) = 0.989Linear Regression: Slope = 0.958, Intercept = -0.052, Pearson (r) = 0.999 |
2. Sample Size and Data Provenance for Test Set
- Repeatability and Intermediate Precision:
- Sample Size:
- 7 human serum samples (5 pooled, 5 pooled spiked) and 2 control samples (PC Universal, PreciControl TS).
- Each sample tested in 2 replicates per run, 2 runs per day for 21 days (total of 84 replicate measurements per sample type).
- Sample Size:
- Linearity:
- Sample Size: 3 high analyte serum samples diluted to 12 concentrations. Each concentration assayed in 3-fold determination within a single run.
- Analytical Sensitivity (LoB, LoD, LoQ):
- LoB: Blank sample tested with 60 replicates (10 replicates per run, 6 days).
- LoD: 5 low-level human serum samples tested with 60 replicates (2 replicates per sample per run, 6 days).
- LoQ: 10 low-level TSH samples tested over 5 days, 5 replicates per sample per day.
- Endogenous Interferences:
- Human serum samples. Specific number not provided, but the outcome is qualitative ("No interference observed").
- Exogenous Interferences (Anticoagulants):
- A minimum of 40 serum/plasma pairs per sample material (presumably 40 serum, 40 Li-Heparin plasma, 40 K2-EDTA plasma, 40 K3-EDTA plasma). Tested in singleton for each type.
- Exogenous Interferences (Drugs):
- 16 commonly used drugs and 13 special drugs. Specific number of samples not provided, but the outcome is qualitative ("No interference").
- Method Comparison:
- Sample Size: 130 human serum samples (single donors and serum pools; native, spiked as well as diluted).
- Data Provenance: Not explicitly stated (e.g., country of origin, retrospective/prospective). However, the use of "human serum samples" and "human serum/plasma pairs" indicates biological samples. The studies are prospective in nature, conducted specifically to validate the device.
3. Number of Experts Used to Establish Ground Truth for Test Set and Qualifications
This device is an immunoassay for quantitative determination of TSH. The "ground truth" for the test set is established by the reference measurement method or the quantitative value itself. No human experts are used to establish ground truth in the same way they would be for image interpretation. The accuracy of the quantitative measurements is assessed against known concentrations (e.g., in linearity, LoB/LoD studies) or against a predicate device (method comparison).
4. Adjudication Method
Not applicable for an immunoassay. Adjudication is typically used when human interpretation of results contributes to the ground truth, which is not the case here.
5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study
No. This type of study is relevant for diagnostic imaging or other interpretations where human readers are involved. This document describes the performance of an in-vitro diagnostic device (IVD) for quantitative measurement, which operates without direct human interpretive input being part of the core measurement.
6. Standalone Performance
Yes, these studies describe the standalone (algorithm only, in this context meaning the device's automated performance without human intervention after sample loading) performance of the Elecsys TSH assay on the cobas e 801 immunoassay analyzer. The results presented are directly from the instrument's measurements.
7. Type of Ground Truth Used
- Reference Materials/Known Concentrations: For precision, linearity, LoB, LoD, LoQ, endogenous and exogenous interference studies, ground truth implicitly refers to the expected concentration/value based on the preparation of known samples or the absence of an analyte (for blanks).
- Predicate Device Measurements: For the method comparison study, the "ground truth" for comparison is the measurement obtained from the predicate device (Elecsys TSH on Elecsys 2010 analyzer).
- Expected Values: The "Expected Values" section establishes a reference range (0.27-4.20 µIU/mL) based on healthy test subjects. This is a clinical reference range, not a direct ground truth for individual measurements, but rather a benchmark for interpretation.
8. Sample Size for the Training Set
The document describes validation studies for an in vitro diagnostic device (IVD), specifically an immunoassay analyzer and assay. IVDs like this do not typically have a "training set" in the machine learning sense. The device's operational parameters, calibration curves, and algorithms are developed during the product development phase by the manufacturer, which might involve internal data, but generally, the submission focuses on external validation. The document does not provide details on the development data used.
9. How the Ground Truth for the Training Set Was Established
As there is no "training set" described in the context of machine learning, this question about establishing ground truth for it is not applicable here. The device output is a quantitative value based on chemical reactions and detection, not a learned prediction from a ground-truthed dataset in the AI sense.
Ask a specific question about this device
(121 days)
The Elecsys TSH CalCheck 5 is an assayed control for use in calibration verification and for use in the verification of the assay range established by the Elecsys TSH reagent on the indicated Elecsys cobas e immunoassay analyzers.
The Elecsys TSH CalCheck 5 is a lyophilized product consisting of TSH in equine serum matrix. During manufacture, the analyte is spiked into the matrix at the desired concentration levels.
The provided 510(k) summary for the device, "Elecsys TSH CalCheck 5," is for an in-vitro diagnostic control material. As such, it does not involve clinical studies with human patients, image analysis, or expert-based ground truth establishment in the same way a diagnostic imaging device would. Instead, its "performance" is assessed based on its chemical and physical characteristics and how accurately it can verify instrument calibration and assay ranges.
Therefore, many of the requested categories in the prompt are not applicable to this type of device submission.
Here is an analysis based on the information provided in the K093836 document:
1. Table of Acceptance Criteria and Reported Device Performance
The document does not explicitly state formal "acceptance criteria" in a quantitative, pass/fail table as would be expected for a diagnostic device. Instead, it states that the device was evaluated for "value assignment and stability." The implication is that the performance characteristics (e.g., how well the assigned values match expectations, and the stability over time) were deemed acceptable for substantial equivalence to the predicate device.
| Characteristic | Acceptance Criteria (Implied) | Reported Device Performance |
|---|---|---|
| Value Assignment | Assumed to be accurate and consistent with intended use as an assayed control for calibration verification. | Evaluated for value assignment. (Specific data not provided in summary). |
| Stability (Unopened) | Stable at 2-8°C until expiration date. | Same as predicate. |
| Stability (Reconstituted) | Stable at 20-25°C for 4 hours. | Same as predicate. |
| Format | Lyophilized | Same as predicate. |
| Matrix | Equine serum matrix | Same as predicate. |
| Levels of Control | Five distinct levels for calibration verification. | Five levels, an increase from the predicate's three. |
2. Sample Size Used for the Test Set and Data Provenance
- Test set: Not applicable in the traditional sense of patient data. The "test set" would be samples of the manufactured control material itself, used for evaluation. The document does not specify the number of batches or individual vials tested.
- Data Provenance: The exact location or nature of the testing is not specified, but it would have been conducted by Roche Diagnostics as part of their product development and validation process. This would be considered prospective manufacturing and testing data.
3. Number of Experts Used to Establish Ground Truth for the Test Set and Qualifications
- Not Applicable. For an in-vitro diagnostic control, the "ground truth" is established through highly controlled analytical methods and established reference materials/methods, not through expert human interpretation. The concentrations of TSH in the control material are assigned through a rigorous internal process, not "established by experts."
4. Adjudication Method for the Test Set
- Not Applicable. No human adjudication is involved for this type of chemical control material. The "adjudication" is metrological, relating to the accuracy and precision of the analytical measurements used to assign values and assess stability.
5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was Done
- No. An MRMC study is relevant for diagnostic devices that involve human interpretation of medical images or data. This device is a quality control material for an automated immunoassay analyzer.
6. If a Standalone (Algorithm only without human-in-the-loop performance) was done
- Not Applicable / Inherent. This device itself is not an algorithm or a diagnostic tool; it's a calibrator/control. Its performance is entirely "standalone" in the sense that it is a physical product with defined chemical characteristics. Its interaction is with the immunoassay analyzer, not a human interpreter directly.
7. The Type of Ground Truth Used
- Assigned Values based on Analytical Methods and Reference Materials: The "ground truth" for the Elecsys TSH CalCheck 5 is the assigned TSH concentration values for each of its five levels. These values are determined by the manufacturer (Roche Diagnostics) using highly precise and accurate analytical methods, typically traceable to international reference standards and/or internal established reference methods. This ensures that the control material has known concentrations to verify the performance of the Elecsys TSH reagent and analyzer.
8. The Sample Size for the Training Set
- Not Applicable. This device is a chemical control product, not a machine learning algorithm that requires a "training set" of data.
9. How the Ground Truth for the Training Set was Established
- Not Applicable. See point 8.
Ask a specific question about this device
(28 days)
The Elecsys TSH CalSet is used for calibrating the quantitative Elecsys TSH assay on the Elecsys immunoassay analyzers.
The Elecsys TSH CalSet consists of equine serum matrix (Cal 1) and a human serum matrix with human TSH (Cal 2) in two concentration ranges. The Elecsys TSH CalSet is supplied in ready for use liquid format.
This 510(k) summary (K060754) for the Elecsys TSH CalSet provides limited information regarding specific performance studies and acceptance criteria typically found for diagnostic devices. The submission primarily focuses on demonstrating substantial equivalence to a predicate device (Elecsys TSH CalSet K961491) rather than presenting detailed performance data from a new clinical study.
Here's an analysis based on the provided text:
1. Table of Acceptance Criteria and Reported Device Performance
The provided document does not explicitly state acceptance criteria or report specific device performance metrics in the format of a table with numerical values for sensitivity, specificity, accuracy, etc. This type of information is generally expected for diagnostic devices that analyze patient samples.
The comparison table in the 510(k) summary focuses on device features of the modified Elecsys TSH CalSet versus the predicate, such as intended use, traceability, levels, storage form, matrix, stability, and target concentrations. These are design and manufacturing specifications, not performance metrics against clinical outcomes or a ground truth.
For example, it states "Stability: Unopened... at 2-8°C up to the stated expiration date," and "Opened... after opening in aliquots at 2-8°C for 12 weeks." While these are important characteristics, they are not performance metrics like accuracy or precision.
2. Sample Size Used for the Test Set and Data Provenance
The document does not mention any specific sample size for a test set or provide details on data provenance (e.g., country of origin, retrospective or prospective data). The submission is for a calibrator, which is used to standardize an assay, not to directly diagnose patients from a test set of patient samples. Therefore, a "test set" in the traditional sense of patient samples for diagnostic performance evaluation is not detailed here.
3. Number of Experts Used to Establish Ground Truth and Qualifications
This information is not applicable or provided in the context of this 510(k) submission. A calibrator's "ground truth" relates to its traceable concentration values, not to interpretations by medical experts. The document states "Assay standardized against the 2nd IRP WHO reference standard 80/558," which indicates traceability to an international reference standard, not ground truth established by medical experts for diagnostic outcomes.
4. Adjudication Method
This information is not applicable or provided. Adjudication methods are used to resolve discrepancies among experts when establishing ground truth for diagnostic studies using patient data. Since this submission is for a calibrator and does not involve patient diagnoses or expert interpretation, adjudication is not relevant.
5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study
A MRMC comparative effectiveness study was not conducted and is not mentioned. This type of study is relevant for diagnostic devices that involve human interpretation (e.g., imaging devices) to assess the impact of AI assistance on human reader performance. As the Elecsys TSH CalSet is a chemical calibrator for an automated immunoassay, human readers are not directly involved in its function or interpretation in a way that would necessitate an MRMC study.
6. Standalone (Algorithm Only Without Human-in-the-Loop Performance) Study
A standalone performance study, as typically understood for diagnostic algorithms, was not conducted and is not mentioned. The Elecsys TSH CalSet itself is a physical calibrator used within an automated immunoassay system. Its performance relates to its ability to correctly set the assay's measurement scale, which is typically evaluated through analytical studies (e.g., precision, accuracy, linearity) of the overall assay system when calibrated. The document implies that the performance of the assay itself (when calibrated with the device) is acceptable, but does not detail studies specifically for the calibrator's standalone performance in isolation.
7. Type of Ground Truth Used
The ground truth used for the Elecsys TSH CalSet is based on international reference standards and defined concentrations. The document explicitly states: "Assay standardized against the 2nd IRP WHO reference standard 80/558." This refers to a recognized international reference for TSH measurements, which provides the basis for establishing the "true" concentration values of the calibrator.
8. Sample Size for the Training Set
The document does not mention a training set sample size. This is because the Elecsys TSH CalSet is a chemical reagent (calibrator), not an AI algorithm or a diagnostic model that requires a training set in the machine learning sense.
9. How the Ground Truth for the Training Set Was Established
Since there is no training set for an AI algorithm or diagnostic model, the method for establishing its ground truth is not applicable or provided. The "ground truth" for the calibrator's stated concentrations is established through reference to the 2nd IRP WHO reference standard 80/558, as mentioned above.
In summary:
This 510(k) submission for the Elecsys TSH CalSet focuses on demonstrating substantial equivalence to a predicate calibrator by comparing manufacturing specifications and intended use. It does not contain detailed performance studies or acceptance criteria typical for diagnostic devices that interpret patient data. The "studies" implied are likely internal analytical validations of the calibrator's characteristics (e.g., stability, concentration accuracy) and its impact on the overall TSH assay, rather than clinical trials with patient cohorts.
Ask a specific question about this device
(95 days)
Immunoassay for the in vitro quantitative determination of Thyroid Stimulating Hormone in human serum and plasma.
Sandwich principle: Total duration of assay: 18 minutes (37°C).
• 1st Incubation (9 minutes): Sample (50µL), a biotinylated monoclonal TSH-specific antibody (60 µL), and a monoclonal TSH-specific antibody labeled with a ruthenium complex (50 µL) react to form a sandwich complex.
• 2nd Incubation (9 minutes): After addition of streptavidin-coated microparticles (40 µL) the complex becomes bound to the solid phase via interaction of biotin and streptavidin.
• The reaction mixture is aspirated into the measuring cell where the microparticles are magnetically captured onto the surface of the electrode. Unbound substances are then removed with ProCell.
• Application of a voltage to the electrode then induces chemiluminescent emission which is measured by a photomultiplier (0.4 second read frame).
• Results are determined via a calibration curve which is instrument-specifically generated by a 2-point calibration curve and a master curve provided via the reagent bar code.
This document describes the Elecsys® TSH Assay, an electrochemiluminescence assay for the quantitative determination of Thyroid Stimulating Hormone (TSH) in human serum and plasma. The K961491 submission claims substantial equivalence to the Enzymun-Test® TSH (K915195).
Here's an analysis of the acceptance criteria and study information provided:
1. Table of Acceptance Criteria and Reported Device Performance
The acceptance criteria are implied by the comparison to the predicate device, Enzymun-Test® TSH, and general scientific principles for immunoassay performance. The document presents performance characteristics for both the Elecsys® TSH and the predicate device, demonstrating that the new device meets or exceeds the predicate's performance in key areas.
| Feature | Acceptance Criteria (Implied by Predicate Performance / General Standards for Immunoassay) | Reported Elecsys® TSH Performance |
|---|---|---|
| Precision | Typically, %CV for immunoassays at various TSH levels should be within acceptable ranges (e.g., single-digit %CV for mid-to-high concentrations, possibly higher for very low concentrations). Comparing to the predicate, Elecsys® TSH should show comparable or better precision. | Within-Run %CV:- Sample Control 1 (0.914 µU/ml): 2.08%- Control 2 (2.451 µU/ml): 1.88%- Control 3 (10.670 µU/ml): 1.47%Total %CV:- Sample Control 1 (0.914 µU/ml): 3.28%- Control 2 (2.451 µU/ml): 2.20%- Control 3 (10.670 µU/ml): 1.76% |
| Sensitivity | Should have a lower detection limit and functional sensitivity suitable for clinical applications, ideally comparable to or better than the predicate's 0.03 µU/ml. | Functional Sensitivity: 0.01 µU/mlLower Detection Limit: 0.005 µU/mL |
| Assay Range / Linearity | Reportable range should cover clinically relevant TSH levels, and values within this range should be linear (e.g., within ±10% deviation from the linear line). Predicate range: 0.03 µU/ml - 40.00 µU/ml. | Reportable Range: 0.01 µU/ml - 100 µU/ml(within ±10% deviation from the linear line) |
| Method Comparison (Correlation with Predicate) | Should demonstrate good correlation with the predicate device (e.g., r > 0.95, slope near 1, intercept near 0). | Vs Enzymun-Test® TSH:- Least Squares: y = 1.09x + 0.14, r = 0.991, SEE = 0.798 (N=132)- Passing/Bablok: y = 1.12X - 0.05, r = 0.991, SEE = 0.798 (N=132)Vs Nichols 3rd Generation:- Least Squares: y = 1.02x - 0.24, r = 0.985, SEE = 1.12 (N=142) |
| Interfering Substances | Should show no significant interference from common biological substances at clinically relevant concentrations. | No interference at:- Bilirubin 25 mg/dL- Hemoglobin 1 g/dL- Lipemia 1500 mg/dL- Biotin 30 ng/mL- RF 339 IU/mL |
| Specificity (Cross-Reactivity) | Should demonstrate minimal or no cross-reactivity with other related hormones to avoid false positives/negatives. | Conc % Cross-Reactivity:- HCG 200: 0- LH 400: 0.038- FSH 400: 0.008- HGH 400: 0.00004 |
2. Sample Size Used for the Test Set and Data Provenance
- Precision: For "Within-Run" and "Total" precision,
N = 60was used for each of the three control levels for the Elecsys® TSH. (The predicate used N=120 for each of its three levels.) - Method Comparison:
N = 132samples were used for comparison between Elecsys® TSH and Enzymun-Test® TSH.N = 142samples were used for comparison between Elecsys® TSH and Nichols 3rd Generation.
- Data Provenance: The document does not explicitly state the country of origin or whether the data was retrospective or prospective. Given the context of a 510(k) summary for a diagnostic assay, it is highly probable that these studies involved prospective collection of human serum and plasma samples according to standard clinical laboratory practices.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications
For an in vitro diagnostic (IVD) immunoassay like the Elecsys® TSH, the "ground truth" is typically established by the reference method (the predicate device, in this case, Enzymun-Test® TSH, and an additional comparator, Nichols 3rd Generation TSH assay) or by expert consensus on the clinical state of the patient using standard clinical diagnostic criteria for thyroid function, rather than by human interpretation of images by experts. Therefore, the concept of "experts" as in radiologists, for example, is not applicable in this context. The "ground truth" values for TSH concentration are derived directly from the laboratory measurements by the reference assays.
4. Adjudication Method for the Test Set
Not applicable for this type of IVD device. The "ground truth" is the quantitative measurement from the reference methods, not subjective interpretation requiring adjudication among human experts.
5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance
Not applicable. This is an immunoassay for TSH, not an imaging device requiring human readers or AI assistance.
6. If a Standalone (i.e. algorithm only without human-in-the loop performance) was done
This device is a standalone algorithm/instrument system. The Elecsys® TSH Assay on the Elecsys® 2010 instrument performs the measurement and provides a quantitative TSH value without human interpretation in the loop impacting the result generation directly. The reported "Performance Characteristics" (precision, sensitivity, linearity, method comparison, interference, specificity) represent the standalone performance of the assay and instrument system.
7. The Type of Ground Truth Used
The ground truth used for establishing the performance of the Elecsys® TSH Assay was:
- Reference Method Comparison: TSH values obtained from samples analyzed by the predicate device (Enzymun-Test® TSH) and another established method (Nichols 3rd Generation TSH). These assays provide quantitative measurements that serve as the "true" or reference values for TSH concentration.
- Known Concentrations/Spiked Samples: For studies like linearity, sensitivity, and interfering substances, samples with known TSH concentrations or spiked with interfering substances would be used as the ground truth.
- Clinical Samples: Samples from patients with various TSH levels (e.g., hyperthyroid, euthyroid, hypothyroid) would be used for method comparison studies to ensure broad clinical utility.
8. The Sample Size for the Training Set
The document does not explicitly mention a "training set" in the context of machine learning. For an immunoassay, the "training" analogous to adjusting an algorithm would be the development and optimization of the assay reagents, protocols, and calibration procedures. The calibration curve for the Elecsys® TSH is generated by a 2-point calibration curve and a master curve provided via the reagent bar code. This essentially "calibrates" the system, allowing it to accurately quantitate unknown samples. The details of the samples used to establish the master curve are not provided but would typically involve highly characterized standard materials.
9. How the Ground Truth for the Training Set was Established
As discussed above, the concept of a training set as understood in AI/ML is not directly applicable. However, the "ground truth" for the development and calibration of the assay would be established through:
- WHO Standardization: The assay standardization is stated to be via the World Health Organization (WHO), indicating that the assay's measurements are traceable to international reference standards for TSH. These standards are rigorously characterized and assigned specific TSH values by expert international committees.
- Internal Validation and Reference Materials: Boehringer Mannheim would have used a series of internal reference materials and standards, carefully characterized for their TSH concentrations, during the assay development and for establishing the master curve. These internal standards would be assigned values based on comparisons to WHO international standards and/or highly accurate internal reference methods.
Ask a specific question about this device
Page 1 of 1