Search Filters

Search Results

Found 14 results

510(k) Data Aggregation

    K Number
    K193053
    Date Cleared
    2020-03-26

    (146 days)

    Product Code
    Regulation Number
    862.1373
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Roche Diagnostics Operations (RDO)

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The Tina-quant Hemoglobin A1cDx Gen.3 assay is intended for use as an aid in diagnosis of diabetes and as an aid in identifying patients who may be at risk for developing diabetes. It is an in vitro diagnostics reagent system intended for quantitative determination of mmol/mol hemoglobin A1c (IFCC) and % hemoglobin A1c (DCCT/NGSP) in hemolysate or venous whole blood on the cobas c 503 clinical chemistry analyzer. HbA1c determinations are useful for monitoring of long-term blood glucose control in individuals with diabetes mellitus.

    Device Description

    Tina-quant Hemoglobin A1cDx Gen.3 assay is an in vitro diagnostics reagent system intended for quantitative determination of mmol/mol hemoglobin A1c (IFCC) and % hemoglobin A1c (DCCT/NGSP) in hemolysate or whole blood on the cobas c 503 clinical chemistry analyzer. The assay offers separate applications that are specific to the sample types whole blood and hemolysate. The Whole Blood Application differs from the Hemolysate Application in the hemolyzing step. For the Whole Blood Application, whole blood samples are placed on the analyzer and hemolysis occurs onboard the analyzer. For the Hemolysate Application, hemolyzed samples are placed on the analyzer and hemolysis occurs manually before placing the samples onboard the analyzer. The two applications yield the same results. Hemolyzing reagent is part of the test system and is either placed on board the analyzer for the Whole Blood Application or used manually for the Hemolysate Application. Anticoagulated whole blood is hemolyzed either manually or automatically prior to determination of HbAlc by a turbidimetric inhibition immunoassay. Liberated hemoglobin (Hb) in the hemolyzed sample is converted to a derivative having a characteristic absorption spectrum and measured bichromatically. The instrument calculates the % HbAlc from the HbAlc/Hb ratio according to a user selected protocol, either IFCC or NGSP protocols.

    AI/ML Overview

    Here's a breakdown of the acceptance criteria and the study that proves the device meets them, based on the provided FDA 510(k) summary for the Tina-quant Hemoglobin A1cDx Gen.3:

    1. A table of acceptance criteria and the reported device performance

    The document doesn't explicitly state "acceptance criteria" as a single, consolidated table with pass/fail thresholds. Instead, it presents various performance studies and their results. The implicit acceptance criteria are that the device's performance metrics are acceptable for its intended use and comparable to or better than the predicate device.

    Here’s a table summarizing the reported device performance for key metrics:

    Performance MetricAcceptance Criteria (Implicit)Reported Device Performance (Tina-quant Hemoglobin A1cDx Gen.3)
    PrecisionAcceptable levels of repeatability and intermediate precision for clinical use.Hemolysate Application:
    • Reproducibility (total CV%): Most samples/controls show CV% between 1.0% and 1.9%.
    • Repeatability (CV%): Most samples/controls show CV% between 0.4% and 0.6%.
      Whole Blood Application:
    • Reproducibility (total CV%): Most samples/controls show CV% between 1.2% and 1.6%.
    • Repeatability (CV%): Most samples/controls show CV% between 0.4% and 0.8%. |
      | Limit of Blank (LoB) | Detection limit sensitive enough for clinical application. | Hb LoB: 0.0530 mmol/L (0.085 g/dL)
      HbA1c LoB: 0.0220 mmol/L (0.035 g/dL)
      This corresponds to 15 mmol/mol (IFCC) and 3.5% HbA1c (DCCT/NGSP) at 13.2 g/dL Hb. |
      | Limit of Detection (LoD) | Detection limit sensitive enough for clinical application. | Hb LoD: 0.119 mmol/L (0.192 g/dL)
      HbA1c LoD: 0.0437 mmol/L (0.07 g/dL)
      This corresponds to 22 mmol/mol (IFCC) and 4.2% HbA1c (DCCT/NGSP) at 13.2 g/dL Hb. |
      | Linearity/Reportable Range | Linear response across the claimed measuring range. | Hemoglobin (Hb): 4 – 40 g/dL (2.48 – 24.8 mmol/L)
      HbA1c: 0.3 – 2.6 g/dL (0.186 – 1.61 mmol/L)
      This corresponds to a measuring range of 23-196 mmol/mol HbA1c (IFCC) and 4.2-20.1% HbA1c (DCCT/NGSP).
      Empirical First Order Regression: Pearson's r for Hb = 0.9999, HbA1c = 0.9990. |
      | Endogenous Interferences | No significant interference from common endogenous substances at specified concentrations. | Demonstrated claimed maximum concentrations without interference for: Bilirubin (60 mg/dL), Ditaurobilirubin (60 mg/dL), Lipemia (400 mg/dL), Rheumatoid Factors (750 IU/mL), Total Protein (21 g/dL), Albumin (60 g/L), Immunoglobulin (IgG) (60 g/L), Glucose (1000 mg/dL), Triglycerides (1584 mg/dL). A percent deviation criteria was used (not explicitly stated but implied to be within acceptable limits). |
      | Cross-Reactivity | No significant cross-reactivity with specified hemoglobin fractions and glycated albumin. | Max Whole Blood Cross-Reactant Concentration with no Interference: HbA0 (120 g/dL), HbA1(a+b) (0.96 g/dL for Level 1, 1.6 g/dL for Level 2), Carbamylated Hb (2.0 g/dL), Acetylated Hb (2.0 g/dL), Glycated Albumin (10 g/dL), Labile HbA1c (1000 mg/dL).
      Note: Specimens with >7% HbF may yield lower than expected HbA1c values. |
      | Hemoglobin Variants | Accurate results for common hemoglobin variants (HbS, HbC, HbE, HbD, HbA2) within acceptable bias. | Relative % Bias from Reference Method at Low (around 6.5%) and High (around 9%) HbA1c:
    • HbS: -2.5% (Low), -4.0% (High)
    • HbC: -3.9% (Low), -6.0% (High)
    • HbE: -0.1% (Low), -1.2% (High)
    • HbD: -1.8% (Low), -2.6% (High)
    • HbA2: -1.0% (Low), 0.4% (High)
      Note: Specimens with >7% HbF may yield lower than expected HbA1c values. |
      | Exogenous Interferences (Drugs) | No significant interference from a list of commonly used drugs at specified concentrations. | No significant interference reported for 18 listed drugs (N-Acetylcysteine, Acetylsalicylic acid, Ampicillin-Na, Ascorbic acid, Cefoxitin, Heparin, Levodopa, Methyldopa + 1.5, Metronidazole, Doxycyclin, Rifampicin, Gammagard, Cyclosporine, Phenylbutazone, Acetaminophen, Ibuprofen, Theophylline, Tolbutamide) at tested concentrations. |
      | Sample Matrix Comparison | Acceptable agreement across different anticoagulants and fill levels. | Mean Difference for K2-EDTA, K3-EDTA, Na Heparin, Li Heparin, NaF/Potassium oxalate, EDTA/Fluoride at full and half-full tubes indicate close agreement (e.g., -0.026 to 0.019). Upper and Lower 95% CIs are provided (e.g., -0.181 to 0.172). |
      | Method Comparison | Good agreement with the NGSP reference method (Tosoh Automated Glycohemoglobin Analyzer HLC-723G8). | Whole Blood Application: Mean bias vs. NGSP TOSOH = -0.046%.
      Hemolysate Application: Mean bias vs. NGSP TOSOH = 0.046%.
      Bias at concentrations: (e.g., 5% HbA1c: WB -2.4%, Hemolysate 0.6%; 12% HbA1c: WB 0.7%, Hemolysate 1.2%). |
      | Total Error (TE) | Total Error within clinical requirements, considering both bias and precision. | Hemolysate Application: TE ranging from 3.0% to 4.4% across HbA1c levels.
      Whole Blood Application: TE ranging from 3.1% to 5.2% across HbA1c levels. |

    2. Sample size used for the test set and the data provenance

    • Precision (Repeatability and Intermediate Precision):

      • Sample Size: 10 samples (2 controls, 8 human samples) for each application (Hemolysate and Whole Blood). Measured for 21 days.
      • Data Provenance: Human samples and controls mentioned. No specific country of origin is stated, but implied to be laboratory-based testing. Prospective study design.
    • Analytical Sensitivity (LoB, LoD):

      • Sample Size:
        • LoB: One analyte-free sample. 60 measurements per lot across 3 lots.
        • LoD: Five unique human samples with low-analyte concentrations. 60 measurements per lot across 3 lots.
      • Data Provenance: Human samples mentioned. Laboratory-based testing. Prospective study design.
    • Linearity/Assay Reportable Range:

      • Sample Size: Separate dilution series (at least eleven levels) prepared from human hemolysate sample pools.
      • Data Provenance: Human hemolysate samples. Laboratory-based testing. Prospective study design.
    • Endogenous Interferences:

      • Sample Size: Pooled whole blood samples at two HbA1c levels, spiked with 9 different interferents. 18 spiked samples + interferent-free pools. Each tested in ten-fold.
      • Data Provenance: Pooled whole blood samples. Laboratory-based testing. Prospective study design.
    • Cross-Reactivity:

      • Sample Size: Not explicitly stated as a number of unique samples, but rather a "series of experiments" with specific cross-reactants. Ten replicates of each sample were analyzed for each dilution level.
      • Data Provenance: Laboratory-based testing using prepared samples to introduce cross-reactants. Prospective study design.
    • Hemoglobin Variants:

      • Sample Size: 30 HbS, 30 HbC, 30 HbE, 29 HbD, 15 HbA2, 19 Elevated HbF. Total = 153 samples.
      • Data Provenance: Not specified, but implied to be characterized patient samples containing the variants. Laboratory-based testing. Prospective.
    • Exogenous Interferences (Drugs):

      • Sample Size: Hemolysate samples at two HbA1c levels, spiked with 18 common drugs at two concentrations. Each drug/concentration combination tested in ten-fold.
      • Data Provenance: Hemolysate samples and spiked drugs. Laboratory-based testing. Prospective study design.
    • Sample Matrix Comparison:

      • Sample Size: At least 40 samples of each anticoagulant type (e.g., K2-EDTA, K3-EDTA, Na Heparin, Li Heparin, NaF/Potassium oxalate, EDTA/Fluoride) at full and half-filled tubes. Samples from one donor for full/half-filled comparisons.
      • Data Provenance: Human donor samples. Laboratory-based testing. Prospective study design.
    • Method Comparison:

      • Sample Size: 171 whole blood samples and 173 hemolysate samples.
      • Data Provenance: Samples from a "secondary NGSP reference laboratory." This suggests these are clinical samples that have been previously characterized by a gold standard (NGSP certified) method. The nature (retrospective/prospective clinical samples) is not explicitly stated but is consistent with a clinical validation using real patient samples.

    3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts

    The document does not describe the use of human experts to establish ground truth in the way one would for image-based diagnostic AI. This device is an in vitro diagnostic (IVD) reagent system for quantifying a biomarker (HbA1c).

    • Ground truth for the performance studies (e.g., precision, linearity, interferences) is established through:
      • Reference materials (e.g., controls like PreciControl HbA1c norm/path).
      • Dilution series from characterized sample pools.
      • Spiking experiments with known concentrations of interferents or cross-reactants.
    • For Hemoglobin Variants and Method Comparison:
      • The "ground truth" or reference method is the NGSP Tosoh HPLC system. This system undergoes certification by the National Glycohemoglobin Standardization Program (NGSP) and is considered a highly accurate laboratory assay method, not dependent on human expert interpretation of a result. No individual human expert counts or qualifications are reported for establishing these reference values.

    4. Adjudication method for the test set

    Not applicable. This is an IVD device, not an AI or imaging diagnostic device that typically requires expert adjudication for ground truth establishment. The performance is assessed by comparing results to established reference methods, spiked concentrations, or statistical analysis of replicates.

    5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

    Not applicable. The Tina-quant Hemoglobin A1cDx Gen.3 assay is an in vitro diagnostic (IVD) device for quantitative determination of HbA1c. It does not involve human readers interpreting images or data with or without AI assistance. It provides a numerical result.

    6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done

    Yes, the studies described are all standalone (algorithm only) performance evaluations. The device autonomously measures HbA1c and Hb concentrations, calculates the ratio, and reports the final HbA1c result. There is no human intervention in the result generation process once the sample is loaded onto the analyzer.

    7. The type of ground truth used

    The ground truth used in various parts of the study consists of:

    • Reference Methods: The NGSP Tosoh HPLC system for method comparison, which is a recognized standardized method for HbA1c determination.
    • Certified Reference Materials/Controls: PreciControl HbA1c norm and path with assigned values.
    • Known Concentrations: For linearity, LoB, LoD studies, the "truth" is derived from preparing samples with known concentrations or by statistical analysis of repeat measurements of low/negative samples.
    • Spiked Samples: For interference and cross-reactivity studies, the "truth" is the un-spiked sample value, and the effect is measured by deviation after adding a known amount of interferent.
    • Characterized Patient Samples: For hemoglobin variant testing, samples from patients known to carry specific hemoglobin variants were used.

    8. The sample size for the training set

    This document does not describe a "training set" in the context of machine learning or AI. The Tina-quant Hemoglobin A1cDx Gen.3 is a reagent system for a well-established immunoassay technique. Its development involved chemical and assay optimization, not machine learning model training.

    9. How the ground truth for the training set was established

    Not applicable, as there is no mention or indication of a machine learning "training set" for this IVD device. The assay's analytical principles are based on turbidimetric inhibition immunoassay (TINIA) and bichromatic photometric determination, which are traditional chemical analysis methods, not AI-driven algorithms requiring training data.

    Ask a Question

    Ask a specific question about this device

    K Number
    K192072
    Date Cleared
    2020-02-21

    (203 days)

    Product Code
    Regulation Number
    866.5270
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Roche Diagnostics Operations (RDO)

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    Tina-quant® C-Reactive Protein IV is an immunoturbidimetric assay for the in vitro quantitative determination of CRP in human serum and plasma on cobas c systems.

    A C-reactive protein immunological test system is a device that consists of the reagents used to measure by immunochemical techniques the C-reactive protein in serum and plasma. Measurement of C-reactive protein aids in evaluation of the amount of injury to body tissues.

    Device Description

    The Tina-quant® C-Reactive Protein IV reagent will be a liquid ready to use 2 component particle enhanced immunoturbidimetric assay.

    Reagents - working solutions

    R1: TRIS* buffer with bovine serum albumin; preservatives

    R2 Latex particles coated with anti-CRP (mouse) in glycine buffer; immunoglobulins (mouse); preservative

    • TRIS= Tris(hydroxymethyl)-aminomethane

    The Tina-quant® C-Reactive Protein IV assay will be based on the DUREL technology (dual radius enhanced latex - technology) which is also used in C-Reactive Protein Gen.3 predicate method. Human CRP agglutinates with latex particles coated with monoclonal anti-CRP antibodies. The aggregates are determined turbidimetrically.

    AI/ML Overview

    The document describes the non-clinical performance evaluation of the Tina-quant® C-Reactive Protein IV device. Here's a summary of the acceptance criteria and the study that proves the device meets them:

    1. A table of acceptance criteria and the reported device performance

    Performance CharacteristicAcceptance Criteria or Expected Outcome (or Predicate Performance)Reported Device Performance (Tina-quant® C-Reactive Protein IV)
    PrecisionRepeatability (CV%)Repeatability (CV%)
    Precinorm ProteinPredicate: 1.2%1.3%
    Precipath ProteinPredicate: 1.3%1.6%
    Human Serum SamplesPredicate: 3.6%, 1.6%, 1.2% (for different samples)1.5% (Serum 2), 1.6% (Serum 3), 2.2% (Serum 4), 2.0% (Serum 5), 1.3% (Serum 6)
    Intermediate Precision (CV%)Intermediate Precision (CV%)Intermediate Precision (CV%)
    Precinorm ProteinPredicate: 2.9%1.5%
    Precipath ProteinPredicate: 1.9%1.9%
    Human Serum SamplesPredicate: 11.1%, 3.9%, 1.7% (for different samples)1.6% (Serum 2), 1.9% (Serum 3), 2.4% (Serum 4), 2.4% (Serum 5), 1.8% (Serum 6)
    Analytical Sensitivity
    Limit of Blank (LoB)Claimed LoB: 0.2 mg/LObserved LoB: 0.0700 mg/L (Meets criterion: Observed is less than claimed)
    Limit of Detection (LoD)Claimed LoD: 0.3 mg/LObserved LoD: 0.137 mg/L (Meets criterion: Observed is less than claimed)
    Limit of Quantitation (LoQ)Claimed LoQ: 3 mg/L (Predicate was 0.6 mg/L, but 3 mg/L is claimed for the candidate device. The study shows the device is capable of quantifying lower.)Observed LoQ: 0.313 mg/L (Exceeds criterion as it is much lower than the claimed 3 mg/L, indicating better performance. The claimed measuring range for Tina-quant® C-Reactive Protein IV starts at 3 mg/L, so the LoQ of 0.313 mg/L is well below the lowest reportable value, which is acceptable.)
    Linearity/Assay Reportable RangeConsistent with predicate, good correlation (R > 0.999), and linearity across the intended measuring range.Linear Regression: y=1.002x-0.0169; Pearson correlation coefficient (R)=0.9994. Claimed Measuring Range: 3 to 350 mg/L. (Meets criterion)
    Endogenous InterferenceNo interference up to specified levels for lipemia, hemolysis, bilirubin, ditauro bilirubin, albumin, IgG, and RF Factor.No interference up to: Lipemia: 1000 L Index; Hemolysis: 1000 H Index; Bilirubin: 60 I Index; Ditauro Bilirubin: 60 I Index; Albumin: 60 g/L; IgG: 50 g/L; RF Factor: 1200 IU/mL. (Meets criterion)
    Exogenous Interference (Drugs)No interference up to specified drug concentrations.No interference up to: N-Acetylcysteine: 1660 mg/L; Ampicillin-Na: 1000 mg/L; Ascorbic acid: 300 mg/L; Cefoxitin: 6600 mg/L; Heparin: 5000 IU/L; Levodopa: 20 mg/L; Methyldopa: 22.5 mg/L; Metronidazole: 200 mg/L; Doxycyclin: 50 mg/L; Acetylsalicylic acid: 1000 mg/L; Rifampicin: 60 mg/L; Ticarcillin: 225 mg/L; Penicillamin: 24 mg/L; Phenylbutazone: 400 mg/L; Cyclosporine: 5 mg/L; Acetaminophen: 200 mg/L; Ibuprofen: 500 mg/L; Theophylline: 100 mg/L. (Meets criterion)
    Sample Matrix ComparisonGood agreement between serum and plasma types (Li-Heparin, K2-EDTA, K3-EDTA) with correlation (r) close to 1 and slope near 1, intercept near 0.Linear Regression: Serum vs. Li-Heparin: y = 1.029x - 0.192, r = 0.999; Serum vs. K2-EDTA: y = 1.024x - 0.201, r = 0.999; Serum vs. K3-EDTA: y = 1.024x - 0.258, r = 0.999. (Meets criterion)
    Method Comparison to PredicateStrong correlation with the predicate device (R > 0.999) and slope near 1, intercept near 0.Passing/Bablok Regression: Slope = 0.985, Intercept = +0.278, Correlation (Pearson) = 0.999. Weighted Deming Regression: Slope = 0.979, Intercept = +0.296, Correlation = 0.999. (Meets criterion for substantial equivalence)
    StabilityMeet Roche Diagnostic's claims on package labeling.Data supports Roche Diagnostic's claims. (Meets criterion)

    Study Details:

    The performance studies were designed in accordance with CLSI guidelines (EP5-A3, EP17-A2, EP6-A) and FDA guidance for CRP assays.

    2. Sample sized used for the test set and the data provenance:

    • Precision (Repeatability & Intermediate Precision):
      • Controls: Precinorm Protein and Precipath Protein.
      • Human Serum Samples: 4 human serum samples were used to evaluate repeatability and intermediate precision, plus 6 human serum samples for the specific results documented in the table. Each sample/control was analyzed with multiple aliquots (e.g., 2 aliquots for 21 days for precision).
      • Data Provenance: Not explicitly stated (e.g., country of origin), but it's noted as "human serum samples." The studies are prospective for the device evaluation.
    • Analytical Sensitivity (LoB, LoD, LoQ):
      • LoB: Ten aliquots of analyte-free saline (N=60 determinations per lot).
      • LoD: Five samples of low analyte level human serum (N=60 determinations per lot).
      • LoQ: Nine low concentration human serum samples (N=25 determinations per sample per lot).
      • Data Provenance: Not explicitly stated for specific origin, but uses "analyte free saline" and "human serum."
    • Linearity/Assay Reportable Range:
      • Samples: Dilution series prepared from native unmodified human serum sample pools, resulting in 15 levels. Each level measured in triplicate (n ≥ 3).
      • Data Provenance: "native unmodified human serum sample pools."
    • Endogenous Interference:
      • Samples: Effects determined at 2 CRP levels (5-10 mg/L and 35-100 mg/L) utilizing 11-level serial dilution sets of interfering substances. Each level measured in triplicate.
      • Data Provenance: Not explicitly stated, likely lab-prepared samples with added interferents.
    • Exogenous Interference (Drugs):
      • Samples: Effects determined at 2 CRP levels (5-10 mg/L and 35-100 mg/L) using pooled samples spiked with drugs. N=5 results per drug.
      • Data Provenance: Lab-prepared samples with added drugs.
    • Sample Matrix Comparison:
      • Samples: Native samples from single donors drawn into serum, Li-Heparin, K2-EDTA, and K3-EDTA plasma primary tubes.
      • Range Tested: 3.34 to 344 mg/L.
      • Data Provenance: "native samples (single donors)."
    • Method Comparison to Predicate:
      • Samples: One hundred ten (N=110) native, unaltered serum samples.
      • Data Provenance: "native, unaltered serum samples."

    3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g., radiologist with 10 years of experience)

    This device is an in-vitro diagnostic (IVD) assay for quantitative determination of C-Reactive Protein (CRP). The "ground truth" for such devices is established by reference methods, certified reference materials, and accepted analytical techniques, not by expert interpretation in the same way imaging studies might use radiologists. The measurements for the test set samples (e.g., CRP concentrations) are determined by the analytical methods themselves, often verified against established standards or predicate devices. There is no mention of human experts establishing ground truth for the test set in the context of interpretation.

    4. Adjudication method (e.g., 2+1, 3+1, none) for the test set

    For IVD assays, ground truth is typically analytical, not based on expert adjudication of observations. The "truth" is the measured concentration, often confirmed by multiple replicates or comparative methods, as opposed to a consensus reading process found in clinical imaging studies. Therefore, no adjudication method (like 2+1 or 3+1) is applicable or described here.

    5. If a multi-reader multi-case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

    No, an MRMC comparative effectiveness study was not performed. This device is an in-vitro diagnostic instrument for measuring a biomarker (CRP). It does not involve human readers interpreting images or results that would be "assisted" by AI. The device directly produces quantitative results.

    6. If a standalone (i.e., algorithm only without human-in-the-loop performance) was done

    Yes, the performance studies described are for the device (Tina-quant® C-Reactive Protein IV on a cobas c 501 analyzer) operating in a standalone capacity. It measures CRP in samples without human intervention in the interpretive output. The studies evaluate the analytical performance of the instrument and reagents themselves.

    7. The type of ground truth used (expert consensus, pathology, outcomes data, etc.)

    The ground truth for this IVD device is based on:

    • Analytical Standards: For LoB, LoD, LoQ, and Linearity, ground truth is established through statistical derivation from measurements of samples with known low or varying concentrations, or through the use of analyte-free samples or reference materials.
    • Predicate Device Comparison: The "Method Comparison to Predicate" establishes the ground truth by comparing the device's results against a legally marketed and established predicate device (Roche Diagnostics C-Reactive Protein Gen.3), assuming the predicate provides the accepted reference values.
    • Spiked Samples/Known Concentrations: For interference studies (endogenous and exogenous), ground truth is established by adding known amounts of interfering substances or drugs to samples with known CRP concentrations and observing the recovery of the expected CRP value.
    • Certified Reference Materials (CRM): The "Traceability/Standardization" indicates that the candidate device is standardized against the certified reference material of IRMM (Institute for Reference Materials and Measurements) ERM-DA474/IFCC. This is a primary source of analytical ground truth.

    8. The sample size for the training set

    This document describes a premarket notification (510(k)) submission for a medical device. The "training set" concept is typically associated with machine learning or AI models. This device is an immunoturbidimetric assay, which is a traditional analytical chemistry method, not an AI/ML system. Therefore, there is no "training set" in the context of machine learning. The studies described are performance evaluations to demonstrate that the device meets its analytical specifications.

    9. How the ground truth for the training set was established

    As there is no "training set" for an AI/ML model for this traditional IVD assay, this question is not applicable. The device's performance is validated against analytical performance criteria as described above in point 7.

    Ask a Question

    Ask a specific question about this device

    K Number
    K183517
    Device Name
    Ammonia II
    Date Cleared
    2019-02-08

    (52 days)

    Product Code
    Regulation Number
    862.1065
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Roche Diagnostics Operations (RDO)

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The Ammonia II assay is an enzymatic in vitro test for the quantitative determination of ammonia in human plasma on Roche/Hitachi cobas c systems.

    Ammonia measurements are used in the diagnosis and treatment of severe liver disorders, such as cirrhosis, hepatitis, and Reye's syndrome.

    Device Description

    The Ammonia II (NH3L2) assay is an enzymatic in vitro test for the quantitative determination of ammonia in human plasma on Roche/Hitachi cobas c systems. The Ammonia II assay is an enzymatic method, with glutamate dehydrogenase.

    AI/ML Overview

    This document describes the Ammonia II assay for the quantitative determination of ammonia in human plasma. Here's a breakdown of the acceptance criteria and study information:

    1. Table of Acceptance Criteria and Reported Device Performance

    The acceptance criteria are generally qualitative ("All data passed the predetermined acceptance criteria") rather than specific numerical thresholds presented in a consolidated table. However, the reported performance data for each test indicates the values achieved. Based on the provided text, a summary of performance can be extracted:

    Ammonia II Assay Performance Summary

    Performance CharacteristicAcceptance Criteria (Implied)Reported Device Performance
    Precision (Intermediate)All data passed predetermined acceptance criteria.AMM-N (67.9 µmol/L): SD 1.61 µmol/L, CV 2.4%
    AMM-P (243 µmol/L): SD 4.26 µmol/L, CV 1.8%
    Plasma 1 (26.0 µmol/L): SD 1.29 µmol/L, CV 4.9%
    Plasma 2 (57.7 µmol/L): SD 1.72 µmol/L, CV 3.0%
    Plasma 3 (110 µmol/L): SD 1.92 µmol/L, CV 1.7%
    Plasma 4 (480 µmol/L): SD 6.30 µmol/L, CV 1.3%
    Plasma 5 (853 µmol/L): SD 12.4 µmol/L, CV 1.5%
    Limit of Blank (LoB)≤ 10 µmol/L1.80 µmol/L
    Limit of Detection (LoD)≤ 10 µmol/L3.46 µmol/L
    Limit of Quantitation (LoQ)≤ 10 µmol/L9.36 µmol/L
    LinearityCorrelation coefficient (r²) approaching 1.000 for linear fit.Lot 1: y = 1.003x - 2.19, r² = 0.9999
    Lot 2: y = 1.002x - 1.30, r² = 1
    Lot 3: y = 1.002x - 1.56, r² = 0.9999
    Endogenous InterferenceNo significant interference (implicitly, within specified levels).Hemolysis (114-146 mg/dL): Passed at 36.1-91.8 µmol/L Ammonia
    Unconjugated Bilirubin (68-69 mg/dL): Passed at 46.4-113 µmol/L Ammonia
    Conjugated Bilirubin (64 mg/dL): Passed at 40.2-89.1 µmol/L Ammonia
    Lipemia (764-771 mg/dL): Passed at 51.5-92.7 µmol/L Ammonia
    Albumin (77.2-77.5 g/L): Passed at 47.2-108 µmol/L Ammonia
    Immunoglobulin (IgG) (71.4-71.7 g/L): Passed at 41.5-83.9 µmol/L Ammonia
    Exogenous Interference (Drugs)No interference at therapeutic concentrations (except noted).No interference found for common drug panels with the exceptions of Cefoxitin, Sulfasalazin, and Temozolomid.
    Matrix ComparisonCorrelation (Pearson (r)) approaching 1.000, slope near 1.0, intercept near 0.0.Lot 1: y = 1.002x – 1.18, r = 1.000
    Lot 2: y = 0.987x – 0.77, r = 1.000
    Lot 3: y = 1.005x – 1.39, r = 1.000
    Method Comparison (Predicate)Correlation (r) approaching 1.000, slope near 1.0, intercept near 0.0.y = 1.001x – 1.90 µmol/L, r = 1.000

    2. Sample sizes used for the test set and the data provenance

    • Precision: Not explicitly stated as a "test set" in the context of diagnostic accuracy but involves replicate measurements of various controls and human plasma samples over 21 days.
    • LoB, LoD, LoQ:
      • LoB: One analyte-free sample measured with three lots in 10-fold determination in 6 runs (60 measurements per lot).
      • LoD: Five samples with low-analyte concentration measured with three lots in two-fold determination in 6 runs (60 measurements per lot).
      • LoQ: A low-level sample set (7 human plasma samples) tested in 5 replicates per sample on 5 days.
    • Linearity: Not explicitly stated, typically involves a range of spiked samples.
    • Endogenous Interferences: Pooled human plasma samples spiked with varying levels of interferent (10 dilution steps per sample), tested in triplicate.
    • Exogenous Interferences (Drugs): Two sample pools (low and high NH3L2), each divided into aliquots. Reference aliquot (not spiked) tested n=3. Spiked aliquots tested in triplicate.
    • Matrix Comparison: 52-53 tubes of K2 EDTA plasma and 52-53 tubes of K3 EDTA plasma for each of 3 reagent lots (total of ~156-159 tubes per anticoagulant type).
    • Method Comparison to Predicate: 112 human plasma samples.

    Data Provenance: The document generally refers to "human plasma" samples, suggesting human subjects. The country of origin is not specified but given the submitter is Roche Diagnostics (with registration numbers for Mannheim, Germany, Penzberg, Germany, and the United States), the data could be from multiple regions. The studies are prospective performance evaluations of the device conducted according to CLSI guidelines.

    3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts

    Not applicable. This device is an in vitro diagnostic (IVD) assay for quantitative measurement. The "ground truth" for the performance characteristics (precision, limits, linearity, interference) is established by analytical methods and reference materials, not by expert interpretation of images or clinical cases.

    4. Adjudication method for the test set

    Not applicable. This is an IVD assay, and the studies are analytical performance evaluations, not clinical studies involving expert adjudication of diagnostics results or images.

    5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

    Not applicable. This is an IVD assay for quantitative ammonia measurement, not an AI-powered diagnostic imaging device or a decision support system for human readers.

    6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done

    Yes, directly. The studies described (Precision, LoB/LoD/LoQ, Linearity, Interference, Matrix Comparison, Method Comparison) evaluate the analytical performance of the Ammonia II assay itself, without a human-in-the-loop component for result generation. The device (Ammonia II assay on Roche/Hitachi cobas c systems) performs the quantitative determination of ammonia.

    7. The type of ground truth used

    The ground truth used for these analytical studies is based on:

    • Reference materials and spiked samples: For linearity, LoB/LoD/LoQ, and interference studies, known concentrations of analyte or interferents are used to challenge the assay.
    • Statistical methods: For precision, calculations of SD and CV reflect the inherent variability.
    • Comparative methods: For method comparison, the results are compared against a legally marketed predicate device (Beckman Coulter Ammonia assay) using statistical regression.
    • Clinical Laboratory Standards Institute (CLSI) guidelines: These guidelines (EP05-A3, EP17-A2, EP06-A) provide standardized methodologies for establishing analytical performance, which inherently define how "ground truth" is approached for these types of assays.

    8. The sample size for the training set

    Not applicable. This is not a machine learning or AI device that requires a distinct "training set." The performance studies are analytical evaluations of a chemical assay.

    9. How the ground truth for the training set was established

    Not applicable, as there is no "training set" in the context of this device.

    Ask a Question

    Ask a specific question about this device

    K Number
    K182095
    Date Cleared
    2018-11-05

    (94 days)

    Product Code
    Regulation Number
    866.5880
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Roche Diagnostics Operations (RDO)

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    Tina-quant Transferrin ver.2 (urine application) assay is an in vitro test for the quantitative determination of transferrin in human urine on Roche/Hitachi cobas c systems.

    A transferrin immunological test system is a device that consists of the reagents used to measure by immunochemical techniques the transferrin (an iron-binding and transporting serum protein) in urine. Measurement of transferrin levels aids in the diagnosis of malnutrition, acute inflammation, infection, and red blood cell disorders, such as iron deficiency anemia.

    Device Description

    The Tina-quant Transferrin ver.2 (urine application) assay is a two reagent assay for the in vitro quantitative determination of transferrin in human urine on automated clinical chemistry analyzers. It is an immunoturbidimetric assay in which human transferrin forms a precipitate with a specific antiserum which is determined turbidimetrically.

    Engineering drawings, schematics, and figures are not pertinent to describe the device, as the device is a reagent.

    AI/ML Overview

    The document provided is a 510(k) Premarket Notification for an in vitro diagnostic device, the "Tina-quant Transferrin ver.2 (urine application) assay." This type of submission focuses on demonstrating substantial equivalence to a legally marketed predicate device, rather than proving clinical effectiveness through extensive human studies often seen with novel medical devices. Therefore, the information regarding acceptance criteria and study design will be primarily focused on analytical performance validation rather than multi-reader multi-case clinical studies involving human interpretation of images, as this is a laboratory reagent.

    Here's an analysis of the provided text in the context of your request:

    1. Table of Acceptance Criteria and Reported Device Performance

    The acceptance criteria for this device are largely implicit in the fact that "All data passed the predetermined acceptance criteria" for each analytical study. The performance is reported as the results of these studies.

    Performance CharacteristicAcceptance Criteria (Implicit: "All data passed the predetermined criteria")Reported Device Performance
    PrecisionCV% and SD values within predefined limits.Repeatability (within-run precision)
    - PreciControl ClinChem Multi 1Not explicitly stated, but results passed.Mean: 1.98 mg/dL, SD: 0.0140 mg/dL, CV: 0.7%
    - PreciControl ClinChem Multi 2Not explicitly stated, but results passed.Mean: 3.05 mg/dL, SD: 0.0242 mg/dL, CV: 0.8%
    - Human Urine 1Not explicitly stated, but results passed.Mean: 0.435 mg/dL, SD: 0.00979 mg/dL, CV: 2.3%
    - Human Urine 2Not explicitly stated, but results passed.Mean: 0.737 mg/dL, SD: 0.00920 mg/dL, CV: 1.2%
    - Human Urine 3Not explicitly stated, but results passed.Mean: 1.27 mg/dL, SD: 0.0107 mg/dL, CV: 0.8%
    - Human Urine 4Not explicitly stated, but results passed.Mean: 2.52 mg/dL, SD: 0.0184 mg/dL, CV: 0.7%
    - Human Urine 5Not explicitly stated, but results passed.Mean: 3.30 mg/dL, SD: 0.0252 mg/dL, CV: 0.8%
    Intermediate Precision (within-lab precision)Not explicitly stated, but results passed.
    - PreciControl ClinChem Multi 1Not explicitly stated, but results passed.Mean: 1.98 mg/dL, SD: 0.0158 mg/dL, CV: 0.8%
    - PreciControl ClinChem Multi 2Not explicitly stated, but results passed.Mean: 3.05 mg/dL, SD: 0.0267 mg/dL, CV: 0.9%
    - Human Urine 1Not explicitly stated, but results passed.Mean: 0.435 mg/dL, SD: 0.0111 mg/dL, CV: 2.5%
    - Human Urine 2Not explicitly stated, but results passed.Mean: 0.737 mg/dL, SD: 0.0112 mg/dL, CV: 1.5%
    - Human Urine 3Not explicitly stated, but results passed.Mean: 1.23 mg/dL, SD: 0.0130 mg/dL, CV: 1.1%
    - Human Urine 4Not explicitly stated, but results passed.Mean: 2.52 mg/dL, SD: 0.0215 mg/dL, CV: 0.9%
    - Human Urine 5Not explicitly stated, but results passed.Mean: 3.30 mg/dL, SD: 0.0289 mg/dL, CV: 0.9%
    Analytical Sensitivity
    - Limit of Blank (LoB)LoB Claim: 0.10 mg/dL (highest measurement for blank sample with stated prob.)Lot #1: 0.0150 mg/dL, Lot #2: 0.0130 mg/dL, Lot #3: 0.0150 mg/dL
    - Limit of Detection (LoD)LoD Claim: 0.15 mg/dL (lowest detectable analyte concentration with 95% prob.)Lot #1: 0.0382 mg/dL, Lot #2: 0.0331 mg/dL, Lot #3: 0.0353 mg/dL
    - Limit of Quantitation (LoQ)LoQ Claim: 0.22 mg/dL with 20% CV (lowest quantifiable concentration)Lot #1: 0.124 mg/dL, Lot #2: 0.137 mg/dL, Lot #3: 0.143 mg/dL
    Linearity/Assay Reportable RangeLinear relationship across the measuring range.
    - Measuring Range Claim0.22 to 3.5 mg/dL.Confirmed.
    - Pearson Correlation Coefficient (r)Close to 1.Lot 1: 0.9999, Lot 2: 0.9999, Lot 3: 0.9997
    Endogenous InterferencesNo interference at specified concentrations.
    - AlbuminNo interference ≤ 5000 mg/L.Passed (tested at 5 g/L).
    - CalciumNo interference ≤ 8 mmol/L.Passed (tested up to 9.92/9.80 mmol/L).
    - CitrateNo interference ≤ 10 mmol/L.Passed (tested up to 11 mmol/L).
    - CreatinineNo interference ≤ 44 mmol/L.Passed (tested up to 88 mmol/L).
    - GlucoseNo interference ≤ 111 mmol/L.Passed (tested up to 388 mmol/L).
    - HemoglobinNo significant interference up to 100 mg/dL.Passed (tested up to 146/149 mg/dL).
    - Immunoglobulin (IgG)No interference ≤ 500 mg/L.Passed (tested up to 1.1 g/L).
    - MagnesiumNo interference ≤ 75 mmol/L.Passed (tested up to 75 mmol/L).
    - OxalateNo interference ≤ 2.2 mmol/L.Passed (tested up to 3.75 mmol/L).
    - PhosphateNo interference ≤ 40 mmol/L.Passed (tested up to 130 mmol/L).
    - UreaNo interference ≤ 1000 mmol/L.Passed (tested up to 1500/1800 mmol/L).
    - Uric AcidNo interference ≤ 6 mmol/L.Passed (tested up to 6 mmol/L).
    - UrobilinogenNo interference ≤ 15 mg/dL.Passed (tested up to 15 mg/dL).
    Exogenous Interferences – DrugsNo interference at therapeutic concentrations (except noted).
    - AcetaminophenNot explicitly stated, but results passed up to 3000 mg/L.No interference up to 3000 mg/L.
    - Ascorbic acidNot explicitly stated, but results passed up to 4000 mg/L.No interference up to 4000 mg/L.
    - CefoxitinNot explicitly stated, but results passed up to 12000 mg/L.No interference up to 12000 mg/L.
    - Gentamicin sulfateNot explicitly stated, but results passed up to 400 mg/L.No interference up to 400 mg/L.
    - IbuprofenNot explicitly stated, but results passed up to 500 mg/L.No interference up to 500 mg/L.
    - LevodopaNot explicitly stated, but results passed up to 1000 mg/L.No interference up to 1000 mg/L.
    - MethyldopaNot explicitly stated, but results passed up to 2000 mg/L.No interference up to 2000 mg/L.
    - N-AcetylcysteineNot explicitly stated, but results passed up to 10 mg/L.No interference up to 10 mg/L.
    - OfloxacineNo interference.Interference observed (artificially high results). Claim adjusted.
    - PhenazopyridineNot explicitly stated, but results passed up to 50 mg/L.No interference up to 50 mg/L.
    - Salicyluric acidNot explicitly stated, but results passed up to 100 mg/L.No interference up to 100 mg/L.
    - TetracyclineNot explicitly stated, but results passed up to 300 mg/L.No interference up to 300 mg/L.
    Method Comparison to PredicatePredetermined acceptance criteria met. (e.g. slope near 1, intercept near 0, high r)y = 1.007x + 0.0052, r = 0.995 (Passing Bablok Regression)

    2. Sample Size Used for the Test Set and Data Provenance

    • Precision and Analytical Sensitivity (LoB, LoD, LoQ):
      • Precision (Repeatability and Intermediate Precision): 5 human urine sample pools and 2 control samples. Tested for 21 days, 1 run/day, with 2 aliquots per sample in singlicate per part. This setup generates a large number of individual measurements over time to assess variability.
      • LoB: One analyte-free sample, measured 10-fold per run across 6 runs (over 4 days) on 3 reagent lots, resulting in 60 measurements per lot.
      • LoD: Five human urine samples with low-analyte concentration, measured 2-fold per run across 6 runs (over 4 days) on 3 reagent lots, resulting in 60 measurements per lot.
      • LoQ: A low-level sample set prepared by diluting 5 human urine samples, tested in 5 replicates per sample on 4 days, 1 run per day.
    • Linearity/Assay Reportable Range: Dilution series prepared using human urine sample pools (number of pools not specified, but likely at least one concentrated pool), with 13 concentrations measured on 3 lots in triplicate.
    • Endogenous Interferences: Two human urine pools (at two transferrin concentrations) were used for each interferent. Each pool was divided into two aliquots (spiked with interferent vs. solvent control). A dilution series of 11 steps was prepared and 3 aliquots per level were tested.
    • Exogenous Interferences – Drugs: Two human urine sample pools (spiked with approximately 0.433 and 2.48 mg/dL transferrin concentrations) were used for each drug. Each pool was divided into two aliquots (drug spiked vs. solvent control), measured in triplicate.
    • Method Comparison to Predicate: One hundred and seven (107) routine fresh, never-frozen human urine samples. Two samples were excluded (pH >8, value outside measuring range), so 107 samples were truly used in the comparison.
    • Data Provenance: The document explicitly states "human urine samples" or "human urine sample pools." For the method comparison, samples were "routine fresh, never-frozen human urine samples." There is no specific mention of the country of origin, but Roche Diagnostics Operations (RDO) is located in Indianapolis, Indiana, USA, and Roche Diagnostics GmbH, Mannheim, Germany is also mentioned as having the establishment registration. The studies are prospective analytical validation studies conducted with collected samples, not retrospective analysis of clinical patient data in the typical sense for imaging.

    3. Number of Experts Used to Establish Ground Truth for the Test Set and Qualifications of Those Experts

    This type of in vitro diagnostic device (IVD) aims for quantitative measurement of a biomarker. Therefore, the "ground truth" is established through analytical reference methods, certified reference materials, or highly rigorous internal validation processes tied to metrological traceability, rather than human expert consensus on subjective findings (as would be the case for an imaging AI).

    • The ground truth for the test set is established by the analytical measurement on the reference method (for method comparison study), and by the known concentrations/dilutions of samples prepared for analytical studies (e.g., linearity, sensitivity, interference).
    • No "experts" in the sense of radiologists interpreting images were involved in establishing the ground truth for these analytical performance studies. The accuracy of measurements is verified against the reference standard or predetermined analytical values.

    4. Adjudication Method for the Test Set

    Not applicable for this type of analytical performance study. Adjudication methods (e.g., 2+1, 3+1) are common in clinical studies where multiple human readers independently assess data (like images) and then a consensus or tie-breaking mechanism is needed to establish ground truth or assess agreement. For an IVD, the "truth" is typically defined by the analytical method itself or a reference method.

    5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done, If So, What Was the Effect Size of How Much Human Readers Improve with AI vs Without AI Assistance

    Not applicable. This device is a quantitative laboratory assay (a reagent for measuring transferrin in urine), not an AI imaging algorithm that assists human readers. No MRMC study was performed as it is irrelevant to the device's function.

    6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) Was Done

    Yes, the analytical performance studies (Precision, Analytical Sensitivity, Linearity, Interference, Method Comparison) represent the "standalone" performance of the assay itself (the reagent/instrument system) without human intervention in the result generation beyond operating the analyzer according to instructions. This is the primary form of performance evaluation for an IVD.

    7. The Type of Ground Truth Used

    • For Precision, Analytical Sensitivity, Linearity, and Interference studies: The ground truth is effectively derived from known concentrations in prepared samples (e.g., analyte-free samples, low-concentration samples, dilution series, spiked samples) or reference materials/controls with established values.
    • For Method Comparison: The ground truth is the measurement obtained from the predicate device, the "N Antisera to Human Transferrin (Siemens) on the BN ProSpec analyzer." This establishes substantial equivalence to an already legally marketed device.

    8. The Sample Size for the Training Set

    Not applicable. This is not an AI/machine learning device that requires "training data" in the conventional sense. It's a chemical reagent for an established analytical method (immunoturbidimetry). The development process would have involved formulation and optimization, but not "training" on a data set in the way an AI model would be.

    9. How the Ground Truth for the Training Set Was Established

    Not applicable, as there is no "training set" for this type of IVD, which relies on chemical and immunological principles rather than machine learning from data.

    Ask a Question

    Ask a specific question about this device

    K Number
    K171080
    Device Name
    ALP IFCC Gen.2
    Date Cleared
    2017-05-10

    (29 days)

    Product Code
    Regulation Number
    862.1050
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Roche Diagnostics Operations (RDO)

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    ALP IFCC Gen.2 is an in vitro test intended for the quantitative determination of the catalytic activity of alkaline phosphatase in human serum and plasma on COBAS INTEGRA systems. Measurements of alkaline phosphatase or its isoenzymes are used in the diagnosis and treatment of liver, bone, parathyroid, and intestinal diseases.

    Device Description

    The Roche ALP IFCC Gen.2 assay provides quantitative measurement of the catalytic activity of alkaline phosphatase in human serum and plasma in accordance with a standardized method.. The reagents are packaged in a cassette with two bottles labeled with their instrument positioning, R1 (position B) and SR (position C).

    In the presence of magnesium and zinc ions, p-nitrophenyl phosphate is cleaved by phosphatases into phosphate and p-nitrophenol. The p-nitrophenol released is directly proportional to the catalytic ALP activity. It is determined by measuring the increase in absorbance.

    AI/ML Overview

    Here's an analysis of the provided text regarding the acceptance criteria and study information:

    This document is a 510(k) summary for a diagnostic assay, not an AI/ML device. Therefore, many of the typical questions for AI/ML studies (like MRMC studies, reader performance, training set details, etc.) are not applicable here. The acceptance criteria and performance are for an in vitro diagnostic (IVD) reagent and its analytical performance.


    1. Table of Acceptance Criteria and Reported Device Performance

    The document describes modifications to an existing device (ALP IFCC Gen.2). The acceptance criteria are implicit in the "Pass/Fail criteria" for the verification and validation tests performed. The "reported device performance" refers to the characteristics of the modified device and the confirmation that it met these criteria.

    Performance CharacteristicAcceptance Criterion (Implicit)Reported Device Performance (Modified ALP IFCC Gen.2)
    Measuring Range3.0 - 1200 U/L (consistent with predicate/intended use)3.0 - 1200 U/L
    Lower Detection Limit (LDL)3.0 U/L (consistent with predicate/intended use)3.0 U/L
    Precision"See predicate method sheet" (implies performance is comparable)"Same" as predicate (meaning performance met the established precision specifications for the predicate)
    Method Comparison"See predicate method sheet" (implies performance is comparable)"Same" as predicate (meaning the method comparison with established methods yielded comparable results to the predicate, likely within established statistical agreement limits)
    Interference: HemolysisNo significant interference up to 0.16 mmol/L (2.5 g/L) hemoglobinNo significant interference up to hemoglobin level of 0.16 mmol/L (2.5 g/L).
    Interference: IcterusNo significant interference up to specified I index levelsNo significant interference up to an I index of 42 for conjugated bilirubin and 60 for unconjugated bilirubin. (This is an improvement/addition to the predicate which simply stated "No significant interference.")
    Interference: LipemiaNo significant interference up to specified L index levelsNo significant interference up to an L index of 2000. (This is an improvement/addition to the predicate which simply stated "No significant interference.")
    Traceability/StandardizationStandardized against the IFCC (2011) reference procedureStandardized against the IFCC (2011) procedure. (This is the primary change and was successfully implemented.)
    Recovery in ControlsMet pre-determined Pass/Fail criteria for accuracyPassed all tests based on pre-determined Pass/Fail criteria (specific values not provided, but implies recovery was within acceptable limits for various control levels across the measuring range).
    LinearityMet pre-determined Pass/Fail criteria for linearity across rangePassed all tests based on pre-determined Pass/Fail criteria (specific values not provided, but implies the assay demonstrated linear response across its measuring range within acceptable deviations).

    Summary of the Study:

    The document describes a Special 510(k) Premarket Notification for modifications to an existing in vitro diagnostic device, ALP IFCC Gen.2. The core purpose was to change the traceability standard of the assay and add specific interference claims. The "study" refers to the verification, validation, and testing activities conducted to confirm that these modifications did not adversely affect the device's performance and that the new claims were supported.

    Breakdown of Information Request:

    1. Table of acceptance criteria and reported device performance: See table above.

    2. Sample size used for the test set and the data provenance (e.g., country of origin of the data, retrospective or prospective):

      • Sample Size: Not explicitly stated. The document mentions "verification, validation and testing activities" including "recovery in controls, linearity, method comparison, within run precision and interference characteristics." For these types of analytical studies, samples typically include:
        • Controls: Multiple replicates, often 2-3 levels, run over several days/runs for precision and recovery.
        • Linearity samples: A series of diluted or spiked samples across the measuring range.
        • Method Comparison samples: A set of patient samples (often 40-100+) covering the assay range, compared against a reference method or the predicate device.
        • Interference samples: Patient samples or spiked samples tested with various concentrations of interferents (hemoglobin, bilirubin, lipids).
      • Data Provenance: Not explicitly stated, but standard practice for Roche Diagnostics (a global company with manufacturing in Germany and operations in the US) would be internal lab testing, likely at their R&D facilities in Germany or the US. It would be prospective testing of the modified device.
    3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g., radiologist with 10 years of experience):

      • This question is not applicable in the context of an IVD reagent analytical performance study. "Ground truth" for an IVD assay's performance would be established by:
        • Highly accurate reference measurement procedures (e.g., the IFCC (2011) reference method cited for traceability).
        • Certified reference materials.
        • Comparison against a legally marketed predicate device or a clinical laboratory's established, validated method.
      • No "experts" in the sense of clinical reviewers are typically used to establish ground truth for analytical performance, but rather highly skilled laboratory scientists and metrologists ensure the accuracy of the reference methods and measurements.
    4. Adjudication method (e.g., 2+1, 3+1, none) for the test set:

      • This question is not applicable. Adjudication methods like "2+1" or "3+1" are characteristic of clinical studies involving human interpretation (e.g., image reading), where disagreements among reviewers need resolution. This document describes analytical performance testing of a reagent where results are quantitative and objective.
    5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:

      • This is not applicable. An MRMC study assesses the performance of human readers, often with and without AI assistance, on a set of cases. This document is about the analytical performance of an in vitro diagnostic reagent, not an AI/ML device or human reader performance.
    6. If a standalone (i.e., algorithm only without human-in-the-loop performance) was done:

      • This is not applicable. The device is an in vitro diagnostic reagent executed on an automated instrument (COBAS INTEGRA systems). Its performance is inherently "standalone" in functionality (it performs the assay automatically), but it's not an algorithm in the AI/ML sense that would have an "algorithm only" performance study. Its performance is the instrument's performance running the reagent.
    7. The type of ground truth used (expert consensus, pathology, outcomes data, etc.):

      • For this type of analytical IVD study, the "ground truth" for method comparison and traceability would be:
        • Reference Measurement Procedures: Specifically, the modified IFCC (2011) reference method for ALP activity.
        • Certified Reference Materials/Calibrators: These provide established, highly accurate values.
        • Comparison to Predicate Device: The performance of the modified device was compared to the legally marketed predicate, which itself would have been validated against established clinical laboratory methods or reference methods.
    8. The sample size for the training set:

      • This is not applicable. This is an IVD reagent, not an AI/ML algorithm that requires a "training set." The reagent's formulation and associated analytical procedures are developed through biochemical and analytical chemistry principles, not machine learning training.
    9. How the ground truth for the training set was established:

      • This is not applicable for the same reason as point 8.
    Ask a Question

    Ask a specific question about this device

    K Number
    K160571
    Date Cleared
    2016-12-19

    (294 days)

    Product Code
    Regulation Number
    862.1373
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Roche Diagnostics Operations (RDO)

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The cobas c 513 clinical chemistry analyzer is a fully automated, standalone clinical chemistry analyzer intended for the in-vitro quantitative determination of analytes in body fluids.

    The Tina-quant Hemoglobin A1cDx Gen.3 assay is intended for use as an aid in diagnosis of diabetes and as an aid in identifying patients who may be at risk for developing diabetes. It is an in vitro diagnostics reagent system intended for quantitative determination of mmol/mol hemoglobin A1c (IFCC) and % hemoglobin A1c (DCCT/NGSP) in hemolysate or whole blood on the Roche/Hitachi cobas c 513 clinical chemistry analyzer. HbA1c determinations are useful for monitoring of long-term blood glucose control in individuals with diabetes mellitus.

    Device Description

    The cobas c 513 clinical chemistry analyzer is a fully automated, software controlled analyzer system for in vitro quantitative determination of analytes in human body fluids. The cobas c 513 analyzer system includes a control unit and an analyzer with a closed tube sampling functionality.

    The cobas c 513 control unit includes a computer (PC) located in the sampler unit, a touchscreen monitor, soft-keyboard, a mouse (optional use), and a printer. The control unit is used to perform tasks on the analyzer and the PC runs the software that controls the analyzer.

    The software manages all instrument functions, all system functions, and all information related to orders and results. The software offers a graphical user interface (GUI) to control all functions by the operator. The control unit contains System Control software including interfaces to a Medical Device Data System (cobas Link) and to the customer Laboratory Information System (LIS).

    The analyzer is composed of the sampler unit and the analytical unit. The sampler unit is composed of the rack loading/unloading areas, a barcode reader, a rack rotor, a STAT port, and conveyor lines. It is used to load and unload racks, power on the system, access the PC, and manage the conveyance of samples to the analytical unit.

    The analytical unit is comprised of the reagent area, the sample area, and the reaction disk. Samples are conveyed to the analytical unit from the sample unit for photometric analysis before being returned to the sample unit.

    Anticoagulated whole blood is hemolyzed either manually or automatically prior to determination of HbAlc by a turbidimetric inhibition immunoassay. Liberated hemoglobin (Hb) in the hemolyzed sample is converted to a derivative having a characteristic absorption spectrum and measured bichromatically. The instrument calculates the % HbAlc from the HbAlc/Hb ratio according to a user selected protocol, either IFCC or NGSP protocols.

    The assay offers separate applications that are specific to the sample types whole blood and hemolysate. The Whole Blood Application differs from the Hemolysate Application in the hemolyzing step. For the Whole Blood Application, whole blood samples are placed on the analyzer. Hemolysis occurs onboard the analyzer. For the Hemolysate Application, hemolyzed samples are placed on the analyzer. Hemolysis occurs manually before placing the samples onboard the analyzer. The two applications yield the same results.

    AI/ML Overview

    This document, a 510(k) premarket notification, describes the performance evaluation of the cobas c 513 Analyzer and cobas c 513 Tina-quant HbA1cDx Gen.3 Assay. It does not describe an AI/ML powered device, but rather an in-vitro diagnostic system for measuring Hemoglobin A1c. Therefore, many of the typical acceptance criteria and study designs relevant to AI/ML based devices (e.g., expert consensus, MRMC studies, training set details) are not applicable or detailed in the same way.

    However, I can extract and present the information as per your request based on the provided document, interpreting "acceptance criteria" as the performance criteria the device was tested against and "study" as the non-clinical performance evaluation conducted.

    Device Name: cobas c 513 Tina-quant HbA1cDx Gen.3 Assay

    Device Type: In-vitro diagnostic reagent system for quantitative determination of HbA1c.


    1. Table of Acceptance Criteria and Reported Device Performance

    Given that this is a 510(k) for an in-vitro diagnostic (IVD) device, the "acceptance criteria" are not explicitly listed in a single table with pass/fail remarks as might be seen for an AI/ML algorithm. Instead, the document details various performance studies (e.g., precision, linearity, method comparison, interference) and their results, implicitly demonstrating that the device meets an acceptable level of performance for its intended use based on standard IVD guidelines.

    The table below summarizes the key performance metrics and their reported values. The "Acceptance Criteria" column reflects typical expected performance ranges or goals for such IVDs based on general industry standards and the context provided by the results themselves. The document states "All acceptance criteria for method comparison were met" and "All acceptance criteria for drug interferences were met," indicating that internal predefined criteria were satisfied.

    Performance MetricAcceptance Criteria (Implicit/Inferred from Context)Reported Device Performance (cobas c 513 Tina-quant HbA1cDx Gen.3 Assay)
    Limit of Blank (LoB)Expected to be very low, indicating minimal signal in the absence of analyte.Hb: 0.50 g/dL (0.31 mmol/L)
    HbA1c: 0.19 g/dL (0.12 mmol/L)
    Limit of Detection (LoD)Expected to be low, indicating the lowest concentration reliably detected.Hb: 1.00 g/dL (0.62 mmol/L)
    HbA1c: 0.29 g/dL (0.18 mmol/L)
    Precision (Total %CV) (Hemolysate)Expected to be low across the measuring range (e.g., typically 7% deviation in HbA1c) at specified maximum concentrations.Met criteria; specific maximum concentrations without interference provided for: Lipemia, Bilirubin, Ditaurobilirubin, Glucose, Rheumatoid Factor
    Drug InterferencesNo significant interference (defined as > ±7% deviation) at specified drug concentrations.Met criteria for all 16 tested drugs.
    Cross-ReactivityNo significant interference due to common hemoglobin variants and other related substances.No significant interference with tested Hb variants (HbS, HbC, HbE, HbD, HbA2) unless otherwise specified. HbF > 7% may yield lower than expected values.

    2. Sample Sizes Used for the Test Set and Data Provenance

    • Limit of Blank (LoB): One analyte-free sample measured 10-fold with three lots, over six runs distributed over >3 days on one c 513 analyzer. Total 60 measurements per lot.
    • Limit of Detection (LoD): Five samples with low-analyte concentration measured 2-fold with three lots, over six runs distributed over >3 days on one c 513 analyzer. Total 60 measurements per lot.
    • Precision: Eight samples (two controls, seven human samples with varying HbA1c concentrations) measured in two aliquots per sample, once each in two runs per day for 21 days, on three cobas c 513 analyzers using 3 reagent lots per system.
    • Method Comparison: 155 samples (Hemolysate) and 154 samples (Whole Blood) from the secondary NGSP reference laboratory. Samples were tested over a 3-day period with one lot of reagent on one cobas c 513 analyzer.
    • Linearity: Two separate dilution series consisting of at least 11 levels, using human hemolysate sample pools. Samples measured in triplicate.
    • Matrix Comparison: At least 40 samples of each sample type (anticoagulant and fill volume) and at least 40 half-filled tubes of each sample type. Overall sample count not explicitly summed but implies a substantial number.
    • Endogenous Interference: 12 spiked samples (2 HbA1c levels x 6 interferents). Each treated pool (spiked and control) had a dilution series of at least 10 levels. Dilution series tested 10-fold.
    • Drug Interferences: Native patient samples at 2 different HbA1c levels (approx. 6% and 8% HbA1c) were spiked with 16 common drugs at two defined concentrations. Samples measured in 10-fold.
    • Cross-reactivity: Multiple experiments for each cross-reactant (HbA0, HbA1a+b, Acetylated Hb, Carbamylated Hb, Glycated Albumin, Labile HbA1c). Each involved a series of dilutions or concentration variations, with 10 replicates per sample.
    • Hemoglobin Variants: 20 samples each for HbS, HbC, HbE, HbD, Elevated F. 13 samples for HbA2. Each tested once in at least one run.

    Data Provenance: The document does not explicitly state the country of origin for the human samples used in these studies. The studies were non-clinical performance evaluations (laboratory-based testing). The samples for method comparison were obtained from a secondary NGSP (National Glycohemoglobin Standardization Program) reference laboratory. This implies a standardized and presumably well-characterized dataset. The studies are prospective in the sense that they are designed performance evaluations conducted specifically for device submission, rather than analysis of existing stored data.


    3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications

    This document describes a laboratory diagnostic device, not an AI/ML algorithm that interprets medical images or other complex data requiring human expert consensus for ground truth.

    • Ground truth for HbA1c values: For the method comparison study, the ground truth was established by a secondary NGSP reference laboratory using a Tosoh HPLC system. This is a recognized and standardized reference method for measuring HbA1c. The document mentions "Traceability: This method has been standardized against the approved IFCC reference method for the measurement of HbA1c in human blood and can be transferred to results traceable to DCCT/NGSP by calculation." This indicates that the ground truth is established via an internationally recognized and highly accurate analytical method, rather than through expert human assessment.

    Therefore, the concept of "number of experts" and their "qualifications" for establishing ground truth in the context of an AI/ML diagnostic for image interpretation is not directly applicable here.


    4. Adjudication Method for the Test Set

    Not applicable. As described above, the ground truth for this IVD device is established through a laboratory reference method (Tosoh HPLC system) traceable to international standards (IFCC, NGSP), not through human expert assessment needing adjudication.


    5. If a Multi Reader Multi Case (MRMC) Comparative Effectiveness Study Was Done

    No. This document describes the performance of an in-vitro diagnostic instrument and assay, not an AI/ML application intended to assist human readers (e.g., radiologists) in interpreting medical images. Therefore, an MRMC study and the concept of "how much human readers improve with AI vs. without AI assistance" are not relevant to this device.


    6. If a Standalone (i.e. algorithm only without human-in-the loop performance) Was Done

    Yes, in essence. The performance studies detailed in this document (precision, method comparison, linearity, interference, etc.) directly evaluate the cobas c 513 Tina-quant HbA1cDx Gen.3 Assay and cobas c 513 Analyzer as a standalone system for quantitative determination of HbA1c in patient samples. The results are generated entirely by the instrument and reagents, independent of human interpretive input beyond standard laboratory procedures for operating the device and reporting results. There is no "human-in-the-loop" interpretive component that would require a separate "standalone" versus "human-in-the-loop" performance evaluation as might be seen for an AI algorithm.


    7. The Type of Ground Truth Used

    The ground truth for the HbA1c values, particularly in the method comparison study, was established using a Tosoh HPLC system operated by a secondary NGSP (National Glycohemoglobin Standardization Program) reference laboratory. This method is traceable to the approved IFCC (International Federation of Clinical Chemistry and Laboratory Medicine) reference method and linked to DCCT/NGSP standards. This represents a highly standardized and analytically robust reference method/pathology/analytical outcome data rather than expert consensus on subjective findings.


    8. The Sample Size for the Training Set

    This document does not describe the development of an AI/ML algorithm that would have separate "training" and "test" sets in the conventional sense. This is an IVD device where performance characteristics are assessed on "test sets" (i.e., various sample groups used in the performance studies) to demonstrate its analytical capability. Therefore, the concept of a "training set" is not applicable here.


    9. How the Ground Truth for the Training Set Was Established

    Not applicable, as there is no "training set" in the context of an AI/ML algorithm.

    Ask a Question

    Ask a specific question about this device

    K Number
    K162593
    Date Cleared
    2016-10-19

    (33 days)

    Product Code
    Regulation Number
    862.1475
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Roche Diagnostics Operations (RDO)

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    In vitro diagnostic test for the quantitative determination of the HDL-cholesterol concentration in human serum and plasma on Roche/Hitachi cobas c systems.

    A lipoprotein test system is a device intended to measure lipoprotein in serum and plasma. Lipoprotein measurements are used in the diagnosis and treatment of lipid disorders (such as diabetes mellitus), atherosclerosis, and various liver and renal diseases.

    Device Description

    The HDL-Cholesterol Gen.4 is a homogeneous enzymatic colorimetric test. Non-HDL lipoproteins such as LDL, VLDL and chylomicrons are combined with polyanions and a detergent forming a water-soluble complex. In this complex the enzymatic reaction of CHER and CHOD towards non-HDL lipoproteins is blocked. Finally only HDL-particles can react with CHER and CHOD. The concentration of HDL-cholesterol is determined enzymatically by CHER and CHOD.

    AI/ML Overview

    Here's a breakdown of the acceptance criteria and study details for the HDL-Cholesterol Gen.4 device, extracted from the provided document:

    Device: HDL-Cholesterol Gen.4
    Type: In vitro diagnostic test for the quantitative determination of HDL-cholesterol concentration in human serum and plasma on Roche/Hitachi cobas c systems.


    Acceptance Criteria and Reported Device Performance

    Acceptance Criteria CategorySpecific Criteria (Implicitly met by study design and results)Reported Device Performance
    PrecisionLow %CV for repeatability and intermediate precision across various HDL-C concentrations.Repeatability:
    • PreciControl ClinChem Multi 1 (Mean 28.0 mg/dL): SD 0.20 mg/dL, CV 0.7%
    • PreciControl ClinChem Multi 2 (Mean 68.1 mg/dL): SD 0.44 mg/dL, CV 0.6%
    • Human Serum 1 (Mean 9.48 mg/dL): SD 0.17 mg/dL, CV 1.8%
    • Human Serum 2 (Mean 40.5 mg/dL): SD 0.26 mg/dL, CV 0.7%
    • Human Serum 3 (Mean 59.4 mg/dL): SD 0.32 mg/dL, CV 0.5%
    • Human Serum 4 (Mean 79.4 mg/dL): SD 0.51 mg/dL, CV 0.6%
    • Human Serum 5 (Mean 141 mg/dL): SD 0.83 mg/dL, CV 0.6%
      Intermediate Precision:
    • PreciControl ClinChem Multi 1 (Mean 28.4 mg/dL): SD 0.30 mg/dL, CV 1.1%
    • PreciControl ClinChem Multi 2 (Mean 66.4 mg/dL): SD 0.9 mg/dL, CV 1.4%
    • Human Serum 1 (Mean 9.48 mg/dL): SD 0.20 mg/dL, CV 2.2%
    • Human Serum 2 (Mean 40.7 mg/dL): SD 0.33 mg/dL, CV 0.8%
    • Human Serum 3 (Mean 59.4 mg/dL): SD 0.40 mg/dL, CV 0.7%
    • Human Serum 4 (Mean 79.4 mg/dL): SD 0.65 mg/dL, CV 0.8%
    • Human Serum 5 (Mean 141 mg/dL): SD 1.07 mg/dL, CV 0.8% |
      | Analytical Sensitivity (LoB, LoD, LoQ) | LoB, LoD, and LoQ should be below the claimed measuring range. | LoB Observed: 0.00 mg/dL (Claim: 3.09 mg/dL)
      LoD Observed: 0.50 mg/dL (Claim: 3.09 mg/dL)
      LoQ Observed: 2.89 mg/dL (Claim: 3.09 mg/dL) |
      | Linearity/Assay Reportable Range | Measurements should be linear across the claimed measuring range (3.09 to 150 mg/dL), with good correlation and low deviation. | Serum: Slope 1.020, Intercept -0.399, Correlation Coefficient (r2) 0.9992, Repeatability 1.5%
      Plasma: Slope 1.022, Intercept -0.173, Correlation Coefficient (r2) 0.9929, Repeatability 0.8%
      Claimed Measuring Range: 3.09 to 150 mg/dL (for both serum and plasma).
      Nonlinearity did not deviate by more than 10%. |
      | Endogenous Interferences | No significant interference (bias >10%) from common interferents like hemolysis, lipemia, icterus, and triglycerides at specified levels. | Hemolysis: No Interference up to 1200 H index
      Lipemia: No Interference up to 2000 L index
      Unconjugated Bilirubin: No Interference up to 60 I index
      Conjugated Bilirubin: No Interference up to 60 I index
      Triglycerides: No Interference up to 1200 mg/dL |
      | Exogenous Interferences (Drugs) | No significant interference from a panel of common drugs at specified concentrations. | Results provided in Table 7 (specific details of "no interference" for each drug are implied by listing them in a "Test Concentrations Results" table within the interference section, assuming they met the 10% bias criterion for non-interference). |
      | Method Comparison to Predicate | Strong correlation with a legally marketed predicate device, with acceptable bias at medical decision points. | Regression Analysis (HDL-Cholesterol Gen.4 vs. Predicate): y = 0.956x - 0.949, r = 0.995
      Bias at medical decision points:
      -6.7 % at 40.2 mg/dL
      -6.0 % at 59.9 mg/dL |
      | Matrix Comparison | Acceptable correlation between serum and various plasma anticoagulant types. | Serum vs. Serum Gel Separation: y = 0.99x - 0.33, r = 0.999
      Serum vs. Li-heparin: y = 0.99x - 0.32, r = 1.000
      Serum vs. K2-EDTA: y = 0.98x - 0.70, r = 0.999
      Serum vs. K3-EDTA: y = 0.95x - 0.08, r = 0.999 |

    Study Details

    1. Sample sizes used for the test set and the data provenance:

      • Precision (Repeatability & Intermediate Precision): 5 human serum pools and 2 control samples were used. Tested for 21 days with 4 replicates/day. Data provenance is not explicitly stated as country of origin, but implied to be from a laboratory setting (likely in the US or Germany, given Roche's locations). The nature of the study (analyzing human serum pools and controls) suggests prospective data collection for evaluating device performance.
      • Analytical Sensitivity (LoB, LoD, LoQ):
        • LoB: One analyte-free sample. Measured 10-fold in 6 runs over 3 days, per reagent lot (total 60 measurements per lot).
        • LoD: Five samples with low-analyte concentration. Measured two-fold in 6 runs over 3 days, per reagent lot (total 60 measurements per lot).
        • LoQ: A low-level sample set prepared by diluting 5 human serum samples. Tested in 5 replicates per sample on 5 days.
      • Linearity/Assay Reportable Range: Dilution series prepared using 1 serum pool and 1 plasma pool. The dilution series contained 11 concentrations for serum and 15 concentrations for plasma.
      • Endogenous Interferences: Two human serum pools spiked with HDL-Cholesterol and interfering substances.
      • Exogenous Interferences (Drugs): Two human serum sample pools.
      • Method Comparison to Predicate: 111 routine laboratory serum samples. Additionally, 4 samples spiked with high human serum HDL-Cholesterol and 1 sample diluted with 0.9% NaCl. Data provenance is not explicitly stated as country of origin, but implied to be from a laboratory setting. The use of "routine laboratory serum samples" suggests retrospective collection, though the spiking and dilution aspects are prospective for the study design.
      • Matrix Comparison: 38 paired samples (serum and plasma) from single donors.
    2. Number of experts used to establish the ground truth for the test set and the qualifications of those experts:

      • For this type of in vitro diagnostic device (quantitative measurement of a biomarker), "ground truth" is typically established by reference methods or validated comparative methods, not by human expert consensus or clinical adjudication as would be seen in imaging diagnostics.
      • The predicate device (Ultra N-geneous HDL Cholesterol Reagent, K021316) serves as a comparative "ground truth" for the method comparison study. The precision, sensitivity, linearity, and interference studies establish the intrinsic performance properties of the device against predefined analytical standards (e.g., CLSI guidelines).
      • Therefore, the concept of "experts" as in "a radiologist with 10 years of experience" is not directly applicable here. The experts involved would be laboratory scientists, biochemists, and statisticians who designed and executed the studies according to CLSI guidelines and interpreted the analytical data.
    3. Adjudication method (e.g. 2+1, 3+1, none) for the test set:

      • Adjudication methods like 2+1 or 3+1 are typically used in clinical imaging studies where subjective interpretation is involved.
      • For this in vitro diagnostic device, measurements are quantitative, and "adjudication" is done through statistical analysis and adherence to predefined acceptance criteria based on established analytical guidelines (e.g., CLSI EP5-A3 for precision, CLSI EP17-A2 for detection limits, CLSI EP6-A for linearity). There is no "human adjudication" process for individual results as there would be for image interpretation.
    4. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:

      • No, an MRMC comparative effectiveness study was not done. This type of study is relevant for imaging devices where human readers interpret medical images, and AI might assist or replace them. The HDL-Cholesterol Gen.4 is an in vitro diagnostic device that quantifies a substance in a laboratory sample; it does not involve human "readers" interpreting results in a subjective or visual manner that AI would enhance.
    5. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done:

      • Yes, the performance evaluation reports are inherently demonstrating the "standalone" performance of the analytical algorithm/reagent system. The studies evaluate the device's ability to accurately and precisely measure HDL-cholesterol concentrations in samples, independent of further human interpretation beyond routine laboratory operation and quality control. The reported results (e.g., mean, SD, CV, regression equations) directly reflect the algorithm's performance.
    6. The type of ground truth used (expert consensus, pathology, outcomes data, etc.):

      • Analytical Ground Truth: For the precision, sensitivity, linearity, and interference studies, the "ground truth" is based on the known concentrations of analytes in prepared samples (e.g., spiked samples, diluted samples, control materials) or the absence of analytes (blank samples), and performance is evaluated against established analytical standards and acceptable deviations.
      • Comparative Ground Truth: For the method comparison study, the predicate device (Ultra N-geneous HDL Cholesterol Reagent, K021316) served as the comparative "ground truth" or reference method for evaluating substantial equivalence. This is a common approach for 510(k) clearances.
      • No pathology or outcomes data was used for establishing the ground truth for device performance in this submission, as it's an analytical performance study for an IVD.
    7. The sample size for the training set:

      • This document describes the pre-market notification (510(k)) studies for device validation, not the development or training of an AI algorithm. Therefore, there is no "training set" for an AI mentioned or implied in this submission. The device is a chemical reagent system, not an AI/ML independent medical device.
    8. How the ground truth for the training set was established:

      • As noted above, no "training set" for an AI algorithm is described in this submission. The ground truth for the analytical studies described (e.g., precision, linearity) is based on the preparation of samples with known concentrations or comparative analysis against a validated predicate device, as per standard laboratory practice and CLSI guidelines.
    Ask a Question

    Ask a specific question about this device

    K Number
    K161817
    Date Cleared
    2016-07-27

    (26 days)

    Product Code
    Regulation Number
    862.1225
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Roche Diagnostics Operations (RDO)

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    Tina-quant Cystatin Gen.2 is an in vitro test for the quantitative determination of cystatin C in human serum and plasma on Roche/Hitachi cobas c systems. Cystatin C measurements are used as an aid in the diagnosis and treatment of renal diseases.

    Device Description

    The Roche Tina-quant Cystatin C Gen.2 assay provides quantitative measurement of the cystatin C that is present in human serum and plasma. The reagents are packaged in a cassette with two bottles labeled with their instrument positioning, R1 (Reagent 1) and R2 (Reagent 2).

    R1 contains a solution of polymers in MOPS-buffered saline with preservative and stabilizers. R2 is latex particles coated with anti-cystatin C antibodies (rabbit) in glycine buffer with preservatives and stabilizers.

    Human cystatin C agglutinates with the antibody coated latex particles. The aggregate is determined turbidimetrically.

    AI/ML Overview

    The provided text describes a 510(k) premarket notification for a modified in vitro diagnostic device, "Tina-quant Cystatin C Gen.2". The modifications primarily involve updated labeling information rather than changes to the device itself. Therefore, the study details are focused on validating these labeling changes.

    Here's an analysis based on the provided document:

    1. A table of acceptance criteria and the reported device performance

    Feature/MetricAcceptance Criteria (Predicate)Reported Device Performance (Candidate)
    Sample StabilityNot specified in provided text (new information added to labeling)New room temperature and refrigerated serum and plasma sample stability information was added. Specific data not provided, but the process describes testing samples in triplicate at 15-25 °C and 2-8 °C, with results compared to time zero. The conclusion states "all of the acceptance criteria were met," implying satisfactory stability for the expanded claims.
    High dose hook-effectNo false result occurs up to a cystatin C concentration of 20 mg/L.No false result occurs up to a cystatin C concentration of 12 mg/L. (This is a more conservative and reduced claim compared to the predicate.)
    HARA interferenceNot specified in provided text (new warning added to labeling)Warning added: "In very rare cases falsely elevated results for Cystatin C will be obtained from samples taken from patients who have been treated with rabbit antibodies or have developed anti-rabbit antibodies." This warning is supported by internal testing and cited literature, indicating the device exhibited interference in the presence of HARA, leading to the label change.
    Intended use/IndicationsQuantitative determination of cystatin C in human serum and plasma as an aid in diagnosis and treatment of renal diseases.Same
    Test principleParticle enhanced immunoturbidimetric assaySame
    InstrumentRoche/Hitachi cobas c 501Same
    Sample typeSerum, Li-heparin, K2-, and K3- EDTA plasmaSame
    Measuring Range0.40 - 6.80 mg/LSame
    PrecisionSee predicate method sheetSame
    LoB0.30 mg/LSame
    LoD0.40 mg/LSame
    LoQ0.40 mg/LSame

    2. Sample size used for the test set and the data provenance (e.g. country of origin of the data, retrospective or prospective)

    • Sample Stability: Human serum and plasma patient samples were adjusted with cystatin C. The exact number of samples is not explicitly stated, but it mentions "patient samples" and that "These samples are split into two sets". The text does not specify the country of origin or whether the data was retrospective or prospective, but it implies prospective testing for stability.
    • High dose hook-effect: A human serum pool was used, from which an 18-step dilution series was prepared. The exact volume or number of individual samples within the pool is not specified. Data provenance is not given.
    • HARA interference: "Internal testing was done at Roche to confirm the customer results." The number of samples tested internally and the provenance of customer data are not detailed.

    3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g. radiologist with 10 years of experience)

    Not applicable. This device is an in vitro diagnostic (assay for a biomarker), not an imaging or diagnostic device requiring expert interpretation of results for ground truth. Ground truth for an assay is typically established through reference methods or spiked samples with known concentrations.

    4. Adjudication method (e.g. 2+1, 3+1, none) for the test set

    Not applicable. Adjudication methods like 2+1 or 3+1 are typically used in clinical trials or studies where subjective interpretations (e.g., image readings) are being evaluated. For an IVD, the results are quantitative measures.

    5. If a multi-reader multi-case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

    Not applicable. This study is for a laboratory assay, not an AI-assisted diagnostic tool for human readers.

    6. If a standalone (i.e. algorithm only without human-in-the loop performance) was done

    This refers to the performance of the analytical device itself. The studies described for sample stability, hook effect, and HARA interference were standalone evaluations of the assay's performance characteristics.

    7. The type of ground truth used (expert consensus, pathology, outcomes data, etc.)

    • Sample Stability: The ground truth for sample stability was the result of the fresh sample at time zero, which is considered the baseline and implicitly the "true" concentration at that point.
    • High dose hook-effect: The ground truth was the "known concentration" obtained from preparing a dilution series from a concentrated serum pool.
    • HARA interference: The ground truth was based on confirming "falsely elevated results" observed in patient samples and corroborated by peer-reviewed literature.

    8. The sample size for the training set

    Not applicable. This device is an in vitro diagnostic reagent kit, not a machine learning or AI algorithm that requires a training set. The "training set" concept does not apply here.

    9. How the ground truth for the training set was established

    Not applicable, as there is no training set for this type of device.

    Ask a Question

    Ask a specific question about this device

    K Number
    K160570
    Device Name
    Creatine Kinase
    Date Cleared
    2016-05-25

    (86 days)

    Product Code
    Regulation Number
    862.1215
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Roche Diagnostics Operations (RDO)

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    Creatine Kinase is an in vitro test for the quantitative determination of creatine kinase (CK) in human serum and plasma on Roche/Hitachi cobas c systems. The determination of CK and CK isoenzyme activities is utilized in the diagnosis and monitoring of myocardial infarction and myopathies such as the progressive Duchenne muscular dystrophy.

    Measurements of creatine phosphokinase and its isoenzymes are used in the diagnosis and treatment of myocardial infarction and muscle diseases such as progressive, Duchenne-type muscular dystrophy.

    Device Description

    The Creatine Kinase assay is a two reagent assay for the quantitative determination of creatine kinase (CK) in human serum and plasma on automated clinical chemistry analyzers. Photometrically measured NAPDP formation is directly proportional to CK activity in a human sample.

    AI/ML Overview

    Here's a breakdown of the acceptance criteria and study information based on the provided document:

    Creatine Kinase Device Performance Study Summary

    1. Acceptance Criteria and Reported Device Performance

    Feature / MetricAcceptance Criteria (Claim in Document)Reported Device Performance
    Limit of Blank (LoB)Claim: 7 U/L0.3 U/L
    Limit of Detection (LoD)Claim: 7 U/L1.0 U/L
    Limit of Quantitation (LoQ)Claim: 7 U/L3.3 U/L
    Precision (Repeatability)Achieved with Human Serum samples and PreciControl ClinChem Multi controls. Specific acceptance limits for CV/SD are not explicitly stated as "acceptance criteria" but implied by the presentation of successful results. For example: Human Serum 1 (18.7 U/L) CV = 0.998) and slope close to 1, intercept close to 0 implied for substantial equivalence.Serum vs. Serum Gel Separation: y = 0.998x + 0.010, r = 0.999
    Serum vs. Li-heparin: y = 1.00x - 1.994, r = 0.998
    Serum vs. K2-EDTA: y = 0.993x - 2.016, r = 0.998
    Serum vs. K3-EDTA: y = 0.981x - 2.671, r = 0.999
    Interference (Hemolysis)No significant interference up to an H index of 100 (approx. 62.1 µmol/L or 100 mg/dL).No interference up to Level 1: 103 H Index, Level 2: 130 H Index.
    Interference (Lipemia)No significant interference up to an L index of 1000.No interference up to Level 1: 1356 L Index, Level 2: 1143 L Index.
    Interference (Unconjugated Bilirubin)No significant interference up to an I index of 60 for conjugated and unconjugated bilirubin (approx. 1026 µmol/L or 60 mg/dL).No interference up to Level 1: 67 I Index, Level 2: 67 I Index.
    Interference (Conjugated Bilirubin)No significant interference up to an I index of 60 for conjugated and unconjugated bilirubin (approx. 1026 µmol/L or 60 mg/dL).No interference up to Level 1: 68 I Index, Level 2: 76 I Index.
    Interference (Drugs)No interference at therapeutic concentrations using common drug panels. (Exception noted for Cyanokit).No interference found at therapeutic concentrations using common drug panels. (Cyanokit (Hydroxocobalamin) at therapeutic concentrations interferes with the test).
    Method Comparison (Predicate)The objective is for results to demonstrate substantial equivalence to the predicate device (COBAS INTEGRA Creatine Kinase, K951595) via Passing Bablok Regression where the slope is close to 1 and the intercept close to 0, and a high correlation coefficient (r).y = 1.021x + 5.88 U/L, r = 0.999

    2. Sample Sizes Used for the Test Set and Data Provenance

    • Detection Limits (LoB, LoD):
      • LoB: One analyte-free sample, measured with three lots, 10-fold determination in 6 runs (total 60 measurements per lot).
      • LoD: Five low-analyte concentration samples, measured with three lots, two-fold determination in 6 runs (total 60 measurements per lot).
    • Limit of Quantitation (LoQ):
      • Five human serum samples, tested in 5 replicates per sample on 5 days.
    • Precision (Repeatability & Intermediate):
      • Not explicitly stated as a single number, but experiments conducted with multiple human serum samples (5) and control materials (2), with two aliquots per run, two runs per day for ≥ 21 days on the same analyzer using 3 lots of reagent.
    • Linearity (Serum & Plasma):
      • Two separate dilution series (serum and plasma), each with 14 concentrations, measured in triplicate.
    • Matrix Comparison - Anticoagulants:
      • For each of the four tube types (Serum Gel Separation, Li-heparin, K2-EDTA, K3-EDTA), 30 tubes were filled completely. This implies 30 samples for each comparison.
    • Interferences - H, L, I Indices:
      • Pooled human serum samples spiked with varying levels of interferent. The resulting sample series (10 dilution steps per sample) were tested in triplicate.
    • Interferences - Drugs:
      • Two sample pools (low and high CK concentrations), divided into aliquots. Each spiked aliquot measured in triplicate.
    • Method Comparison to Predicate:
      • 132 human serum samples (9 of which were spiked with human recombinant CK MB). Samples tested in singlicate.

    Data Provenance: The document explicitly mentions "human serum samples" and "pooled human serum samples." The manufacturer is Roche Diagnostics Operations, located in Indianapolis, IN, USA. Based on the context of FDA submission for a device to be marketed in the USA, it is highly probable the data is retrospective and likely collected in a clinical laboratory setting (possibly in the USA or aligned with international standards like CLSI), but the specific country of origin for the patient samples is not stated.

    3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications

    N/A. This is a submission for an in vitro diagnostic device that quantitatively measures a biomarker (Creatine Kinase). The "ground truth" for the test set is established by the reference measurement procedure or the known concentration of the analyte in calibrators/controls, not by expert interpretation of images or clinical data. Therefore, human experts for ground truth adjudication are not applicable in this context.

    4. Adjudication Method for the Test Set

    N/A. See explanation above. The measurements are quantitative chemical analyses against instrument-derived values and established reference methods/materials, not subjective interpretations.

    5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

    No. This is an in vitro diagnostic device for quantitative measurement of a biomarker in biological samples. MRMC studies are typically performed for imaging devices or other diagnostic tools where human interpretation plays a significant role, to evaluate how AI assistance impacts human reader performance. This is not applicable here.

    6. Standalone (Algorithm Only) Performance Study

    Yes, the entire submission is a standalone performance study of the Creatine Kinase assay on the Roche/Hitachi cobas c systems. The device itself is an "algorithm only" in the sense that it is an automated analytical system (reagent + instrument) that produces quantitative results without human intervention in the measurement process itself, beyond sample loading and system maintenance. The studies described (Detection Limits, Precision, Linearity, Interference, Method Comparison) directly assess the performance of this standalone analytical system.

    7. Type of Ground Truth Used

    The ground truth for the performance studies relies on:

    • Reference Materials/Methods: For calibration and verification of accuracy, the method is stated to be traceable to IFCC (International Federation of Clinical Chemistry and Laboratory Medicine) Method for Creatine Kinase.
    • Known Concentrations: For studies like LoB, LoD, LoQ, linearity, and interference, samples are either analyte-free, spiked with known concentrations of analyte or interferents, or diluted from samples with established reference values. This essentially uses calibrated reference standards and materials as the ground truth.
    • Predicate Device Measurements: For method comparison, the predicate device's results (COBAS INTEGRA Creatine Kinase cleared in K951595 on the COBAS INTEGRA analyzer) serve as a comparative ground truth to establish substantial equivalence.

    8. Sample Size for the Training Set

    N/A. This is not a machine learning or AI-based diagnostic device in the modern sense that requires a "training set" of data to learn from. It is a traditional in vitro diagnostic assay based on a defined enzymatic chemical reaction and photometric measurement. The development of such assays involves extensive research and development to optimize reagents and instrument parameters, but not in the framework of a "training set" as understood in AI/ML.

    9. How the Ground Truth for the Training Set Was Established

    N/A. As explained above, there is no "training set" in the context of an AI/ML device for this product. The development of the assay involves chemical and enzymatic principles, optimized through laboratory experimentation and knowledge of biochemistry, rather than learning from a dataset via a specified ground truth.

    Ask a Question

    Ask a specific question about this device

    K Number
    K152245
    Date Cleared
    2016-01-08

    (151 days)

    Product Code
    Regulation Number
    862.3950
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    ROCHE DIAGNOSTICS OPERATIONS (RDO)

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    In vitro test for the quantitative determination of vancomycin in serum and plasma on Roche/Hitachi cobas c systems.

    A vancomycin test system is a device intended to measure vancomycin, an antibiotic drug, in serum and plasma. Measurements obtained by this device are used in the diagnosis and treatment of vancomycin overdose and in monitoring the level of vancomycin to ensure appropriate therapy.

    Device Description

    The ONLINE TDM Vancomycin Gen.3 is a two reagent assay for the in vitro quantitative determination of vancomycin in human serum or plasma on automated clinical chemistry analyzers. It is a homogeneous microparticle agglutination immunoassay based on the kinetic interaction of microparticles in solution (KIMS). A competitive reaction takes place between the drug conjugate and vancomycin in the serum sample for binding to the vancomycin antibody on the microparticles. The resulting kinetic interaction of microparticles is indirectly proportional to the amount of drug present in the sample.

    AI/ML Overview

    The provided text details the performance evaluation of the "ONLINE TDM Vancomycin Gen.3" device. Here's a breakdown of the requested information:

    1. A table of acceptance criteria and the reported device performance

    The document doesn't explicitly state "acceptance criteria" as separate rows but presents performance study results, implying these results are considered acceptable for substantial equivalence. The table below compiles the reported performance data.

    Performance MetricAcceptance Criteria (Implied by reported performance)Reported Device Performance (ONLINE TDM Vancomycin Gen.3)
    Detection Limit
    Limit of Blank (LoB)$\le$ 1.0 µg/mLMP Lot: 0.6 µg/mL
    P2 Lot: 0.7 µg/mL
    P3 Lot: 0.5 µg/mL
    Limit of Detection (LoD)$\le$ 1.5 µg/mLMP Lot: 1.4 µg/mL
    P2 Lot: 1.3 µg/mL
    P3 Lot: 1.1 µg/mL
    Limit of Quantitation (LoQ)$\le$ 4.0 µg/mLMP Lot: 2.0 µg/mL
    P2 Lot: 3.3 µg/mL
    P3 Lot: 3.1 µg/mL
    Precision (Repeatability)Not explicitly stated, but consistent low CVs are expectedTDM Control 1: Mean 7.45 µg/mL, SD 0.4 µg/mL, CV 5.2%
    TDM Control 2: Mean 21.5 µg/mL, SD 0.5 µg/mL, CV 2.3%
    TDM Control 3: Mean 36.2 µg/mL, SD 0.9 µg/mL, CV 2.4%
    Human Serum 1: Mean 4.82 µg/mL, SD 0.4 µg/mL, CV 8.2%
    Human Serum 2: Mean 7.95 µg/mL, SD 0.4 µg/mL, CV 5.2%
    Human Serum 3: Mean 32.1 µg/mL, SD 0.8 µg/mL, CV 2.5%
    Human Serum 4: Mean 40.0 µg/mL, SD 1.0 µg/mL, CV 2.5%
    Human Serum 5: Mean 71.4 µg/mL, SD 2.0 µg/mL, CV 2.8%
    Precision (Intermediate)Not explicitly stated, but consistent low CVs are expectedTDM Control 1: Mean 7.45 µg/mL, SD 0.5 µg/mL, CV 6.2%
    TDM Control 2: Mean 21.5 µg/mL, SD 0.8 µg/mL, CV 3.7%
    TDM Control 3: Mean 35.5 µg/mL, SD 1.1 µg/mL, CV 3.2%
    Human Serum 1: Mean 4.93 µg/mL, SD 0.5 µg/mL, CV 10.5%
    Human Serum 2: Mean 7.95 µg/mL, SD 0.5 µg/mL, CV 5.9%
    Human Serum 3: Mean 32.1 µg/mL, SD 1.1 µg/mL, CV 3.4%
    Human Serum 4: Mean 39.5 µg/mL, SD 1.1 µg/mL, CV 2.9%
    Human Serum 5: Mean 71.4 µg/mL, SD 2.2 µg/mL, CV 3.1%
    LinearityPearson correlation coefficient (R) close to 1, slope close to 1, intercept close to 0Serum: y=1.000x-0.000, R=0.9985
    Plasma: y=1.000x-0.000, R=0.9976
    Measuring Range4.0 to 80.0 µg/mL4.0 to 80.0 µg/mL (Claimed, consistent with linearity results)
    Matrix ComparisonStrong correlation (r value close to 1) between plasma and serum measurementsSerum vs. Li-heparin: y = 1.01x -0.3, r = 0.996
    Serum vs. K2-EDTA: y = 0.99x -0.0, r = 0.996
    Serum vs. K3-EDTA: y = 1.00x - 0.3, r = 0.995
    Endogenous InterferenceNo significant interference up to stated levelsHemolysis: No interference up to H index of 1000 (1000 mg/dL hemoglobin)
    Lipemia: No interference up to L index of 1000 (1000 mg/dL triglycerides)
    Icterus (Unconjugated Bilirubin): No interference up to I index of 60 (60 mg/dL or 1026 umol/L)
    Icterus (Conjugated Bilirubin): No interference up to I index of 60 (60 mg/dL or 1026 umol/L)
    Drug InterferenceNo interference up to specified concentrationsNo interference observed for a list of common drugs at specified concentrations (e.g., Acetylsalicylic acid 1000 mg/L, Acetaminophen 200 mg/L, Heparin 5000 U/L, etc.)
    Method Comparison to PredicateStrong correlation with predicate device, Passing Bablok regression results with slope close to 1 and intercept close to 0y = 0.993x + 0.641, r = 0.994

    2. Sample sized used for the test set and the data provenance (e.g. country of origin of the data, retrospective or prospective)

    • Detection Limit (LoB, LoD):
      • LoB: 60 measurements (5-fold determinations per run, 6 runs over 3 days, across one or two instruments) per lot.
      • LoD: 30 samples/measurements (5 serum samples, 6 runs over 3 days, 1-fold or 2-fold determination per run, across one or two instruments) per lot.
      • LoQ: 15 serum samples, tested in two aliquots over 6 runs for 4 days.
    • Precision: Not explicitly stated, but "two runs per day for $\geq$ 21 days" were performed. The number of samples for controls (3) and human serum (5) are listed, with replicates per run not specified but implied to be sufficient for precision calculations.
    • Linearity: Sixteen levels (dilution series from a human serum sample pool and diluent) were prepared. The process was repeated for plasma samples.
    • Matrix Comparison: 67 full tubes and 9 half-filled tubes of serum and plasma from a single donor. (K2-EDTA plasma had 10 half-filled tubes).
    • Interferences (H, L, I Indices): Two human serum sample pools spiked with Vancomycin. An 11-step dilution series prepared for each interferent, with 3 aliquots per level tested.
    • Interferences (Drugs): Two human serum sample pools spiked with Vancomycin. Tested with 3 replicates.
    • Method Comparison to Predicate: 125 single native human serum samples from patients taking Vancomycin. 8 additional native Vancomycin samples were spiked, and 1 sample diluted to cover the range.

    The data provenance regarding the country of origin is not specified. All studies appear to be prospective experimental studies conducted in a controlled lab setting, rather than retrospective patient data analysis.

    3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g. radiologist with 10 years of experience)

    This device is an in-vitro diagnostic (IVD) assay for quantitative determination of vancomycin concentration. The "ground truth" for these types of devices is based on established analytical reference methods or assigned values.

    • For LoQ, the expected value was determined with Vancomycin LCMS/MS, which is a highly accurate reference method, not expert consensus.
    • For Method Comparison to Predicate, the predicate device (ONLINE TDM Vancomycin, K060586) served as the reference standard for comparison, not human experts.
    • No human experts were involved in establishing the ground truth for any of these analytical performance studies. These are laboratory-based measurements.

    4. Adjudication method (e.g. 2+1, 3+1, none) for the test set

    Not applicable. This is an IVD device for quantitative measurement, not an imaging or qualitative diagnostic device requiring expert adjudication. The "truth" is determined by analytical reference methods or comparison to a predicate device.

    5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

    Not applicable. This is an IVD device for quantitative measurement, not an AI-assisted diagnostic tool for human readers.

    6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done

    This entire submission describes the standalone performance of the ONLINE TDM Vancomycin Gen.3 assay. The device itself is an automated chemical analyzer system (Roche/Hitachi cobas c systems) that performs the assay, not an AI algorithm. The performance metrics listed (detection limit, precision, linearity, interference, method comparison) are all standalone analytical performance characteristics of the device.

    7. The type of ground truth used (expert consensus, pathology, outcomes data, etc)

    The ground truth or reference methods used for evaluation include:

    • LCMS/MS (Liquid Chromatography-Mass Spectrometry/Mass Spectrometry): Used for determining expected values for the Limit of Quantitation (LoQ).
    • Predicate Device (ONLINE TDM Vancomycin, K060586): Used as the comparative reference for the method comparison study.
    • Standard Analytical Protocols: Studies like precision, linearity, and interference follow established CLSI guidelines, where the "truth" is defined by the experimental setup (e.g., known concentrations of analytes, spiked interferents).

    8. The sample size for the training set

    Not applicable. This device is an IVD assay, not a machine learning or AI-based system that requires a "training set" in the conventional sense. The development of such assays involves reagent formulation, optimization, and extensive analytical verification and validation, but not typically "training data" for an algorithm.

    9. How the ground truth for the training set was established

    Not applicable, as there is no "training set" for an AI algorithm here.

    Ask a Question

    Ask a specific question about this device

    Page 1 of 2