K Number
K131544
Manufacturer
Date Cleared
2013-07-17

(49 days)

Product Code
Regulation Number
862.1110
Panel
CH
Reference & Predicate Devices
AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
Intended Use

cobas c Bilirubin Total Gen.3 is an in vitro test for the quantitative determination of total bilirubin in serum and plasma of adults and neonates on Roche/Hitachi cobas c systems. Measurement of the levels of bilirubin, an organic compound formed during the normal and abnormal destruction of red blood cells, is used in the diagnosis and treatment of liver, hemolytic, hematological, and metabolic disorders, including hepatitis and gall bladder block.

Device Description

cobas c Bilirubin Total Gen.3 reagent provides quantitative measurement of the total bilirubin that is present in serum and plasma of adults and neonates. Reagents are packaged in a cassette with two bottles labeled with their instrument positioning, R1 (Reagent 1) and R2 (Reagent 2). R1 contains detergent, buffer, and stabilizers at pH 1.0. R2 is a 3,5-dichlorophenyl diazonium salt: ≥ 1.35 mmol/L.

AI/ML Overview

The provided text describes the 510(k) summary for the cobas c Bilirubin Total Gen.3 device, a quantitative colorimetric method for determining total bilirubin in serum and plasma. The acceptance criteria and supporting studies are detailed for various performance characteristics.

Here's a breakdown of the requested information:

1. Table of Acceptance Criteria and Reported Device Performance

Performance CharacteristicAcceptance CriteriaReported Device Performance
PrecisionNot explicitly stated as a single criterion, but implied by the detailed imprecision (SD & CV%) requirements generally found in CLSI EP5-A2 studies.Repeatability (Within Run Imprecision):
  • PCCC1: 0.02 mg/dL (2.1% CV)
  • PCCC2: 0.02 mg/dL (0.6% CV)
  • Human Serum 1 (0.51 mg/dL): 0.01 mg/dL (2.9% CV)
  • Human Serum 2 (17.7 mg/dL): 0.10 mg/dL (0.6% CV)
  • Human Serum 3 (31.8 mg/dL): 0.14 mg/dL (0.4% CV)
    Intermediate Precision (Total Imprecision):
  • PCCC1: 0.02 mg/dL (2.1% CV)
  • PCCC2: 0.03 mg/dL (0.8% CV)
  • Human Serum 1 (0.51 mg/dL): 0.02 mg/dL (3.3% CV)
  • Human Serum 2 (17.7 mg/dL): 0.14 mg/dL (0.8% CV)
  • Human Serum 3 (31.8 mg/dL): 0.18 mg/dL (0.6% CV) |
    | Linearity/Measuring Range | For both serum and plasma, the first-order (linear) regression must be significant. | Serum: Range tested and found: 0.12-38.9 mg/dL. Recommended measuring range: 0.15-35.1 mg/dL. Linear Regression: y=1.0021x-0.0317, r² = 0.999881 (Significant).
    Plasma: Range tested and found: 0.12-39.0 mg/dL. Recommended measuring range: 0.15-35.1 mg/dL. Linear Regression: y = 1.0014x - 0.0232, r² = 0.999954 (Significant). |
    | Detection Limit (LoB, LoD, LoQ) | Not explicitly stated in terms of acceptance criteria values, but the reported claims represent the specifications. The LoQ is determined based on precision at 20% CV. | LoB claim: 0.10 mg/dL
    LoD claim: 0.15 mg/dL
    LoQ claim: 0.15 mg/dL |
    | Analytical Specificity (Endogenous Substances) | Lipemia: ≤± 0.10 mg/dL for samples ≤ 1 mg/dL or ≤± 10% for samples > 1 mg/dL
    Hemolysis HbA: ≤±0.20 mg/dL for samples ≤ 2 mg/dL or ≤± 10% for samples > 2 mg/dL
    Hemolysis HbF: ≤± 0.10 mg/dL for samples ≤ 1 mg/dL or ≤ ± 10% for samples > 1 mg/dL
    Indican: ≤± 0.10 mg/dL for samples ≤ 1 mg/dL or ≤± 10% for samples > 1 mg/dL | Lipemia: No significant interference up to an L index of 1000. (Tested up to 1196-1217 L index)
    Hemolysis HbA: No significant interference up to an H index of 800. (Tested up to 946-951 H index)
    Hemolysis HbF: No significant interference up to an H index of 1000. (Tested up to 1047-1053 H index)
    Indican: No significant interference from indican up to 3 mg/dL. (Tested up to 3.75 mg/dL) |
    | Analytical Specificity (Common Drugs) | Difference in recovery to the reference sample: ≤± 10% | All tested drugs (Acetylcystein, Ampicillin - Na, Ascorbic acid, Phenylbutazone, Cyclosporine A, Cefoxitin, Levodopa, Methyldopa + 1.5, Metronidazole, Doxycyclin, Acetylsalycilic acid, Rifampicin, Acetaminophen, Ibubrofen, Theophylline) passed the acceptance criteria at their respective highest concentrations. |
    | Matrix Comparison (Anticoagulants) | For sample concentrations ≤ 0.99 mg/dL, the deviation must be ≤ ± 0.10 mg/dL. For sample concentrations > 0.99 mg/dL, the deviation must be ≤± 10%. | All data passed the criteria.
  • Li-Heparin (full & half), K2-EDTA (full & half), and Gel Separation Tube showed acceptable recovery within the tested ranges (e.g., Li-Heparin full: 0.35 - 34.52 mg/dL).
  • Serum vs. Li-heparin: y = 1.000x + 0.000, r = 0.9998 |
    | Adult Method Comparison with Predicate Device | Not explicitly stated with a numerical criterion, but the strong correlation (r=0.9997) and the regression equation (y = 0.959x + 0.091 mg/dL) demonstrate substantial agreement. | Equation: y = 0.959x + 0.091 mg/dL
    Correlation coefficient: r = 0.9997 |

2. Sample Size Used for the Test Set and Data Provenance

  • Precision:
    • Human Sera Samples: 3 samples (0.51, 17.7, and 31.8 mg/dL)
    • Control Samples: 2 serum-based control samples (PCCC1, PCCC2)
    • Each sample/control run in two aliquots per run, two runs per day for 21 days.
    • Data Provenance: Not explicitly stated, but implied to be laboratory-generated (not from real patient populations with specific countries of origin). Retrospective or prospective is not specified, but the study design suggests prospective lab testing.
  • Linearity/Assay Reportable Range:
    • Serum dilution series: 14 levels
    • Plasma dilution series: 13 levels
    • Data Provenance: Laboratory-generated, with human serum/plasma pool spiked with unconjugated bilirubin. Not specified for country of origin or retrospective/prospective.
  • Detection Limits (LoB, LoD, LoQ):
    • LoB: One blank sample
    • LoD: Five low-analyte samples
    • LoQ: A low-level sample set of nine
    • Data Provenance: Laboratory-generated.
  • Analytical Specificity (Endogenous Substances):
    • Interferents: Hemoglobin, lipids, indican.
    • Two pools of human serum used (one spiked, one unspiked) to create dilution series.
    • Interference tested at two levels of bilirubin.
    • Data Provenance: Laboratory-generated using human serum.
  • Analytical Specificity (Common Drugs):
    • 15 commonly used drugs.
    • Serum sample pools at two target concentrations of total bilirubin (~1.0 mg/dL and ~14.0 mg/dL).
    • Data Provenance: Laboratory-generated using serum.
  • Adult Method Comparison with Predicate Device:
    • Sample Size: n=131 human sera adult samples.
    • Data Provenance: Not explicitly stated for country of origin or retrospective/prospective, but implies de-identified human serum samples.
  • Matrix Comparison (Anticoagulants):
    • Sample Size: 35 tubes collected per anticoagulant type (Li-heparin, K2-EDTA, Gel Separation Tube).
    • Data Provenance: Not explicitly stated for country of origin or retrospective/prospective, but implies human plasma/serum samples.

3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts

This device is an in vitro diagnostic (IVD) for quantitative measurement of total bilirubin. Expert consensus is not typically used to establish ground truth for this type of quantitative biochemical assay. The ground truth is generally established by:

  • Reference Methods: For this device, the "ground truth" or reference method for traceability is explicitly stated as "Standardized against the Doumas manual reference method."
  • Predicate Device: For method comparison, the predicate device (Total Bilirubin reagent on the cobas c 501) serves as the comparator.

Therefore, the concept of "experts" in the context of clinical interpretation for ground truth is not applicable here.

4. Adjudication Method for the Test Set

Adjudication methods (e.g., 2+1, 3+1) are typically used in studies where human readers provide subjective assessments (e.g., image interpretation). This is a quantitative chemical assay, where measurements are objective. Therefore, no adjudication method was used or is relevant.

5. If a Multi Reader Multi Case (MRMC) Comparative Effectiveness Study Was Done, If So, What Was the Effect Size of How Much Human Readers Improve with AI vs without AI Assistance

No MRMC comparative effectiveness study was done. This device is a fully automated in vitro diagnostic test for measuring bilirubin levels. It does not involve human readers for interpretation, nor does it incorporate AI (Artificial Intelligence) in a way that would assist human readers.

6. If a Standalone (i.e., Algorithm Only Without Human-in-the-Loop Performance) Was Done

Yes, a standalone study was done. The entire performance evaluation (precision, linearity, detection limits, interference, method comparison) described in the document is for the device operating as a standalone quantitative assay without human intervention in the measurement process. The "algorithm" here refers to the chemical reaction principles and photometric measurement methodology.

7. The Type of Ground Truth Used (Expert Consensus, Pathology, Outcomes Data, Etc.)

The ground truth for the quantitative measurement of total bilirubin is generally established by:

  • Reference Methods: The device is standardized against the Doumas manual reference method (as stated under "Traceability"). This is the gold standard for bilirubin measurement.
  • Comparator Methods: In the adult method comparison study, the predicate device (Total Bilirubin reagent) values served as the comparator for assessing agreement.

8. The Sample Size for the Training Set

The provided document describes a 510(k) submission for a diagnostic test. Unlike AI/ML-based diagnostic devices, this type of device does not typically involve "training sets" in the machine learning sense. The "training" in developing such a device involves refining chemical reagents and optimizing instrument parameters, which is a different process than training an algorithm on a dataset. The studies described are performance validation studies.

9. How the Ground Truth for the Training Set Was Established

As explained above, there isn't a "training set" in the context of an AI/ML algorithm for this type of IVD device. The development process would involve optimizing the reagent formulation and assay conditions against an established reference method (like the Doumas method) to ensure accurate and precise measurements.

§ 862.1110 Bilirubin (total or direct) test system.

(a)
Identification. A bilirubin (total or direct) test system is a device intended to measure the levels of bilirubin (total or direct) in plasma or serum. Measurements of the levels of bilirubin, an organic compound formed during the normal and abnormal distruction of red blood cells, if used in the diagnosis and treatment of liver, hemolytic hematological, and metabolic disorders, including hepatitis and gall bladder block.(b)
Classification. Class II.