Search Filters

Search Results

Found 591 results

510(k) Data Aggregation

    K Number
    K243455
    Date Cleared
    2025-07-31

    (266 days)

    Product Code
    Regulation Number
    866.3981
    Reference & Predicate Devices
    N/A
    Why did this record match?
    Applicant Name (Manufacturer) :

    Roche Molecular Systems, Inc.

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The cobas® Respiratory 4-flex for use on the cobas® 5800/6800/8800 Systems is an automated, multiplex, nucleic acid test that utilizes real-time polymerase chain reaction (PCR) technology intended for simultaneous in vitro qualitative detection and differentiation of severe acute respiratory syndrome coronavirus (SARS-CoV-2), influenza A virus, influenza B virus, and respiratory syncytial virus (RSV) in nasopharyngeal swab specimens obtained from individuals with signs and symptoms of respiratory tract infection. Clinical signs and symptoms of respiratory viral infection due to SARS-CoV-2, influenza A, influenza B and RSV can be similar. This test is intended to aid in the differential diagnosis of SARS-CoV-2, influenza A, influenza B, and RSV infections in humans and is not intended to detect influenza C virus infections.

    Nucleic acids from the viral organisms identified by this test are generally detectable in nasopharyngeal swab specimens during the acute phase of infection. The detection and identification of specific viral nucleic acids from individuals exhibiting signs and symptoms of respiratory tract infection are indicative of the presence of the identified virus, and aid in diagnosis if used in conjunction with other clinical and epidemiological information, and laboratory findings.

    The results of this test should not be used as the sole basis for diagnosis, treatment, or other patient management decisions. Negative results do not preclude SARS-CoV-2, influenza A virus, influenza B virus, or RSV infections. Conversely, positive results do not rule out coinfection with other organisms, and the agent(s) detected by the cobas® Respiratory 4-flex for use on the cobas® 5800/6800/8800 Systems may not be the definite cause of disease.

    Device Description

    cobas® Respiratory 4-flex for use on the cobas® 5800/6800/8800 Systems (cobas® Respiratory 4-flex) is based on fully automated sample preparation (nucleic acid extraction and purification) followed by PCR amplification and detection. The cobas® 5800 System is designed as one integrated instrument. The cobas® 6800/8800 Systems consist of the sample supply module, the transfer module, the processing module, and the analytic module. Automated data management is performed by the cobas® 5800 System or cobas® 6800/8800 Systems software(s), which assigns results for all tests. Results can be reviewed directly on the system screen and printed as a report.

    Nucleic acid from patient samples and added Internal Control RNA (RNA IC) molecules are simultaneously extracted. Nucleic acid is released by addition of proteinase and lysis reagent to the sample. The released nucleic acid binds to the silica surface of the added magnetic glass particles. Unbound substances and impurities, such as denatured protein, cellular debris and potential PCR inhibitors, are removed with subsequent wash steps and purified nucleic acid is eluted from the magnetic glass particles with elution buffer at elevated temperature. External controls (positive and negative) are processed in the same way.

    Selective amplification of target nucleic acid from the sample is achieved by the use of target-specific forward and reverse primers detecting conserved viral genome regions as shown in Table 1.

    Selective amplification of RNA IC is achieved by the use of non-competitive, sequence specific forward and reverse primers, which have no homology with the viral-target specific genomes. Amplified target is detected by the cleavage of fluorescently labeled oligonucleotide probes. Roche's temperature assisted generation of signal (TAGS) technology, short TAGS technology, is introduced to differentiate up to three targets per fluorescence channel, enabling the detection of up to14 targets, and the Internal Control, per well. A thermostable DNA polymerase enzyme is used for amplification.

    Multiplicity of target detection is enabled with temperature-dependent quenching of cleaved fluorescent target-specific probes. This is achieved by separating signals from probes into introduced thermal channels, where fluorescence is acquired at two additional fixed temperatures for each amplification cycle.

    During the PCR amplification step, hybridization of the probes to the specific single-stranded DNA template results in cleavage of the probe by the 5' to 3' exonuclease activity of the DNA polymerase, resulting in separation of the reporter and quencher dyes, and the generation of a fluorescent signal. Conventional probes release fluorescence signal immediately upon separation of reporter from quencher. TAGS probes rely on temperature dependent fluorescence activation, requiring both nuclease cleavage during the extension phase, as well as an increase in reaction temperature, to activate the otherwise dormant fluorophore. For this reason, during each PCR cycle the TAGS technology captures fluorescence in five available fluorescence channels in combination with three thermal channels (detection of fluorescence at three defined temperatures T1, T2 and T3).

    The cobas® Respiratory 4-flex master mix contains detection probes which are specific for influenza A virus, influenza B virus, RSV, SARS-CoV-2 and the RNA Internal Control (RNA IC) nucleic acid, which enables simultaneous detection and differentiation of influenza A virus, influenza B virus, RSV, and SARS-CoV-2 viral targets and the RNA IC.

    The master mix includes deoxyuridine triphosphate (dUTP), instead of deoxythymidine triphosphate (dTTP), which is incorporated into the newly synthesized DNA (amplicon). Any contaminating amplicons from previous PCR runs are destroyed by the AmpErase enzyme [uracil-N-glycosylase], which is included in the PCR mix, when heated in the first thermal cycling step. However, newly formed amplicons are not destroyed since the AmpErase enzyme is inactivated once exposed to temperatures above 55°C.

    The RESP-4FLEX ASAP enables the system to differentiate and report the qualitative results of the four targets influenza A virus, influenza B virus, RSV and SARS-CoV-2. For each specimen the customer can test for any combination of the four enabled virus targets. Also, additional target calculation (digital reflex) can be ordered for the four enabled virus targets (influenza A virus, influenza B virus, RSV and SARS-CoV-2) on the cobas® 5800 System.

    AI/ML Overview

    Here's an analysis of the acceptance criteria and study detailed in the provided FDA clearance letter for the cobas Respiratory 4-flex, structured according to your request:

    1. Table of Acceptance Criteria and Reported Device Performance

    The FDA clearance letter does not explicitly state pre-defined acceptance criteria for the clinical performance. Instead, it reports the observed performance metrics (PPA and NPA) from the clinical studies. For the purpose of this table, I will present the reported clinical performance as the "met acceptance criteria," assuming these values were deemed acceptable by the FDA for clearance.

    AnalyteAcceptance Criteria (Reported PPA CI)Device Performance (PPA %)Acceptance Criteria (Reported NPA CI)Device Performance (NPA %)
    Influenza A
    Fresh Pros.(90.5%, 98.5%)96.2(99.3%, 99.9%)99.7
    Frozen Pros.(89.0%, 99.1%)96.8(99.4%, 99.8%)99.7
    Combined Pros.(92.3%, 98.3%)96.4(99.5%, 99.8%)99.7
    Retrospective(94.1%, 100.0%)100.0(97.6%, 99.4%)98.8
    Influenza B
    Fresh Pros.(94.5%, 100.0%)100.0(99.6%, 100.0%)99.9
    Frozen Pros.(79.8%, 99.3%)95.8(99.8%, 100.0%)100.0
    Combined Pros.(94.0%, 99.8%)98.9(99.8%, 100.0%)99.9
    Retrospective(87.1%, 99.6%)97.5(98.3%, 99.7%)99.3
    RSV
    Fresh Pros.(77.4%, 94.7%)88.7(99.8%, 100.0%)100.0
    Frozen Pros.(81.5%, 95.3%)90.4(99.8%, 100.0%)100.0
    Combined Pros.(83.1%, 93.9%)89.7(99.9%, 100.0%)100.0
    Retrospective(96.4%, 100.0%)100.0(98.2%, 99.7%)99.3
    SARS-CoV-2
    Fresh Pros.(92.4%, 98.6%)96.7(98.0%, 99.1%)98.6
    Frozen Pros.(95.3%, 98.9%)97.7(97.8%, 98.8%)98.4
    Combined Pros.(95.4%, 98.5%)97.3(98.0%, 98.8%)98.5

    Study Proving Device Meets Criteria: The detailed clinical performance evaluation described in "5. CLINICAL PERFORMANCE EVALUATION" (pages 23-26) demonstrates that the cobas Respiratory 4-flex achieves the reported Positive Percent Agreement (PPA) and Negative Percent Agreement (NPA) values against a U.S. FDA-cleared molecular comparator assay. These reported percentage agreements, along with their 95% confidence intervals, serve as the evidence that the device meets the performance expectations for clinical use.

    2. Sample Size Used for the Test Set and Data Provenance

    • Prospective Clinical Study:

      • Total NPS specimens enrolled: 4,475
      • Total NPS specimens tested: 4,378 (1,832 fresh, 2,546 frozen)
      • Total NPS specimens evaluable: 4,341 (1,827 fresh, 2,514 frozen)
      • Data Provenance: Fresh prospective specimens collected at eleven collection sites during the 2023-2024 respiratory viral season. Frozen prospective specimens collected during parts of the 2022-2023 respiratory viral season at seven sites and the 2023-2024 respiratory viral season from 14 collection sites. The specific country of origin is not explicitly stated but implies U.S. based on the "U.S. testing sites" mention for retrospective samples, and the FDA clearance context. The data is prospective.
    • Retrospective Clinical Study:

      • Total NPS specimens enrolled: 770
      • Total NPS specimens evaluable:
        • Influenza A: 657
        • Influenza B: 647
        • RSV: 659
      • Data Provenance: Archived NPS specimens collected between 2014 and 2022 from individuals with signs and symptoms of respiratory viral infection. Tested at three (3) U.S. testing sites. The data is retrospective.

    3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications

    The document does not mention the use of human experts to establish ground truth for the test set. The ground truth was established by a "U.S. FDA-cleared molecular assay" as the comparator method.

    4. Adjudication Method for the Test Set

    The document does not describe an adjudication method involving experts for discrepant results. Instead, it states that an "FDA 510(k) cleared comparator" method was used to establish the "ground truth." For the influenza A target in the prospective study, "three (3) additional specimens (two (2) fresh and one (1) frozen) were excluded from analysis due to inconclusive results obtained from the comparator test," implying a reliance on the comparator's definitive result rather than external adjudication. The same pattern is noted for retrospective samples, with exclusions for failed or invalid comparator test results.

    5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done, and the Effect Size of Human Readers' Improvement with AI vs. Without AI Assistance

    This section is Not Applicable to the provided document. The cobas Respiratory 4-flex is an automated, multiplex nucleic acid detection test, not an AI-powered diagnostic tool requiring human reader interpretation or assistance. Therefore, an MRMC study or analysis of human reader improvement with AI is not relevant.

    6. If a Standalone (i.e., Algorithm Only Without Human-in-the-Loop Performance) Was Done

    Yes, this was a standalone performance evaluation. The device is an automated in vitro diagnostic (IVD) test. The clinical performance evaluation directly compares the cobas Respiratory 4-flex's results (algorithm only, as it's an automated system) against a predicate FDA-cleared molecular assay. There is no human interpretation or intervention in the generation of the primary test result from the cobas system itself.

    7. The Type of Ground Truth Used (Expert Consensus, Pathology, Outcomes Data, etc.)

    The ground truth for the clinical performance evaluation was established by a "U.S. FDA-cleared molecular assay." This means another legally marketed and validated molecular diagnostic test was used as the reference standard.

    8. The Sample Size for the Training Set

    The document does not specify a separate training set or its sample size. This is typical for in vitro diagnostic (IVD) devices that use established laboratory techniques (like PCR) rather than machine learning algorithms which require explicit training data. The development of such assays involves extensive analytical validation (LoD, precision, specificity, inclusivity, etc.) and then clinical validation with independent samples.

    9. How the Ground Truth for the Training Set Was Established

    Since no explicit training set for a machine learning algorithm is mentioned, the concept of "ground truth for the training set" is not applicable in the context of this device's validation as described. The analytical studies (LoD, inclusivity, specificity, etc.) characterize the inherent performance of the assay's chemical and hardware components.

    Ask a Question

    Ask a specific question about this device

    K Number
    K242505
    Manufacturer
    Date Cleared
    2025-07-17

    (329 days)

    Product Code
    Regulation Number
    862.1205
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Roche Diagnostics

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    Immunoassay for the in vitro quantitative determination of cortisol in human urine. The determination of cortisol is used for the recognition and treatment of functional disorders of the adrenal gland.

    The electrochemiluminescence immunoassay "ECLIA" is intended for use on cobas e immunoassay analyzers.

    Device Description

    The Elecsys Cortisol III immunoassay employs a competitive test principle using a cortisol-specific biotinylated monoclonal antibody and a cortisol-derivative labeled with a ruthenium complex. The Elecsys Cortisol III immunoassay is intended for the in vitro quantitative determination of cortisol in human urine. The determination of cortisol is used for the recognition and treatment of functional disorders of the adrenal gland on the cobas e immunoassay analyzers.

    Results are determined via a calibration curve which is instrument-specifically generated by a two-point calibration and a master curve provided via the cobas link.

    The Elecsys Cortisol III immunoassay reagent Rack Pack comprises the following:

    M Streptavidin-coated microparticles (transparent cap), 1 bottle, 12.4 mL:
    Streptavidin-coated microparticles 0.72 mg/mL; preservative.

    R1 Anti-cortisol-Ab~biotin (gray cap), 1 bottle, 21.0 mL:
    Biotinylated monoclonal anti-cortisol antibody (mouse) 18 ng/mL; danazol 20 μg/mL; MES buffer 100 mmol/L, pH 6.0; preservative.

    R2 Cortisol-peptide~Ru(bpy) (black cap), 1 bottle, 21.0 mL:
    Cortisol derivative (synthetic), labeled with ruthenium complex, 5 ng/mL; danazol 20 μg/mL; MES buffer 100 mmol/L, pH 6.0; preservative.

    MES = 2-morpholino-ethane sulfonic acid

    AI/ML Overview

    The provided 510(k) summary for the Elecsys Cortisol III device focuses primarily on non-clinical performance evaluations to demonstrate substantial equivalence to a predicate device. It does not describe a study to prove performance against specific acceptance criteria for diagnostic accuracy (e.g., sensitivity, specificity, or agreement with ground truth in a clinical context) with a test set of patient samples.

    Here's an analysis of the available information:

    1. Acceptance Criteria and Reported Device Performance

    The document does not explicitly state "acceptance criteria" in the traditional sense for diagnostic performance metrics like sensitivity, specificity, or agreement against a clinical ground truth. Instead, it details performance specifications for various analytical aspects and states that these "met the predefined acceptance criteria." These are primarily related to the analytical performance of the assay itself.

    CategoryAcceptance Criteria (Not explicitly stated as clinical performance criteria, but implied as met from the document)Reported Device Performance (Summary of findings)
    PrecisionPredefined acceptance criteria met.Repeatability (cobas e 801 analyzer): CV ranges from 2.0% to 2.7% for human urine samples and controls.
    Intermediate Precision (cobas e 801 analyzer): CV ranges from 2.5% to 3.8% for human urine samples and controls.
    Reproducibility: Lot-to-lot reproducibility met predefined acceptance criteria.
    Analytical Sensitivity (LoB, LoD, LoQ)Predefined acceptance criteria met.LoB: 4.00 nmol/L (0.145 µg/dL)
    LoD: 7.50 nmol/L (0.272 µg/dL)
    LoQ: 10.0 nmol/L (0.363 µg/dL)
    Linearity/Assay Reportable RangePredefined acceptance criteria met.Reportable Range: 20.0 - 500 nmol/L (0.725 - 18.1 µg/dL)
    Human Anti-Mouse Antibodies (HAMA)Predefined acceptance criteria met.Differentiation between HAMA-negative and HAMA-positive samples assessed; data met acceptance criteria.
    Endogenous InterferencesNo significant interference.No significant interference observed for 13 endogenous substances (e.g., bilirubin, hemoglobin, intralipid, biotin, rheumatoid factor, various immunoglobulins, albumin, creatinine, glucose, NaCl, urea) up to the tested concentrations.
    Analytical Specificity/Cross-ReactivityExpected cross-reactivity profiles.Cross-reactivity % reported for various related steroids, with 11-Deoxycortisol (24.3%) and Allotetrahydrocortisol (11.3%) showing the highest cross-reactivity at the tested concentration. Many common steroids showed "n.d." (not detected) or very low cross-reactivity.
    Exogenous Interferences – DrugsNo interference with the assay at therapeutic concentrations for most drugs.No interference found for 12 commonly used pharmaceuticals. Prednisolone and hydrocortisone caused elevated cortisol concentrations. No interference observed for 6 methylprednisolone ≤ 0.157 mg/dL. Additional special drugs tested (amlodipine, betamethasone, beclomethasone, etc.) showed no interference.
    Method ComparisonPredefined acceptance criteria met.Data analyzed according to CLSI EP09-A3 and met all predefined acceptance criteria when compared to the predicate device (ARCHITECT Cortisol) using native 24-hour urine samples spanning the measuring range.
    StabilityPredefined acceptance criteria met.Supports claims for unopened reagents at 2-8 °C up to the stated expiration date and 16 weeks on the analyzer.
    Reference RangeEstablished reference range for healthy population.2.5th percentile: 24.8 nmol/24h (8.98 µg/24h)
    97.5th percentile: 238 nmol/24h (86.2 µg/24h) for a healthy US population.

    2. Sample Size and Data Provenance for Test Set

    • Precision (Repeatability & Intermediate Precision): Human urine samples (24-hour urine) and controls. Two replicates per run, two runs per day for 21 days for each of 4 human urine samples and 2 controls. (Total of $4 \text{ samples} \times 2 \text{ replicates/run} \times 2 \text{ runs/day} \times 21 \text{ days} = 336$ measurements for human urine, plus $2 \text{ controls} \times 2 \text{ replicates/run} \times 2 \text{ runs/day} \times 21 \text{ days} = 168$ measurements for controls. Or potentially 42 total runs for each sample/control).
    • Analytical Sensitivity (LoB, LoD, LoQ): Not specified beyond "reagents and calibrators" likely being used.
    • Linearity/Assay Reportable Range: Dilution series contained a minimum of 9 concentrations. Number of samples not explicitly stated but implies a set of samples specifically created to span the measuring range.
    • HAMA: Not specified.
    • Endogenous Interferences: Human urine samples (24-hour urine) were used. The number of samples is not explicitly stated.
    • Analytical Specificity/Cross-Reactivity: Human urine (24-hour urine) samples. Specific numbers not provided beyond "samples were measured in the presence and absence of the potential cross-reactants."
    • Exogenous Interferences – Drugs: In vitro tests performed on 12 commonly used pharmaceuticals and additional special drugs. This implies spiked samples rather than a "test set" of patient samples.
    • Method Comparison: "Native 24 h urine samples" for comparison with the predicate device. The number of samples is not specified.
    • Reference Range Study: Samples collected from an "apparently healthy population in the United States" across three study sites. The exact number of samples is not provided, but it's sufficient for establishing 2.5th and 97.5th percentiles (typically requires 120+ samples according to CLSI EP28-A3c).

    Data Provenance: The document explicitly states "human urine samples (24-hour urine)" for most studies and for the reference range, "collected across three study sites... in the United States." This indicates prospective collection for the reference range study specifically for generating normal values applicable to the US population. For other analytical performance claims, the sample type (human urine) is generally mentioned, suggesting a similar provenance, likely for prospective testing within the manufacturer's lab or clinical sites.

    3. Number of Experts and Qualifications for Ground Truth

    Not applicable for the Elecsys Cortisol III. This is an in vitro diagnostic device (IVD) that quantitatively measures a biomarker (cortisol). The "ground truth" for such devices is typically established through recognized analytical standards, reference methods, and comparison to a legally marketed predicate device, rather than expert consensus on diagnostic images or clinical assessments. The closest to "ground truth" in this context would be the accuracy against a gold standard analytical method or purified cortisol standards. These details are not provided but are implicit in the validation that relies on CLSI guidelines.

    4. Adjudication Method for the Test Set

    Not applicable. As this is a quantitative IVD for a biomarker, diagnostic classification and adjudication by experts are not relevant to the described analytical studies. The performance is assessed by comparison to expected analytical results or a predicate device.

    5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

    Not applicable. MRMC studies are typically for imaging devices or software that assist human readers in making a diagnosis. The Elecsys Cortisol III is an automated in vitro diagnostic immunoassay for quantitative measurement of cortisol in urine. It does not involve human readers interpreting cases with or without AI assistance.

    6. Standalone Performance Study

    Yes, the entire submission describes standalone performance. The Elecsys Cortisol III is an immunoassay designed to operate on cobas e immunoassay analyzers. All the performance data (precision, sensitivity, linearity, interference, cross-reactivity, method comparison) are generated directly from the device's measurement of cortisol in urine samples. The device itself performs the quantitative determination without human-in-the-loop interpretation impacting the measurement results. The method comparison study directly compares its quantitative output to the predicate device's quantitative output.

    7. Type of Ground Truth Used

    For an IVD like Elecsys Cortisol III, the "ground truth" for the test set is established by:

    • Reference standards/Calibrators: For analytical sensitivity (LoB, LoD, LoQ) and linearity studies, known concentrations of cortisol (or materials traceable to them) are used.
    • Predicate device comparison: For method comparison, the results from the Elecsys Cortisol III are compared to those obtained from the legally marketed ARCHITECT Cortisol (K062204), which serves as the established "truth" or benchmark for demonstrating substantial equivalence.
    • Spiked samples/characterized samples: For interference and cross-reactivity studies, samples with known concentrations of interferents or cross-reactants are used to determine the device's accuracy in their presence.
    • Clinically characterized healthy population samples: For the reference range study, samples from healthy individuals are used to establish normal ranges, though this isn't a "ground truth" for diagnostic accuracy.

    8. Sample Size for the Training Set

    The document does not mention "training set" in the context of an AI/ML algorithm. This device is an immunoassay, which relies on chemical reactions and optical detection, not an AI/ML model that requires a training set. The term "training set" is therefore not applicable here.

    9. How the Ground Truth for the Training Set Was Established

    Not applicable. As noted above, there is no AI/ML training set for this immunoassay device.

    Ask a Question

    Ask a specific question about this device

    K Number
    K250768
    Manufacturer
    Date Cleared
    2025-06-10

    (89 days)

    Product Code
    Regulation Number
    866.3983
    Reference & Predicate Devices
    N/A
    Why did this record match?
    Applicant Name (Manufacturer) :

    Roche Diagnostics

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    Elecsys Anti-SARS-CoV-2 is an immunoassay intended for the in vitro qualitative detection of total antibodies to Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) in human serum and Li-heparin, K2-EDTA and K3-EDTA plasma collected on or after 15 days post-symptom onset. The test is intended as an aid in identifying individuals with an adaptive immune response to SARS-CoV-2, indicating recent or prior infection.

    The electrochemiluminescence immunoassay "ECLIA" is intended for use on cobas e 601 immunoassay analyzer.

    Device Description

    Elecsys Anti-SARS-CoV-2 is a qualitative, serological, double-antigen sandwich principle immunoassay to be used on the cobas e 601 analyzer with an 18-minute test time. Results are determined automatically by the software by comparing the electrochemiluminescence signal obtained from the reaction product of the sample with the signal of the cutoff value previously obtained by calibration. The Elecsys Anti‑SARS‑CoV-2 assay uses a recombinant protein representing the nucleocapsid (N) antigen for the determination of antibodies against SARS‑CoV‑2.

    The reagent working solutions include: rackpack (kit placed on the analyzer)

    • M Streptavidin-coated microparticles (transparent cap), 1 bottle, 12 mL: Streptavidin-coated microparticles 0.72 mg/mL; preservative.
    • R1 SARS-CoV-2-Ag~biotin, (gray cap), 1 bottle, 16 mL: Biotinylated SARS‑CoV‑2‑specific recombinant antigen (E. coli)
    AI/ML Overview

    The provided FDA 510(k) clearance letter and summary describe the acceptance criteria and the study that proves the device, Elecsys Anti-SARS-CoV-2, meets those criteria.

    Here's the breakdown of the requested information:

    1. Table of Acceptance Criteria and Reported Device Performance

    The document doesn't explicitly state "acceptance criteria" as clear numerical targets for PPA and NPA prior to presenting the results. However, implied acceptance criteria for qualitative serology tests typically involve a high percentage of agreement. Based on the reported performance, we can infer the acceptance criteria were met by these results.

    Performance MetricImplied Acceptance Criteria (High Agreement)Reported Device Performance
    Negative Percent Agreement (NPA)High (e.g., >99%)99.81% (95% CI: 99.70%)
    Positive Percent Agreement (PPA) (Traditional Clinical Study)High (e.g., >95%)98.82% (95% CI: 96.59% - 99.60%)
    PPA (Real-World Data)High (e.g., >95%)96.49% (95% CI: 93.66% - 98.08%)

    Additional Non-Clinical Acceptance Criteria (Met for all):

    • Precision: Standard Deviation (SD) and Coefficient of Variance (CV) values within predetermined limits for repeatability, between-run, between-day, between-lot, and between-site precision.
    • Hook Effect: No hook effect observed.
    • Potential Interference (Endogenous Substances): Biotin tolerance $\le$ 1200 ng/mL; no interference within specification for Intralipid, Bilirubin, Hemoglobin, Rheumatoid Factor, IgG, IgM, IgA, human serum albumin, ANA, cholesterol, and triglycerides.
    • Analytical Cutoff Sensitivity: Cutoff of 1.00 COI corresponds to 1.137 BAU/mL (demonstrated alignment with international standard).
    • Analytical Specificity- Potential Cross-Reactivity: False positive rate for cross-reacting antibodies within acceptable limits (2 false positives out of 7 MERS-CoV glycoprotein samples observed, overall 1836 samples tested).
    • Exogenous Interference: Results within specification for 17 common drugs and 18 special drugs (with the exception of Ritonavir, which was within specification at 1x daily dose).
    • Matrix Comparison: Matrix equivalency demonstrated for serum, Li-Heparin, K2-EDTA, K3-EDTA plasma, and separation gel tubes.
    • Reagent, Calibrator, and Control Stability: Met stated storage times and conditions (e.g., 28 days on-board reagent, 10 hours on-board PreciControl, 30 days refrigerator after first opening, 28 days after first opening for PreciControl, 25 days lot calibration stability, 7 days on-board calibration stability).
    • Specimen Stability: Met stated storage times and conditions (e.g., 7 days at 15-25°C, 14 days at 2-8°C, 28 days at -20°C, 3 freeze-thaw cycles).
    • Fresh/Frozen Study: All results within specification for fresh vs. frozen samples.

    2. Sample Sizes Used for the Test Set and the Data Provenance

    • Negative Percent Agreement (NPA):
      • Sample Size: 9007 pre-pandemic specimens.
      • Data Provenance: Not explicitly stated (e.g., country of origin), but implicitly "pre-pandemic" suggests samples collected before December 2019. This is retrospective data.
    • Positive Percent Agreement (PPA) - Traditional Clinical Study:
      • Sample Size: 254 specimens collected $\ge$ 15 days post symptom onset (DPSO), excluding COVID-19 vaccinated individuals and immunocompromised subjects.
      • Data Provenance: Not explicitly stated (e.g., country of origin), but described as collected under "routine laboratory conditions." This is retrospective or potentially a mix of retrospective and prospective, reflecting real clinical samples.
    • PPA - Real-World Data:
      • Sample Size: 285 samples from non-immunocompromised subjects who did not receive the COVID-19 vaccine, collected $\ge$ 15 DPSO.
      • Data Provenance: Collaborating institution in the United States, collected from March 2020 – March 2021. This is retrospective data.

    3. Number of Experts Used to Establish the Ground Truth for the Test Set and the Qualifications of Those Experts

    For this serology test, the ground truth is established through laboratory methods, not by human expert readers in the way an imaging AI would be adjudicated.

    • NPA: Ground truth was "presumed to be negative for anti-SARS-CoV-2 antibodies" based on collection before December 2019, prior to the widespread circulation of SARS-CoV-2.
    • PPA (Traditional Clinical Study): Ground truth was established by a composite comparator method comprised of 3 SARS-CoV-2 serology assays (including the predicate assay). Seropositivity was determined by majority rule ($\ge$ 2 out of 3). Additionally, these individuals had a history of SARS-CoV-2 infection confirmed by a prior FDA authorized RT-PCR test.
    • PPA (Real-World Data): Ground truth was established by PCR as the comparator. Data was collected from electronic medical records and laboratory information systems.

    Qualifications of Experts: Not applicable in the context of serology ground truth determination as it relies on other laboratory assays.

    4. Adjudication Method (e.g., 2+1, 3+1, none) for the Test Set

    • NPA: No adjudication method as samples were "presumed negative" based on collection date.
    • PPA (Traditional Clinical Study): A form of "majority rule" for the composite comparator method was used: $\ge$ 2 out of 3 serology assays. This is akin to a 2/3 agreement rule, but applied to the reference method rather than human readers adjudicating an AI's output. The confirmatory RT-PCR also served as a strong initial ground truth.
    • PPA (Real-World Data): PCR was the direct comparator, so no explicit adjudication method beyond the result of the PCR test itself.

    5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done, If So, What Was the Effect Size of How Much Human Readers Improve with AI vs Without AI Assistance

    This is a clinical laboratory immunoassay (serology test), not an AI software intended for medical image interpretation or human-in-the-loop assistance. Therefore, an MRMC comparative effectiveness study involving human readers and AI assistance is not applicable and was not performed.

    6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) Was Done

    The device itself is a standalone immunoassay system (Elecsys Anti-SARS-CoV-2 on the cobas e 601 analyzer) that provides a qualitative result (positive/negative) automatically. The entire clinical performance evaluation section describes the standalone performance of this device against established ground truths. Thus, a standalone performance evaluation was indeed done.

    7. The Type of Ground Truth Used (expert consensus, pathology, outcomes data, etc.)

    • NPA: Pre-pandemic sample collection date (before December 2019), implying presumed negative status. This serves as a strong epidemiological ground truth for SARS-CoV-2 negativity.
    • PPA (Traditional Clinical Study):
      • Composite Comparator Method: Majority rule ($\ge$ 2 out of 3) of other FDA-de novo and EUA-authorized Anti-SARS-CoV-2 serology assays.
      • Confirmatory RT-PCR: Individuals had a history of SARS-CoV-2 infection confirmed by a prior FDA authorized RT-PCR test.
    • PPA (Real-World Data): FDA authorized RT-PCR test results from electronic medical records and laboratory information systems.

    In summary, the ground truth primarily relies on a combination of other FDA-authorized laboratory tests (serology and RT-PCR) and epidemiological/temporal evidence.

    8. The Sample Size for the Training Set

    This document describes the validation of a serology immunoassay, not a machine learning or AI model. Therefore, there is no "training set" in the context of AI model development. The "training" for such an assay would typically involve analytical development and optimization of reagents and protocols, not a data-driven training set in the AI sense.

    9. How the Ground Truth for the Training Set Was Established

    As there is no AI training set described or applicable for this type of device, this question is not relevant to the provided information. The ground truth for performance evaluation was established as described in point 7.

    Ask a Question

    Ask a specific question about this device

    K Number
    K243863
    Date Cleared
    2025-05-30

    (164 days)

    Product Code
    Regulation Number
    892.2050
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Roche Molecular Systems, Inc.

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    Opulus™ Lymphoma Precision is a software device that uses a machine learning-based algorithm to automate segmentation and visualization of lesions along with automation of measurement of total metabolic tumor volume within whole-body FDG-PET/CT scans of patients with FDG-avid lymphomas.

    Opulus™ Lymphoma Precision is used to assist trained interpreting physicians with visualization of suspected lesions and calculation of total volume of all lesions in a body. This information can be used in addition to the standard of care image interpretation of FDG-PET/CT scans. Opulus™ Lymphoma Precision annotated images can be reviewed by an appropriately trained physician.

    The algorithm is assistive, and requires a radiologist review, who will make the final decision on FDG-PET/CT image interpretation.

    Device Description

    Opulus™ Lymphoma Precision is an assistive tool which can be used by physicians to automate the labor intensive task of quantifying disease burden in whole-body FDG-PET/CT scans of patients already diagnosed with FDG-avid lymphomas. It does so by using a machine learning methodology to localize and segment FDG-PET activity ('hot-spots' on FDG-PET scans) of lymphoma lesions within a PET/CT image. Opulus™ Lymphoma Precision does not screen for or diagnose lymphoma. It is intended for patients already diagnosed with FDG-avid lymphoma.

    The following is a list of key functionalities algorithm performs to accomplish the proposed intended use.

    • localization and segmentation,
    • visualization of lymphoma-related tumor lesions
    • quantification of Total Metabolic Tumor Volume (TMTV)

    Opulus™ Lymphoma Precision aids the efficiency of medical professionals by automatically generating tumor boundary Regions of Interest (ROIs) and quantifying TMTV, which is a tedious task when performed manually. The physician has the option to accept/reject the output generated by the device. The user does not have the ability to modify the device output.

    AI/ML Overview

    Here's a breakdown of the acceptance criteria and the study proving the device meets them, based on the provided FDA 510(k) clearance letter for Opulus™ Lymphoma Precision:

    1. Table of Acceptance Criteria and Reported Device Performance

    The provided document does not explicitly present a table of "acceptance criteria" with pass/fail thresholds. However, it does state the objectives of the performance validation study and the results that demonstrate the device's agreement and accuracy. We'll infer the implicit acceptance criteria from these objectives.

    Performance MetricAcceptance Criteria (Implicit)Reported Device Performance
    Agreement of TMTV (Cubic Root)Demonstrate an acceptable difference between aTMTV (algorithm) and mTMTV (manual ground truth).Mean difference: -0.20 cm (95% CI: -0.50, 0.10) for TMTV
    Ask a Question

    Ask a specific question about this device

    K Number
    K243400
    Date Cleared
    2025-04-25

    (176 days)

    Product Code
    Regulation Number
    866.3981
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Roche Molecular Systems, Inc.

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The cobas liat SARS-CoV-2 & Influenza A/B v2 nucleic acid test is an automated rapid multiplex real-time reverse transcription polymerase chain reaction (RT-PCR) test intended for the simultaneous qualitative detection and differentiation of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), influenza A virus and influenza B virus nucleic acids in anterior nasal (nasal) and nasopharyngeal swab specimens from individuals exhibiting signs and symptoms of respiratory tract infection. Clinical signs and symptoms of respiratory tract infection due to SARS-CoV-2 and influenza can be similar. This test is intended to aid in the differential diagnosis of SARS-CoV-2, influenza A and influenza B infections in humans and is not intended to detect influenza C virus infections.

    Nucleic acids from the viral organisms identified by this test are generally detectable in nasopharyngeal and nasal swab specimens during the acute phase of infection. The detection and identification of specific viral nucleic acids from individuals exhibiting signs and symptoms of respiratory tract infection are indicative of the presence of the identified virus, and aid in diagnosis if used in conjunction with other clinical and epidemiological information and laboratory findings.

    The results of this test should not be used as the sole basis for diagnosis, treatment, or other patient management decisions. Positive results do not rule out coinfection with other organisms. The organism(s) detected by the cobas liat SARS-CoV-2 & Influenza A/B v2 nucleic acid test may not be the definite cause of disease. Negative results do not preclude SARS-CoV-2, influenza A virus or influenza B virus infections.

    Device Description

    The cobas liat SARS-CoV-2 & Influenza A/B v2 nucleic acid test is performed on the cobas liat analyzer which automates and integrates sample purification, nucleic acid amplification, and detection of the target sequence in biological samples using real-time PCR assays. The assay targets both the ORF1 a/b non-structural region and membrane protein gene that are unique to SARS-CoV-2, a well-conserved region of the matrix gene of influenza A (Flu A target), and the nonstructural protein 1 (NS1) gene of influenza B (Flu B target). An Internal Control (IC) is included to control for adequate processing of the target virus through all steps of the assay process and to monitor the presence of inhibitors in the RT-PCR processes.

    AI/ML Overview

    This document describes the validation study for the cobas liat SARS-CoV-2 & Influenza A/B v2 nucleic acid test.

    Here's an analysis of the acceptance criteria and the study proving the device meets them:

    1. Table of Acceptance Criteria and Reported Device Performance

    Since this is a diagnostic test, the primary acceptance criteria revolve around analytical and clinical performance metrics like Limit of Detection, Inclusivity, Cross-Reactivity, Reproducibility, and Clinical Agreement (Positive Percent Agreement and Negative Percent Agreement). The document doesn't explicitly state "acceptance criteria" values in a separate table, but these are implied by the performance metrics reported and the general standards for diagnostic device clearance. I will extract the reported device performance from the provided text.

    Performance MetricTarget AnalyteSpecimen TypeReported Performance (Value)Implied Acceptance Criteria (Typically high for diagnostic tests)
    Analytical Sensitivity (LoD)SARS-CoV-2Co-spiked panels0.0350 TCID50/mLLowest detectable concentration for 95% positivity
    Influenza ACo-spiked panels0.00325 TCID50/mLLowest detectable concentration for 95% positivity
    Influenza BCo-spiked panels0.183 TCID50/mLLowest detectable concentration for 95% positivity
    Reactivity/InclusivitySARS-CoV-2Respective variants100% detection at 3x LoDDetection of various strains/variants
    Influenza ARespective variants100% detection at varying LoD (up to 12x)Detection of various strains/variants
    Influenza BRespective variants100% detection at 3x LoDDetection of various strains/variants
    Cross-Reactivity/Microbial InterferenceAll targetsVarious microorganismsNo cross-reactivity/interferenceNo false positives or interference from other common pathogens
    Competitive InhibitionAll targetsCo-spiked samplesNo interferenceAccurate detection of all targets even in co-infection
    Endogenous/Exogenous InterferenceAll targetsVarious substancesNo interferenceRobust performance in presence of common respiratory interferents
    Reproducibility (Negative)N/ANegative samples100.0% AgreementHigh agreement for negative samples across sites, lots, days
    Reproducibility (1x-2x LoD)SARS-CoV-2Low Positive samples100.0% AgreementHigh agreement for low positive samples
    Influenza ALow Positive samples99.6% AgreementHigh agreement for low positive samples
    Influenza BLow Positive samples99.6% AgreementHigh agreement for low positive samples
    Reproducibility (3x-5x LoD)SARS-CoV-2Moderate Positive100.0% AgreementHigh agreement for moderate positive samples
    Influenza AModerate Positive100.0% AgreementHigh agreement for moderate positive samples
    Influenza BModerate Positive100.0% AgreementHigh agreement for moderate positive samples
    *Clinical Performance (PPA)ProspectiveSARS-CoV-2NPS94.5% (90.7-96.8 CI)High sensitivity (ability to detect true positives)
    SARS-CoV-2ANS96.7% (93.4-98.4 CI)High sensitivity (ability to detect true positives)
    Influenza ANPS100.0% (93.4-100.0 CI)High sensitivity (ability to detect true positives)
    Influenza AANS100.0% (93.2-100.0 CI)High sensitivity (ability to detect true positives)
    Influenza BNPS100.0% (85.1-100.0 CI)High sensitivity (ability to detect true positives)
    Influenza BANS100.0% (86.2-100.0 CI)High sensitivity (ability to detect true positives)
    *Clinical Performance (NPA)ProspectiveSARS-CoV-2NPS97.6% (96.7-98.3 CI)High specificity (ability to correctly identify true negatives)
    SARS-CoV-2ANS97.2% (96.2-97.9 CI)High specificity (ability to correctly identify true negatives)
    Influenza ANPS99.3% (98.8-99.6 CI)High specificity (ability to correctly identify true negatives)
    Influenza AANS99.3% (98.8-99.6 CI)High specificity (ability to correctly identify true negatives)
    Influenza BNPS99.3% (98.8-99.6 CI)High specificity (ability to correctly identify true negatives)
    Influenza BANS99.5% (99.0-99.7 CI)High specificity (ability to correctly identify true negatives)
    *Clinical Performance (PPA)RetrospectiveInfluenza BNPS100.0% (89.8-100.0 CI)High sensitivity (ability to detect true positives)
    Influenza BANS100.0% (89.8-100.0 CI)High sensitivity (ability to detect true positives)
    *Clinical Performance (NPA)RetrospectiveInfluenza BNPS97.9% (94.7-99.2 CI)High specificity (ability to correctly identify true negatives)
    Influenza BANS98.3% (95.0-99.4 CI)High specificity (ability to correctly identify true negatives)

    2. Sample Sizes Used for the Test Set and Data Provenance

    • Prospective Clinical Study:

      • Sample Size: 1729 symptomatic subjects enrolled.
        • 1705 evaluable NPS specimens for analysis (19 non-evaluable due to missing/invalid results, 5 due to handling).
        • 1706 evaluable ANS specimens for SARS-CoV-2 and Influenza B analysis (22 non-evaluable due to missing/invalid results, 1 due to handling).
        • 1704 evaluable ANS specimens for Influenza A analysis (2 additional found inconclusive for comparator).
      • Data Provenance: Prospective, collected between September 2023 and March 2024 at 14 point-of-care testing sites in the United States (US).
    • Retrospective Clinical Study (Influenza B Supplement):

      • Sample Size: 223 archived NPS specimens and 206 archived ANS specimens (total 429).
        • One NPS sample pre-characterized as positive for influenza B was non-evaluable.
      • Data Provenance: Retrospective, frozen archived (Category III) specimens collected between 2019 and 2023. Distributed to 6 sites for testing.

    3. Number of Experts Used to Establish Ground Truth for the Test Set and Qualifications of Experts

    The document does not mention the use of experts to establish ground truth for the clinical test sets. For molecular diagnostic tests like this, the ground truth is typically established by comparing the investigational device's results against a highly accurate, accepted comparator method (another FDA-cleared Nucleic Acid Amplification Test specific for the target analytes). The expertise lies in the development and validation of these comparator methods, not in individual expert review of each sample for ground truth in this context.

    4. Adjudication Method for the Test Set

    The document describes discrepant result analysis for both prospective and retrospective clinical studies.

    • For the prospective study, "discrepant NAAT results" are detailed for SARS-CoV-2 (NPS and ANS), Influenza A (NPS and ANS), and Influenza B (NPS and ANS).
    • For the retrospective study, discrepant NAAT results are detailed for Influenza B (NPS and ANS).

    The method appears to be:

    • The cobas liat test result is compared to the FDA-cleared comparator NAAT result.
    • When there's a discrepancy (e.g., cobas liat positive, comparator negative), it explicitly states how many were "positive" and "negative" upon further investigation or re-evaluation (e.g., with "discrepant NAAT results").
      • For example: "Of 12 specimens negative on cobas® liat and positive on the comparator, 8 were positive and 4 were negative." This implies some form of re-testing or deeper analysis (not specified as "adjudication by experts" but rather "discrepant NAAT results"). It's more of a re-confirmation of the comparator or a third method, rather than a human expert consensus process. Such re-evaluation often involves re-testing using the comparator or a reference method.

    Therefore, while there's no "2+1" or "3+1" expert adjudication method described as would be seen in imaging studies, there is a discrepant resolution process based on further NAAT results. It's not "none" in the sense that discrepancies are just reported without follow-up; rather, they are further investigated using additional NAAT results to re-confirm the original comparator status if possible.

    5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done, If So, What Was the Effect Size of How Much Human Readers Improve with AI vs Without AI Assistance

    No. This is a standalone diagnostic test (RT-PCR), not an AI-assisted imaging device or a test that involves human "readers" interpreting results. Therefore, an MRMC comparative effectiveness study involving human readers and AI assistance is not applicable and was not performed.

    6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) Was Done

    Yes, implicitly. This is a fully automated RT-PCR test run on the cobas liat analyzer. The performance metrics (LoD, inclusivity, cross-reactivity, reproducibility, and clinical agreement) are measures of the device's performance on its own against established ground truth (comparator NAAT). While humans load samples and interpret the final digital result (positive/negative), the core detection and differentiation is algorithm-driven within the instrument, making its performance essentially "standalone" in the context of diagnostic accuracy.

    7. The Type of Ground Truth Used

    • Clinical Performance (Prospective and Retrospective): The ground truth for clinical sample testing was established by comparing the cobas liat results against an FDA-cleared Nucleic Acid Amplification Test (NAAT), which serves as the reference or "ground truth" method for molecular diagnostic assays. The document explicitly states: "PPA and NPA were determined by comparing the results of cobas® liat SARS-CoV-2 & Influenza A/B v2 to the results of an FDA-cleared Nucleic Acid Amplification Test (NAAT)." and "The comparator method was an acceptable FDA-cleared molecular assay."
    • Analytical Studies (LoD, Inclusivity, Cross-Reactivity, Interference, Reproducibility): Ground truth was established by preparing precisely known concentrations of viral material (cultured or inactivated viruses) or specific microorganisms in controlled laboratory settings. For these studies, the "ground truth" is meticulously prepared and verified laboratory standards.

    8. The Sample Size for the Training Set

    The document does not specify a separate "training set" sample size. For an RT-PCR diagnostic platform, the "training" involves the fundamental biochemical and optical engineering, and the optimization of assay (reagent) design to achieve sensitivity and specificity. This is distinct from machine learning models that often require large, labeled datasets for "training." The analytical and clinical validation studies described here are verification and validation (V&V) studies, akin to a "test set" to prove the device's performance against its design specifications and clinical utility.

    9. How the Ground Truth for the Training Set Was Established

    Since no explicit "training set" for a machine learning algorithm is mentioned (as this is a molecular diagnostic test), this question is not directly applicable. However, the ground truth for assay development and optimization (which can be considered analogous to "training" in a broader sense of device development) would have been established through extensive laboratory work using:

    • Highly characterized viral cultures or purified nucleic acids: Used to define target sequences, optimize primer/probe design, and determine initial analytical sensitivity.
    • Spiked samples: Adding known quantities of targets or interferents to negative clinical matrices to mimic real-world conditions during early development.
    • Early clinical samples: Used to refine assay performance and resolve initial issues prior to formal validation studies.

    These processes ensure the assay correctly identifies the target nucleic acids.

    Ask a Question

    Ask a specific question about this device

    K Number
    K243406
    Date Cleared
    2025-04-25

    (175 days)

    Product Code
    Regulation Number
    866.3981
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Roche Molecular Systems, Inc.

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The cobas liat SARS-CoV-2, Influenza A/B & RSV nucleic acid test is an automated rapid multiplex real-time reverse transcription polymerase chain reaction (RT-PCR) test intended for the simultaneous qualitative detection and differentiation of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), influenza A virus, influenza B virus and respiratory syncytial virus (RSV) nucleic acids in anterior nasal (nasal) and nasopharyngeal swab specimens from individuals exhibiting signs and symptoms of respiratory tract infection. Clinical signs and symptoms of respiratory viral infection due to SARS-CoV-2, influenza and RSV can be similar. This test is intended to aid in the differential diagnosis of SARS-CoV-2, influenza A, influenza B, and RSV infections in humans and is not intended to detect influenza C virus infections.

    Nucleic acids from the viral organisms identified by this test are generally detectable in nasopharyngeal and nasal swab specimens during the acute phase of infection. The detection and identification of specific viral nucleic acids from individuals exhibiting signs and symptoms of respiratory tract infection are indicative of the presence of the identified virus, and aid in diagnosis if used in conjunction with other clinical and epidemiological information, and laboratory findings.

    The results of this test should not be used as the sole basis for diagnosis, treatment, or other patient management decisions. Positive results do not rule out coinfection with other organisms. The organism(s) detected by the cobas liat SARS-CoV-2, Influenza A/B & RSV nucleic acid test may not be the definite cause of disease. Negative results do not preclude SARS-CoV-2, influenza A virus, influenza B virus, or RSV infections.

    Device Description

    The cobas liat SARS-CoV-2, Influenza A/B & RSV nucleic acid test is performed on the cobas liat analyzer which automates and integrates sample purification, nucleic acid amplification, and detection of the target sequence in biological samples using real-time PCR assays. The assay targets both the ORF1 a/b non-structural region and membrane protein gene that are unique to SARS-CoV-2, a well-conserved region of the matrix gene of influenza A (Flu A target), the nonstructural protein 1 (NS1) gene of influenza B (Flu B target) and the matrix gene of RSV (RSV target). An Internal Control (IC) is included to control for adequate processing of the target virus through all steps of the assay process and to monitor the presence of inhibitors in the RT-PCR processes.

    AI/ML Overview

    The provided text describes the analytical and clinical performance evaluation of the cobas® liat SARS-CoV-2, Influenza A/B & RSV nucleic acid test, which is a real-time RT-PCR assay. The information mainly focuses on the performance characteristics required for FDA clearance (510(k)).

    Here's a breakdown of the requested information based on the provided document:

    Acceptance Criteria and Device Performance

    The document does not explicitly present a table of "acceptance criteria" in a pass/fail format for clinical performance. Instead, it demonstrates the device's performance through various analytical studies and clinical agreement percentages relative to a comparator method. The acceptance for a 510(k) submission is typically that the device is "substantially equivalent" to a legally marketed predicate device, which implies demonstrating comparable performance characteristics.

    The key performance metrics are the Positive Percent Agreement (PPA) and Negative Percent Agreement (NPA) in clinical studies. While there aren't explicit numeric acceptance criteria stated, the achieved performance values are presented as evidence of substantial equivalence.

    Here’s a table summarizing the reported clinical device performance based on the prospective study (Table 13) and the retrospective study (Table 15). These are the metrics by which the device's clinical performance would be "accepted" as substantially equivalent.

    Table of Reported Device Performance (Clinical)

    TargetSpecimen TypePPA (%) (95% CI)NPA (%) (95% CI)
    SARS-CoV-2NPS94.5 (90.7-96.8)97.6 (96.7-98.3)
    SARS-CoV-2ANS96.7 (93.4-98.4)97.2 (96.2-97.9)
    Influenza ANPS100.0 (93.4-100.0)99.3 (98.8-99.6)
    Influenza AANS100.0 (93.2-100.0)99.3 (98.8-99.6)
    Influenza BNPS (Prospective)100.0 (85.1-100.0)99.3 (98.8-99.6)
    Influenza BANS (Prospective)100.0 (86.2-100.0)99.5 (99.0-99.7)
    Influenza BNPS (Retrospective)100.0 (89.8-100.0)97.9 (94.7-99.2)
    Influenza BANS (Retrospective)100.0 (89.8-100.0)98.3 (95.0-99.4)
    RSVNPS100.0 (94.8-100.0)99.0 (98.3-99.3)
    RSVANS97.5 (91.4-99.3)98.8 (98.2-99.3)

    Note on "Acceptance Criteria" for Analytical Performance: The document describes detailed analytical studies (LoD, inclusivity, cross-reactivity, interference, reproducibility), and the reported hit rates and concentrations demonstrate that the device met the internal analytical performance specifications, which are implicitly the "acceptance criteria" for these aspects. For instance, for LoD, the acceptance criterion is implied to be ≥95% hit rate at the determined concentration. For inclusivity, it's detection at or near 3x LoD. For cross-reactivity and interference, the acceptance criterion is no cross-reactivity/interference observed. The document states that "none of the organisms tested cross reacted or interfered" and that "substances... did not interfere," indicating successful meeting of these criteria. For reproducibility, the agreement percentages for positive and negative samples are above 99% for most categories.

    Study Details

    1. Sample sizes used for the test set and the data provenance:

      • Prospective Clinical Study (Category I):
        • NPS specimens: 1729 enrolled subjects leading to 1704 evaluable specimens for SARS-CoV-2, Flu A, Flu B, and 1705 for RSV.
        • ANS specimens: 1729 enrolled subjects leading to 1705 evaluable specimens for SARS-CoV-2, Flu B, 1703 for Flu A, and 1706 for RSV.
        • Data Provenance: Fresh specimens, prospective, collected between September 2023 and March 2024 at 14 point-of-care testing sites in the United States (US).
      • Retrospective Clinical Study (Category III):
        • Specimens: Frozen archived clinical NPS (n=223) and ANS (n=206) specimens.
        • Data Provenance: Retrospective, collected between 2019 and 2023. Distributed to 6 sites for testing. Country of origin not explicitly stated but implied to be US given the overall context of a US FDA clearance (though not definitively stated for the retrospective part).
    2. Number of experts used to establish the ground truth for the test set and the qualifications of those experts:
      The ground truth for the clinical test set was established by comparing the results of the cobas® liat test to the "results of an FDA-cleared Nucleic Acid Amplification Test (NAAT)." The document does not specify the number of human experts, their qualifications, or their role in establishing this ground truth. The "ground truth" here is the result from the comparator NAAT, not human expert interpretation of images or clinical data.

    3. Adjudication method (e.g. 2+1, 3+1, none) for the test set:
      The document describes a discrepant analysis for cases where the cobas® liat test results differed from the comparator NAAT. For the prospective study, the discrepancy analysis showed how many of the discrepant results (e.g., cobas® liat negative, comparator positive) were ultimately confirmed as positive or negative by further investigation (implied to be by the comparator method or potentially a third method, though not explicitly detailed beyond "discrepant NAAT results"). The details provided are:

      • SARS-CoV-2 NPS: Of 12 negative cobas® liat/positive comparator, 8 were positive and 4 negative. Of 35 positive cobas® liat/negative comparator, 12 were positive and 23 negative.
      • Similar analyses are provided for other targets and specimen types.
        This implies an adjudication method where discrepant results were further investigated, likely with repeat testing or a confirmatory reference method, but the specific "2+1" or "3+1" reader/expert adjudication model (common in imaging studies) is not applicable or described for this in vitro diagnostic (IVD) device.
    4. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:
      No, an MRMC comparative effectiveness study was not done. This type of study is primarily relevant for imaging devices that assist human readers (e.g., AI for radiology). The cobas® liat test is an automated molecular diagnostic test directly detecting nucleic acids, not an AI-assisted interpretation device for human "readers."

    5. If a standalone (i.e. algorithm only without human-in-the loop performance) was done:
      Yes, the performance reported (PPA, NPA, and analytical studies) represents the standalone performance of the cobas® liat device. It is an automated system where the "algorithm" (the RT-PCR assay and its interpretation software) directly produces a qualitative result (Detected/Not Detected), without human "in-the-loop" interpretation for the primary result. Human operators load samples and review results, but the analytical detection and differentiation itself is automated.

    6. The type of ground truth used (expert consensus, pathology, outcomes data, etc.):
      The ground truth for both prospective and retrospective clinical studies was based on the results of an FDA-cleared Nucleic Acid Amplification Test (NAAT), which served as the comparator method. For discrepant samples, further re-testing against the comparator or a reference method was performed for adjudication. This falls under a "reference standard" or "comparator method" type of ground truth.

    7. The sample size for the training set:
      The document does not specify the sample size for a "training set." This type of molecular diagnostic device typically relies on analytical validation (LoD, inclusivity, specificity) and clinical validation through comparison to a reference method, rather than a machine learning model that requires explicit training data. The development process would involve iterative optimization of primers, probes, and assay conditions, but this is not typically referred to as a "training set" in the context of IVD submissions, especially for traditional PCR assays.

    8. How the ground truth for the training set was established:
      As no explicit "training set" for a machine learning model is described, the question of how its ground truth was established is not applicable based on the provided text. The "ground truth" in the context of this traditional IVD development refers to the reliable identification of the target analytes in samples for analytical and clinical validation, often through established reference methods or characterized materials.

    Ask a Question

    Ask a specific question about this device

    K Number
    K243346
    Date Cleared
    2025-04-11

    (165 days)

    Product Code
    Regulation Number
    866.3982
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Roche Molecular Systems, Inc.

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The cobas® liat SARS-CoV-2 v2 nucleic acid test is an automated real-time reverse transcription polymerase chain reaction (RT-PCR) test intended for the qualitative detection of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) nucleic acids in anterior nasal (nasal) and nasopharyngeal swab specimens collected from individuals exhibiting signs and symptoms of respiratory tract infection (i.e., symptomatic). Additionally, this test is intended to be used with nasal and nasopharyngeal swab specimens collected from individuals without signs and symptoms of COVID-19 (i.e., asymptomatic).

    The cobas® liat SARS-CoV-2 v2 nucleic acid test is intended for use as an aid in the diagnosis of COVID-19 if used in conjunction with other clinical and epidemiological information and laboratory findings. SARS-CoV-2 RNA is generally detectable in nasal swab and nasopharyngeal swab specimens during the acute phase of infection.

    Positive results are indicative of the presence of SARS-CoV-2 RNA. Positive results do not rule out co-infection with other microorganisms. Negative results do not preclude SARS-CoV-2 infection. Negative results must be combined with clinical observations, patient history, and epidemiological information. The results of this test should not be used as the sole basis for diagnosis, treatment, or other patient management decisions.

    A negative result from an asymptomatic individual is presumptive. Additionally, a negative result obtained with a nasal or nasopharyngeal swab collected from an asymptomatic individual should be followed up by testing at least twice over three days with at least 48 hours between tests.

    Device Description

    The cobas® liat SARS-CoV-2 v2 nucleic acid test is performed on the cobas® liat analyzer which automates and integrates sample purification, nucleic acid amplification, and detection of the target sequence in biological samples using real-time PCR assays. The assay targets both the ORF1 a/b non-structural region and membrane protein gene that are unique to SARS-CoV-2. An Internal Control (IC) is included to control for adequate processing of the target virus through all steps of the assay process and to monitor the presence of inhibitors in the RT-PCR processes.

    AI/ML Overview

    The provided text is a 510(k) Clearance Letter for a medical device which does not include information about AI/ML models. Therefore, it's not possible to extract the information you requested about Acceptance Criteria and a study proving an AI/ML device meets those criteria.

    The device described, the "cobas liat SARS-CoV-2 v2 nucleic acid test," is an in vitro diagnostic (IVD) device based on real-time RT-PCR technology. It directly detects viral targets and its performance is evaluated through analytical and clinical studies common for IVDs, not against AI/ML performance metrics like sensitivity, specificity, MRMC studies, or multi-reader reviews.

    Here's a breakdown of why your requested information isn't present in this document:

    • No AI/ML Component: The document describes a traditional RT-PCR assay. There is no mention of algorithms, machine learning, deep learning, or any AI component.
    • Performance Metrics Differ: The performance metrics provided (Limit of Detection, Inclusivity, Cross-reactivity, Reproducibility, Positive Percent Agreement, Negative Percent Agreement) are standard for IVD assays. They are not analogous to metrics used for evaluating AI/ML models (e.g., AUC, F1-score, accuracy in image classification, or diagnostic improvement from AI-assistance).
    • No Human Reader Interaction: Since it's an automated lab test, there's no "human reader" (like a radiologist) involved in interpreting the device's output in a way that an AI would assist. The output is qualitative (Detected/Not Detected).
    • No Ground Truth Experts in the AI Sense: Ground truth for this IVD is established by a "comparator" (another FDA-cleared NAAT) and clinical/epidemiological information, not by multiple human experts reviewing AI outputs or images.
    • No Training/Test Set Split for AI: The "test set" and "training set" concepts described in your request are fundamental to AI/ML model development and validation. For this IVD, there's a "clinical performance evaluation" using prospective and retrospective samples, which serves as the validation dataset, but it's not structured as a training/test split for an AI.

    Therefore, I cannot provide the requested table and detailed points because the provided document does not pertain to an AI/ML device.

    If you have a document describing an AI/ML medical device, please provide that, and I can attempt to extract the relevant information.

    Ask a Question

    Ask a specific question about this device

    K Number
    K240867
    Date Cleared
    2025-02-11

    (319 days)

    Product Code
    Regulation Number
    866.3981
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Roche Molecular Systems, Inc.

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    cobas® SARS-CoV-2 Qualitative for use on the cobas®5800/6800/8800 Systems is a real-time RT-PCR test intended for the qualitative detection of nucleic acids from SARS-CoV-2 in nasopharyngeal swab specimens collected from individuals with signs and symptoms of COVID-19 and in anterior nasal swab specimens collected from any individuals with or without signs and symptoms of COVID-19.

    Positive results are indicative of the presence of SARS-CoV-2 RNA. Positive results do not rule out bacterial infection or co-infection with other pathogens.

    Negative results do not preclude SARS-CoV-2 infection and should not be used as the sole basis for patient management decisions. Results are meant to be used in conjunction with clinical observations, patient history, recent exposures, epidemiological information, and laboratory data, in accordance with the guided by the relevant public health authorities.

    Device Description

    cobas® SARS-CoV-2 Qualitative is based on fully automated sample preparation (nucleic acid extraction and purification) followed by PCR amplification and detection. The cobas® 5800 System is designed as one integrated instrument. The cobas® 6800/8800 Systems consist of the sample supply module, the transfer module, the processing module, and the analytic module. Automated data management is performed by the cobas® 5800 or cobas® 6800/8800 Systems software(s), which assigns test results for all tests. Results can be reviewed directly on the system screen, and printed as a report.

    Nucleic acid from patient samples and added internal control RNA (RNA IC) molecules are simultaneously extracted. Nucleic acid is released by addition of proteinase and lysis reagent to the sample. The released nucleic acid binds to the silica surface of the added magnetic glass particles. Unbound substances and impurities, such as denatured protein, cellular debris and potential PCR inhibitors, are removed with subsequent wash steps and purified nucleic acid is eluted from the magnetic glass particles with elution buffer at elevated temperature. External controls (positive and negative) are processed in the same way.

    Selective amplification of target nucleic acid from the sample is achieved by the use of targetspecific forward and reverse primers for ORF1 a/b non-structural region that is unique to SARS-CoV-2. Additionally, a conserved region in the structural protein envelope E-gene were chosen for pan-Sarbecovirus detection. The pan-Sarbecovirus detection sets will also detect SARS-CoV-2 virus.

    Selective amplification of RNA Internal Control is achieved by the use of non-competitive sequence specific forward and reverse primers which have no homology with the coronavirus genome. A thermostable DNA polymerase enzyme is used for amplification.

    The cobas® SARS-CoV-2 Qualitative master mix contains detection probes which are specific for the coronavirus type SARS-CoV-2, members of the Sarbecovirus subgenus, and the RNA Internal Control nucleic acid. The coronavirus and RNA Internal Control detection probes are each labeled with unique fluorescent dyes that act as a reporter. Each probe also has a second dye which acts as a quencher. When not bound to the target sequence, the fluorescent signals of the intact probes are suppressed by the quencher dye. During the PCR amplification step, hybridization of the probes to the specific single-stranded DNA template results in cleavage of the probe by the 5' to 3' exonuclease activity of the DNA polymerase resulting in separation of the reporter and quencher dyes and the generation of a fluorescent signal. With each PCR cycle, increasing amounts of cleaved probes are generated and the cumulative signal of the reporter dye increases concomitantly. Each reporter dye is measured at defined wavelengths, which enables simultaneous detection and discrimination of the amplified coronavirus target and the RNA Internal Control. The master mix includes deoxyuridine triphosphate (dUTP), instead of deoxythimidine triphosphate (dTTP), which is incorporated into the newly synthesized DNA (amplicon). Any contaminating amplicons from previous PCR runs are destroyed by the AmpErase enzyme [uracil-N-glycosylase], which is included in the PCR mix, when heated in the first thermal cycling step. However, newly formed amplicons are not destroyed since the AmpErase enzyme is inactivated once exposed to temperatures above 55°C.

    cobas® SARS-CoV-2 Qualitative is a qualitative nucleic acid test for use on the cobas® 5800/6800/8800 System for the detection of the 2019 novel coronavirus (SARS-CoV-2) RNA in individual nasal and nasopharyngeal swab samples collected in Copan Universal Transport Medium System (UTM-RT), BD™ Universal Viral Transport System (UVT), cobas® PCR Media, or 0.9% physiological saline. The RNA Internal Control, used to monitor the entire sample preparation and PCR amplification process, is introduced into each specimen.

    AI/ML Overview

    Here's an analysis of the acceptance criteria and the study that proves the device meets them, based on the provided text:

    Acceptance Criteria and Device Performance

    The acceptance criteria are implicitly defined by the reported performance metrics of the device, which are Positive Percent Agreement (PPA) and Negative Percent Agreement (NPA) against a comparator algorithm. The device needs to demonstrate high agreement for both positive and negative results in asymptomatic individuals.

    Table of Acceptance Criteria and Reported Device Performance:

    Performance MetricAcceptance Criteria (Implied)cobas® SARS-CoV-2 Qualitative Performance (NFL Study)cobas® SARS-CoV-2 Qualitative Performance (TUAH Study)
    Positive Percent Agreement (PPA)High agreement with positive comparator algorithm results (e.g., >90%)100.0% (11/11) (95% CI: 74.1% - 100.0%)94.3% (315/334) (95% CI: 91.4% - 96.8%)
    Negative Percent Agreement (NPA)High agreement with negative comparator algorithm results (e.g., >98%)99.8% (1762/1765) (95% CI: 99.5% - 99.9%)99.2% (37,586/37,858) (95% CI: 99.2% - 99.4%)

    Note: The document does not explicitly state numerical acceptance criteria in a dedicated section. The "acceptance criteria" are inferred from the robust performance demonstrated and the claim of "equivalent performance" to the predicate device.

    Study Details for Demonstrating Acceptance Criteria:

    The device's performance was evaluated through two clinical studies focusing on asymptomatic populations: the 2020 National Football League (NFL) COVID-19 Surveillance Program and the 2021 Test Us at Home (TUAH) study.


    1. NFL COVID-19 Surveillance Program (Real-world evidence)

    • Sample Size Used for the Test Set: A total of 1776 samples were selected for analysis.
    • Data Provenance: The data was collected from the United States (NFL COVID-19 Surveillance Program participants). It was retrospective as it used data collected between August 2020-January 2021. Samples were prospectively collected for the surveillance program itself.
    • Number of Experts Used to Establish Ground Truth & Qualifications: The document does not specify the number or qualifications of experts used for clinical adjudication within the NFL testing program. It mentions a "comparator algorithm that was based on molecular comparator test results and/or clinical adjudication."
    • Adjudication Method: Not explicitly stated beyond "clinical adjudication" as part of the comparator algorithm.
    • Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study: No, this type of study was not done. This device is a diagnostic test, not an AI-assisted human reading system.
    • Standalone Performance: Yes, this study evaluates the standalone performance of the cobas® SARS-CoV-2 Qualitative device against a composite comparator algorithm.
    • Type of Ground Truth Used: "molecular comparator test results and/or clinical adjudication performed within the NFL testing program." This indicates a composite ground truth method.
    • Sample Size for the Training Set: Not applicable for a clinical performance evaluation study; this is a validation study. The training set for the development of the device itself is not provided in this document.
    • How the Ground Truth for the Training Set was Established: Not applicable.

    2. Test Us at Home (TUAH) Study (Clinical Study)

    • Sample Size Used for the Test Set: 38,192 samples from the TUAH study were included.
    • Data Provenance: The data was collected from the United States (TUAH study participants). It was prospective as samples were collected between October 2021 and April 2022 specifically for the longitudinal study.
    • Number of Experts Used to Establish Ground Truth & Qualifications: The document does not specify the number or qualifications of experts. The comparator algorithm for this study relies on "two consecutive test results (molecular comparator)."
    • Adjudication Method: The comparator algorithm used "two consecutive test results (molecular comparator) over 48 hours" to determine the ground truth. This is a form of algorithmic adjudication based on molecular tests, not human expert adjudication in the traditional sense.
    • Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study: No, this type of study was not done.
    • Standalone Performance: Yes, this study evaluates the standalone performance of the cobas® SARS-CoV-2 Qualitative device against a composite comparator algorithm based on molecular results.
    • Type of Ground Truth Used: Comparator algorithm based on "two consecutive test results (molecular comparator)." This indicates a molecular test-based composite ground truth.
    • Sample Size for the Training Set: Not applicable for a clinical performance evaluation study.
    • How the Ground Truth for the Training Set was Established: Not applicable.

    Summary of In Silico Analysis (Non-Clinical Performance):

    • An in-silico analysis was conducted in January 2025 using SARS-CoV-2 sequences from the GISAID database (as of January 15, 2025).
    • Sample Size for Test Set: 16,156,883 sequences from the GISAID database.
    • Data Provenance: Global (various countries submitting to GISAID). Retrospective, as it used existing sequence data.
    • Ground Truth: Bioinformatic analysis of shared viral sequences.
    • Results: >99.9% of sequences for SARS-CoV-2 had no changes in primer/probe binding sites at both target regions simultaneously. All sequences were predicted to be detected by at least one of the two targets. This addresses potential variations in the virus that might affect detection.

    This document clearly outlines the analytical and clinical performance of the device, particularly focusing on its effectiveness in detecting SARS-CoV-2 in asymptomatic individuals against established comparator methods.

    Ask a Question

    Ask a specific question about this device

    K Number
    K241453
    Manufacturer
    Date Cleared
    2025-02-07

    (261 days)

    Product Code
    Regulation Number
    862.1602
    Reference & Predicate Devices
    N/A
    Why did this record match?
    Applicant Name (Manufacturer) :

    Roche Diagnostics

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    Immunoassays for the in vitro quantitative determination of the soluble fms like tyrosine kinase-1/placental growth factor (sFlt-1/PlGF) ratio in human serum.

    The sFlt-1/PlGF ratio is indicated as an aid in the risk assessment of pregnant women, with a singleton pregnancy (23+0 to 34+6/7 weeks' gestation) hospitalized for hypertensive disorders of pregnancy (preeclampsia, chronic hypertension with or without superimposed preeclampsia, or gestational hypertension), to develop preeclampsia with severe features within two weeks from testing. The sFit-1/PlGF ratio should be used in conjunction with clinical assessment and routine laboratory testing.

    The electrochemiluminescence immunoassay "ECLIA" is intended for use on cobas e immunoassay analyzers.

    Device Description

    The Elecsys sFlt-1 and Elecsys PlGF assays employ a sandwich principle using electrochemiluminescence immunoassay "ECLIA" technology. The total duration of each assay is 18 minutes. Samples are incubated with biotinylated and ruthenium-labeled monoclonal antibodies specific to sFlt-1 or PlGF, forming a sandwich complex. Streptavidin-coated microparticles are added, binding the complex to the solid phase. The microparticles are magnetically captured, unbound substances are removed, and a voltage is applied to induce chemiluminescent emission, which is measured by a photomultiplier. Results are determined via a calibration curve generated by 2-point calibration and a master curve provided via the reagent barcode. The reagents for each assay are combined in a "rackpack".

    AI/ML Overview

    Here's a breakdown of the acceptance criteria and study information for the Elecsys sFlt-1 and Elecsys PlGF assays, based on the provided document.

    Acceptance Criteria and Device Performance

    Acceptance Criteria CategorySpecific CriteriaReported Device Performance
    Clinical PerformanceRisk Assessment for Preeclampsia with Severe Features within two weeks from testing (Cutoff: >38): high Negative Predictive Value (NPV) and acceptable Positive Predictive Value (PPV) for pregnant women with singleton pregnancy (23+0 to 34+6/7 weeks' gestation) hospitalized for hypertensive disorders of pregnancy.Overall Intended Use Population (N=556):
    • Sensitivity: 91.40% (95% CI: 86.41, 95.00)
    • Specificity: 77.30% (95% CI: 72.68, 81.47)
    • NPV (ratio ≤ 38): 94.70% (95% CI: 91.54, 96.94)
    • PPV (ratio > 38): 66.93% (95% CI: 60.77, 72.68) |
      | Non-Clinical Performance | Precision: Low coefficients of variation (CV) for repeatability (within-run) and intermediate precision (within-laboratory). | Elecsys PlGF (N=84 per sample type):
    • Repeatability CV: 1.0% - 5.7%
    • Intermediate precision CV: 1.4% - 9.9%
      Elecsys sFlt-1 (N=84 per sample type):
    • Repeatability CV: 0.9% - 2.4%
    • Intermediate precision CV: 1.7% - 3.7%
      Ratio (N=84 per sample type):
    • Repeatability CV: 1.1% - 4.9%
    • Intermediate precision CV: 1.4% - 7.0% |
      | | Linearity/Assay Reportable Range: Measurements are linear across the claimed measuring range. | - Elecsys sFlt-1: 80-85000 pg/mL (claimed range)
    • Elecsys PlGF: 10-5400 pg/mL (claimed range)
      (Study concludes measurements are linear across these ranges) |
      | | Limit of Blank (LoB): ≤ 2 pg/mL for PlGF and 26.4 mg/dL can cause up to 10% decrease in ratio.
    • Hemoglobin, Intralipid, Rheumatoid Factors, Biotin (up to 1200 ng/mL): No significant interference reported (implies within acceptable limits though quantitative data not listed).
    • Common Drugs (15 tested): No interference.
    • Additional Substances (13 tested): No interference.
    • Heparin: Interference with Elecsys PlGF for concentrations > 500 U/L. |
      | | Analytical Specificity/Cross-Reactivity: Highly specific for sFlt-1 and PlGF, with minimal cross-reactivity with related substances. | - sFlt-1 cross-reactivity:
    Ask a Question

    Ask a specific question about this device

    K Number
    K241220
    Date Cleared
    2025-01-24

    (268 days)

    Product Code
    Regulation Number
    866.5600
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Roche Diagnostics Operations

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The Tina-quant Lipoprotein (a) Gen.2 Molarity assay is an in vitro test for the quantitative determination of lipoprotein (a) [Lp(a]] in human serum and plasma on cobas c systems. The measurement of Lp(a) is useful in evaluating lipid metabolism disorders and assessing atherosclerotic cardiovascular disease risk, when used in conjunction with clinical evaluation and other lipoprotein tests.

    Device Description

    The Tina-quant Lipoprotein (a) Gen.2 Molarity assay is an in vitro test for the quantitative determination of lipoprotein (a) [Lp(a)] in human serum and plasma on cobas c systems. The measurement of Lp(a) is useful in evaluating lipid metabolism disorders and assessing atherosclerotic cardiovascular disease risk, when used in conjunction with clinical evaluation and other lipoprotein tests.

    Tina-quant Lipoprotein (a) Gen.2 Molarity assay quantifies lipoprotein (a) in human serum and plasma and reports the values in nmoVL with calibrator values traceable to the WHO/IFCC SRM2B reference material.

    Reagents - working solutions
    R1: Glycine buffer: 170 mmol/L. pH 7.0: stabilizers: BSA: rabbit serum 0.1 %, preservative
    R3: Latex particles coated with polyclonal anti-human lipoprotein (a) antibodies (rabbit): 0.5 %; glycine buffer: 170 mmol/L, pH 7.3, BSA; preservative

    AI/ML Overview

    Here's a breakdown of the acceptance criteria and study details for the Tina-quant Lipoprotein (a) Gen.2 Molarity assay, based on the provided document:

    This device is an in vitro diagnostic (IVD) assay, not an AI/ML-driven device. Therefore, the concepts of human readers, multi-reader multi-case (MRMC) studies, ground truth establishment by experts for images, training sets, and adjudication methods are not directly applicable in the typical sense as they would be for an AI model that interprets medical images. The "acceptance criteria" here refer to the predefined performance specifications for an analytical assay.

    Device Name: Tina-quant Lipoprotein (a) Gen.2 Molarity

    1. Table of Acceptance Criteria and Reported Device Performance

    The document states, "All acceptance criteria were met" for the non-clinical performance evaluation sections (Precision, Analytical Sensitivity, Linearity, Dilution, High Dose Hook Effect, Endogenous Interferences, Analytical Specificity/Cross-Reactivity, Sample Matrix Comparison, Method Comparison, and Stability). Specific pre-defined acceptance criteria are generally internal to the manufacturer's quality system and not explicitly listed in this 510(k) summary (which focuses on summarizing the results against those criteria). However, the reported device performance is provided, which demonstrates that the device met the manufacturer's internal criteria.

    Performance CharacteristicAcceptance Criteria (Implied/General)Reported Device Performance (as stated in document)
    Precision (Repeatability)Within pre-defined CV% limitsCV% between 0.4% and 2.1% (for various samples)
    Precision (Intermediate Precision)Within pre-defined CV% limitsCV% between 0.7% and 2.6% (for various samples)
    Limit of Blank (LoB)LoB should be ≤ 6 nmol/LLoB = 6 nmol/L
    Limit of Detection (LoD)LoD should be ≤ 7 nmol/LLoD = 7 nmol/L
    Limit of Quantitation (LoQ)LoQ should be ≤ 7 nmol/LLoQ = 7 nmol/L
    Linearity/Assay Reportable RangeLinear within 7 – 240 nmol/LConfirmed for the measuring range of 7 – 240 nmol/L
    DilutionAccurate dilution of samples > measuring range (1:3 rerun function)Confirmed, supporting 1:3 dilution for samples above measuring range
    High Dose Hook EffectNo false results up to a high concentrationConfirmed no false result up to 450 nmol/L
    Endogenous InterferencesNo significant interference from tested substances (Icterus, Hemolysis, Lipemia, Rheumatoid factors)All predefined acceptance criteria were met. Claims: Icterus up to I index 60, Hemolysis up to H index 1000, Lipemia up to L index 2000, Rheumatoid factors up to 1200 IU/mL.
    Analytical Specificity / Cross-ReactivityNo significant cross-reactivity from tested substances (Plasminogen, Apolipoprotein B)No significant cross-reactivity in tested concentration ranges (Plasminogen up to 150 mg/dL, Apolipoprotein B up to 200 mg/dL).
    Exogenous InterferencesNo significant interference from common drug panelsAll predefined acceptance criteria were met for 15 listed drugs at specified concentrations.
    Sample Matrix ComparisonAcceptable performance across serum and different plasma typesAll predefined acceptance criteria were met (Slope, Intercept, Correlation Coefficient for comparison of serum vs. serum with gel, Li-Heparin, K2-EDTA, K3-EDTA plasma).
    Method Comparison to Lp(a) ELISA reference methodStrong correlation with reference methodSample size (n) = 126. Deming regression: y = 1.023x + 0.692 nmol/L, r = 0.992. Sample concentrations 8.70 - 234 nmol/L.
    StabilitySupports manufacturer's claimsStability data supports Roche Diagnostic's claims as reported in the package labeling.

    2. Sample Sizes and Data Provenance

    • Precision (Repeatability): n = 84 (number of individual measurements per sample level).
    • Precision (Intermediate Precision): 2 aliquots per run, 2 runs per day, 21 days.
    • LoB: One analyte-free sample measured with three reagent lots, 6 runs, 10-fold determination per run, distributed over >3 days.
    • LoD: 5 serum samples with low analyte concentrations measured with three reagent lots, 2-fold determination per run, 6 runs distributed over 5 days.
    • LoQ: 5 serum samples measured with three reagent lots, 5 runs distributed over 5 days.
    • Linearity: 1 run using 3 reagent lots and 5 replicates per sample. A dilution series prepared from human serum (sample High) and NaCl 0.9% (sample Blank) to obtain 16 levels.
    • Method Comparison (to Lp(a) ELISA): n = 126 native human serum samples.
    • Sample Matrix Comparison: ≥ 50 samples.
    • Reference Range Study:
      • Caucasian/White: n = 425
      • African-American/Black: n = 111
      • Asian: n = 128
      • Hispanic/Latino (among Caucasian/White): n = 110
      • Non-Hispanic/Non-Latino (among Caucasian/White): n = 311
      • Data Provenance for Reference Range Study: Samples from apparently healthy adults in the United States, with equal representation of males and females. This suggests prospective collection for the purpose of establishing reference ranges. Other studies (e.g., method comparison, precision) would typically use laboratory samples which could be retrospective or specifically prepared for the study. The document does not specify "retrospective" or "prospective" for all tests, but the nature of these analytical performance studies often involves controlled, prepared, or collected samples without a specific patient encounter context. The "native human serum samples" for method comparison generally implies biological samples.

    3. Number of Experts and Qualifications for Ground Truth

    For this in vitro diagnostic device, "ground truth" is established by reference methods or validated analytical measurements, not by human expert interpretation in the way it would be for an AI image analysis tool.

    • Not Applicable in the traditional sense for AI/ML image analysis. The "ground truth" for analytical performance tests like precision, linearity, or interference is an established analytical value or the characteristic of the sample itself (e.g., known concentration, presence/absence of interfering substance). For "method comparison," the ground truth is provided by the designated "Lp(a) ELISA reference method."

    4. Adjudication Method for the Test Set

    • Not Applicable in the traditional sense for AI/ML image analysis. Adjudication is usually performed by multiple human experts reviewing a case. For an IVD, the "adjudication" is inherent in the rigorous analytical protocols, statistical methods (e.g., CLSI guidelines), and the use of reference methods or certified reference materials for traceability.

    5. Multi Reader Multi Case (MRMC) Comparative Effectiveness Study

    • Not Applicable. This is an in vitro diagnostic assay, not an AI-assisted diagnostic imaging system that would involve human readers interpreting cases.

    6. Standalone (i.e. algorithm only without human-in-the loop performance) Performance

    • Yes, implicitly. The performance studies (Precision, Analytical Sensitivity, Linearity, Interference, Method Comparison) evaluate the device (assay on the cobas c 503 analyzer) as a standalone system. There is no human intervention in the measurement or calculation of results once the sample is loaded. The device generates a quantitative value for Lp(a).

    7. The Type of Ground Truth Used

    • Reference Method/Analytical Standards:
      • Precision, Sensitivity, Linearity, Interferences: Ground truth is based on known concentrations in control materials, spiked samples, or by using analyte-free samples, following standardized laboratory practices and CLSI guidelines (e.g., CLSI EP05-A3, EP17-A2, EP06-A-Ed2).
      • Method Comparison: The "ground truth" or reference values were derived from the Lp(a) ELISA reference method.
      • Traceability: The device's calibration values are traceable to the WHO/IFCC SRM2B reference material for nmol/L, indicating a standardized and accepted reference for accuracy.

    8. The Sample Size for the Training Set

    • Not applicable in the AI/ML sense. This is a traditional IVD assay, not an AI model that requires a "training set" to learn features. The assay is based on well-understood principles of immunoturbidimetry and does not involve machine learning training.

    9. How the Ground Truth for the Training Set Was Established

    • Not Applicable. As there is no AI/ML training set, this question is not relevant to this device. The assay's "knowledge" is built into its chemical reagents, optical detection system, and pre-programmed algorithms for calculating concentration from turbidity measurements, based on established analytical principles and calibration to reference materials.
    Ask a Question

    Ask a specific question about this device

    Page 1 of 60