Search Filters

Search Results

Found 2 results

510(k) Data Aggregation

    K Number
    K100910
    Date Cleared
    2011-05-11

    (405 days)

    Product Code
    Regulation Number
    866.5750
    Reference & Predicate Devices
    Predicate For
    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    For in vitro diagnostic use with the IMMULITE® 2000 Analyzer -- for the quantitative measurement of allergen-specific IgE in human serum, as an aid in the clinical diagnosis of IgE-mediated allergic disorders. The test results are to be used in conjunction with clinical findings and other laboratory tests.

    Device Description

    IMMULITE® 2000 3gAllergy™ Specific IgE is a solid-phase, two-step, chemiluminescent immunoassay that exploits liquid phase kinetics in a bead format. It represents a significant advance over conventional methods relying on allergens attached to a solid-phase support, such as a paper disk. The allergens are covalently bound to a soluble polymer matrix, which in turn is labeled with a ligand. The use of an amino acid co-polymer amplifies the amount of allergen that the matrix can support. Incubation Cycles: 2 × 30 minutes.

    AI/ML Overview

    The Siemens Healthcare Diagnostics Inc. IMMULITE® 2000 3gAllergy™ Specific IgE Assay is intended for the quantitative measurement of allergen-specific IgE in human serum, to aid in the clinical diagnosis of IgE-mediated allergic disorders.

    1. Acceptance Criteria and Reported Device Performance

    The provided document does not explicitly state pre-defined acceptance criteria for precision, linearity, or clinical performance in numerical terms for the new allergens to be cleared. However, the study results are presented to demonstrate acceptable analytical performance and comparability to clinical data.

    Precision:
    Precision was evaluated by calculating the intra-assay (Within-Run) and inter-assay (Total) percent coefficients of variation (%CV) for positive samples. The reported CVs are generally low, with within-run CVs mostly below 5% (with some exceptions like Positive #4 for Lime at 9.15%) and total CVs mostly below 6% (with some exceptions like Positive #4 for Lime at 11.47%). The document states that "acceptable analytical performance including precision" was demonstrated, implying these values met internal or regulatory expectations.

    Linearity:
    Linearity was assessed by comparing observed to expected data from 2-fold serial dilutions. The regression equations show slopes very close to 1 and intercepts close to 0, with 95% confidence intervals for both slope and intercept generally containing 1 and 0 respectively. This indicates good linearity across the tested range. The document states "acceptable analytical performance including linearity" was demonstrated.

    Specificity (Inhibition Studies):
    Specificity was confirmed through competitive inhibition testing. The acceptance criterion was explicitly stated as achieving a target % inhibition of 50% for the highest inhibitor concentration tested. The reported performance is that this target was met for all tested allergens.
    Additional inhibition studies for cross-reactivity used a criterion of results being below 9.9% for specific allergens when tested with unrelated allergen extracts. The reported performance states that results were below 9.9% for Asparagus, Blueberry, Cauliflower, and Perch when tested with unrelated extracts, and for Apricot, Chili Pepper, Chub Mackerel, Ginger, Lime, and Whey.

    Clinical Performance:
    The document presents an agreement rate with clinical data. The acceptance criteria for clinical performance are implicitly defined by the reported lower and upper confidence intervals, which fall within generally accepted ranges for such diagnostic assays.

    Performance MetricAcceptance Criteria (Implied / Stated)Reported Device Performance
    PrecisionAcceptable within-run and total Coefficients of Variation (%CV)Within-Run CV: Ranged from 2.46% (Blueberry, Pos #3) to 9.15% (Lime, Pos #4). Most were below 5%.
    Total CV: Ranged from 2.76% (Blueberry, Pos #3) to 11.47% (Lime, Pos #4). Most were below 6%.
    LinearityRegression slope close to 1, intercept close to 0; 95% CI contains 1 and 0.Slope 95% CI: All CIs contained 1 (e.g., Apricot: 0.960 to 1.024; Lime: 0.981 to 1.018).Intercept 95% CI: Most CIs contained 0 (e.g., Apricot: -0.1487 to 0.0520; Ginger: -0.0675 to 0.0573).
    Specificity (Inhibition)Target 50% inhibition at highest inhibitor concentration.Met for Apricot, Asparagus, Blueberry, Cauliflower, Chili Pepper, Chub Mackerel, Ginger, Lime, Perch, and Whey.
    Specificity (Cross-reactivity)Below 9.9% inhibition for unrelated allergens.< 9.9% for Asparagus, Blueberry, Cauliflower and Perch (with unrelated extracts); and for Apricot, Chili Pepper, Chub Mackerel, Ginger, Lime and Whey (with negative controls).
    Clinical PerformanceAcceptable agreement with clinical data, including sensitivity and specificity.Sensitivity: 71.2% (Lower Conf 67%, Upper Conf 76%)Specificity: 96.3% (Lower Conf 95%, Upper Conf 97%)Overall Agreement: 89.2% (Lower Conf 88%, Upper Conf 91%)

    2. Sample Size Used for the Test Set and Data Provenance

    • Precision Test Set: The number of samples varied. For each allergen, "two aliquots of each test sample in two runs per day on 20 different days" were used for Positive 1-3. For Positive #4, "two aliquots of each test sample in two runs per day on 10 different days" were used. Three allergen lots were tested using three positive and one negative sample. The allergen specificity results involved a single serum sample or pool of sera for inhibition studies.
    • Linearity Test Set: For each allergen, two samples were diluted in 2-fold serial dilutions to 5 levels, plus the undiluted sample. The "N" in the regression table (e.g., 11 or 12) likely refers to the number of data points used for regression analysis, representing these diluted samples.
    • Specificity (Inhibition) Test Set: A single serum sample or pool of sera was used for each specific allergen, tested with various concentrations of inhibitor extract. For cross-reactivity, one positive sample with three unrelated allergen extracts was used.
    • Clinical Performance Test Set: A total of 1,398 serum samples were tested: 396 from clinically diagnosed atopic individuals and 1,002 from non-atopic individuals.
    • Data Provenance: The document does not explicitly state the country of origin for the clinical or analytical samples. The study appears to be retrospective, as it refers to "serum samples from clinically diagnosed atopic and non-atopic individuals" and "clinical documentation of presence or absence of signs, symptoms and other diagnostic evidence of allergen sensitivity."

    3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications

    N/A. For this IVD device, ground truth for clinical performance was established by "clinical documentation of presence or absence of signs, symptoms and other diagnostic evidence of allergen sensitivity." It does not involve human readers/experts evaluating images or other subjective data, but rather diagnoses and other medical records.

    4. Adjudication Method for the Test Set

    N/A. Ground truth for clinical performance was based on "clinical documentation." There is no mention of an adjudication method among multiple experts for establishing this ground truth, as it's based on existing clinical diagnoses and evidence.

    5. If a Multi Reader Multi Case (MRMC) Comparative Effectiveness Study was done

    No, an MRMC comparative effectiveness study was not done. This is not applicable to a standalone immunoassay device like the IMMULITE® 2000 3gAllergy™ Specific IgE Assay, which performs an automated quantitative measurement and does not involve human readers interpreting results in the same way as, for example, diagnostic imaging studies.

    6. If a Standalone (i.e. algorithm only without human-in-the-loop performance) was done

    Yes, the studies described are essentially "standalone" performance studies for the IMMULITE® 2000 3gAllergy™ Specific IgE Assay. The device performs the quantitative measurement of allergen-specific IgE without human intervention in the analytical process. The results are then compared to "clinical documentation," but the device's measurement itself is autonomous.

    7. The Type of Ground Truth Used

    • Analytical Performance (Precision, Linearity): Ground truth is based on the inherent properties of the quality control materials (e.g., known concentrations for linearity, statistical properties for precision).
    • Specificity (Inhibition): Ground truth for inhibition is the expected biochemical reaction demonstrating specific binding. Ground truth for cross-reactivity is established by using known unrelated allergens and expecting a low response.
    • Clinical Performance: The ground truth for the clinical performance study was based on clinical diagnoses and "other diagnostic evidence of allergen sensitivity" from medically documented cases (e.g., atopic or non-atopic individuals). This is considered outcomes data or existing clinical records.

    8. The Sample Size for the Training Set

    N/A. This document describes the validation of a laboratory diagnostic assay, not an AI/machine learning algorithm that typically requires a distinct training set. The assay's "design" is based on established immunochemistry principles rather than training on a dataset.

    9. How the Ground Truth for the Training Set Was Established

    N/A. As this is not an AI/ML algorithm, there is no "training set" in that context.

    Ask a Question

    Ask a specific question about this device

    K Number
    K091984
    Date Cleared
    2009-10-28

    (118 days)

    Product Code
    Regulation Number
    866.5750
    Reference & Predicate Devices
    Predicate For
    N/A
    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    For in vitro diagnostic use with the IMMULITE® 2000 Analyzer - for the quantitative measurement of allergen-specific IgE in human serum, as an aid in the clinical diagnosis of IgE-mediated allergic disorders.

    Device Description

    IMMULITE® 2000 3gAllergy™ Specific IgE is a solid-phase, two-step, chemiluminescent immunoassay that exploits liquid phase kinetics in a bead format. It represents a significant advance over conventional methods relying on allergens attached to a solid-phase support, such as a paper disk. The allergens are covalently bound to a soluble polymer matrix, which in turn is labeled with a ligand. The use of an amino acid co-polymer amplifies the amount of allergen that the matrix can support. Incubation Cycles: 2 × 30 minutes.

    AI/ML Overview

    The Siemens Healthcare Diagnostics Inc. IMMULITE® 2000 3gAllergy™ Specific IgE Assay is an in vitro diagnostic device intended for the quantitative measurement of allergen-specific IgE in human serum, to aid in the clinical diagnosis of IgE-mediated allergic disorders. The provided document focuses on the clearance of 27 additional specific allergens for use with this existing assay.

    Here's an analysis of the acceptance criteria and study data provided:

    1. Table of Acceptance Criteria and Reported Device Performance

    The document does not explicitly state pre-defined acceptance criteria in terms of numerical thresholds for precision, linearity, or specificity (inhibition). Instead, it presents the study results and concludes that they demonstrate "acceptable analytical performance." For clinical performance, it discusses general agreement with clinical data.

    Therefore, the table below will summarize the reported performance metrics, implying that these results were deemed acceptable by the manufacturer and the FDA for substantial equivalence.

    Performance MetricAcceptance Criteria (Implied by Study Results & Approval)Reported Device Performance
    PrecisionWithin-run CV and Total CV within acceptable ranges for immunoassays.Within-Run CV: Ranges from 2.68% (Pear, Positive #2) to 11.08% (Black Pepper, Positive #2). Most values are between 3-5%. Total CV: Ranges from 3.94% (Sole, Positive #3) to 12.30% (Black Pepper, Positive #2). Most values are below 9%.
    LinearityRegression Slope close to 1 and Intercept close to 0, with narrow 95% Confidence Intervals.Slope: All slopes are very close to 1 (e.g., 0.9871 to 1.0233). Intercept: All intercepts are close to 0 (e.g., -0.2153 to 0.4035). 95% CI: The 95% CIs for both slope and intercept generally encompass 1 and 0 respectively or are reasonably tight.
    Specificity (Inhibition)Demonstrated concentration-dependent inhibition by relevant extracts, with at least 50% inhibition at the highest inhibitor concentration.All tested allergens (Black Pepper, Broccoli, Cabbage, Cheese-Mold Type, Cherry, Chestnut, Chocolate, Coffee, Cucumber, Grape, Grapefruit, Haddock, Lamb, Lemon, Lima Bean, Peach, Pear, Pineapple, Plum, Pumpkin, Red Snapper, Sole, Spinach, Sweet Potato, Trout, Turkey Meat, and Watermelon) showed: - Concentration-dependent inhibition. - Target of 50% inhibition met at the highest inhibitor concentration tested (5 mg/mL, or the starting concentration for Haddock, Red Snapper, and Sole).
    Clinical PerformanceGood agreement with clinical documentation of allergen sensitivity.Sensitivity: 66.2% (Lower Conf 64%, Upper Conf 69%) Specificity: 98.9% (Lower Conf 99%, Upper Conf 99%) Overall Agreement: 89.1% (Lower Conf 88%, Upper Conf 90%)

    2. Sample Size Used for the Test Set and Data Provenance

    • Precision: Three positive samples and one negative sample were tested for each allergen. Each sample was assayed in two aliquots, two runs per day, on 20 different days, for three allergen lots. This setup aims to assess within-run and total precision across different batches and extended testing periods.
    • Linearity: For each allergen, two samples were diluted in 2-fold serial dilutions to 5 levels. Each diluted and undiluted sample was tested.
    • Specificity (Inhibition): A "single serum sample or pool of sera" was used for competitive inhibition testing for each allergen. A negative sample was used as a background control. Inhibition experiments involved 70uL of undiluted and minimally 4-5 levels of serially diluted inhibitor extract (5, 1, 0.2, 0.04, 0.008 mg/mL, and sometimes more dilute levels). Each sample mixture with inhibitor extract and controls was assayed with 1 lot of each allergen.
    • Clinical Performance: 4,118 samples were tested: 1,238 from clinically positive individuals and 2,880 from clinically normal (non-atopic) individuals.
    • Data Provenance: The document does not explicitly state the country of origin or whether the data is retrospective or prospective for any of these studies. It can be inferred that these are prospective studies conducted by the manufacturer, Siemens Healthcare Diagnostics Inc., for regulatory submission.

    3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts

    • Precision, Linearity, Specificity: For these analytical performance studies, the "ground truth" is based on the inherent properties of the measurements and controls, rather than expert interpretation of a diagnostic outcome. The accuracy of the assay itself is being evaluated.
    • Clinical Performance: For the clinical performance study, the "ground truth" (clinical data for IgE-mediated allergic disorders) was established based on "clinically diagnosed atopic and non-atopic individuals." The document does not specify the number or qualifications of the experts (e.g., allergists, physicians) who performed these clinical diagnoses.

    4. Adjudication Method for the Test Set

    • Precision, Linearity, Specificity: Not applicable. These are analytical studies where results are quantitative measurements against known standards or controls.
    • Clinical Performance: The document states that the ground truth for clinical performance was based on "clinical data" to define individuals as "clinically diagnosed atopic and non-atopic individuals." There is no mention of an adjudication method (like 2+1, 3+1 consensus) explicitly detailed for the clinical diagnoses themselves. It implies that these were established clinical classifications prior to testing with the IMMULITE® 2000.

    5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

    No, a multi-reader multi-case (MRMC) comparative effectiveness study was not done. This device is an in vitro diagnostic assay, not an imaging device or AI algorithm intended to assist human readers in interpretation. Therefore, the concept of "human readers improve with AI vs. without AI assistance" does not apply here.

    6. Standalone (Algorithm Only Without Human-in-the-Loop Performance) Study

    Yes, the studies evaluating the IMMULITE® 2000 3gAllergy™ Specific IgE Assay are fundamentally standalone. The device performs quantitative measurements of IgE levels in serum, and its performance (precision, linearity, specificity, and comparison to clinical diagnoses) is assessed based on these measurements. There is no "human-in-the-loop" component in the analytical operation of the assay or the interpretation of its quantitative output for the purpose of these performance studies. Clinicians then use these quantitative results, alongside other clinical information, for diagnosis.

    7. Type of Ground Truth Used

    • Precision, Linearity: Ground truth is based on known concentrations or expected values derived from serial dilutions.
    • Specificity (Inhibition): Ground truth is based on the known presence and concentration of the inhibitor extract and the expected inhibition of the specific allergen reaction.
    • Clinical Performance: The ground truth was "clinical data," referring to the diagnosis of "clinically diagnosed atopic and non-atopic individuals." This would typically involve a combination of patient history, physical examination, and potentially other diagnostic tests (e.g., skin prick tests, other lab results, patient symptoms, and outcomes). It is not solely pathology or "outcomes data" in a broader sense but relies on a clinical determination of allergy status.

    8. Sample Size for the Training Set

    The document describes performance studies for the device itself, not the development of an algorithm that would require a distinct "training set" in the context of machine learning or AI. Therefore, the concept of a training set for an AI algorithm is not applicable to this submission. The studies detailed are for validation of the assay performance.

    9. How the Ground Truth for the Training Set Was Established

    As explained in point 8, the concept of a "training set" for an AI algorithm is not applicable to these studies for this in vitro diagnostic device.

    Ask a Question

    Ask a specific question about this device

    Page 1 of 1