Search Filters

Search Results

Found 1 results

510(k) Data Aggregation

    K Number
    K970220
    Manufacturer
    Date Cleared
    1997-04-08

    (77 days)

    Product Code
    Regulation Number
    866.5100
    Reference & Predicate Devices
    N/A
    Why did this record match?
    Device Name :

    IS-ANTI-SM TEST SYSTEM

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The assay is intended for use in detecting antibodies to Sm antigen in a single human serum sample. The results of the assay are to be used as an aid in the diagnosis of autoimmune disorders.

    Device Description

    The Is-anti-Sm Test Kit System is an enzyme-linked immunosorbent assay (ELISA) for the detection and semi-quantitation of IgG to Sm antigen in human serum.

    AI/ML Overview

    Acceptance Criteria and Device Performance Study for Diamedix Is-anti-Sm Test Kit

    This document summarizes the acceptance criteria and the study conducted to demonstrate the performance of the Diamedix Is-anti-Sm Test Kit.

    The Diamedix Is-anti-Sm Test Kit is an enzyme-linked immunosorbent assay (ELISA) designed for the detection and semi-quantitation of IgG to Sm antigen in human serum, intended as an aid in the diagnosis of autoimmune disorders.

    1. Acceptance Criteria and Reported Device Performance

    The acceptance criteria for the Is-anti-Sm Test Kit are not explicitly stated in terms of predefined thresholds. Instead, the performance is reported as a comparison to an equivalent, commercially available anti-Sm ELISA test kit. The "acceptance" is implicitly based on achieving comparable or superior performance metrics to the predicate device.

    Here's a table summarizing the reported device performance against a comparative method:

    MetricPredicate Device Performance (Implicit Acceptance Criteria)Diamedix Is-anti-Sm Test Kit (Manual) Reported PerformanceDiamedix Is-anti-Sm Test Kit (MAGO) Reported Performance
    Relative SensitivityNot explicitly stated (comparison target)87% (34/39) [95% CI: 73-96]85% (35/41) [95% CI: 71-94]
    Relative SpecificityNot explicitly stated (comparison target)100% (107/107) [95% CI: 97-100]100% (107/107) [95% CI: 97-100]
    Overall AgreementNot explicitly stated (comparison target)97% (141/146)* [95% CI: 92-99]96% (142/148)** [95% CI: 92-99]
    Linearity (R-squared)Not explicitly stated (comparison target)0.99490.9879
    Precision (Intra-CV%)Not explicitly stated (comparison target)Varies per serum (e.g., 2.8-12.1%)Varies per serum (e.g., 2.1-47.2%)
    Precision (Inter-CV%)Not explicitly stated (comparison target)Varies per serum (e.g., 3.5-25.0%)Varies per serum (e.g., 3.4-50.0%)
    Cross-reactivityAbsence of significant cross-reactivityNo false positives for non-Sm specificities shownNo false positives for non-Sm specificities shown
    Correlation (Manual vs. MAGO)Not explicitly stated (internal consistency metric)0.99 (Pearson)0.99 (Pearson)
    • Two equivocal and two borderline samples were excluded from the calculations.
      ** Two borderline samples were excluded from the calculations.

    2. Sample Size Used for the Test Set and Data Provenance

    • Test Set Sample Size:
      • Comparison Testing: 150 sera (100 from normal blood donors and 50 from autoimmune patients).
      • Precision Testing: 6 different sera and kit controls.
      • Cross-reactivity: 24 sera positive for six different autoimmune specificities.
      • Expected Values: 100 normal donor sera and 50 clinically characterized sera.
      • Correlation of Manual and MAGO Results: 150 samples (presumably the same 100 normal and 50 autoimmune sera from comparison testing).
    • Data Provenance: The 100 normal donor sera for expected values were collected in South Florida. The document does not specify the country of origin for the autoimmune patient sera or the sera used in comparison/precision/cross-reactivity testing, nor does it explicitly state if the data was retrospective or prospective. However, given the context of a 510(k) submission for a diagnostic device, it is typically presumed to be clinical study data, which often involves a mix of retrospective and prospective recruitment depending on the specific sample needs.

    3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications

    The document does not specify the number of experts used or their qualifications for establishing the ground truth for the test set.

    4. Adjudication Method for the Test Set

    The document does not specify any formal adjudication method for the test set. For the "Comparison Testing," discordant results between the Is-anti-Sm kit and the comparative method were resolved by testing with "a third method," but the nature of this method or any adjudication process around it is not detailed.

    5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

    There is no indication that a multi-reader multi-case (MRMC) comparative effectiveness study was performed or that the device involves human interpretation in a manner that would be assisted by AI. The device is an ELISA test system, which generates quantitative (EU/ml) or categorical (positive/negative) results directly, rather than providing an image or data that a human "reader" would interpret in the traditional sense of an MRMC study. Therefore, there is no information on the effect size of human readers improving with AI vs. without AI assistance.

    6. Standalone (Algorithm Only) Performance Study

    The study implicitly represents standalone performance. The "Diamedix Is-anti-Sm Test Kit" is a laboratory diagnostic device, and its performance metrics (sensitivity, specificity, linearity, precision, cross-reactivity) are derived from the device's output, either performed manually or with the "MAGO" system. There is no human-in-the-loop component mentioned in interpreting the raw output of the ELISA.

    7. Type of Ground Truth Used

    The ground truth for the test set appears to be established through:

    • Clinical Diagnosis: For the "autoimmune patients," the description mentions "autoimmune patients" and "clinically characterized sera," implying a diagnosis based on established clinical criteria.
    • Absence of Disease: For "normal blood donors," the ground truth is the absence of the condition (i.e., not having an autoimmune disorder requiring anti-Sm antibodies).
    • Reference Method/Predicate Device: For "Comparison Testing," the performance is benchmarked against "another commercially available anti-Sm ELISA test kit." For discordant results, "a third method" was used, which served as a tie-breaker or confirmatory ground truth.
    • Known Specificity: For "Cross-reactivity" testing, the ground truth was the known specificity of the sera (e.g., positive for SSA, SSB, Sm, RNP, Jo-1, Scl-70).

    This suggests a combination of clinical diagnoses and established reference methods rather than pathology reports or direct outcomes data.

    8. Sample Size for the Training Set

    The document does not provide information regarding a distinct "training set" or its sample size. For in vitro diagnostic (IVD) devices like this ELISA kit, the development process typically involves optimizing reagents and protocols, but a formal "training set" in the machine learning sense is not usually delineated as it would be for an AI/ML algorithm. The performance studies described are for the finalized device.

    9. How the Ground Truth for the Training Set Was Established

    As no distinct training set is mentioned in the provided text, there is no information on how its ground truth might have been established. Any internal development and optimization would have relied on similar forms of ground truth (e.g., characterized patient samples, known positive/negative controls).

    Ask a Question

    Ask a specific question about this device

    Page 1 of 1