Search Filters

Search Results

Found 1 results

510(k) Data Aggregation

    K Number
    K223867
    Device Name
    IDS ACTH II
    Date Cleared
    2023-08-18

    (238 days)

    Product Code
    Regulation Number
    862.1025
    Reference & Predicate Devices
    Predicate For
    N/A
    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    IDS ACTH II assay is an automated in vitro diagnostic device intended for the quantitative, determination of ACTH in human K2 and K3 EDTA plasma on the IDS system. Results are to be used in conjunction with other clinical and laboratory data as an aid in the assessment of pituitary and adrenal gland function and the differential diagnosis of hyper- and hypo-cortisolism.

    Device Description

    The IDS ACTH II assay consists of a reagent cartridge. The reagent cartridge contains multiple reagents:

    • MP: Magnetic particles coated with mouse monoclonal anti-ACTH antibody and buffer containing phosphate with blocking proteins and ProClin 300 as preservative.
    • R1: Mouse monoclonal anti-ACTH antibody labelled with an acridinium ester derivative, in buffer containing phosphate with BSA and ProClin 300 as preservative.
    • R2: Buffer containing phosphate with blocking proteins and ProClin 300 as preservative.
    AI/ML Overview

    The provided text describes the performance characteristics of the IDS ACTH II assay, which is an automated in vitro diagnostic device for the quantitative determination of ACTH in human K2 and K3 EDTA plasma. The study aims to demonstrate that the device meets the acceptance criteria for various analytical performance parameters.

    Here's a breakdown of the requested information:

    1. A table of acceptance criteria and the reported device performance

    The document does not explicitly state "acceptance criteria" as a separate column for each test. Instead, it describes the methodology used to determine each performance characteristic and then presents the results. Based on the context and the nature of these studies, the reported values often serve as the demonstrated "performance" which, by the conclusion of the 510(k) summary, are deemed sufficient to support substantial equivalence. For analytical characteristics like Linearity, Interference, and Cross-Reactivity, the document does specify thresholds for acceptable performance.

    Performance CharacteristicAcceptance Criteria (Implied/Stated)Reported Device Performance
    Analytical Limits
    Limit of Blank (LoB)(Determined according to CLSI EP17-A)0 pg/mL
    Limit of Detection (LoD)(Determined according to CLSI EP17-A)1 pg/mL
    Limit of Quantitation (LoQ)Lowest concentration with within-laboratory precision CV ≤ 20%3 pg/mL
    Precision(Evaluated according to CLSI EP05-A3)Repeatability (Within Run/Within Laboratory): CVs for various concentrations range from 0.9% to 14.5% (Within Run) and 1.7% to 26.8% (Within Laboratory). Reproducibility (Between sites/systems): CVs for various concentrations range from 1.2% to 14.4% (Repeatability) and 4.4% to 24.8% (Reproducibility). Reproducibility (Between lots): CVs for various concentrations range from 0.6% to 20.8% (Between-Run), 1.1% to 35.2% (Between-Day), and 3.2% to 50.5% (Reproducibility).
    LinearityAllowable Deviation of Linearity (ADL) of ≤±16.3% or ≤±4 pg/mL for concentrations below 20 pg/mL.The IDS ACTH II is linear across the analytical measuring interval of 4 to 1000 pg/mL, within the allowable deviation of linearity.
    Analytical Specificity (Interference)No significant interference: ≤±10% bias (Cholesterol ≤±15%)No significant interference (<+10% bias, excluding Cholesterol) up to specified thresholds for Bilirubin, Biotin, Haemoglobin, HAMA, Rheumatoid Factor, Total Protein, Triglyceride, Acetaminophen, Acetylsalicylic acid, Ampicillin, Ibuprofen, Dexamethasone, Metyrapone. No significant interference (≤±10% bias) observed for Total Cholesterol up to 400 mg/dL. Lowest Hemoglobin level not significantly interfering is 62.5 mg/dL. Lowest Rheumatoid Factor not significantly interfering is 324 IU/mL.
    Analytical Specificity (Cross-Reactivity)(Determined by % cross-reactivity formula)Very low to negative % Cross-Reactivity for tested compounds (POMC, b-endorphin, aMSH 1-13, bMSH, ACTH 1-17, ACTH 1-24, ACTH 18-39 (CLIP), ACTH 22-39, ACTH 1-10, ACTH 11-24) across various tested concentrations (mostly below 5%, often <1%).
    Method ComparisonClose agreement with a commercially available quantitative automated assay (predicate device).Predicate comparison (170 samples): Slope = 1.0 (95% CI: 1.0 to 1.1), Intercept = -0.9 pg/mL (95% CI: -2.1 to 0.4), Correlation Coeff. (r) = 1.0. K2 EDTA vs K3 EDTA (55 matched samples): Slope = 1.0 (95% CI: 1.0 to 1.1), Intercept = 1.9 pg/mL (95% CI: 0.7 to 3.2), Correlation Coeff. (r) = 1.0.

    2. Sample size used for the test set and the data provenance (e.g. country of origin of the data, retrospective or prospective)

    • Analytical Limits (LoB, LoD, LoQ):
      • LoB and LoD: 60 replicates of 4 blank samples and 6 low concentration samples per reagent lot.
      • LoQ: 90 replicates of 6 low concentration samples per reagent lot.
    • Precision (Repeatability): 5 plasma samples, 80 replicates each (duplicate, twice a day for 20 days).
    • Precision (Reproducibility – between sites/systems): 5 plasma samples, 75 replicates each (5 replicates, once a day for 5 days on 3 systems).
    • Precision (Reproducibility – between lots): 5 plasma samples, 75 replicates each (5 replicates, once a day for 5 days on 1 system using 3 reagent lots).
    • Linearity: The sample size isn't explicitly stated as a single number but involved testing across the analytical measuring interval of 4 to 1000 pg/mL.
    • Analytical Specificity (Interference): 2 samples containing 15 and 200 pg/mL ACTH for most interfering agents; 2 samples containing 30 and 500 pg/mL ACTH for Total Cholesterol.
    • Analytical Specificity (Cross-Reactivity): 2 samples containing 20 and 400 pg/mL ACTH spiked with various cross-reactants.
    • Method Comparison: 170 patient samples for comparison against the predicate device.
    • Matrix Comparison: 55 matched samples for K2 vs K3 EDTA comparison.
    • Expected Values (Reference Interval): 140 apparently healthy adults.

    Data Provenance: The document does not specify the country of origin of the data or whether the samples were retrospective or prospective, except that the submitter is based in the United Kingdom.

    3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g. radiologist with 10 years of experience)

    This is an in vitro diagnostic device (an assay), not an imaging or diagnostic AI system that requires expert interpretation for ground truth. The "ground truth" for the performance characteristic studies (like LoQ, precision, linearity, interference, cross-reactivity, and method comparison) is established by the analytical measurement itself, often compared against a reference method or known spiked concentrations. For method comparison, another commercially available, quantitative automated assay serves as the comparative reference. For the reference interval study, the "ground truth" is derived from the measured ACTH concentrations in a defined population of apparently healthy adults using the IDS ACTH II assay itself, following CLSI guidelines for establishing reference intervals.

    Therefore, the concept of "experts establishing ground truth" in the way it applies to imaging studies (e.g., radiologists) is not relevant here.

    4. Adjudication method (e.g. 2+1, 3+1, none) for the test set

    Adjudication methods like 2+1 or 3+1 are typically used in clinical trials or diagnostic studies where there's human interpretation involved and potential for disagreement. This document describes analytical performance studies of an IVD assay, where the results are quantitative measurements. The methods followed standard CLSI guidelines (e.g., EP17-A, EP05-A3, EP06, EP07-A3, EP-9A2, C28-A3) for laboratory testing, which do not generally involve an adjudication process in the same way clinical judgment studies would.

    5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

    No, an MRMC comparative effectiveness study was not done. This device is an in vitro diagnostic assay, not an AI-assisted diagnostic tool that involves human readers.

    6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done

    This is an automated in vitro diagnostic assay, meaning it operates in a standalone manner (algorithm only, without human-in-the-loop performance for result generation or interpretation, beyond standard laboratory procedures). The performance data presented are for the device's inherent analytical capabilities.

    7. The type of ground truth used (expert consensus, pathology, outcomes data, etc)

    • Analytical Limits, Precision, Linearity, Interference, Cross-Reactivity: Ground truth is established through controlled laboratory experiments using known concentrations (e.g., spiked samples, blank samples, reference materials) and rigorous statistical analysis as per CLSI guidelines.
    • Method Comparison: The "ground truth" for method comparison is the measurement obtained from a predicate, commercially available quantitative automated assay using patient samples, against which the candidate device's measurements are compared.
    • Reference Intervals: The "ground truth" for expected values is the statistical distribution of ACTH concentrations measured by the IDS ACTH II assay itself in a predefined population of apparently healthy adults (n=140).

    8. The sample size for the training set

    The concept of a "training set" is typically associated with machine learning or AI models. This document describes the validation of an IVD assay. The assay itself does not involve a machine learning model that requires a distinct training set. The various sample sizes mentioned in point 2 are for different performance characteristic evaluation tests.

    9. How the ground truth for the training set was established

    As there is no "training set" in the context of an AI/ML model for this IVD assay, this question is not applicable. The assay's analytical characteristics are established through chemical and immunochemical principles and validated through the performance studies described.

    Ask a Question

    Ask a specific question about this device

    Page 1 of 1