Search Filters

Search Results

Found 1 results

510(k) Data Aggregation

    K Number
    DEN160019
    Date Cleared
    2017-03-04

    (285 days)

    Product Code
    Regulation Number
    864.1865
    Type
    Direct
    Reference & Predicate Devices
    N/A
    Why did this record match?
    Device Name :

    CINtec Histology (50 tests), CINtec Histology (250 tests)

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    CINtec Histology is a qualitative immunohistochemistry (IHC) test using mouse monoclonal anti-p16 antibody clone E6H4. and is intended for use in the light microscopic assessment of the p16thK4a protein in formalin-fixed, paraffin-embedded (FFPE) cervical punch biopsy tissues using OptiView DAB IHC Detection Kit on a VENTANA BenchMark ULTRA instrument. The test is indicated as an adjunct to examination of hematoxylin and eosin (H&E) stained slide(s), to improve consistency in the diagnosis of cervical intraepithelial neoplasia (CIN). Diagnosis of CIN presence or level should be based on H&E stained slide(s) and other clinical and laboratory test information.

    Device Description

    The CINtec Histology test is a single dispenser IHC assay system comprised of an anti-p16 primary antibody optimized for use with the BenchMark ULTRA automated slide staining instrument and the OptiView DAB IHC Detection Kit. The antibody is diluted in a Tris-HCl buffer containing carrier protein and 0.1% ProClin 300 as a preservative, and provided as a ready-to-use liquid in a FloLock dispenser. CINtec Histology is available in a 50 test size and a 250 test size.

    The OptiView DAB IHC Detection Kit (OptiView) is an indirect, biotin-free system for detecting mouse IgG, mouse IgM, and rabbit primary antibodies and is comprised of 6 dispensers packaged together in one box.

    AI/ML Overview

    Here's a breakdown of the acceptance criteria and study details for the CINtec Histology device:

    1. Acceptance Criteria and Reported Device Performance

    The general acceptance criteria for this device type are outlined in 21 CFR 864.1865, specifically under "Special Controls." The clinical study data demonstrated a statistically significant improvement in the consistency of diagnoses by Community Pathologists (CPs) when using CINtec Histology staining. The reported performance relates to the improvement in agreement rates.

    Acceptance Criteria Category (Derived from Special Controls)Specific Metric Referenced in DocumentReported Device Performance (H&E + CINtec Histology)Baseline Performance (H&E Only)Difference / Improvement
    Clinical Validity (Consistency of CIN Diagnosis)Positive Percent Agreement (PPA) for ≥HSIL-histology (LAST Cases)95.9% (165/172)66.4% (85/128)29.5% (95% CI: 21.2%; 37.7%) (Statistically Significant)
    Clinical Validity (Consistency of CIN Diagnosis)Negative Percent Agreement (NPA) for ≤LSIL-histology (LAST Cases)49.6% (131/264)42.5% (131/308)7.1% (95% CI: 1.3%; 13.1%) (Statistically Significant)
    Clinical Validity (Consistency of CIN Diagnosis)Positive Percent Agreement (PPA) for ≥HSIL-histology (ALL Cases)94.1% (206/219)71.3% (119/167)22.8% (95% CI: 15.5%; 30.1%) (Statistically Significant)
    Clinical Validity (Consistency of CIN Diagnosis)Negative Percent Agreement (NPA) for ≤LSIL-histology (ALL Cases)64.4% (567/881)56.5% (527/933)7.9% (95% CI: 4.9%; 10.8%) (Statistically Significant)
    Staining PerformanceOverall Staining Acceptability99.09% (19,074/19,250)N/A (criteria for CINtec Histology staining)N/A
    Staining PerformanceMorphology Acceptability99.99% (19,249/19,250)N/A (criteria for CINtec Histology staining)N/A
    Staining PerformanceBackground Acceptability99.99% (19,249/19,250)N/A (criteria for CINtec Histology staining)N/A
    Precision/ReproducibilityWithin-Day (Repeatability) Precision for CINtec Histology Status and CIN Category100%N/AN/A
    Precision/ReproducibilityDay-to-Day Precision for CINtec Histology Status and CIN Category100%N/AN/A
    Precision/ReproducibilityInstrument-to-Instrument Precision for CINtec Histology Status and CIN Category100%N/AN/A
    Precision/ReproducibilityLot-to-Lot Precision for CINtec Histology Status and CIN Category100% (CINtec Histology Status), 98.6% (CIN Category)N/AN/A
    Precision/ReproducibilityWithin-Reader Agreement for CINtec Histology Status98.7%N/AN/A
    Precision/ReproducibilityReader-to-Reader Agreement for CINtec Histology Status (Precision Study)98.7%N/AN/A
    Reproducibility (Inter-laboratory)Reader-to-Reader Agreement of CINtec Histology results (Positive: 95.5%, Negative: 92.9%)N/AN/AN/A
    Reproducibility (Inter-laboratory)Day-to-Day Agreement of CINtec Histology results (Positive: 98.2%, Negative: 97.1%)N/AN/AN/A
    Reproducibility (Inter-laboratory)Site-to-Site Agreement of CINtec Histology results (Positive: 96.2%, Negative: 93.9%)N/AN/AN/A
    Analytical SpecificityWestern Blot, Peptide Inhibition Study, Immunoreactivity (detailed in section M.1.e)Demonstrated specificity for p16INK4a protein and no unexpected stainingN/AN/A
    RobustnessTissue Thickness (3, 4, 5, 6, 7 microns), Fixation (10% NBF, zinc formalin, Z-Fix for 6-72 hrs), Staining Options (various combinations)All demonstrated appropriate specific staining and background levels.N/AN/A
    StabilityAssay Reagent (24 months at 2-8 °C), Cut-Slide (24 weeks at 2-8°C or 30°C), Shipping Conditions (heated & freeze/thaw)Acceptable stability confirmed for all conditions.N/AN/A

    2. Sample Size Used for the Test Set and Data Provenance

    The primary clinical study evaluating diagnostic consistency used 1,100 retrospectively collected FFPE cervical punch biopsy specimens.

    The data provenance is described as: "retrospectively collected FFPE cervical punch biopsy specimens, which represent a colposcopy referral population." The study involved Board Certified CPs from across the United States.

    3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications

    • Number of Experts: Three (3) Expert Pathologists (XPs).
    • Qualifications of Experts: Not explicitly stated beyond "Expert pathologists" and "Board Certified CPs" (for community pathologists). However, the role and processes imply their expertise in cervical pathology.

    4. Adjudication Method for the Test Set

    The ground truth (Expert-derived Reference Diagnosis) for the test set was established using a 3+1 adjudication method:

    • Two XPs initially established independent diagnoses based on H&E-stained slides.
    • Discordant cases were evaluated by a third XP.
    • Cases for which a "2 out of 3 majority diagnosis" was not achieved were reviewed during an adjudication review meeting that included all three XPs.
    • "Majority (or consensus) results established the Expert-derived Reference Diagnosis for each case."

    This process was repeated for establishing the reference diagnosis based on H&E and CINtec Histology stained slides.

    5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done, What Was the Effect Size of How Much Human Readers Improve with AI vs. Without AI Assistance

    Yes, an MRMC comparative effectiveness study was done. This study compared the diagnostic consistency of community pathologists (CPs) with and without the aid of CINtec Histology staining.

    The "effect size" can be quantified by the observed differences in Positive Percent Agreement (PPA) and Negative Percent Agreement (NPA) between the "H&E Only" and "H&E and CINtec Histology" conditions. The study demonstrated a statistically significant improvement in consistency.

    • PPA Improvement for ≥HSIL-histology (LAST Cases): 29.5% (from 66.4% to 95.9%)
    • NPA Improvement for ≤LSIL-histology (LAST Cases): 7.1% (from 42.5% to 49.6%)
    • PPA Improvement for ≥HSIL-histology (ALL Cases): 22.8% (from 71.3% to 94.1%)
    • NPA Improvement for ≤LSIL-histology (ALL Cases): 7.9% (from 56.5% to 64.4%)

    These values represent the improvement in agreement rates of CPs with the expert reference diagnosis when using CINtec Histology as an adjunct to H&E.

    6. If a Standalone (i.e., Algorithm Only Without Human-in-the-Loop Performance) Was Done

    No, a standalone (algorithm only) performance study was not done or described. The CINtec Histology device is a qualitative immunohistochemistry test where results are "interpreted using a light microscope by a pathologist." Its indication for use is "as an adjunct to examination of hematoxylin and eosin (H&E) stained slide(s), to improve consistency in the diagnosis of cervical intraepithelial neoplasia (CIN)."

    7. The Type of Ground Truth Used

    The primary ground truth used for the clinical study was an Expert Consensus Diagnosis (referred to as "Expert-derived Reference Diagnosis"). This was established by a panel of three expert pathologists through initial independent readings and subsequent adjudication (2 out of 3 majority, followed by a review meeting for persistent discordance). This consensus was established twice: once based on H&E alone, and once based on H&E + CINtec Histology.

    8. The Sample Size for the Training Set

    The document does not explicitly state a separate "training set" for the CINtec Histology product itself. As an immunohistochemistry (IHC) assay for detecting a protein marker, it is a laboratory test with defined reagents and protocols, rather than a machine learning algorithm that requires a dedicated training set. The various analytical and precision studies describe the evaluation of the assay's performance characteristics.

    9. How the Ground Truth for the Training Set Was Established

    As noted above, there is no explicit mention of a "training set" for the device in the context of an algorithm. The development and optimization of the IHC assay would have involved standard laboratory practices, including using known positive and negative control tissues. For instance, the analytical performance section mentions using "cervical carcinoma or CIN2/3 cervical tissue positive for CINtec Histology staining" as a positive control and "normal cervical tissue with negative staining" as a negative control. These are used to confirm assay performance rather than to "train" an algorithm.

    Ask a Question

    Ask a specific question about this device

    Page 1 of 1