Search Filters

Search Results

Found 1 results

510(k) Data Aggregation

    K Number
    K200760

    Validate with FDA (Live)

    Device Name
    Rapid ASPECTS
    Manufacturer
    Date Cleared
    2020-06-26

    (94 days)

    Product Code
    Regulation Number
    892.2060
    Age Range
    All
    Reference & Predicate Devices
    Predicate For
    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticPediatricDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    Rapid ASPECTS is a computer-aided diagnosis (CADx) software device used to assist the clinician in the assessment and characterization of brain tissue abnormalities using CT image data. The Software automatically registers images and segments and analyzes ASPECTS Regions of Interest (ROIs). Rapid ASPECTS extracts image data for the ROI(s) to provide analysis and computer analytics based on morphological characteristics. The imaging features are then synthesized by an artificial intelligence algorithm into a single ASPECT (Alberta Stroke Program Early CT) Score. Rapid ASPECTS is indicated for evaluation of patients presenting for diagnostic imaging workup with known MCA or ICA occlusion, for evaluation of extent of disease. Extent of disease refers to the number of ASPECTS regions affected which is reflected in the total score. This device provides information that may be useful in the characterization of early ischemic brain tissue injury during image interpretation (within 6 hours). Rapid ASPECTS provides a comparative analysis to the ASPECTS standard of care radiologist assessment using the ASPECTS atlas definitions and atlas display including highlighted ROIs and numerical scoring.

    Device Description

    Rapid ASPECTS provides an automatic ASPECT score based on the case input file for the physician. The score includes which ASPECT regions are identified based on regional imaging features derived from non-contrast computed tomography (NCCT) brain image data. The results are generated based on the Alberta Stroke Program Early CT Score (ASPECTS) guidelines and provided to the clinician for review and verification. At the discretion of the clinician, the scores may be adjusted based on other clinical factors the clinician may integrate though the Rapid Platform User Interface.

    The ASPECTS software module processing pipeline performs four major tasks:

    • Orientation and spatial normalization of the input imaging data (rigid registration/alignment with anatomical template);
    • Delineation of pre-defined regions of interest on the normalized input data and computing numerical values characterizing underlying voxel values within those regions;
    • Identification and highlighting previous/old stroke areas along with areas of early ischemic change; and
    • Labeling of these delineated regions and providing a summary score reflecting the number of regions with early ischemic change as per ASPECTS guidelines.

    Subsequently, the system notifies the physician of the ASPECT score which then requires the confirmation by the physician that a Large Vessel Occlusion (LVO) is detected. The ASPECTS information is then available for the physician to review and edit prior to pushing the data to a PACS or Workstation. The final summary score together with the regions selected and underlying voxel values are then sent to the Picture Archiving and Communication System (PACS) to become a part of the permanent patient medical record.

    AI/ML Overview

    Here's a summary of the acceptance criteria and the study details for the Rapid ASPECTS device, based on the provided document:

    1. Table of Acceptance Criteria and Reported Device Performance

    The FDA clearance document does not explicitly state pre-defined acceptance criteria in terms of specific performance metrics (e.g., minimum accuracy, sensitivity, specificity thresholds). Instead, the performance is demonstrated through a comparative effectiveness study showing improvement in human reader agreement.

    Acceptance Criteria CategorySpecific Criteria (Implicitly from study goals)Reported Device Performance (as stated in document)
    Clinical EfficacyImprovement in agreement with expert consensus read for ASPECTS scoring.Readers (neurologists, radiologists, emergency medicine, neurocritical care specialists) significantly increased their agreement with an expert consensus read when using Rapid ASPECTS (P<0.0001). Readers agreed, on average, with almost ½ a region (0.425, 95% CI 0.11 - 0.74) more per scan with Rapid ASPECTS than without. Non-neuroradiologists improved their agreement from 73.6% to 79.8% with Rapid ASPECTS, which is comparable to the agreement achieved by expert neuroradiologist readers with each other. The software allows the non-expert physician to perform at the expert-like level.
    SafetyMinimizing risks associated with incorrect scoring, misuse, and device failure.Identified risks include incorrect scoring (false positive/negative), misuse (unintended patient population/incompatible hardware), and device failure. The document concludes that probable benefits outweigh probable risks, given general and special controls and application of mitigating measures. The device is unlikely to decrease diagnostic performance, and misuse risks are comparable to other radiological image processing devices. A gating condition of Large Vessel Occlusion (LVO) determination guides ASPECTS use, averting many stroke mimic confounding risks.
    Technical PerformanceAccurate representation of key processing parameters and adherence to design requirements/specifications.Extensive performance validation testing, software verification, and validation testing demonstrated that the Rapid ASPECTS module provides accurate representation of key processing parameters under a range of clinically relevant parameters and perturbations. The module met all design requirements and specifications.

    2. Sample Size Used for the Test Set and Data Provenance

    • Sample size for the test set: 50 cases. Each case had 10 regions scored independently.
    • Data Provenance: Retrospective data from case data. The country of origin is not specified in the provided document.

    3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications

    • Number of experts: Three experts.
    • Qualifications of experts: The document refers to them as "expert neuroradiologist readers." Specific years of experience or other detailed qualifications are not provided.

    4. Adjudication Method for the Test Set

    • Adjudication method: "Data truthing was performed by three experts." This implies an expert consensus method, but the specific process (e.g., whether it was 2+1, 3+1, or another form of consensus) is not detailed.

    5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done, and the Effect Size of Improvement

    • MRMC Comparative Effectiveness Study: Yes, an MRMC study was done, described as a "concurrent read, cross-over study design."
    • Effect size of improvement:
      • Readers (neurologists, radiologists, emergency medicine, neurocritical care specialists) significantly increased their agreement with an expert consensus read (p<0.0001).
      • With Rapid ASPECTS, readers agreed, on average, with 0.425 more regions (95% CI 0.11 - 0.74) per scan than without Rapid ASPECTS.
      • Non-neuroradiologists improved their level of agreement with experts from 73.6% to 79.8%.

    6. If a Standalone (Algorithm Only Without Human-in-the-Loop Performance) Was Done

    • The document implies that the primary performance evaluation was focused on the AI-assisted human reading. While the device "provides an automatic ASPECT score," the clinical study focuses on how humans improve with the device. The "Performance Data" section mentions "extensive performance validation testing and software verification and validation testing of the Rapid ASPECTS module both as standalone software and as integrated within the Rapid Platform," indicating that standalone testing for technical performance (e.g., accuracy against a "truth" ASPECTS score) was performed, but specific performance metrics for this standalone algorithm were not provided in this summary. The clinical efficacy, however, is reported in the context of human-in-the-loop.

    7. The Type of Ground Truth Used (Expert Consensus, Pathology, Outcomes Data, etc.)

    • Type of Ground Truth: Expert consensus. "Data truthing was performed by three experts" and the device performance was measured against "an expert consensus read."

    8. The Sample Size for the Training Set

    • The sample size for the training set is not explicitly stated in the provided text. The document refers to "historical training data" but does not give a number.

    9. How the Ground Truth for the Training Set Was Established

    • The document states that the "Rapid ASPECTS analytics calculates morphological characteristics of brain tissue using the historical training data." It further explains that "The results are generated based on the Alberta Stroke Program Early CT Score (ASPECTS) guidelines." However, the specific method for establishing the ground truth for this "historical training data" (e.g., number of experts, their qualifications, adjudication method) is not detailed in this summary. It can be inferred that it likely also involved expert assessment based on ASPECTS guidelines.
    Ask a Question

    Ask a specific question about this device

    Page 1 of 1