Search Filters

Search Results

Found 2 results

510(k) Data Aggregation

    K Number
    K203256
    Manufacturer
    Date Cleared
    2021-03-09

    (125 days)

    Product Code
    Regulation Number
    892.2050
    Reference & Predicate Devices
    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The Imbio RV/LV Software device is designed to measure the maximal diameters of the right and left ventricles of the heart from a volumetric CTPA acquisition and report the ratio of those measurements. RV/LV analyzes cases using an artificial intelligence algorithm to identify the location and measurements of the ventricles. The RV/LV software provides the user with annotated images showing ventricular measurements. Its results are not intended to be used on a stand-alone basis for clinical decision-making or otherwise preclude clinical assessment of CTPA cases.

    Device Description

    The Imbio CT RV/LV Software is a set of medical image post-processing computer algorithms that together perform automated image segmentation and diameter measurements on computed tomography pulmonary angiography (CTPA) images. The device then reports the ratio of those diameter measurements. The Imbio CT RV/LV Software is a single command-line executable program that may be run directly from the command-line or through scripting and thus the user interface is minimal.

    Imbio RV/LV Software is a Software and Medical Device (SaMD) intended to provide annotated images and a PDF report that will be read most typically at a PACS workstation. Imbio RV/LV Software is an aid only used to support a physician in the analysis of CTPA images.

    The Imbio RV/LV Software program reads in DICOM CPTA image datasets, processes the data, then writes output DICOM files and summary reports to a specified directory. Imbio RV/LV Software outputs DICOMs of the original input DICOM CPTA images overlaid with color-codings representing the results of RV/LV computer caliper measurement. Additionally, a summary PDF report is output.

    Imbio RV/LV Software does not interface directly with any CT scanner or data collection equipment; instead the software imports data files previously generated by such equipment and is integrated as part of the radiological work-flow, reducing the risk of use errors.

    AI/ML Overview

    Here's an analysis of the Imbio RV/LV Software based on the provided FDA 510(k) summary, structured to answer your questions:


    1. Table of Acceptance Criteria and Reported Device Performance

    The FDA 510(k) summary provided does not explicitly state numerical acceptance criteria in terms of performance metrics (e.g., accuracy thresholds, sensitivity, specificity targets). Instead, it describes clinical performance testing designed to demonstrate improvement in agreement among general radiologists and accuracy compared to radiologists' measurements.

    Performance MetricAcceptance Criteria (Not Explicitly Stated in Document)Reported Device Performance (Summary of Findings)
    Reader Study I: Improvement in Agreement Among General Radiologists(Implicit: Demonstrates improved agreement with AI assistance)Demonstrated improvement of agreement among general radiologists with the assistance of the RV/LV output report.
    Reader Study II: Accuracy of RV/LV Diameter Ratios(Implicit: Demonstrates accuracy compared to radiologists' measurements)Demonstrated accuracy of RV/LV diameter ratios compared to radiologists' measurement of the RV/LV diameter ratio.

    2. Sample Size Used for the Test Set and Data Provenance

    The document states: "Anonymized CTPA datasets were utilized in the reader study." However, it does not specify the exact sample size of the test set nor the country of origin of the data. It does indicate that the study was retrospective as it used "anonymized CTPA datasets."

    3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts

    The document states: "The second test (Reader Study-II) will demonstrated the accuracy of RVLV diameter ratios compared to radiologist's measurement of the RVLV diameter ratio." This implies that radiologists' measurements were used as a reference for accuracy. However, the document does not specify the number of radiologists or their specific qualifications (e.g., years of experience, subspecialty) used to establish this ground truth.

    4. Adjudication Method for the Test Set

    The document does not describe any specific adjudication method (e.g., 2+1, 3+1) for establishing the ground truth or resolving discrepancies in Reader Study II. It only mentions "radiologist's measurement," implying individual radiologist readings were used as comparison. For Reader Study I, which focused on "agreement among general radiologists," the specific adjudication or consensus method to determine the "improved agreement" is not detailed.

    5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

    Yes, a Multi-Reader Multi-Case (MRMC) comparative effectiveness study was performed in the form of Reader Study I. This study "demonstrated the improvement of the agreement among general radiologist with the assistance of the RVLV output report."

    Effect size of how much human readers improve with AI vs. without AI assistance: The document states that Reader Study I "demonstrated the improvement of the agreement among general radiologist with the assistance of the RVLV output report." However, it does not provide quantitative effect size results (e.g., specific statistical metrics like AUC improvement, sensitivity/specificity changes, or inter-reader agreement measures like kappa values) directly in this summary.

    6. Standalone (Algorithm Only) Performance Study

    Yes, a standalone performance evaluation was also done, implicitly referred to as Reader Study II. This study "demonstrated the accuracy of RVLV diameter ratios compared to radiologist's measurement of the RVLV diameter ratio." This test assesses the algorithm's direct output (RV/LV diameter ratios) against a human reference, indicating a standalone performance evaluation.

    7. Type of Ground Truth Used

    The ground truth used for performance evaluation (specifically for Reader Study II, or for comparison in general) was based on expert (radiologist) measurements. The document states, "accuracy of RVLV diameter ratios compared to radiologist's measurement of the RVLV diameter ratio."

    8. Sample Size for the Training Set

    The document does not provide any information regarding the sample size used for the training set of the AI algorithm.

    9. How the Ground Truth for the Training Set Was Established

    The document does not provide any information on how the ground truth for the training set was established.

    Ask a Question

    Ask a specific question about this device

    K Number
    K180129
    Manufacturer
    Date Cleared
    2018-03-16

    (58 days)

    Product Code
    Regulation Number
    892.2050
    Reference & Predicate Devices
    Predicate For
    N/A
    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The Imbio Segmentation Editing Tool Software is used by trained medical professionals asa tool to modify the contours of segmentation masks produced by Imbio algorithms or to manually create segmentation mask contours. The Segmentation Editing Tool can provide further support to the users of Imbio's algorithms.

    Device Description

    Imbio Segmentation Editing Tool (SET) Software is a segmentation editing tool designed to allow users to optimize segmentations calculated by Imbio's fully-automated suite of algorithms (Each algorithm is a separate Imbio program and either has or will be submitted for regulatory approval independently). Imbio is building a suite of medical image post-processing applications that run automatically after data transfer off the medical imaging scanner. Automatic image segmentation is often an essential step in Imbio's analyses. To date, the automatic segmentation algorithms used in Imbio's applications have been robust, however segmentation failures do occur. The purpose of the Segmentation Editing Tool is to provide customers with a tool to locally correct poor segmentations. Additionally, if the Imbio automatic segmentation fails such that it is unable to produce a result, this tool can be used to semi-manually draw the segmentation required for analysis. SET reads in anatomical images used in an automatic segmentation algorithm and the results of the automated segmentation algorithm (if available). The user is then able to locally correct insufficiencies in the segmentation result, or create a segmentation mask from scratch. The finalized segmentation mask is then pushed back to Imbio's Core Computing Platform and the job is re-processed.

    AI/ML Overview

    The provided FDA 510(k) summary for the "Imbio Segmentation Editing Tool Software" (K180129) does not contain details about specific acceptance criteria or a study that proves the device meets such criteria.

    Instead, it focuses on demonstrating substantial equivalence to a predicate device (MIM 5.2 Brachy K103576). The document mentions "Non-clinical testing was done to show validity of SET software" and "Design validation was performed using the Imbio Segmentation Editing Tool Software in actual and simulated use settings," but it does not provide the results of these tests, specific acceptance criteria, or detailed methodologies.

    Here's a breakdown based on the information provided and not provided in the document:

    1. A table of acceptance criteria and the reported device performance:

    • Not provided. The document does not list any specific quantitative acceptance criteria (e.g., Dice score, mean surface distance, sensitivity, specificity) or present device performance metrics against such criteria.

    2. Sample size used for the test set and the data provenance (e.g. country of origin of the data, retrospective or prospective):

    • Not provided. The document states "Design validation was performed using the Imbio Segmentation Editing Tool Software in actual and simulated use settings," but it does not specify the number of cases (sample size) used for these tests, nor the origin or nature (retrospective/prospective) of the data.

    3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g. radiologist with 10 years of experience):

    • Not provided. Since specific test sets and ground truth establishment are not detailed, this information is absent. The device is a segmentation editing tool meant to be used by "trained medical professionals," suggesting a human-in-the-loop context, but not a fully automated algorithm that produces its own segmentations against a pre-established ground truth for validation.

    4. Adjudication method (e.g. 2+1, 3+1, none) for the test set:

    • Not provided. This information is typically relevant for studies where multiple readers determine ground truth or interpret results, which is not described for this device's validation.

    5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:

    • Not provided. The document states, "This technology is not new; therefore, a clinical study was not considered necessary prior to release. Additionally, there was no clinical testing required to support the medical device as the indications for use is equivalent to the predicate device."
    • While "Usability testing was completed for this product to ensure proper use of the product by intended users," this is not equivalent to an MRMC comparative effectiveness study measuring improved human performance with AI assistance. The device is a tool to edit segmentations, not an AI that provides initial interpretations.

    6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done:

    • Not explicitly stated as a primary validation method for this specific 510(k). The device is described as "a segmentation editing tool designed to allow users to optimize segmentations calculated by Imbio's fully-automated suite of algorithms." It's an editing tool for other Imbio algorithms' outputs. Therefore, its performance is inherently linked to human interaction. The validation focuses on the tool's functionality for editing, not on a standalone algorithmic diagnostic performance.

    7. The type of ground truth used (expert consensus, pathology, outcomes data, etc.):

    • Not provided for the "non-clinical testing" or "design validation." Since the device is an editing tool, the "ground truth" in operational use would be the expert's final, corrected segmentation. How the accuracy of the editing tool itself was measured against a truth standard is not detailed.

    8. The sample size for the training set:

    • Not applicable / Not provided. The Imbio Segmentation Editing Tool Software is described as a software tool for editing segmentation masks, not an AI algorithm that learns from a training set to produce segmentations itself. The document mentions "Imbio's fully-automated suite of algorithms" which do perform segmentation, but this 510(k) is for the editing tool, not for those underlying algorithms. Therefore, a training set for the editing tool is not relevant in the same way it would be for a segmentation algorithm.

    9. How the ground truth for the training set was established:

    • Not applicable / Not provided. As mentioned above, the editing tool itself does not have a training set in the context of learning to perform segmentation.
    Ask a Question

    Ask a specific question about this device

    Page 1 of 1