Search Filters

Search Results

Found 3 results

510(k) Data Aggregation

    K Number
    K223809
    Manufacturer
    Date Cleared
    2023-05-30

    (161 days)

    Product Code
    Regulation Number
    870.1405
    Reference & Predicate Devices
    Predicate For
    N/A
    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    PrecisionTAVI is an optional, non-invasive, post processing software solution that is indicated for patient-specific simulations of Transcatheter Aortic Valve Replacement (TAVR) during procedural planning.

    The software performs computer simulation to predict post TAVR in vivo valve frame deformation of clinician selected Transcatheter Heart Valve (THV) device types and sizes.

    The information provided by PrecisionTAVI is intended for use by cardiologists, and clinical specialists, and is not intended in any way to eliminate, replace, or substitute for, in part, the healthcare provider's judgment and analysis of the patient's condition receiving the images retains the responsibility for interpreting and validating all information and making all patient treatment decisions.

    PrecisionTAVI is not intended to replace the simulated device's instructions for use for final TAVR device selection and placement.

    Device Description

    DASI Simulations PrecisionTAVI is a computer simulation device that predicts implant frame deformation after implantation of a Transcatheter Heart Valve (THV) device. The simulation combines a predefined THV device model and size with a patient-specific model of the patient's anatomy thereby predicting the post deployment deformation of the THV and the anatomy. The simulation results are intended to be used by qualified clinicians as additional information for planning transcatheter aortic valve replacement (TAVR).

    PrecisionTAVI conducts TAVR device deployment simulation using proprietary computational modeling technology.

    The input for the simulation is a 3D model of the patient anatomy. The 3D model is generated from 2D medical images of the patient anatomy (multi-slice Cardiac Computed Tomography).

    The simulation output is a report with 3D visualization capability to depict the predicted deformed THV in the deformed patient-specific anatomy of the aortic valve and root.

    The 3D model generation and the report generation from the simulation is performed by trained operators at DASI Simulations using an established workflow. The report is accessible to the end user as a download from the DASI Simulations portal with a standard web browser.

    AI/ML Overview

    Here is a summary of the acceptance criteria and the study proving the device meets those criteria, based on the provided text:

    1. Table of Acceptance Criteria and Reported Device Performance

    MetricAcceptance CriteriaReported Device Performance
    Quantitative Validation (THV Deformation)
    Mean THV diameter (inflow, waist, outflow regions)80% agreement in clinician qualitative assessments. (Though specific criteria were described as "close agreement with the clinical outputs" across various views, the overall acceptance was >80%)96% of all case evaluations (48/50) were found to be in agreement, with 90.5% (181/200) cut planes testing successfully.
    Conclusion: Satisfied.
    Qualitative Validation (Engineer Assessment)> 80% agreement in engineer qualitative assessments. (Specifically for eccentricity and apposition of the THV stent)- Eccentricity: 97% of cases found in agreement.
    • Apposition: 99% of cases found in agreement.
      Conclusion: Satisfied. |

    2. Sample Size Used for the Test Set and Data Provenance

    • Sample Size: 89 patients.
    • Data Provenance: The data was derived from clinical deployments. Patients had tricuspid aortic valve morphology, received a SAPIEN S3/Ultra THV, and had both pre-TAVR and post-TAVR CT imaging available. The specific country of origin is not explicitly stated, but it's implied to be clinical data. It is retrospective as it uses pre-existing clinical deployment data (pre-TAVR and post-TAVR CT images).

    3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts

    • Number of Experts:
      • Quantitative Ground Truth: No external experts were used; ground truth was established by reconstructing THV geometries directly from post-operative clinical CT image data.
      • Qualitative Ground Truth:
        • Five (5) experienced independent clinicians in the TAVR space.
        • Three (3) trained DASI Simulations engineers.
    • Qualifications of Experts:
      • Clinicians: "Experienced independent clinicians in the TAVR space." (Specific years of experience or other detailed qualifications not provided).
      • Engineers: "Trained DASI Simulations engineers." (Specific qualifications not provided beyond being "trained").

    4. Adjudication Method for the Test Set

    • Quantitative: Not applicable, as ground truth was derived directly from post-operative clinical CT images for quantitative measurements.
    • Qualitative: Not explicitly stated as a formal adjudication method like '2+1' or '3+1'. However, clinicians and engineers were individually presented with comparison image pairs and asked to state if they found the simulated outputs to be "in close agreement" with the clinical outputs. The overall percentage of agreement was then reported. It does not appear there was a consensus or tie-breaking process explicitly described for individual cases, but rather an aggregate assessment of agreement.

    5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

    • No, a MRMC comparative effectiveness study was not reported. The study focused on the performance of the AI device itself (standalone and qualitative assessment), not on how human readers improved with or without AI assistance.

    6. Standalone Performance Study

    • Yes, a standalone performance study was done.
      • Quantitative Validation: The device's predicted THV deformation (diameter and aspect ratio) was compared directly against measurements derived from post-TAVR CT images.
      • Qualitative Validation: Clinicians and engineers assessed the "close agreement" between the device's simulated outputs and clinical post-procedural images. Both of these are examples of standalone performance evaluation.

    7. Type of Ground Truth Used

    • Quantitative Validation: The ground truth for quantitative measurements (THV diameter and aspect ratio) was derived from post-operative clinical CT image data. This is essentially "outcomes data" in the sense that it represents the actual, measured post-TAVR state in patients.
    • Qualitative Validation: The ground truth for qualitative assessments was also the post-operative clinical images (clinical outputs), against which the simulated outputs were compared by clinicians and engineers.

    8. Sample Size for the Training Set

    • The document does not provide information regarding the sample size for the training set. It only mentions the test set of 89 patients.

    9. How the Ground Truth for the Training Set Was Established

    • As the training set sample size is not provided, the method for establishing its ground truth is also not specified in the document.
    Ask a Question

    Ask a specific question about this device

    K Number
    K214066
    Device Name
    FEops HEARTguide
    Manufacturer
    Date Cleared
    2022-02-25

    (60 days)

    Product Code
    Regulation Number
    870.1405
    Reference & Predicate Devices
    Predicate For
    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    FEops HEARTguide™ is indicated for patient-specific simulation of transcatheter left atrial appendage occlusion (LAAO) device implantation during procedural planning.

    The software performs computer simulation to predict implant frame deformation to support the evaluation for LAAO device size and placement.

    FEops HEARTguide™ is intended to be used by qualified clinicians in conjunction with the simulated device instructions for use, the patient's clinical history, symptoms, and other preprocedural evaluations, as well as the clinician's professional judgment.

    FEops HEARTguide™ is not intended to replace the simulated device instructions for use for final LAAO device selection and placement.

    FEops HEARTguide™ is prescription use only.

    Device Description

    FEops HEARTguide™ predicts implant frame deformation after percutaneous LAAO device implantation through computer simulation. The predicted deformation provides additional information during LAAO procedural planning.

    The simulation is based on a 3D model of the patient anatomy which is generated from 2D medical images of the patient anatomy (multi-slice Cardiac Computed Tomography). The simulation is executed by FEops Case Analysts and run on FEops infrastructure.

    The simulation report is created by combining a predefined device model with a patient-specific model of the patient anatomy. This is performed by trained operators at FEops using an internal software platform through an established workflow. The purposely qualified case analysts and quality control analysts process the received medical images of the patient to produce the simulation results.

    The simulation results are provided as 2D and numerical data shown in a PDF report and 3D, 2D and numerical data shown in a web-based Viewer application accessible through a standard web browser.

    AI/ML Overview

    The information provided primarily describes the FEops HEARTguide™ device and its substantial equivalence to a predicate device, focusing on regulatory aspects rather than detailed study results. Given the available text, I can extract and infer some information, but many specific details regarding acceptance criteria and study findings are not explicitly provided.

    Here's an attempt to answer your questions based on the provided text, with acknowledgments of what is not present:

    1. Table of acceptance criteria and the reported device performance

    The document states: "Acceptance criteria were defined using the same method as for the predicate device demonstrating the same clinical meaningfulness." However, the specific acceptance criteria (e.g., a numerical threshold for accuracy, precision, etc.) and the reported device performance values against these criteria are not provided in the given text.

    The text generally states that the performance validation testing demonstrated "a similar performance level" and "the performance of the subject device is equivalent to the performance of the predicate device." It also mentions "an assessment of the agreement between the computational model results and clinical data across the full intended operating range."

    Without the specific criteria and metrics, a table cannot be fully constructed.

    2. Sample size used for the test set and the data provenance (e.g. country of origin of the data, retrospective or prospective)

    • Sample Size for Test Set: The text states: "For both added LAAO devices, the performance study was performed on a cohort with a sample size equal to or larger than the predicate device." The exact number is not specified for either the predicate or the current device.
    • Data Provenance: The document mentions "clinical data" but does not specify the country of origin or whether the data was retrospective or prospective.

    3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g. radiologist with 10 years of experience)

    This information is not provided in the given text. The text mentions "qualified clinicians" in the context of device usage and interpretation but not explicitly for ground truth establishment during a performance study.

    4. Adjudication method (e.g. 2+1, 3+1, none) for the test set

    This information is not provided in the given text.

    5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

    The document describes the device as "Interventional cardiovascular implant simulation software," which predicts "implant frame deformation." It is intended to support procedural planning and "not intended to replace the simulated device instructions for use for final LAAO device selection and placement." This implies that it is a tool to assist clinicians.

    The text mentions "a Human factors evaluation report was provided demonstrating the ability of the user interface and labeling to allow for intended and qualified users to correctly use the device and interpret the provided information." It also says, "To ensure consistency of modeling outputs, the validation was performed with multiple qualified operators using the procedure that will be implemented under anticipated conditions of use..."

    However, the text does not explicitly state or present results from a Multi-Reader Multi-Case (MRMC) comparative effectiveness study comparing human readers with AI assistance versus without AI assistance, nor does it provide an effect size for such a comparison. The focus is on the device's predictive capability and its agreement with clinical data.

    6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done

    The device is described as "simulation software" operated by "trained operators at FEops using an internal software platform through an established workflow." The "simulation results are provided as 2D and numerical data shown in a PDF report and 3D, 2D and numerical data shown in a web-based Viewer application accessible through a standard web browser." This indicates that the software performs the simulation independently, and its outputs are then presented.

    The "performance study" assesses the "agreement between the computational model results and clinical data." This implies a standalone evaluation of the algorithm's predictions against real-world clinical outcomes or measurements. Therefore, it is highly likely that a standalone performance evaluation of the algorithm's predictive capabilities was performed, but the results in raw form are not in the provided text.

    7. The type of ground truth used (expert concensus, pathology, outcomes data, etc.)

    The document mentions "a comparison of the results to clinical data supporting the indications for use" and "an assessment of the agreement between the computational model results and clinical data." This strongly suggests that clinical data (which could include imaging, procedural findings, or direct measurements from patients after implantation) was used as the ground truth. It does not specify if this clinical data was corroborated by expert consensus, pathology, or specific outcomes data, but "clinical data" is a broad term that would encompass such information.

    8. The sample size for the training set

    The document discusses "computational modeling verification and validation activities" and "performance validation testing data," but it does not mention a separate training set or its sample size. The focus is on the validation of the models against clinical data. It describes the software primarily as a "simulation software" based on a "3D model of the patient anatomy," "predefined device model," and "patient-specific model," rather than a machine learning model that would typically have a distinct training set.

    9. How the ground truth for the training set was established

    Since a training set is not explicitly mentioned for a machine learning context, this question is not applicable based on the provided text. The device performs simulations based on computational models, not necessarily learned from a training set in the typical AI sense.

    Ask a Question

    Ask a specific question about this device

    K Number
    DEN200030
    Device Name
    FEops HEARTguide
    Manufacturer
    Date Cleared
    2021-09-08

    (489 days)

    Product Code
    Regulation Number
    870.1405
    Type
    Direct
    Reference & Predicate Devices
    N/A
    Predicate For
    N/A
    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    FEops HEARTguide is indicated for patient-specific simulation of transcatheter left atrial appendage occlusion (LAAO) device implantation during procedural planning.

    The software performs computer simulation to predict implant frame deformation to support the evaluation for LAAO device size and placement.

    FEops HEARTguide is intended to be used by qualified clinicians in conjunction with the simulated device instructions-for-use, the patient's clinical history, symptoms, and other preprocedural evaluations, as well as the clinician's professional judgment.

    FEops HEARTguide is not intended to replace the simulated device's instructions for use for final LAAO device selection and placement.

    FEops HEARTguide is prescription use only.

    Device Description

    FEops HEARTguide is a computer simulation device which provides a prediction of implant frame deformation (device-tissue interaction) post transcatheter LAAO device implantation. The device performs simulation by combining a predefined device model with a patient-specific model of the patient anatomy (Figure 1). The simulation results are intended to be used by qualified clinicians as a pre-procedural planning adjunct for LAAO implantation.

    AI/ML Overview

    Here's a breakdown of the acceptance criteria and the study proving the device meets them, based on the provided text:

    Acceptance Criteria and Reported Device Performance

    Acceptance CriteriaReported Device Performance
    Quantitative Evaluation: Maximum allowed difference in percentage ((predicted Dmax - observed Dmax)/observed Dmax) must be less than the predetermined performance goal of ±15%.Met: The mean difference was -1.9%, and the limits of agreement (95% CI) were 7.4% and -11.2%. Since the 95% CI of the agreement limits were within ±15%, the quantitative endpoint was met.
    Qualitative Evaluation: More than 75% of the verdicts should be "similar" or "acceptable" when 3 cardiology experts rated the similarity between the visualization of the simulated deployed device in the anatomy versus the geometry reconstructed from the postoperative CT images.Met: Overall, 90.6% (169/180) of the grades from the experts were "acceptable" or better, thus meeting the qualitative performance goal.

    Study Details for Clinical Accuracy Validation

    1. Sample Size and Data Provenance

    • Test Set Sample Size: 60 retrospective Watchman left atrial appendage occlusion (LAAO) cases.
    • Data Provenance: Retrospective, from 5 centers. The specific country of origin is not explicitly stated, but the sponsor is based in Belgium.

    2. Number of Experts and Qualifications for Ground Truth

    • Number of Experts: 3 cardiology experts.
    • Qualifications: Referred to as "cardiology experts." No further specific details on years of experience or board certification are provided in the text.

    3. Adjudication Method

    • Adjudication Method: Not explicitly detailed as 2+1 or 3+1. The text states that "3 cardiology experts rated the similarity." It implies a consensus or majority rule for the qualitative endpoint, as 90.6% of the grades (plural) were "acceptable" or better. It doesn't specify if discrepancies were resolved.

    4. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

    • MRMC Study Done? No, a traditional MRMC comparative effectiveness study where human readers' performance with and without AI assistance is compared was not reported. The study focused on the accuracy of the device simulation's output compared to observed data and expert qualitative assessment of that output.
    • Effect Size of Human Improvement (if applicable): Not applicable, as this type of MRMC study was not performed.

    5. Standalone (Algorithm Only) Performance

    • Standalone Performance: Yes, the study evaluates the performance of the FEops HEARTguide software in predicting device deformation without direct human-in-the-loop assistance during the simulation process. The experts evaluate the output of the simulation.

    6. Type of Ground Truth Used

    • Quantitative Ground Truth: Actual Watchman deformation observed on post-operative cardiac CT, measured by the maximum device diameter (Dmax).
    • Qualitative Ground Truth: Geometry reconstructed from post-operative CT images, against which the simulated deployed device visualization was compared by cardiology experts.

    7. Training Set Sample Size

    • The text does not explicitly state the sample size for the training set. It mentions training, but not specific numbers for a "training set" in the context of a machine learning model. The "Model Development" section describes the creation of the computational models and material validation, but does not detail a separate training set for an AI/ML algorithm in the typical sense. It implies the model was developed based on CAD files and expansion tests from the manufacturer, and pre/post-operative CT images for material validation, but these "datasets" were not re-used in the clinical validation, suggesting they might have been part of development/training.

    8. How Ground Truth for Training Set was Established

    • As the training set size is not explicitly stated in the context of an AI/ML algorithm, the method for establishing its ground truth is also not detailed.
    • For material validation (which could be considered analogous to part of model development/training), the text states: "Material properties validation of the LAA soft tissue used in the patient-specific simulations. This was achieved using datasets consisting of pre- and post-operative CT images." This implies the "ground truth" for material properties came from the observed changes between pre- and post-operative CT images. The "Implant Device Model" validation used "expansion tests received from the manufacturer" to validate the material model based on CAD files.
    Ask a Question

    Ask a specific question about this device

    Page 1 of 1