Search Filters

Search Results

Found 2 results

510(k) Data Aggregation

    K Number
    K240062
    Device Name
    ARVIS® Shoulder
    Date Cleared
    2024-04-29

    (111 days)

    Product Code
    Regulation Number
    882.4560
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Insight Medical Systems, Inc.

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    ARVIS® Shoulder is indicated for assisting the surgeon in the positioning and alignment of implants relative to reference alignment axes and landmarks in stereotactic orthopedic surgery. The system aids the surgeon in making intraoperative measurements and locating anatomical structures of the shoulder joint based on the patient's preoperative imaging. ARVIS® Shoulder is indicated for total shoulder arthroplasty using the Enovis AltiVate implant system.

    Device Description

    ARVIS® Shoulder is a computer-controlled surgical navigation system intended to provide intra-operative measurements to the surgeon to aid in selection and positioning of orthopedic implant components. The subject device is the equivalent shoulder system of the predicate ARVIS® Surgical Navigation System used for indicated knee and hip arthroplasties. ARVIS® Shoulder combines software, electronic hardware and surgical instruments to intraoperatively track tools and locate anatomical structures based on the patient's preoperative imaging. The navigation platform uses the same electronic hardware, mounted on the surgeon's head and waist, as the predicate device. A new equivalent navigation application and a new equivalent surgical instrument set are provided to allow surgeons to navigate instruments in shoulder arthroplasty procedures. The ARVIS® Shoulder workflow involves CT based reconstruction of the patient's shoulder anatomy and preoperative planning to enable image-based navigation. The surgeon uses the plan data as guidance to navigate and help position shoulder instruments and implants. The preoperative planning platform uses Al-based automatic image segmentation and landmarking algorithms. The data used to train and test the algorithms was labeled and validated in advance by trained experts. The total data consisted of 300 CT scans (from 300 patients) acquired from candidates for shoulder joint replacement surgery. The cohort was partitioned into two disjoint subsets through random sampling, with 80% producing a training dataset and 20% constituting the test dataset. The training dataset consisted of 240 CT scans (from 240 patients). Patient ages ranged from 36 to 89 years (mean age of 70), with 46% male and 54% female. All CT scans were acquired using FDA cleared CT scanners. The navigation system is intended to be used with the Enovis AltiVate implant system. ARVIS® Shoulder displays measurements as described in Performance Claims.

    AI/ML Overview

    Here's a breakdown of the acceptance criteria and the study that proves the device meets them, based on the provided text:


    1. Table of Acceptance Criteria and Reported Device Performance

    Device: ARVIS® Shoulder
    Study Type: Validation of AI algorithms for automatic image segmentation and landmarking.

    Metric (Segmentation)Acceptance Criteria (AC)Reported Result
    Scapula Avg DSC> 0.90.981
    Scapula Avg MAD≤ 2mm0.229mm
    Scapula Avg HD≤ 5mm0.824mm
    Humerus Avg DSC> 0.90.989
    Humerus Avg MAD≤ 2mm0.352mm
    Humerus Avg HD≤ 5mm0.917mm
    Metric (Landmarking)Acceptance Criteria (AC)Reported Result
    Glenoid Center Mean ED1.79mm
    Glenoid Center SPCR95.0%
    Trigonum Mean ED1.86mm
    Trigonum SPCR95.0%
    Inferior Point Mean ED≤ 3.72mm2.11mm
    Inferior Point SPCR≥ 75%94.9%
    Medial Epicondyle Mean ED3.19mm
    Medial Epicondyle SPCR83.3%
    Lateral Epicondyle Mean ED3.29mm
    Lateral Epicondyle SPCR83.3%
    Neck Plane Position Mean ED2.01mm
    Neck Plane Position SPCR90.0%
    Neck Plane Orientation Mean AS≤ 10°8.70°
    Neck Plane Orientation SACR86.7%

    2. Sample Size and Data Provenance for Test Set

    • Sample Size: 60 CT scans (from 60 unique patients)
    • Data Provenance: The CT scans were acquired from patients who were candidates for shoulder joint replacement surgery. The scans were acquired using FDA cleared CT scanners (Toshiba, Siemens, Philips, GE Medical Systems, Canon). The specific country of origin is not specified.
    • Retrospective/Prospective: The text describes the data as having been used to train and test algorithms, and the cohort was partitioned into disjoint subsets. This suggests the data was retrospective (collected prior to the study for the purpose of algorithm development and validation).

    3. Number of Experts and Qualifications for Ground Truth

    • Number of Experts: Total of 3 experts.
      • 1 trained engineer
      • 2 orthopedic surgeons
    • Qualifications:
      • Trained Engineer: More than 2 years' experience with medical image processing.
      • Orthopedic Surgeons: Subspecialty qualifications in upper limb surgery.

    4. Adjudication Method for Test Set

    The adjudication method described is: None (single review - approval).
    The reference (ground-truth) label for each CT volume was obtained by a manual process, reviewed, and approved by the consensus of the trained engineer and the two orthopedic surgeons. This implies a single, agreed-upon ground truth rather than a process of resolving disagreements between multiple independent assessments.


    5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

    There is no mention of a Multi-Reader Multi-Case (MRMC) comparative effectiveness study being done to measure the effect of AI assistance on human readers. The validation focuses solely on the standalone performance of the AI algorithms against expert-established ground truth. Clinical testing was explicitly stated as "not required".


    6. Standalone Performance Study

    Yes, a standalone (algorithm only without human-in-the-loop performance) study was done.
    The study compared the algorithm-generated outputs for segmentation (Dice Similarity Coefficient, Mean Absolute Distance, Hausdorff Distance) and landmarking (Euclidean Distance, Angular Separation, Successful Point and Angular Classification Rates) against manually established ground truth.


    7. Type of Ground Truth Used

    The ground truth used was expert consensus.
    It was established through a manual process, reviewed, and approved by a trained engineer with medical image processing experience and two orthopedic surgeons with subspecialty qualifications in upper limb surgery.


    8. Sample Size for Training Set

    • Sample Size: 240 CT scans (from 240 unique patients)
    • Total Data Pool: 300 CT scans (80% used for training, 20% for testing).

    9. How the Ground Truth for the Training Set Was Established

    The text states that "The data used to train and test the algorithms was labelled and validated in advance by trained experts." While it details the process for the test set's ground truth, it implies a similar method was used for the training set's ground truth by "trained experts", without providing specific numbers or identical qualification details as for the test set. Given the context, it's reasonable to infer a process of expert labeling, likely by similar qualified individuals, but the exact expert composition for the training set ground truth isn't explicitly detailed with the same specificity as for the test set.

    Ask a Question

    Ask a specific question about this device

    K Number
    K203115
    Date Cleared
    2021-07-14

    (271 days)

    Product Code
    Regulation Number
    882.4560
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Insight Medical Systems Inc.

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The ARVIS Surgical Navigation System is indicated for assisting the surgeon in the positioning and alignment of implants relative to reference alignment axes and landmarks in stereotactic orthopedic surgery. The system aids the surgeon in making intraoperative measurements such as changes in leg length in Hip Arthroplasty. The system is compatible with straight acetabular impactors and with specific offset impactors, identified in the instructions for use, for which an adapter has been validated.

    Example orthopedic surgical procedures include but are not limited to:

    • Total Knee Arthroplasty
    • · Unicompartmental Knee Arthroplasty: Tibial Transverse Resection
    • · Hip Arthroplasty
    Device Description

    The ARVIS® Surgical Navigation System (ARVIS® System) is to be used by orthopedic surgeons and operating room staff who perform hip and knee arthroplasty.

    The ARVIS® System uses cameras to measure locations and angles between trackers mounted on the patient and trackers mounted on surgical instruments. By prompting the user through a procedurespecific workflow to register the reference tracker to anatomic landmarks, the ARVIS® Application Software calculates and displays positions of the instruments relative to the patient's anatomy.

    The Eyepiece Assembly contains stereo infrared (IR) tracking cameras, a color camera, a stereo display, IR illumination, and IR laser illuminator. The Eyepiece also includes a headlight. The Eyepiece communicates with the Belt Pack via a cable connection.

    The Belt Pack houses the computer module, the battery, and the power management board. The Belt Pack supplies power to the eyepiece and computer module. The computer module runs the ARVIS® Application Software.

    All system instructions, prompts, alerts, and outputs are displayed to the surgeon on the Eyepiece display. The ARVIS® System Eyepiece is worn on the surgeon's head via a surgical helmet. The ARVIS® Belt Pack is worn on the surgeon's belt or waistband. No electronic hardware is applied to the patient. The surgeon stands adjacent to the patient to operate. The ARVIS® Battery Charger is intended to be used outside the operating room.

    The ARVIS® System comprises the major elements listed in Table 1.

    ItemDescriptionPurpose
    1Eyepiece AssemblyHouses display, speakers, cameras, and other sensors.
    2Belt PackSystem power management. Houses the External Battery
    and Computer module.
    3Computer ModuleRuns the ARVIS® Application Software.
    4External BatteryRemovable/swappable. Provides power to the Eyepiece
    Assembly and the Computer module.
    5Eyepiece CableConnects Eyepiece to the Belt Pack.
    ------------------------------------------------------------------------------------------------------------------------------------------------
    6Battery Charging
    SystemCharges External Battery when system is not in use.
    Intended to be used outside the operating room.
    9Instrument SetSurgical tools, including trackers, mounts, adapters, etc.
    that are required to perform surgical procedures.
    AI/ML Overview

    The ARVIS® Surgical Navigation System has the following acceptance criteria and study data:

    1. Acceptance Criteria and Reported Device Performance

    Acceptance CriteriaReported Device Performance
    Cleaning process Validation: The ARVIS® Instruments can be adequately cleaned using the specified procedure provided in the Instructions for Use.Cleaning process Validation: The ARVIS® Instruments can be adequately cleaned using the specified procedure provided in the Instructions for Use.
    Sterilization Validation:Sterilization Validation:
    a. The ARVIS® Surgical Instruments are compatible with the necessary FDA-cleared reprocessing equipment.a. The ARVIS® Surgical Instruments are compatible with the necessary FDA-cleared reprocessing equipment.
    b. The reprocessing instructions are technically feasible for implementation by users.b. The reprocessing instructions are technically feasible for implementation by users.
    c. The sterilization process has been validated to attain a sterility assurance level (SAL) of 10-6.c. The sterilization process has been validated to attain a sterility assurance level (SAL) of 10-6.
    Software Verification and Validation Testing:Software Verification and Validation Testing:
    1) All requirements and specifications in the ARVIS® Software Requirements Specification were implemented and operate correctly.1) All requirements and specifications in the ARVIS® Software Requirements Specification were implemented and operate correctly.
    2) All Risk Mitigations to be implemented in software were implemented and operated correctly.2) All Risk Mitigations to be implemented in software were implemented and operated correctly.
    3) The software conforms with the user needs and intended uses of the ARVIS® device.3) The software conforms with the user needs and intended uses of the ARVIS® device.
    Electromagnetic Compatibility (EMC) testing: The ARVIS® System is compliant with applicable Standards for Electromagnetic Compatibility.Electromagnetic Compatibility (EMC) testing: The ARVIS® System is compliant with applicable Standards for Electromagnetic Compatibility.
    Electrical Safety testing: The ARVIS® System is compliant with applicable Standards for Electrical Safety.Electrical Safety testing: The ARVIS® System is compliant with applicable Standards for Electrical Safety.
    Safety and Performance Bench Testing: The ARVIS® System meets its performance specifications and is substantially equivalent to the predicate device performance.Safety and Performance Bench Testing: The ARVIS® System meets its performance specifications and is substantially equivalent to the predicate device performance.
    Simulated Clinical Validation Testing: The particular requirements for the specified intended use can be consistently fulfilled by the ARVIS® System, including validation of user requirements and navigation accuracy.Simulated Clinical Validation Testing: The particular requirements for the specified intended use can be consistently fulfilled by the ARVIS® System, including validation of user requirements and navigation accuracy.

    2. Sample size used for the test set and the data provenance

    The document indicates that "Simulated Clinical Validation Testing" was conducted in a "human cadaveric setting." However, it does not specify the sample size (number of cadavers or simulated cases) used for this test set, nor does it provide details on the country of origin or whether the cadaveric data was retrospective or prospective.

    3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts

    The document does not provide information on the number of experts used or their qualifications for establishing ground truth in the simulated clinical validation testing.

    4. Adjudication method for the test set

    The document does not describe any adjudication method (e.g., 2+1, 3+1) for the test set.

    5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

    The document does not mention an MRMC comparative effectiveness study or any effect size related to human reader improvement with AI assistance. The testing focused on device performance and accuracy in a simulated clinical setting.

    6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done

    The "Simulated Clinical Validation Testing" involved validating "user requirements and navigation accuracy," suggesting human interaction with the system. While the "Safety and Performance Bench Testing" also assessed the system's performance specifications, it's not explicitly stated if a standalone, algorithm-only performance evaluation without any human-in-the-loop was performed. The device is a "Surgical Navigation System" which inherently implies human-in-the-loop operation.

    7. The type of ground truth used

    For the "Simulated Clinical Validation Testing," the ground truth was likely established through precise measurements or direct observation in the human cadaveric setting to assess navigation accuracy and fulfillment of user requirements. The document does not explicitly state the specific method for establishing this ground truth (e.g., highly accurate physical measurements, known anatomical landmarks).

    8. The sample size for the training set

    The document does not provide information about a training set since no clinical testing was performed for the determination of substantial equivalence (as stated in Section 9.2). The device is a surgical navigation system, and the provided tests focus on verification and validation of its components and overall system performance rather than an AI model that would require a distinct training set.

    9. How the ground truth for the training set was established

    As no training set is mentioned or implied for an AI model, the method for establishing its ground truth is not applicable or described in this document.

    Ask a Question

    Ask a specific question about this device

    Page 1 of 1