K Number
K221943
Device Name
EmbedMed
Date Cleared
2023-02-01

(211 days)

Product Code
Regulation Number
888.3030
Panel
OR
Reference & Predicate Devices
AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
Intended Use

EmbedMed is intended for use as a software system and image segmentation system for the transfer of imaging information from a medical scanner such as a CT based system. The input data file is processed by the system, and the result is an output data file. This file may then be provided as digital models or used as input to an additive manufacturing portion of the system. The additive manufacturing portion of the system produces physical outputs including anatomical models and surgical guides for use in the marking of bone and/or in guiding surgical instruments in non-acute, non-joint replacing osteotomies, including the resection of bone tumors, for the appendicular skeleton. EmbedMed is also intended as a pre-operative software tool for simulating/evaluating surgical treatment options.

Device Description

EmbedMed utilizes Commercial Off-The-Shelf (COTS) software to manipulate 3D medical images to create digital and additive manufactured, patient-specific physical anatomical models and surgical guides for use in non-joint replacing orthopedic surgical procedures for the appendicular skeleton.

Imaging data files are obtained from the surgeons for treatment planning and various patient-specific products that are manufactured with biocompatible photopolymer resins using additive manufacturing (stereolithography).

AI/ML Overview

The provided FDA 510(k) clearance letter for EmbedMed focuses on demonstrating substantial equivalence to predicate devices, primarily through comparison of intended use, design, materials, and manufacturing processes, rather than detailed performance against specific acceptance criteria for an AI/algorithm-driven device.

Therefore, the document does not contain the level of detail typically found in a study proving an AI/software device meets specific acceptance criteria. Specifically, it lacks information regarding:

  • A table of acceptance criteria and reported device performance metrics (e.g., accuracy, precision for segmentation).
  • Sample sizes and provenance for test sets designed to evaluate algorithmic performance (only mentions "worst-case features" for verification and "real patient scan data" for validation without specific numbers).
  • Number of experts, their qualifications, and adjudication methods for establishing ground truth.
  • Details of MRMC comparative effectiveness studies or standalone algorithmic performance.
  • Specific types of ground truth used beyond "real patient scan data."
  • Sample size for training sets and how ground truth for training was established.

This is because EmbedMed's primary function, as described, revolves around human-guided image segmentation using COTS software and subsequent additive manufacturing of physical models and guides, rather than an automated AI algorithm making diagnostic or interpretive outputs that would necessitate such detailed performance metrics for regulatory clearance. The "image segmentation system" appears to be a tool used by trained personnel rather than an autonomous AI making critical decisions.

The document emphasizes physical output accuracy and biological safety, as well as the manufacturing process, which aligns with its classification as an orthopedic surgical planning and instrument guide system, rather than a diagnostic AI.

However, based on the limited information related to performance testing in the document, here's a summary of what can be inferred or directly stated, and what is missing:


1. A table of acceptance criteria and the reported device performance

The document does not provide a quantitative table of acceptance criteria and reported numerical performance metrics for the software's image segmentation capabilities (e.g., Dice score, Hausdorff distance for segmentation accuracy).

Instead, it states:

  • Acceptance Criteria (Implied): The physical outputs (anatomical models and surgical guides) should meet "feature and dimensional accuracy requirements" and "meet the intended use of the product and its design requirements."
  • Reported Performance: "Verification testing performed on coupons... demonstrated that the EmbedMed physical outputs meets the feature and dimensional accuracy requirements for patient-specific surgical guides and anatomical models." And "The validation testing on the EmbedMed physical outputs manufactured from real patient scan data demonstrated through simulated use testing that the system produces patient-specific outputs that meet the intended use of the product and its design requirements."

2. Sample sized used for the test set and the data provenance

  • Test Set Sample Size: Not explicitly stated. The document mentions "coupons, which were designed with the worst-case features and dimensions" for verification testing and "real patient scan data" for validation testing. No specific number of instances or patients is provided.
  • Data Provenance: Not explicitly stated (e.g., country of origin, specific hospitals). The data consists of "patient specific medical imaging files" and "real patient scan data." The document does not specify whether it was retrospective or prospective.

3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts

  • This information is not provided. Given the description of the software being used to "segment the image file" and the "digital output is then reviewed and approved by the prescribing clinician," the "ground truth" for the utility of the output seems to be clinician approval. However, for the accuracy of the segmentation itself, the ground truth establishment method is not detailed.

4. Adjudication method for the test set

  • No adjudication method is described.

5. If a multi-reader multi-case (MRMC) comparative effectiveness study was done

  • No, an MRMC comparative effectiveness study was not done. The document states: "Clinical testing was not necessary for the demonstration of substantial equivalence." This implies that the study focused on technical performance and comparison to predicate devices rather than a human-reader performance study.

6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done

  • The document implies that the "image segmentation system" works with human input/guidance ("processed by the system," "reviewed and approved by the prescribing clinician"). It focuses on the accuracy of the physical outputs derived from this process. It does not provide metrics for a standalone algorithmic performance of the segmentation software itself, independent of human review/guidance.

7. The type of ground truth used

  • For the physical outputs: The ground truth appears to be "design requirements" and "intended use of the product" as validated through "simulated use testing."
  • For the software's segmentation capabilities directly: Not explicitly defined beyond the implication that a "prescribing clinician" reviews and approves the digital output. This suggests the "ground truth" for clinical acceptability is clinician approval, not an independent, pre-established expert consensus or pathology.

8. The sample size for the training set

  • Information about a training set is not provided, as the "image segmentation system" uses "Commercial Off-The-Shelf (COTS) software." This implies it is a commercially available, established segmentation tool (Simpleware Scan IP) rather than a newly developed AI model requiring a bespoke training set.

9. How the ground truth for the training set was established

  • Not applicable/Not provided, as the software is COTS and not a newly trained AI model for which the submitter would establish a training ground truth.

§ 888.3030 Single/multiple component metallic bone fixation appliances and accessories.

(a)
Identification. Single/multiple component metallic bone fixation appliances and accessories are devices intended to be implanted consisting of one or more metallic components and their metallic fasteners. The devices contain a plate, a nail/plate combination, or a blade/plate combination that are made of alloys, such as cobalt-chromium-molybdenum, stainless steel, and titanium, that are intended to be held in position with fasteners, such as screws and nails, or bolts, nuts, and washers. These devices are used for fixation of fractures of the proximal or distal end of long bones, such as intracapsular, intertrochanteric, intercervical, supracondylar, or condylar fractures of the femur; for fusion of a joint; or for surgical procedures that involve cutting a bone. The devices may be implanted or attached through the skin so that a pulling force (traction) may be applied to the skeletal system.(b)
Classification. Class II.