AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
Intended Use

Hardware:
The Materialise Shoulder Guide and Models are intended to be used as a surgical instrument to assist in the intraoperative positioning of glenoid components used with total and reverse shoulder arthroplasty by referencing anatomic landmarks of the shoulder that are identifiable on preoperative CT-imaging scans.

The Materialise Shoulder Guide and Models are single use only.

The Materialise Shoulder Guide and Models can be used in conjunction with the following total and reverse shoulder implants systems and their respective compatible components:

Software:
SurgiCase Shoulder Planner is intended to be used as a pre-surgical planner for simulation of surgical interventions for shoulder orthopedic surgery. The software is used to assist in the positioning of shoulder components. SurgiCase Shoulder Planner allows the surgeon to visualize, measure, reconstruct, annotate and edit pre-surgical plan data. The software leads to the generation of a surgery report along with a pre-surgical plan data file which can be used as input data to design the Materialise Shoulder Guide and Models.

Device Description

Materialise Shoulder System™ is a patient-specific medical device that is designed to be used to assist the surgeon in the placement of shoulder components during total anatomic and reverse shoulder replacement surgery. This can be done by generating a pre-surgical shoulder plan and, if requested by the surgeon, by manufacturing a patient-specific glenoid guide and models to transfer the glenoid plan to surgery. The device is a system composed of the following:

  • a software component, branded as SurgiCase Shoulder Planner. This software is a planning tool used . to generate a pre-surgical plan for a specific patient.
  • Materialise Shoulder Guide and Models, which are a patient-specific quide and models that are based ● on a pre-surgical plan. This pre-surgical plan is generated using the software component. Patientspecific glenoid guide and models will be manufactured if the surgeon requests patient-specific guides to transfer the glenoid plan to surgery. The Materialise Shoulder Guide is designed and manufactured to fit the anatomy of a specific patient. A bone model of the scapula is delivered with the Materialise Shoulder Guide. A graft model can be delivered with the Materialise Shoulder Guide. The graft model visualizes the graft-space between implant and bone, based on the pre-operative planning of the surgeon. The graft model serves as a visual reference for the surgeon in the OR.
AI/ML Overview

The provided FDA 510(k) summary (K242813) for the Materialise Shoulder System™ describes a submission seeking substantial equivalence to a previously cleared device (K241143). This submission is primarily for adding compatibility with new implant components rather than introducing a completely new AI capability or significant software change that would necessitate extensive new performance data. Therefore, the document does not contain the detailed information typically found in a study proving a device meets acceptance criteria for an AI/ML product.

Specifically, the document states:

  • "The non-clinical performance data has demonstrated that the subject software technological differences between the subject and predicate devices do not raise any different questions of safety and effectiveness." (Page 9)
  • "Software verification and validation were performed, and documentation was provided following the 'Guidance for the Content of Premarket Submissions for Software Contained in Medical Devices.' This includes verification against defined requirements, and validation against user needs." (Page 10)
  • "Previous testing for biocompatibility, sterility, cleaning, debris, dimensional stability and packaging are applicable to the subject device. Testing verified that the accuracy and performance of the system is adequate to perform as intended. The stability of the device placement, surgical technique, intended use and functional elements of the subject device are the same as that of the predicate device of Materialise Shoulder System™ K241143 and previously cleared devices... therefore previous simulated surgeries using rapid prototyped bone models and previous cadaver testing on previously cleared devices K153602 and K131559 are considered applicable to the subject device." (Page 10)

Given this, I cannot provide detailed answers to many of your questions as the submission relies on the substantial equivalence principle and prior testing rather than new, extensive performance studies for AI/ML.

However, I can extract what is available:

1. A table of acceptance criteria and the reported device performance

The document does not provide a specific table of quantitative acceptance criteria and reported device performance for the current submission (K242813), as it relies on the previous clearance and the assessment that the changes (adding implant compatibility) do not raise new safety or effectiveness concerns.

The general acceptance criterion mentioned is that the "accuracy and performance of the system is adequate to perform as intended." This was verified through previous testing, including "simulated surgeries using rapid prototyped bone models and previous cadaver testing."

2. Sample size used for the test set and the data provenance (e.g. country of origin of the data, retrospective or prospective)

The document mentions "previous simulated surgeries using rapid prototyped bone models and previous cadaver testing on previously cleared devices K153602 and K131559." It does not specify the sample size for these tests, nor the country of origin of the data or whether it was retrospective or prospective.

3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g. radiologist with 10 years of experience)

This information is not provided in the document.

4. Adjudication method (e.g. 2+1, 3+1, none) for the test set

This information is not provided in the document.

5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

No such MRMC study is mentioned. The device is a "pre-surgical planner" and "surgical instrument" designed to assist the surgeon, but the provided text does not detail comparative effectiveness studies of human readers (surgeons) with and without the AI (planning software) assistance.

6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done

The software (SurgiCase Shoulder Planner) generates a pre-surgical plan which the "qualified surgeon" can "visualize, measure, reconstruct, annotate, edit and approve" (Page 9). This indicates a human-in-the-loop process. Standalone performance of the algorithm without human interaction is not discussed as it's not the intended use.

7. The type of ground truth used (expert consensus, pathology, outcomes data, etc)

The document generally refers to "verification against defined requirements, and validation against user needs" and "accuracy and performance of the system is adequate to perform as intended" based on "simulated surgeries using rapid prototyped bone models and previous cadaver testing." This suggests a ground truth established through expert-defined surgical planning parameters and comparison to physical outcomes in the simulated/cadaveric environment, but specifics on how this ground truth was formalized (e.g., expert consensus on optimal planning, precise measurement validation) are not detailed.

8. The sample size for the training set

This device is a surgical planning tool and guides, not a deep learning AI model that requires a "training set" in the conventional sense for image classification or similar tasks. It is based on algorithms that process CT-imaging scans and anatomical landmarks to generate personalized plans and guides. Therefore, the concept of a "training set" for AI/ML is not applicable here in the way it would be for a pattern recognition AI. The software's robustness and accuracy are likely validated through extensive testing against various patient anatomies and surgical scenarios.

9. How the ground truth for the training set was established

As explained above, the concept of a training set as typically understood for AI/ML models is not directly applicable to this device based on the provided information.

§ 888.3660 Shoulder joint metal/polymer semi-constrained cemented prosthesis.

(a)
Identification. A shoulder joint metal/polymer semi-constrained cemented prosthesis is a device intended to be implanted to replace a shoulder joint. The device limits translation and rotation in one or more planes via the geometry of its articulating surfaces. It has no linkage across-the-joint. This generic type of device includes prostheses that have a humeral resurfacing component made of alloys, such as cobalt-chromium-molybdenum, and a glenoid resurfacing component made of ultra-high molecular weight polyethylene, and is limited to those prostheses intended for use with bone cement (§ 888.3027).(b)
Classification. Class II. The special controls for this device are:(1) FDA's:
(i) “Use of International Standard ISO 10993 ‘Biological Evaluation of Medical Devices—Part I: Evaluation and Testing,’ ”
(ii) “510(k) Sterility Review Guidance of 2/12/90 (K90-1),”
(iii) “Guidance Document for Testing Orthopedic Implants with Modified Metallic Surfaces Apposing Bone or Bone Cement,”
(iv) “Guidance Document for the Preparation of Premarket Notification (510(k)) Application for Orthopedic Devices,” and
(v) “Guidance Document for Testing Non-articulating, ‘Mechanically Locked’ Modular Implant Components,”
(2) International Organization for Standardization's (ISO):
(i) ISO 5832-3:1996 “Implants for Surgery—Metallic Materials—Part 3: Wrought Titanium 6-aluminum 4-vandium Alloy,”
(ii) ISO 5832-4:1996 “Implants for Surgery—Metallic Materials—Part 4: Cobalt-chromium-molybdenum casting alloy,”
(iii) ISO 5832-12:1996 “Implants for Surgery—Metallic Materials—Part 12: Wrought Cobalt-chromium-molybdenum alloy,”
(iv) ISO 5833:1992 “Implants for Surgery—Acrylic Resin Cements,”
(v) ISO 5834-2:1998 “Implants for Surgery—Ultra-high Molecular Weight Polyethylene—Part 2: Moulded Forms,”
(vi) ISO 6018:1987 “Orthopaedic Implants—General Requirements for Marking, Packaging, and Labeling,” and
(vii) ISO 9001:1994 “Quality Systems—Model for Quality Assurance in Design/Development, Production, Installation, and Servicing,” and
(3) American Society for Testing and Materials':
(i) F 75-92 “Specification for Cast Cobalt-28 Chromium-6 Molybdenum Alloy for Surgical Implant Material,”
(ii) F 648-98 “Specification for Ultra-High-Molecular-Weight Polyethylene Powder and Fabricated Form for Surgical Implants,”
(iii) F 799-96 “Specification for Cobalt-28 Chromium-6 Molybdenum Alloy Forgings for Surgical Implants,”
(iv) F 1044-95 “Test Method for Shear Testing of Porous Metal Coatings,”
(v) F 1108-97 “Specification for Titanium-6 Aluminum-4 Vanadium Alloy Castings for Surgical Implants,”
(vi) F 1147-95 “Test Method for Tension Testing of Porous Metal,”
(vii) F 1378-97 “Standard Specification for Shoulder Prosthesis,” and
(viii) F 1537-94 “Specification for Wrought Cobalt-28 Chromium-6 Molybdenum Alloy for Surgical Implants.”