K Number
K212560
Date Cleared
2021-10-12

(60 days)

Product Code
Regulation Number
888.3660
Panel
OR
Reference & Predicate Devices
AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
Intended Use

The Signature™ ONE System is indicated, based on patient-specific radiological images with identifiable placement anatomical landmarks, to assist in pre-operative planning and/or intra-operative guiding of surgical instruments for shoulder replacement surgical procedures on patients not precluded from being radiologically scanned.

The Signature™ ONE System is to be used with the glenoid components of the following shoulder implant systems in accordance with their indications and contraindications: Zimmer® Trabecular Metal™ Reverse Plus Shoulder, Comprehensive® Total Shoulder System, Comprehensive® Reverse Shoulder System, Comprehensive® Reverse Augmented Baseplates and Alliance™ Glenoid System.

The Signature™ ONE Guides and bone models are intended for single use only.

Device Description

The Signature™ ONE System is developed to assist in preoperative planning of the glenoid component for Total Shoulder Arthroplasty (using the Signature™ ONE Planner) and to accurately transfer a pre-operative plan to orthopedic surgical procedures (using the Signature™ ONE Guides) if desired. Both anatomic and reverse (TSA and RSA respectively) approaches are supported.

The Signature ONE Guides and Bone Model are designed and manufactured of polyamide (nylon) using additive manufacturing (selective laser sintering), based on the approved/finalized pre-surgical plan and shipped prior to surgery. The guides and bone models are provide nonsterile and sterilized at the hospital. They are used intraoperatively to assist the surgeon in reproducing the plan. The Signature ONE System surgical technique remains close to the conventional shoulder arthroplasty to allow converting to standard surgical technique at any time if needed during the operation.

The Signature™ ONE System uses the Zimmer Biomet Drive Portal for the interaction with external users (i.e. imaging technician and the surgeon). The internal users (i.e. the Zimmer Biomet operators) use manufacturing software applications to prepare the patient cases for the surgeon.

Modifications have been made to include guides and bone models for the Alliance Glenoid System, to the planning application and user interface, and the inclusion of an additional glenosphere size for the Comprehensive Reverse Implant System within the Signature™ ONE planning software application. The overall planning process, manufacturing process, materials, sterilization methods, principal of operation, have not changed from previous predicates.

AI/ML Overview

The provided text describes a 510(k) premarket notification for the Signature™ ONE System, a device used for pre-operative planning and intra-operative guiding in shoulder replacement surgery. However, the text does not contain the specific details required to answer all parts of your request regarding acceptance criteria and a study proving the device meets those criteria.

Specifically, the document lacks a table of acceptance criteria with reported device performance metrics, sample sizes for test and training sets, details about ground truth establishment (number/qualifications of experts, adjudication methods), and information about MRMC studies or standalone algorithm performance.

The document primarily focuses on explaining the device's indications for use, its substantial equivalence to predicate devices, and the general types of testing performed (engineering analysis, performance tests, system validation, and software verification/validation).

Here's what can be extracted and what is missing based on your prompt:

1. A table of acceptance criteria and the reported device performance:

  • Missing. The document states that "Performance Tests- Design verification tests were O documented to ensure the performance of the implemented features and verify related design inputs" but does not provide specific acceptance criteria or the measured performance outcomes.

2. Sample sizes used for the test set and the data provenance (e.g. country of origin of the data, retrospective or prospective):

  • Missing sample size for the test set.
  • Missing data provenance details. The document mentions "Cadaveric validation performed" but doesn't specify the number of cadavers or their origin. It also doesn't specify if other data used for software testing was retrospective or prospective, or its geographic origin.

3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g. radiologist with 10 years of experience):

  • Missing. The document does not describe how ground truth was established for any performance testing, nor does it mention the involvement of experts in defining a gold standard.

4. Adjudication method (e.g. 2+1, 3+1, none) for the test set:

  • Missing. No information on adjudication methods for establishing ground truth is provided.

5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:

  • Missing. The document does not mention any MRMC studies or comparative effectiveness studies involving human readers with and without AI assistance. The device is described as assisting in planning and guiding, implying human interaction, but no such study details are provided.

6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done:

  • Implicitly yes, partially, but no metrics are provided. The software verification and validation would involve algorithm-only testing to ensure its functionality. However, specific standalone performance metrics (e.g., accuracy of anatomical landmark identification by the algorithm alone) are not reported. The device's function is to "assist" which suggests a human-in-the-loop system.

7. The type of ground truth used (expert consensus, pathology, outcomes data, etc):

  • Not explicitly stated. For the "Cadaveric validation," the ground truth would likely be based on physical measurements or surgical outcomes on the cadavers, but this is not detailed. For software testing, the ground truth for image processing tasks would typically be pre-annotated data, but the source or method of annotation is not mentioned.

8. The sample size for the training set:

  • Missing. The document does not provide any information about a training set since it focuses on verification and validation of a cleared device, not the development or training phase of an AI model per se. While the device has "planning application" and "user interface" modifications, and "overall workflow remains unchanged from the predicate devices," it isn't explicitly stated that a "training set" in the machine learning sense was used for this particular submission.

9. How the ground truth for the training set was established:

  • Missing. As no training set information is provided, no details on how its ground truth was established are present.

In summary, the provided document is a regulatory approval letter and a summary of the 510(k) submission, confirming substantial equivalence. It outlines the device's purpose and general testing activities but does not delve into the detailed performance study methodology, acceptance criteria, and specific results you've requested for an AI/ML device. This level of detail is often found in the full 510(k) submission or associated study reports, which are typically not included in the public-facing FDA clearance letter.

§ 888.3660 Shoulder joint metal/polymer semi-constrained cemented prosthesis.

(a)
Identification. A shoulder joint metal/polymer semi-constrained cemented prosthesis is a device intended to be implanted to replace a shoulder joint. The device limits translation and rotation in one or more planes via the geometry of its articulating surfaces. It has no linkage across-the-joint. This generic type of device includes prostheses that have a humeral resurfacing component made of alloys, such as cobalt-chromium-molybdenum, and a glenoid resurfacing component made of ultra-high molecular weight polyethylene, and is limited to those prostheses intended for use with bone cement (§ 888.3027).(b)
Classification. Class II. The special controls for this device are:(1) FDA's:
(i) “Use of International Standard ISO 10993 ‘Biological Evaluation of Medical Devices—Part I: Evaluation and Testing,’ ”
(ii) “510(k) Sterility Review Guidance of 2/12/90 (K90-1),”
(iii) “Guidance Document for Testing Orthopedic Implants with Modified Metallic Surfaces Apposing Bone or Bone Cement,”
(iv) “Guidance Document for the Preparation of Premarket Notification (510(k)) Application for Orthopedic Devices,” and
(v) “Guidance Document for Testing Non-articulating, ‘Mechanically Locked’ Modular Implant Components,”
(2) International Organization for Standardization's (ISO):
(i) ISO 5832-3:1996 “Implants for Surgery—Metallic Materials—Part 3: Wrought Titanium 6-aluminum 4-vandium Alloy,”
(ii) ISO 5832-4:1996 “Implants for Surgery—Metallic Materials—Part 4: Cobalt-chromium-molybdenum casting alloy,”
(iii) ISO 5832-12:1996 “Implants for Surgery—Metallic Materials—Part 12: Wrought Cobalt-chromium-molybdenum alloy,”
(iv) ISO 5833:1992 “Implants for Surgery—Acrylic Resin Cements,”
(v) ISO 5834-2:1998 “Implants for Surgery—Ultra-high Molecular Weight Polyethylene—Part 2: Moulded Forms,”
(vi) ISO 6018:1987 “Orthopaedic Implants—General Requirements for Marking, Packaging, and Labeling,” and
(vii) ISO 9001:1994 “Quality Systems—Model for Quality Assurance in Design/Development, Production, Installation, and Servicing,” and
(3) American Society for Testing and Materials':
(i) F 75-92 “Specification for Cast Cobalt-28 Chromium-6 Molybdenum Alloy for Surgical Implant Material,”
(ii) F 648-98 “Specification for Ultra-High-Molecular-Weight Polyethylene Powder and Fabricated Form for Surgical Implants,”
(iii) F 799-96 “Specification for Cobalt-28 Chromium-6 Molybdenum Alloy Forgings for Surgical Implants,”
(iv) F 1044-95 “Test Method for Shear Testing of Porous Metal Coatings,”
(v) F 1108-97 “Specification for Titanium-6 Aluminum-4 Vanadium Alloy Castings for Surgical Implants,”
(vi) F 1147-95 “Test Method for Tension Testing of Porous Metal,”
(vii) F 1378-97 “Standard Specification for Shoulder Prosthesis,” and
(viii) F 1537-94 “Specification for Wrought Cobalt-28 Chromium-6 Molybdenum Alloy for Surgical Implants.”