Search Results

The Signature™ ONE System is indicated, based on patient-specific radiological images with identifiable placement anatomical landmarks, to assist in pre-operative planning and/or intra-operative guiding of surgical instruments for shoulder replacement surgical procedures on patients not precluded from being radiologically scanned.

The Signature™ ONE System is designed for use on a skeletally mature patient population. The targeted population has the same characteristics as the population that is suitable for the implants compatible with the Signature™ ONE System.

The Signature™ ONE System is to be used with the glenoid components of the following shoulder implant systems in accordance with their indications and contraindications: Zimmer® Trabecular Metal Reverse Plus® Shoulder, Comprehensive® Total Shoulder System, Comprehensive® Reverse Shoulder System, Comprehensive® Reverse Augmented Baseplates and Alliance® Glenoid System.

The Signature™ ONE System pre-operative planning is also compatible with the humeral components of the following shoulder implant systems in accordance with their indications and contraindications: Comprehensive® Total Shoulder System, Comprehensive® Reverse Shoulder System, and Identity™ Shoulder System.

The Signature™ ONE System Guides and bone models are intended for single use only.

The Signature™ ONE System is developed to assist in preoperative planning (using the Signature™ ONE Planner) and to accurately transfer a pre-operative plan to orthopedic surgical procedures (using the Signature™ ONE Guides and bone model) if desired in skeletally mature individuals for Total Shoulder Arthroplasty. Both anatomic and reverse (TSA and RSA respectively) approaches are supported.

The Signature ONE Guides and Bone Models are designed and manufactured of polyamide (nylon) using additive manufacturing selective laser sintering (SLS), based on the approved/finalized pre-surgical plan and shipped prior to surgery. The guides and bone models are provided non-sterile and sterilized at the hospital. They are used intra-operatively to assist the surgeon in reproducing the plan on the scapula. The Signature ONE System surgical technique remains close to the conventional shoulder arthroplasty workflow.

The Signature™ ONE System uses a Non-Device Medical Device Data System (MDDS) called the Zimmer Biomet Portal for the interaction with external users (i.e. imaging technician and the surgeon). The internal users (i.e. the Zimmer Biomet operators) use manufacturing software applications to prepare the patient cases for the surgeon.

The purpose of the submission is that the CT Reconstruction internal software application was updated with an improved AI/ML locked model for automatic segmentation and also retraining the model with new production grade scapula and humerus CT segmentations. The AI/ML model is used in the Segmentation step only within the CT Reconstruction internal software application prior to manual segmentation performed by the Zimmer Biomet operator. The use of AI has not changed since predicate K232425. In addition, the Landmarking step within the internal software application was updated with option to select additional configurable landmarks in the Planning application (used to determine the reference coordinate systems to provide native bone information).

The provided FDA 510(k) clearance letter for the Signature™ ONE System does not contain a detailed study with specific acceptance criteria, reported performance, or comprehensive information about the data used for testing and training. This document focuses on demonstrating substantial equivalence to a predicate device, K232425 Signature™ ONE System.

The information regarding acceptance criteria and the study that proves the device meets them is very limited in this document. The submission states that "Performance tests documented to ensure the performance of the implemented features and verify related design inputs" were conducted, but does not provide details of these tests or their results.

Here's an attempt to extract and infer the requested information based on the provided text, highlighting what is missing:

Acceptance Criteria and Device Performance Study for Signature™ ONE System (AI/ML Segmentation Update)

1. Table of Acceptance Criteria and Reported Device Performance

2. Sample Size Used for the Test Set and Data Provenance

• Sample Size for Test Set: Not specified. The document mentions the AI/ML model was "retrained with new production grade scapula and humerus CT segmentations" and previous "humerus scans were exploratory quality." This implies a test set was used to establish the "new production grade" status, but the exact size is not provided.
• Data Provenance: Not specified. It only mentions "production grade scapula and humerus CT segmentations." The country of origin and whether the data is retrospective or prospective are not mentioned.

3. Number of Experts Used to Establish Ground Truth for the Test Set and Their Qualifications

• Number of Experts: Not specified.
• Qualifications of Experts: Not specified.

4. Adjudication Method for the Test Set

• Adjudication Method: Not specified.

5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

• Was an MRMC study done? No, the document does not mention an MRMC comparative effectiveness study where human readers improve with AI vs. without AI assistance. The AI/ML model is described as assisting "prior to manual segmentation performed by the Zimmer Biomet operator," implying an assistive role, but no comparative study is detailed.

6. Standalone (Algorithm Only Without Human-in-the-Loop Performance) Study

• Was a standalone study done? Not explicitly stated as a standalone "study." The language "used in the Segmentation step only (...) prior to manual segmentation" suggests the AI performs segmentation independently before human review/modification, but its standalone performance metrics are not provided. The overall system is described as having manual segmentation by an operator after the AI step.

7. Type of Ground Truth Used

• Type of Ground Truth: The document refers to "new production grade scapula and humerus CT segmentations." This implies that the ground truth for segmentation was established by expert review and/or manual segmentation deemed as high quality (i.e., "production grade"). It does not specify if this was expert consensus, pathology, or outcomes data.

8. Sample Size for the Training Set

• Sample Size for Training Set: Not specified. The document states the model was "retrained with new production grade scapula and humerus CT segmentations." The size of this new training set is not provided.

9. How the Ground Truth for the Training Set Was Established

• How Ground Truth Was Established: The ground truth for the training set was established through "production grade scapula and humerus CT segmentations." This suggests that human experts (likely trained Zimmer Biomet operators or clinicians) performed manual segmentations that were then refined and verified to a high standard, serving as the ground truth for training the AI/ML model.

Ask a specific question about this device

The Signature™ ONE System is indicated, based on patient-specific radiological images with identifiable placement anatomical landmarks, to assist in pre-operative planning and/or intra-operative guiding of surgical instruments for shoulder replacement surgical procedures on patients not precluded from being radiologically scanned.

The Signature™ ONE System is designed for use on a skeletally mature patient population. The targeted population has the same characteristics as the population that is suitable for the implants compatible with the Signature™ ONE System.

The Signature™ ONE System is to be used with the glenoid components of the following shoulder implant systems in accordance with their indications: Zimmer® Trabecular Metal Reverse Plus® Shoulder. Comprehensive® Total Shoulder System, Comprehensive® Reverse Shoulder System, Comprehensive® Reverse Augmented Baseplates and Alliance® Glenoid System.

The Signature™ ONE System pre-operative planning is also compatible with the humeral components of the following shoulder implant systems in accordance with their indications: Comprehensive® Total Shoulder System, Comprehensive® Reverse Shoulder System, and Identity™ Shoulder System.

The Signature™ ONE System Guides and bone models are intended for single use only.

The Signature™ ONE System is developed to assist in preoperative planning (using the Signature™ ONE Planner) and to accurately transfer a pre-operative plan to orthopedic surgical procedures (using the Signature™ ONE Guides and bone model) if desired in skeletally mature individuals for Total Shoulder Arthroplasty. Both anatomic and reverse (TSA and RSA respectively) approaches are supported.

The Signature ONE Guides and Bone Models are designed and manufactured of polyamide (nylon) using additive manufacturing selective laser sintering (SLS), based on the approved/finalized pre-surgical plan and shipped prior to surgery. The guides and bone models are provided nonsterile and sterilized at the hospital. They are used intraoperatively to assist the surgeon in reproducing the plan on the scapula. The Signature ONE System surgical technique remains close to the conventional shoulder arthroplasty workflow.

The Signature™ ONE System uses a Non-Device Medical Device Data System (MDDS) called the Zimmer Biomet Portal for the interaction with external users (i.e. imaging technician and the surgeon). The internal users (i.e. the Zimmer Biomet operators) use manufacturing software applications to prepare the patient cases for the surgeon.

The purpose of this submission is to introduce new hardware kits for the existing compatible Comprehensive Reverse Augment implants and to include the addition of pre-operative planning of humeral components. A Rotational Guide component will be available as part of these two kits. Modifications have been made to the software applications to accommodate the new guide ordering option. The overall manufacturing process, materials, sterilization methods, have not changed from the previous primary predicate and principal of operation remains similar.

The provided text does not contain detailed acceptance criteria or a comprehensive study report with the specific performance metrics typically found in such documents. The "Summary of Performance Data (Nonclinical and/or Clinical)" section is quite generic, listing categories of tests rather than specific results or acceptance criteria.

Therefore, I cannot fulfill all components of your request with the information provided. However, I can extract what is available and highlight what is missing.

Here's a summary of the available information and what is absent:

Missing Information:

• Specific Acceptance Criteria and Reported Device Performance (Table): The document lists categories of tests (Performance Tests, Engineering Analysis, Usability Engineering, Validation, Software V&V) but does not provide quantitative acceptance criteria (e.g., accuracy thresholds, precision targets) or the actual reported performance values for the device against these criteria.
• Sample size for the test set and data provenance: The document mentions "Verification and Validation Testing" but does not specify the number of cases or subjects in the test set, nor the country of origin or whether the data was retrospective or prospective.
• Number of experts used to establish ground truth and their qualifications: No information is provided about the experts involved in establishing ground truth for any test sets.
• Adjudication method for the test set: No information is provided regarding adjudication methods.
• Multi-reader multi-case (MRMC) comparative effectiveness study: The document does not mention an MRMC study or any results regarding human reader improvement with AI assistance.
• Standalone (algorithm-only) performance: While software verification and validation are mentioned, specific standalone performance metrics (e.g., sensitivity, specificity, accuracy) for the algorithm are not provided.
• Type of ground truth used: The description of "Validation... to validate related user needs, intended use and safety and effectiveness" is generic and does not specify how ground truth was established (e.g., expert consensus, pathology, outcome data).
• Sample size for the training set: There is no mention of a training set or its size.
• How the ground truth for the training set was established: Since a training set is not mentioned, the method for establishing its ground truth is also not provided.

Available Information (Indirectly related to performance):

The document primarily focuses on establishing substantial equivalence to a predicate device (K212560 and K211359) by demonstrating that the new device, the Signature™ ONE System, does not raise new questions of safety or effectiveness despite new features.

The performance data mentioned in the document is categorized as:

• Device Performance Testing:
  • Performance Tests: Documented to ensure performance of implemented features and verify related design inputs.
  • Engineering Analysis: Documented to ensure performance of implemented features and verify related design inputs.
  • Usability Engineering: Performance of the system in regards to human factors engineering.
  • Validation: Performed to validate related user needs, intended use, and safety and effectiveness.
• Software Verification and Validation Testing: Conducted to satisfy requirements of the "Content of Premarket Submissions for Device Software Functions Guidance" and IEC 62304. This testing aims to demonstrate the system "does not raise any new issues of safety and effectiveness as compared to the predicate devices."

Conclusion from the document:

The conclusion drawn by the submitter is that "any differences between the subject and predicate devices do not raise different questions of safety and effectiveness and the proposed device is at least as safe and effective as the legally marketed predicate devices." This implies that the performance data (though not detailed here) was sufficient to demonstrate this equivalence.

Ask a specific question about this device

The Signature™ ONE System is indicated, based on patient-specific radiological images with identifiable placement anatomical landmarks, to assist in pre-operative planning and/or intra-operative guiding of surgical instruments for shoulder replacement surgical procedures on patients not precluded from being radiologically scanned.

The Signature™ ONE System is to be used with the glenoid components of the following shoulder implant systems in accordance with their indications and contraindications: Zimmer® Trabecular Metal™ Reverse Plus Shoulder, Comprehensive® Total Shoulder System, Comprehensive® Reverse Shoulder System, Comprehensive® Reverse Augmented Baseplates and Alliance™ Glenoid System.

The Signature™ ONE Guides and bone models are intended for single use only.

The Signature™ ONE System is developed to assist in preoperative planning of the glenoid component for Total Shoulder Arthroplasty (using the Signature™ ONE Planner) and to accurately transfer a pre-operative plan to orthopedic surgical procedures (using the Signature™ ONE Guides) if desired. Both anatomic and reverse (TSA and RSA respectively) approaches are supported.

The Signature ONE Guides and Bone Model are designed and manufactured of polyamide (nylon) using additive manufacturing (selective laser sintering), based on the approved/finalized pre-surgical plan and shipped prior to surgery. The guides and bone models are provide nonsterile and sterilized at the hospital. They are used intraoperatively to assist the surgeon in reproducing the plan. The Signature ONE System surgical technique remains close to the conventional shoulder arthroplasty to allow converting to standard surgical technique at any time if needed during the operation.

The Signature™ ONE System uses the Zimmer Biomet Drive Portal for the interaction with external users (i.e. imaging technician and the surgeon). The internal users (i.e. the Zimmer Biomet operators) use manufacturing software applications to prepare the patient cases for the surgeon.

Modifications have been made to include guides and bone models for the Alliance Glenoid System, to the planning application and user interface, and the inclusion of an additional glenosphere size for the Comprehensive Reverse Implant System within the Signature™ ONE planning software application. The overall planning process, manufacturing process, materials, sterilization methods, principal of operation, have not changed from previous predicates.

The provided text describes a 510(k) premarket notification for the Signature™ ONE System, a device used for pre-operative planning and intra-operative guiding in shoulder replacement surgery. However, the text does not contain the specific details required to answer all parts of your request regarding acceptance criteria and a study proving the device meets those criteria.

Specifically, the document lacks a table of acceptance criteria with reported device performance metrics, sample sizes for test and training sets, details about ground truth establishment (number/qualifications of experts, adjudication methods), and information about MRMC studies or standalone algorithm performance.

The document primarily focuses on explaining the device's indications for use, its substantial equivalence to predicate devices, and the general types of testing performed (engineering analysis, performance tests, system validation, and software verification/validation).

Here's what can be extracted and what is missing based on your prompt:

1. A table of acceptance criteria and the reported device performance:

• Missing. The document states that "Performance Tests- Design verification tests were O documented to ensure the performance of the implemented features and verify related design inputs" but does not provide specific acceptance criteria or the measured performance outcomes.

2. Sample sizes used for the test set and the data provenance (e.g. country of origin of the data, retrospective or prospective):

• Missing sample size for the test set.
• Missing data provenance details. The document mentions "Cadaveric validation performed" but doesn't specify the number of cadavers or their origin. It also doesn't specify if other data used for software testing was retrospective or prospective, or its geographic origin.

3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g. radiologist with 10 years of experience):

• Missing. The document does not describe how ground truth was established for any performance testing, nor does it mention the involvement of experts in defining a gold standard.

4. Adjudication method (e.g. 2+1, 3+1, none) for the test set:

• Missing. No information on adjudication methods for establishing ground truth is provided.

5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:

• Missing. The document does not mention any MRMC studies or comparative effectiveness studies involving human readers with and without AI assistance. The device is described as assisting in planning and guiding, implying human interaction, but no such study details are provided.

6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done:

• Implicitly yes, partially, but no metrics are provided. The software verification and validation would involve algorithm-only testing to ensure its functionality. However, specific standalone performance metrics (e.g., accuracy of anatomical landmark identification by the algorithm alone) are not reported. The device's function is to "assist" which suggests a human-in-the-loop system.

7. The type of ground truth used (expert consensus, pathology, outcomes data, etc):

• Not explicitly stated. For the "Cadaveric validation," the ground truth would likely be based on physical measurements or surgical outcomes on the cadavers, but this is not detailed. For software testing, the ground truth for image processing tasks would typically be pre-annotated data, but the source or method of annotation is not mentioned.

8. The sample size for the training set:

• Missing. The document does not provide any information about a training set since it focuses on verification and validation of a cleared device, not the development or training phase of an AI model per se. While the device has "planning application" and "user interface" modifications, and "overall workflow remains unchanged from the predicate devices," it isn't explicitly stated that a "training set" in the machine learning sense was used for this particular submission.

9. How the ground truth for the training set was established:

• Missing. As no training set information is provided, no details on how its ground truth was established are present.

In summary, the provided document is a regulatory approval letter and a summary of the 510(k) submission, confirming substantial equivalence. It outlines the device's purpose and general testing activities but does not delve into the detailed performance study methodology, acceptance criteria, and specific results you've requested for an AI/ML device. This level of detail is often found in the full 510(k) submission or associated study reports, which are typically not included in the public-facing FDA clearance letter.

Ask a specific question about this device