(90 days)
The Laon Ortho is intended for use as a medical front-end device providing tools for management of orthodontic models, systematic inspection, detailed analysis, treatment simulation and virtual appliance design options based on 3D models of the patient's dentition before the start of an orthodontic treatment.
The use of the Laon Ortho requires the user to have the necessary training and domain knowledge in the practice of orthodontics, as well as to have received a dedicated training in the use of the software.
Laon Ortho is a PC-based software that sets up virtual orthodontics via digital impressions. It automatically segments the crown and the gum in a simple manner and provides basic model analysis to assist digital orthodontic procedures.
The provided FDA 510(k) clearance letter and summary for Laon Ortho primarily focus on demonstrating substantial equivalence to predicate devices, particularly concerning its design, functionality, and intended use. While it mentions "verification and validation (V&V) testing" and "performance test," it does not provide granular details about the specific acceptance criteria for AI performance, the study design, sample sizes, ground truth establishment methods, or expert qualifications that would typically be associated with rigorous clinical or non-clinical performance studies for AI/ML devices.
The key takeaway is that the clearance appears to be based on the equivalence of the "Automatic Simulation Mode" to the "Manual Mode" in achieving the same treatment planning, rather than a standalone AI performance study against a clinical ground truth.
Therefore, I will extract what is available and highlight what is not present given the prompt's request.
Here's the breakdown based on the provided document:
Acceptance Criteria and Device Performance for Laon Ortho
The document states: "The results of the verification and validation (V&V) testing showed that the Automatic Mode achieves the same treatment planning as the existing workflow." This implies the "acceptance criteria" for the Automatic Simulation Mode (the new feature) was equivalence to the existing manual workflow for treatment planning. However, the specific metrics for "same treatment planning" are not detailed.
1. Table of Acceptance Criteria and Reported Device Performance
| Acceptance Criteria (Implied) | Reported Device Performance |
|---|---|
| Automatic Mode achieves the "same treatment planning" as existing workflow. | "The results of the verification and validation (V&V) testing showed that the Automatic Mode achieves the same treatment planning as the existing workflow." |
| Meets all performance test criteria. | "Through the performance test, it was confirmed that Laon Ortho meets all performance test criteria and that all functions work without errors." |
Note: The document does not specify quantitative metrics (e.g., accuracy, precision, F1-score, or specific measurement deviations) for "same treatment planning" or "meets all performance test criteria."
2. Sample Size Used for the Test Set and Data Provenance
- Test Set Sample Size: Not explicitly stated. The document mentions "verification and validation (V&V) testing" and "performance test" but does not provide the number of cases or scans used for these tests.
- Data Provenance: Not explicitly stated. The company is based in South Korea, but the origin (e.g., country, specific clinics) of the data used for V&V testing is not mentioned. It also doesn't explicitly state if the data was retrospective or prospective, though performance testing often uses existing (retrospective) data.
3. Number of Experts and Their Qualifications for Ground Truth
- Number of Experts: Not explicitly stated. The document states, "The use of the Laon Ortho requires the user to have the necessary training and domain knowledge in the practice of orthodontics, as well as to have received a dedicated training in the use of the software." This refers to the user of the software, not the experts who established the ground truth for V&V.
- Qualifications of Experts: Not explicitly stated. It's highly probable that orthodontic experts were involved in evaluating if the Automatic Mode achieved "the same treatment planning," but their specific number, roles, and qualifications (e.g., years of experience, board certification) are not detailed in this summary.
4. Adjudication Method for the Test Set
- Adjudication Method: Not explicitly stated. Given the lack of detail on the "same treatment planning" assessment, the method for resolving discrepancies among evaluators (if multiple were used) is unknown from this document.
5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study
- Was an MRMC study done? No, not explicitly stated or implied. The summary explicitly notes "Clinical Test Summary: Not Applicable." This indicates that a rigorous human-in-the-loop study, such as an MRMC study comparing human readers with and without AI assistance, was not performed or submitted as part of this 510(k). The focus was on the internal equivalence of the AI-driven "Automatic Mode" to the device's own "Manual Mode."
- Effect Size: N/A, as no MRMC study was conducted.
6. Standalone (Algorithm Only) Performance Study
- Was a standalone study done? Yes, in an indirect sense, but against an internal benchmark. The "Automatic Simulation Mode" is an algorithm that performs treatment planning. The V&V testing confirmed that this algorithm's output ("Automatic Mode") aligns with the output of the "existing workflow" (presumably the manual or previously cleared aspects of the device). However, this is not a standalone study against an independent, external clinical ground truth (e.g., pathology, clinical outcomes). It's more of a functional validation against an established internal process. The document does not provide standalone quantitative performance metrics (e.g., sensitivity, specificity, accuracy) for the algorithm itself.
7. Type of Ground Truth Used
- Type of Ground Truth: The "ground truth" used for evaluating the "Automatic Simulation Mode" was its ability to achieve "the same treatment planning as the existing workflow." This implies that the accepted output or method of the "existing workflow" served as the reference. It is an internal ground truth based on the device's established manual capabilities, rather than an independent clinical ground truth like pathology, surgical findings, or long-term patient outcomes.
8. Sample Size for the Training Set
- Training Set Sample Size: Not stated. The document refers to "Software Validation" and "Performance Testing" but provides no information about the size or characteristics of the data used to train the "Automatic Simulation Mode" algorithm.
9. How the Ground Truth for the Training Set Was Established
- Ground Truth Establishment for Training: Not stated. Since the training set details are omitted, the method for establishing its ground truth is also not provided.
§ 872.5470 Orthodontic plastic bracket.
(a)
Identification. An orthodontic plastic bracket is a plastic device intended to be bonded to a tooth to apply pressure to a tooth from a flexible orthodontic wire to alter its position.(b)
Classification. Class II.