(62 days)
Axial3D Insight is intended for use as a cloud-based service and image segmentation framework for the transfer of DICOM imaging information from a medical scanner to an output file.
The Axial3D Insight output file can be used for the fabrication of the output file using additive manufacturing methods.
The output file or physical replica can be used for treatment planning.
The output file or physical replica can be used for diagnostic purposes in the field of trauma, orthopedic, maxillofacial, and cardiovascular applications.
Axial3D Insight should be used with other diagnostic tools and expert clinical judgment.
Axial3D Insight is a secure, highly available cloud-based image processing, segmentation, and 3D modelling framework for the transfer of imaging information either as a 3D printed physical model.
Here's a breakdown of the acceptance criteria and study information for the Axial3D Insight device, based on the provided text:
Acceptance Criteria and Device Performance
| Acceptance Criteria | Reported Device Performance |
|---|---|
| Clinical Segmentation Performance (RADPEER score) | All cases scored within the acceptance criteria of 1 or 2a. |
| Intended Use Validation Study | 3D models produced by Axial3D demonstrated satisfaction of end-user needs and indications for use. |
| Phantom Testing (Origin One printer) | Reproduce required geometry to an acceptance criterion of ± 0.3mm. |
| Standalone performance of AI models | No direct acceptance criteria are stated, as AI outputs are not used in isolation. |
Note: The document states that the update to the product does not affect the current software validation, and the software portion is not being updated. Therefore, the existing validation testing from the predicate device (K222745) is considered applicable.
Study Details
Clinical Segmentation Performance Study
- Sample Size for Test Set: 12 cases.
- Data Provenance: Not explicitly stated (e.g., country of origin, retrospective/prospective).
- Number of Experts and Qualifications: 3 radiologists. No specific years of experience or subspecialty are provided, beyond being "radiologists."
- Adjudication Method: Not explicitly stated as 2+1 or 3+1. The study adopted a "peer-reviewed medical imaging review framework of RADPEER" to capture assessment and feedback.
- Multi Reader Multi Case (MRMC) Comparative Effectiveness Study: Not mentioned. This study focused on the performance of the device's segmentation, not human reader improvement with AI assistance.
- Standalone Performance Study: The output of the machine learning models is not used in isolation. The segmentations are further refined and validated by Axial3D trained staff. Therefore, a standalone performance study for the AI component (without human oversight) is not presented as the final product.
- Type of Ground Truth: Not explicitly stated, though implicitly refers to the standard of radiologists reviewing the segmentation.
- Sample Size for Training Set: Not specified for the Clinical Segmentation Performance Study.
- How Ground Truth for Training Set was Established: Not specified for the Clinical Segmentation Performance Study.
Intended Use Validation Study
- Sample Size for Test Set: 12 cases.
- Data Provenance: Not explicitly stated.
- Number of Experts and Qualifications: 9 physicians. No specific qualifications are provided beyond "physicians."
- Adjudication Method: Not explicitly stated.
- Multi Reader Multi Case (MRMC) Comparative Effectiveness Study: Not mentioned.
- Standalone Performance Study: Not applicable; this study validated the 3D models with physician review.
- Type of Ground Truth: Implicitly based on "end user needs and indications for use" as assessed by physicians.
- Sample Size for Training Set: Not specified.
- How Ground Truth for Training Set was Established: Not specified.
Axial™- Machine Learning Validation
This section describes the validation of the underlying machine learning models, which are used to generate initial segmentations, but their output is not used in isolation.
- Sample Size for Test Set (Validation Data):
- Cardiac CT/CTa: 4,838 images
- Neuro CT/CTa: 4,041 images
- Ortho CT: 10,857 images
- Trauma CT: 19,134 images
- Data Provenance: Not explicitly stated (e.g., country of origin, retrospective/prospective). However, a list of various CT scanner manufacturers and models (GE Medical Systems, Siemens, Phillips, Toshiba) indicates a diversity of acquisition sources.
- Number of Experts and Qualifications: Not mentioned for this specific validation as it focuses on model output.
- Adjudication Method: Not mentioned.
- Multi Reader Multi Case (MRMC) Comparative Effectiveness Study: Not mentioned.
- Standalone Performance Study: The document explicitly states that the "output of these models is not used in isolation to produce the final 3D patient specific model." The segmentations are "used by Axial3D trained staff who complete the final segmentation and validation." Therefore, this is not a standalone performance of the AI in a clinical workflow, but an internal validation of the AI component before human refinement.
- Type of Ground Truth: Not explicitly stated for this machine learning validation. Implicitly, it would be expertly generated ground truth for segmentation.
- Sample Size for Training Set: Not specified in the provided text, but it states that the "training data used during the algorithm development was explicitly kept separate and independent from the validation data used."
- How Ground Truth for Training Set was Established: Not specified in the provided text.
Phantom Testing (for 3D Printer Verification)
- Sample Size for Test Set: Not explicitly stated as a number of phantoms, but involves "3D test phantoms provided by the National Institute of Standards and technology (NIST)."
- Data Provenance: NIST test phantoms.
- Number of Experts and Qualifications: Not applicable, as this is a technical verification of printer accuracy.
- Adjudication Method: Not applicable.
- Multi Reader Multi Case (MRMC) Comparative Effectiveness Study: Not applicable.
- Standalone Performance Study: Not applicable.
- Type of Ground Truth: Accuracy measurements against a known NIST test phantom.
- Sample Size for Training Set: Not applicable.
- How Ground Truth for Training Set was Established: Not applicable.
§ 892.2050 Medical image management and processing system.
(a)
Identification. A medical image management and processing system is a device that provides one or more capabilities relating to the review and digital processing of medical images for the purposes of interpretation by a trained practitioner of disease detection, diagnosis, or patient management. The software components may provide advanced or complex image processing functions for image manipulation, enhancement, or quantification that are intended for use in the interpretation and analysis of medical images. Advanced image manipulation functions may include image segmentation, multimodality image registration, or 3D visualization. Complex quantitative functions may include semi-automated measurements or time-series measurements.(b)
Classification. Class II (special controls; voluntary standards—Digital Imaging and Communications in Medicine (DICOM) Std., Joint Photographic Experts Group (JPEG) Std., Society of Motion Picture and Television Engineers (SMPTE) Test Pattern).