Search Results

AI-Rad Companion Organs RT is a post-processing software intended to automatically contour DICOM CT and MR pre-defined structures using deep-learning-based algorithms.

Contours that are generated by AI-Rad Companion Organs RT may be used as input for clinical workflows including external beam radiation therapy treatment planning. AI-Rad Companion Organs RT must be used in conjunction with appropriate software such as Treatment Planning Systems and Interactive Contouring applications, to review, edit, and accept contours generated by AI-Rad Companion Organs RT.

The outputs of AI-Rad Companion Organs RT are intended to be used by trained medical professionals.

The software is not intended to automatically detect or contour lesions.

AI-Rad Companion Organs RT provides automatic segmentation of pre-defined structures such as Organs-at-risk (OAR) from CT or MR medical series, prior to dosimetry planning in radiation therapy. AI-Rad Companion Organs RT is not intended to be used as a standalone diagnostic device and is not a clinical decision-making software.

CT or MR series of images serve as input for AI-Rad Companion Organs RT and are acquired as part of a typical scanner acquisition. Once processed by the AI algorithms, generated contours in DICOMRTSTRUCT format are reviewed in a confirmation window, allowing clinical user to confirm or reject the contours before sending to the target system. Optionally, the user may select to directly transfer the contours to a configurable DICOM node (e.g., the Treatment Planning System (TPS), which is the standard location for the planning of radiation therapy).

AI-Rad Companion Organs RT must be used in conjunction with appropriate software such as Treatment Planning Systems and Interactive Contouring applications, to review, edit, and accept the automatically generated contours. Then the output of AI-Rad Companion Organs RT must be reviewed and, where necessary, edited with appropriate software before accepting generated contours as input to treatment planning steps. The output of AI-Rad Companion Organs RT is intended to be used by qualified medical professionals, who can perform a complementary manual editing of the contours or add any new contours in the TPS (or any other interactive contouring application supporting DICOM-RT objects) as part of the routine clinical workflow.

Here's a breakdown of the acceptance criteria and the study that proves the device meets them, based on the provided text:

Acceptance Criteria and Device Performance Study for AI-Rad Companion Organs RT

1. Table of Acceptance Criteria and Reported Device Performance

The acceptance criteria for the AI-Rad Companion Organs RT device, particularly for the enhanced CT contouring algorithm, are based on comparing its performance to the predicate device and relevant literature/cleared devices. The primary metrics used are Dice coefficient and Absolute Symmetric Surface Distance (ASSD).

Table 3: Acceptance Criteria of AIRC Organs RT VA50

Ask a specific question about this device

DeepContour is a deep learning based medical imaging software that allows trained healthcare professionals to use DeepContour as a tool to automatically process CT images. In addition, DeepCoutour is suitable for the following conditions:

1. Creation of contours using deep-learning algorithms , support quantitative analysis, organ HU distribution statistics, transfer contour files to TPS, and create management archives for patients.
2. Analvze the anatomical structure at different anatomical positions.
3. Rigid and elastic registration based on CT.
4. 3D reconstruction, editing and other visual tools based on organ contours

DeepContour is a deep learning based medical imaging software that allows trained healthcare professionals to use DeepContour as a tool to automatically process CT images. DeepContour contouring workflow supports CT input data and produces RTSTRUCT outputs. The organ segmentation can also be combined into templates, which can be customized by different hospitals according to their needs. DeepContour provides an interactive contouring application to edit and review the contours automatically generated by DeepContour.

Here's a breakdown of the acceptance criteria and study details for the DeepContour (V1.0) device, based on the provided FDA 510(k) Summary:

Acceptance Criteria and Reported Device Performance

1. A table of acceptance criteria and the reported device performance

The document does not explicitly state "acceptance criteria" as a set of predefined quantitative thresholds the device must meet. Instead, the study's aim is to demonstrate that DeepContour's performance is equivalent to or better than the predicate devices. The primary metric used for this comparison is the Dice coefficient, and the implicit acceptance criterion is that DeepContour's performance is not significantly worse than the predicates.

The equivalence definition is stated as: "the lower bound of 95th percentile confidence interval of the subject device segmentation is greater than 0.1 Dice lower than the mean of predicate device segmentation."

Below is a table summarizing the reported Dice coefficients for DeepContour and the predicate devices for a selection of structures. It also includes the summary Average Symmetric Surface Distance (ASSD) comparison.

Table 1: Acceptance Criteria (Implicit) and Reported Device Performance

Table 5: Clinical performance comparison (Peking Union Medical College Hospital) - Selected Structures

| Structure: | DeepContour | AI-Rad CAI-Rad
Companion Organs RT
(K221305) | Contour ProtégéAI
(K223774) |
|--------------------------|---------------------|----------------------------------------------------|--------------------------------|
| Brain | 0.98±0.01(0.97) | 0.93±0.11 | 0.98 ± 0.01 |
| BrainStem | 0.91±0.03(0.89) | 0.90±0.02 | 0.82 ± 0.09 |
| Eye_L | 0.89±0.02(0.88) | 0.81±0.06 | 0.87 ± 0.06 |
| Lung_L | 0.98±0.05(0.96) | 0.92±0.16 | 0.96 ± 0.02 |
| Heart | 0.93±0.16(0.90) | 0.91±0.06 | 0.90 ± 0.07 |
| Liver | 0.96±0.07(0.95) | 0.86±0.17 | 0.93 ± 0.07 |
| Kidney_L | 0.92±0.03(0.91) | 0.82±0.13 | 0.92 ± 0.05 |
| Pancreas | 0.86±0.01(0.86) | 0.87±0.03 | 0.45 ± 0.22 |
| Bladder | 0.95±0.15(0.93) | 0.87±0.15 | 0.52 ± 0.19 |
| Prostate | 0.87±0.02(0.85) | 0.74 ± 0.12 | 0.85 ± 0.06 |
| SpinalCord | 0.93±0.01(0.92) | 0.66 ± 0.14 | 0.63±0.16 |

Table 6: Clinical performance comparison (LCTSC American public datasets) - Selected Structures

| Structure: | DeepContour | AI-Rad CAI-Rad
Companion Organs RT
(K221305) | Contour
ProtégéAI
(K223774) |
|------------|-----------------|----------------------------------------------------|-----------------------------------|
| SpinalCord | 0.92±0.02(0.91) | 0.64±0.13 | 0.62 ± 0.21 |
| Lung L | 0.97±0.15(0.96) | 0.90±0.13 | 0.95 ± 0.05 |
| Heart | 0.92±0.11(0.90) | 0.91±0.04 | 0.90 ± 0.04 |
| Esophagus | 0.89±0.13(0.86) | 0.75±0.13 | 0.68 ± 0.19 |

Table 7: Clinical performance comparison (Pancreas-CT American public datasets) - Selected Structures

| Structure: | DeepContour | AI-Rad CAI-Rad
Companion Organs RT
(K221305) | Contour
ProtégéAI
(K223774) |
|------------|-----------------|----------------------------------------------------|-----------------------------------|
| Spleen | 0.90±0.05(0.88) | 0.91±0.12 | 0.89 ± 0.08 |
| Pancreas | 0.85±0.03(0.83) | 0.84±0.02 | 0.43 ± 0.25 |
| Kidney_L | 0.93±0.02(0.91) | 0.84±0.03 | 0.92 ± 0.17 |
| Liver | 0.97±0.03(0.97) | 0.85±0.13 | 0.92 ± 0.06 |
| Stomach | 0.85±0.02(0.84) | 0.80±0.05 | 0.81 ± 0.17 |

2. Sample sized used for the test set and the data provenance (e.g. country of origin of the data, retrospective or prospective)

• Sample Size: 203 CT images.
  • 100 clinical datasets
  • 103 American public datasets (60 from LCTSC, 43 from Pancreas-CT)
• Data Provenance:
  • 100 clinical datasets: Retrospectively collected from Peking Union Medical College Hospital (China).
  • 103 American public datasets: Publicly available datasets originally from American sources.
    • 2017 Lung CT Segmentation Challenge (LCTSC): 60 thoracic CT scan patients.
    • Pancreas-CT (PCT): 43 abdominal contrast-enhanced CT scan patients.

3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g. radiologist with 10 years of experience)

• For the 100 clinical datasets (China): Two radiation oncologists with more than 10 years of clinical practice established the ground truth annotations. Their detailed CVs are in Appendix 2 (not provided in the input, but referenced).
• For the 103 American public datasets: Annotated by American doctors. (Specific qualifications not detailed in the provided text).

4. Adjudication method (e.g. 2+1, 3+1, none) for the test set

• For the 100 clinical datasets (China): The ground truth was established by two radiation oncologists. A third qualified internal staff member was available to adjudicate if needed. This implies a 2+1 adjudication method if there was disagreement.
• For the 103 American public datasets: No explicit adjudication method is mentioned, only that they were "annotated by American doctors."

5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

The provided text does not describe a Multi-Reader Multi-Case (MRMC) comparative effectiveness study involving human readers with and without AI assistance to measure improvement in human performance. The study focuses on the standalone performance of the AI algorithm (DeepContour) compared to predicate devices.

6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done

Yes, a standalone performance study was done. The entire "Performance comparison" section (Tables 5, 6, 7, and 8) details the Dice coefficients and ASSD values for the DeepContour algorithm, directly comparing its segmentation performance against the ground truth and the predicate devices. There is no human reader involved in generating the DeepContour results reported in these tables.

7. The type of ground truth used (expert consensus, pathology, outcomes data, etc)

• For the 100 clinical datasets (China): Expert consensus (two radiation oncologists applying RTOG and clinical guidelines using manual annotation, with a third available for adjudication).
• For the 103 American public datasets: Expert annotation by American doctors. (Implied expert consensus or single expert annotation from the original dataset creation process, as described by the original publications).

8. The sample size for the training set

• # of Datasets: 800 CT images.
  • 200 for head and neck region
  • 200 for chest region
  • 200 for abdomen region
  • 200 for pelvic region
  • (Out of these, 160 cases per region were used for training, and 40 cases per region for validation.)

9. How the ground truth for the training set was established

The initial segmentations were reviewed and corrected by two radiation oncologists for model training, with a third qualified internal staff member available to adjudicate if needed. This indicates an expert review and correction process, likely similar to the 2+1 adjudication method used for the test set ground truth.

Ask a specific question about this device