Search Results
Found 1 results
510(k) Data Aggregation
(117 days)
a2z-Unified-Triage is a radiological computer-aided triage and notification software indicated for use in the analysis of abdominal/pelvic CT images in adults aged 22 and older. The device is intended to assist hospital networks and appropriately trained medical specialists in workflow triage by flagging and communicating suspected positive cases of the 7 specified abdominopelvic findings: Acute Cholecystitis, Acute Pancreatitis, Unruptured Abdominal Aortic Aneurysm, Acute Diverticulitis, Free Air, Hydronephrosis, and Small Bowel Obstruction. These findings are intended to be used together as one device. The device supports both cloud-based and on-premises deployment, with integration either directly with healthcare facility systems or through third-party healthcare technology platforms.
a2z-Unified-Triage uses an artificial intelligence algorithm to analyze images and flag cases with detected findings in parallel to the ongoing standard of care image interpretation. The device provides analysis results that enable client systems to generate notifications for cases with suspected findings. These results can include DICOM instance UIDs for key images, which are meant for informational purposes only and not intended for primary diagnosis beyond notification. The device does not alter the original medical image and is not intended to be used as a diagnostic device.
The results of a2z-Unified-Triage are intended to be used in conjunction with other patient information and based on clinicians' professional judgment, to assist with triage/prioritization of medical images. Notified clinicians are responsible for viewing full images per the standard of care.
a2z-Unified-Triage is a radiological computer-assisted triage and notification software device. The software consists of an algorithmic component that supports both cloud-based and on-premises deployment on standard server hardware. The device processes abdomen/pelvis CT images from clinical imaging systems, analyzing them using artificial intelligence algorithms to detect suspected cases of 7 abdominopelvic conditions: Acute Cholecystitis, Acute Pancreatitis, Unruptured Abdominal Aortic Aneurysm, Acute Diverticulitis, Free Air, Hydronephrosis, and Small Bowel Obstruction.
Following the AI processing, the analysis results are returned to the client system for worklist prioritization. When a suspected case is detected, the software provides analysis results that enable the client system to generate appropriate notifications. These results can include DICOM instance UIDs for key images, which are for informational purposes only, do not contain any marking of the findings, and are not intended for primary diagnosis beyond notification.
Integration with clinical imaging systems facilitates efficient triage by enabling prioritization of suspect cases for review of the relevant original images in the PACS. Thus, the suspect case receives attention earlier than would have been the case in the standard of care practice alone.
Here's a detailed summary of the acceptance criteria and the study proving the device meets them, based on the provided FDA clearance letter:
Acceptance Criteria and Device Performance
1. Table of Acceptance Criteria and Reported Device Performance
a2z-Unified-Triage differentiates between two types of findings for regulatory purposes: QAS (Qualitative, Automated, and Subjective) and QFM (Quantitative, Functional, and Measurable).
| Condition Type | Acceptance Criteria | Device Performance (with 95% Confidence Intervals) |
|---|---|---|
| QFM Findings | AUC > 0.95 | |
| Acute Cholecystitis | AUC > 0.95 | AUC: 0.985 [0.972-0.998] (Also provided: High Sensitivity: Se 96.1% [89.2-98.7%], Sp 89.3% [86.6-91.5%]; Sensitivity Biased: Se 92.2% [84.0-96.4%], Sp 95.8% [93.9-97.2%]; Balanced: Se 92.2% [84.0-96.4%], Sp 95.8% [93.9-97.2%]) |
| Acute Pancreatitis | AUC > 0.95 | AUC: 0.994 [0.985-1.000] (Also provided: High Sensitivity: Se 98.0% [92.9-99.4%], Sp 87.8% [84.9-90.3%]; Sensitivity Biased: Se 98.0% [92.9-99.4%], Sp 97.0% [95.3-98.1%]; Balanced: Se 98.0% [92.9-99.4%], Sp 97.0% [95.3-98.1%]; High Specificity: Se 92.9% [86.1-96.5%], Sp 99.8% [99.0-100.0%]) |
| Unruptured AAA | AUC > 0.95 | AUC: 0.995 [0.991-0.999] (Also provided: High Sensitivity: Se 100.0% [95.2-100.0%], Sp 86.3% [83.3-88.8%]; Sensitivity Biased: Se 97.4% [90.9-99.3%], Sp 95.8% [93.9-97.2%]; Balanced: Se 97.4% [90.9-99.3%], Sp 97.5% [95.9-98.5%]) |
| Acute Diverticulitis | AUC > 0.95 | AUC: 0.995 [0.990-1.000] (Also provided: High Sensitivity: Se 98.7% [92.9-99.8%], Sp 89.3% [86.6-91.5%]; Sensitivity Biased: Se 97.4% [90.9-99.3%], Sp 96.8% [95.1-98.0%]; Balanced: Se 97.4% [90.9-99.3%], Sp 96.8% [95.1-98.0%]; High Specificity: Se 94.7% [87.2-97.9%], Sp 98.7% [97.4-99.3%]) |
| Hydronephrosis | AUC > 0.95 | AUC: 0.976 [0.960-0.991] (Also provided: High Sensitivity: Se 89.7% [82.1-94.3%], Sp 92.9% [90.5-94.7%]) |
| QAS Findings | Sensitivity > 80% and Specificity > 80% | |
| Small Bowel Obstruction | Sensitivity > 80%, Specificity > 80% | High Sensitivity: Se 94.9% [88.7-97.8%], Sp 91.7% [89.1-93.7%]; Sensitivity Biased: Se 91.9% [84.9-95.8%], Sp 96.0% [94.1-97.3%]; Balanced: Se 88.9% [81.2-93.7%], Sp 98.1% [96.6-98.9%] |
| Free Air | Sensitivity > 80%, Specificity > 80% | Balanced: Se 89.3% [82.2-93.8%], Sp 88.6% [85.7-91.0%]; High Specificity: Se 88.4% [81.1-93.1%], Sp 90.8% [88.1-92.9%] |
Turnaround Time Acceptance Criteria and Performance:
| Metric | Acceptance Criteria (Implied by Predicate) | Device Performance |
|---|---|---|
| Triage Turn-around Time | Mean < 81.6 seconds (Predicate's Mean) | Mean: 58.39 seconds (95% CI: 56.11-60.68) |
| Median: 55.02 seconds | ||
| 95th percentile: 90.36 seconds |
2. Sample size used for the test set and the data provenance
- Test Set Sample Size: 675 cases from 643 unique patients (after excluding 3 cases due to quality control failures from an initial 678 cases).
- Data Provenance: The data was sourced from multiple clinical sites within the United States. Specific states mentioned are New York (45.2%), Kansas (21.2%), Missouri (18.4%), Texas (15.0%), and Nebraska (0.3%). The study evaluated against clinical standards consistent with U.S. practice patterns. The data appears to be retrospective, as it was used for development and testing after collection.
3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts
- Number of Experts: A minimum of two U.S. board-certified radiologists, with a third U.S. board-certified expert adjudicator for discordant cases.
- Qualifications: All experts were U.S. board-certified radiologists. The third adjudicator was specifically fellowship-trained in body imaging.
4. Adjudication method (e.g. 2+1, 3+1, none) for the test set
- Adjudication Method: 2+1 methodology. Each case was independently reviewed by two U.S. board-certified radiologists. If the two initial readers disagreed, a third U.S. board-certified expert adjudicator (fellowship-trained in body imaging) provided the tie-breaking determination.
5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance
- The provided document does not indicate that an MRMC comparative effectiveness study was performed or submitted for this clearance. The study described is a standalone performance assessment of the algorithm itself against ground truth.
6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done
- Yes, a standalone performance assessment was done. The document explicitly states: "A standalone performance assessment was performed for a2z-Unified-Triage to validate the accuracy of detecting the 7 findings against a reference standard established by U.S. board-certified radiologists."
7. The type of ground truth used (expert consensus, pathology, outcomes data, etc.)
- Type of Ground Truth: Expert consensus, specifically a 2+1 consensus of U.S. board-certified radiologists, with the third adjudicator being fellowship-trained in body imaging.
8. The sample size for the training set
- The document states, "The algorithms were developed on an extensive dataset of abdomen/pelvis CT studies from multiple clinical sites." However, a specific numerical sample size for the training set is not provided. It only mentions that strict protocols ensured complete independence between development and testing datasets (mutually exclusive patients).
9. How the ground truth for the training set was established
- The document does not explicitly detail how the ground truth for the training set was established. It only describes the ground truth establishment for the test set (2+1 radiologist consensus). It states that the algorithms were developed on an "extensive dataset" and implies internal processes for data collection and annotation during development.
Ask a specific question about this device
Page 1 of 1