Search Results
Found 1 results
510(k) Data Aggregation
(147 days)
ScreenPoint Medical BV
The ScreenPoint Transpara™ system is intended for use as a concurrent reading aid for physicians interpreting screening mammograms, to identify regions suspicious for breast cancer and assess their likelihood of malignancy. Output of the device includes marks placed on suspicious soft tissue lesions and suspicious calcifications; region-based scores, displayed upon the physician's query, indicating the likelihood that cancer is present in specific regions; and an overall score indicating the likelihood that cancer is present on the mammogram. Patient management decisions should not be made solely on the basis of analysis by Transpara™.
Transpara™ is a software-only device for aiding radiologists with the detection and diagnosis of breast cancer in mammograms. The product consists of a processing server and an optional viewer. The software applies algorithms for recognition of suspicious calcifications and soft tissue lesions, which are trained with large databases of biopsy proven examples of breast cancer, benign lesions and normal tissue. Processing results of Transpara™ can be transmitted to external destinations, such as medical imaging workstations or archives, using the DICOM mammography CAD SR protocol. This allows PACS workstations to implement the interface of Transpara™ in mammography reading applications.
Transpara™ automatically processes mammograms and the output of the device can be used by radiologists concurrently with the reading of mammograms. The user interface of Transpara™ has different functions:
a) Activation of computer aided detection (CAD) marks to highlight locations where the device detected suspicious calcifications or soft tissue lesions. Only the most suspicious soft tissue lesions are marked to achieve a very low false positive rate.
b) Regions can be queried using a pointer for interactive decision support. When the location of the queried region corresponds with a finding of Transpara™ a suspiciousness level of the region computed by the algorithms in the device is displayed. When Transpara™ has identified a corresponding region in another view of the same breast this corresponding region is also displayed to minimize interactions required from the user.
c) Display of the exam based Transpara™ Score which categorizes exams on a scale of 1-10 with increasing likelihood of cancer.
Transpara™ is configured as a DICOM node in a network and receives its input images from another DICOM node, such as a mammography device or a PACS archive. The image analysis unit includes machine learning components trained to detect calcifications and soft tissue lesions and a component to pre-process images in such a way that images from different vendors can be processed by the same algorithms.
1. Acceptance Criteria and Reported Device Performance:
The document primarily focuses on the clinical study's primary effectiveness endpoint, which is a significant increase in the Area Under the Receiver Operating Characteristic (AUC) curve when radiologists use Transpara™ compared to reading unaided.
Acceptance Criteria (Stated as primary effectiveness endpoint) | Reported Device Performance (mean difference) |
---|---|
Significant increase of area under the ROC (AUC) | +0.020 (95% Cl = 0.010 - 0.030, P=0.0019) |
2. Sample Size Used for the Test Set and Data Provenance:
- Sample Size: 240 cases. The study set included 100 cases with cancer, 40 false positive recalls from screening, and 100 normal exams.
- Data Provenance: Retrospectively collected digital mammograms from two clinical centers in the United States using Lorad Selenia (Hologic) and Mammomat Inspiration devices. The cases consisted of series of consecutive samples.
3. Number of Experts Used to Establish Ground Truth for the Test Set and Their Qualifications:
The document doesn't explicitly state the number of experts used to establish the ground truth for the test set that was read by the radiologists in the MRMC study. However, it does state that the device's algorithms were "trained with large databases of biopsy proven examples of breast cancer, benign lesions and normal tissue." This implies that the ground truth for the training data and potentially for the test set (at least for cancer cases) was based on biopsy results.
For the MRMC study itself, the "experts" were the radiologists, who were MQSA qualified radiologists.
4. Adjudication Method for the Test Set:
The document doesn't explicitly describe an adjudication method for establishing the final ground truth of the test set cases. However, for the MRMC study, 14 MQSA qualified radiologists read each case twice (once with and once without Transpara™), implying their consensus or the established truth of the cases was used for evaluation. The "large databases of biopsy proven examples" for training suggest pathology was a key component of ground truth.
5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study:
Yes, an MRMC comparative effectiveness study was done.
- Effect Size of Human Reader Improvement with AI vs. Without AI Assistance: Radiologists significantly improved their detection performance with Transpara™. The average AUC increased from 0.866 to 0.886, representing a mean increase of +0.020 (95% Cl = 0.010 - 0.030, P=0.0019).
- For soft tissue lesions, AUC increased from 0.886 to 0.902 (mean difference = +0.016).
- For calcifications, AUC was 0.878 unaided and 0.898 aided (mean difference = +0.020).
6. Standalone (Algorithm Only) Performance:
Yes, a standalone performance evaluation was conducted.
- Results: The standalone breast cancer detection performance of Transpara™ (AUC=0.887) approached the average performance of the clinical study radiologists when reading mammograms unaided (radiologists' AUC = 0.866).
- Compared to individual radiologists, Transpara™ had a higher AUC (range 1.5-9.3%) than eleven out of fourteen radiologists and a lower AUC (range 1.7-4.7%) than the other three.
7. Type of Ground Truth Used:
The document mentions:
- Biopsy-proven examples: This is explicitly stated for the training of the algorithms.
- Screen-detected cancers: Used in the context of the Transpara™ Score.
- False positive recalls from screening: This indicates clinical follow-up for these cases.
- The overall context of mammography suggests that pathology (from biopsies), clinical follow-up, and possibly expert consensus/review (for normal cases and false positives) were used to establish the ground truth for the cases.
8. Sample Size for the Training Set:
The document states that the algorithms were "trained with large databases of biopsy proven examples of breast cancer, benign lesions and normal tissue." However, it does not provide a specific sample size for the training set.
9. How the Ground Truth for the Training Set Was Established:
The ground truth for the training set was established using "large databases of biopsy proven examples of breast cancer, benign lesions and normal tissue." This indicates that pathological confirmation was the primary method for establishing the ground truth for training data.
Ask a specific question about this device
Page 1 of 1