Search Results
Found 2 results
510(k) Data Aggregation
(24 days)
The BrightHeart View Classifier device is intended to analyze fetal 2D ultrasound images and video clips using machine learning techniques to automatically detect standard views during fetal heart scanning.
The BrightHeart View Classifier device is intended to be used as an adjunct to the acquisition and interpretation of fetal anatomic ultrasound examinations at the second or third trimester of pregnancy performed with transabdominal probes.
BrightHeart View Classifier is a cloud-based software-only device which uses artificial intelligence (AI) to detect standard views during fetal heart scanning in fetal ultrasound images and video clips.
BrightHeart View Classifier is intended to be used by qualified, trained healthcare professional personnel in a professional prenatal ultrasound (US) imaging environment (this includes sonographers, MFMs, OB/GYN, and Fetal surgeons), to help fetal ultrasound examination acquisition and interpretation of 2D grayscale ultrasound by providing automatic classification of video clips and images into standard views, by automatically extracting example frames of standard views from video clips, and by automatically assessing whether the documentation of each standard view in video clips and images satisfies an acquisition protocol defined by the center. Annotated DICOM files generated by the device cannot be modified by the user.
Here's a detailed breakdown of the acceptance criteria and the study proving the BrightHeart View Classifier device meets them, based on the provided FDA 510(k) clearance letter:
1. Table of Acceptance Criteria and Reported Device Performance
The provided document does not explicitly state "acceptance criteria" as a set of predefined thresholds. However, it does present objective performance metrics derived from a validation study. For the purpose of this response, we will consider the reported performance metrics as demonstrative of meeting implicit acceptance criteria for clinical utility and safety, especially since the submission states the device "is as safe and effective as the predicate device and supports a determination of substantial equivalence."
| Metric | Acceptance Criteria (Implicit) | Reported Device Performance |
|---|---|---|
| Mean Standard View Recognition Sensitivity | High sensitivity for detecting standard views, indicating a low rate of missed standard views. (Implicitly, the reported value was deemed sufficient for clearance given its comparison to the predicate, which shares the exact same algorithm). | 0.939 (95% CI: 0.917 – 0.960) |
| Mean Standard View Recognition Specificity | High specificity for identifying standard views, indicating a low rate of incorrectly identified views. (Implicitly, the reported value was deemed sufficient for clearance). | 0.984 (95% CI: 0.973 – 0.996) |
| Performance across subgroups (geographical region, US machine make, gestational age, mother's BMI, mother's age) | Consistent performance across diverse subgroups. | "Performance was consistent across subgroups." |
| Performance across mother's race (Asian and Black mothers) | Consistent performance across mother's race. | "Specificity 95% CI lower bound was slightly lower for Asian and Black mothers, possibly due to large confidence intervals and small sample size." (This indicates a slight deviation but was seemingly acceptable given the context of small sample size in those subgroups). |
| Supported Ultrasound Machine Vendors | Device performance should be validated for specific ultrasound machine makes. | Validated with General Electric, Philips, Samsung, and Siemens ultrasound devices. |
| Supported Gestational Age | Device performance should be validated for specific gestational ages. | Validated for pregnancies at 18 weeks of gestation or later. |
| Supported Probe Type | Device performance should be validated for specific probe types. | Validated for transabdominal probes. |
2. Sample Size Used for the Test Set and Data Provenance
- Sample Size for Test Set: 2290 clinically acquired images and frames from video clips. These were derived from 579 fetal ultrasound examinations.
- Data Provenance: The data was retrospective, consisting of clinically acquired images and frames. The country of origin for the data includes U.S.A. and France.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications
- Number of Experts: Two experts.
- Qualifications of Experts: One sonographer and one MFM specialist (Maternal-Fetal Medicine) with experience in fetal echocardiography.
4. Adjudication Method for the Test Set
The adjudication method was described as a truthing process where the sonographer and MFM specialist independently determined the presence or absence of standard views. The document doesn't explicitly state a 2+1 or 3+1 method with a third tie-breaker, but it implies a consensus or agreement process between the two experts as they "determined" the presence or absence.
5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was done
No, a Multi-Reader Multi-Case (MRMC) comparative effectiveness study was not explicitly mentioned or reported in this document. The study described focuses on the standalone performance of the AI algorithm. Therefore, there is no reported effect size of how much human readers improve with AI vs. without AI assistance.
6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) was done
Yes, a standalone performance study was done. The reported sensitivity and specificity values directly relate to the BrightHeart View Classifier's (algorithm only) ability to identify standard views independently. The document states: "The performance testing demonstrated that BrightHeart View Classifier identifies standard views with a mean standard view recognition sensitivity of 0.939..." This confirms a standalone performance evaluation.
7. The Type of Ground Truth Used
The type of ground truth used was expert consensus / clinical expert interpretation. It was derived through a "truthing process" by a sonographer and an MFM specialist.
8. The Sample Size for the Training Set
The document explicitly states: "The ultrasound examinations used for training and validation are entirely distinct from the examinations used in performance testing." However, the exact sample size for the training set is not provided in the given text.
9. How the Ground Truth for the Training Set Was Established
The document states: "The ultrasound examinations used for training and validation are entirely distinct from the examinations used in performance testing." While it confirms distinct data, it does not explicitly describe how the ground truth for the training set was established. It can be inferred that it likely followed a similar expert review process as the test set, but this information is not detailed in the provided text.
Ask a specific question about this device
(159 days)
The BrightHeart View Classifier device is intended to analyze fetal 2D ultrasound images and video clips using machine learning techniques to automatically detect standard views during fetal heart scanning.
The BrightHeart View Classifier device is intended to be used as an adjunct to the acquisition and interpretation of fetal anatomic ultrasound examinations at the second or third trimester of pregnancy performed with transabdominal probes.
BrightHeart View Classifier is a cloud-based software-only device which uses artificial intelligence (AI) to detect standard views during fetal heart scanning in fetal ultrasound images and video clips.
BrightHeart View Classifier is intended to be used by qualified, trained healthcare professional personnel in a professional prenatal ultrasound (US) imaging environment (this includes sonographers, MFMs, OB/GYN, and Fetal surgeons), to help fetal ultrasound examination acquisition and interpretation of 2D grayscale ultrasound by providing automatic classification of video clips and images into standard views, by automatically extracting example frames of standard views from video clips, and by automatically assessing whether the documentation of each standard view in video clips and images satisfies an acquisition protocol defined by the center. Annotated DICOM files generated by the device cannot be modified by the user.
Here's a breakdown of the acceptance criteria and the study details for the BrightHeart View Classifier, based on the provided FDA 510(k) Clearance Letter:
1. Table of Acceptance Criteria and Reported Device Performance
The FDA letter does not explicitly state pre-defined acceptance criteria values that the device needed to meet. Instead, it reports the device's performance metrics directly from the validation study. However, based on the performance report, we can infer the achieved performance and understand that these values were deemed sufficient for clearance.
| Performance Metric | Acceptance Criteria (Implied) | Reported Device Performance |
|---|---|---|
| Mean Standard View Recognition Sensitivity | High (e.g., >0.90) | 0.939 (95% CI, 0.917 ; 0.960) |
| Mean Standard View Recognition Specificity | High (e.g., >0.95) | 0.984 (95% CI, 0.973 ; 0.996) |
2. Sample Size Used for the Test Set and Data Provenance
- Sample Size: 2290 clinically acquired images and frames from video clips.
- Number of Fetal Ultrasound Examinations: 579
- Country of Origin of Data: U.S.A. and France.
- Retrospective or Prospective: The document implies retrospective data ("clinically acquired images and frames").
3. Number of Experts Used to Establish Ground Truth for the Test Set and Qualifications
- Number of Experts: Two experts: "a sonographer and an MFM specialist".
- Qualifications: "with experience in fetal echocardiography". Specific years of experience are not mentioned.
4. Adjudication Method for the Test Set
- Adjudication Method: Independence was maintained in the ground truth establishment. "The reference standard was derived from the dataset through a truthing process in which a sonographer and an MFM specialist with experience in fetal echocardiography determined the presence or absence of standard views on fetal ultrasound images. The truthing process was conducted independently of the BrightHeart View Classifier device." This indicates a consensus or independent review process, but not a specific 2+1 or 3+1 adjudication as those usually imply a tie-breaker. It seems like both experts independently determined the ground truth.
5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study
- No, a Multi-Reader Multi-Case (MRMC) comparative effectiveness study was not explicitly described. The study evaluated the standalone performance of the AI device.
6. Standalone (Algorithm Only Without Human-in-the-Loop) Performance
- Yes, a standalone performance study was conducted. The reported sensitivity and specificity values are for the BrightHeart View Classifier identifying standard views on its own.
7. Type of Ground Truth Used
- Type of Ground Truth: Expert consensus (from a sonographer and an MFM specialist with experience in fetal echocardiography).
8. Sample Size for the Training Set
- The sample size for the training set is not explicitly stated in the provided document. The document only mentions that "The ultrasound examinations used for training and validation are entirely distinct from the examinations used in performance testing."
9. How the Ground Truth for the Training Set Was Established
- The document does not explicitly state how the ground truth for the training set was established. However, given the nature of the device and the ground truth method for the test set, it is highly probable that a similar expert review and annotation process was used for the training data.
Ask a specific question about this device
Page 1 of 1