Search Results
Found 3 results
510(k) Data Aggregation
(101 days)
The device is intended for noninvasive processing of ultrasound images to detect, measure, and calculate relevant medical parameters of structures and function of patients aged 18 years or older with suspected disease.
Blineslide is a cloud service application that helps qualified users with image-based assessment of lung ultrasound (LUS) cines acquired from the anterior or anterolateral chest regions during a physician-led LUS examination of patients aged 18 years or older. It does not directly interface with ultrasound systems.
Blineslide takes as input user-uploaded B-Mode LUS video clips (cines) in MP4 format and allows users to detect the relevant medical parameters of structures and function (LUS artifacts). Key features of the software are:
- B Line Artifact Module: an AI-assisted tool for detecting the presence or absence of B line artifacts in LUS cines
Blineslide is incompatible with:
- Cines that are acquired from Linear array ultrasound transducers;
- Cines acquired at less than 18 frames per second;
- Cines that require more than 2048 megabytes of memory;
- Cines that are less than 2600 milliseconds in duration; and
- Cines that are greater than 7800 milliseconds in duration
Each of these exclusion criteria are automatically assessed by the software. If detected, an output of Cannot Evaluate is returned to the user to minimize the risk of false LUS artifact detections.
Blineslide does not perform any function that could not be accomplished by a trained user manually. Patient management decisions should not be made solely on the results of Blineslide's analysis.
Here's a breakdown of the acceptance criteria and study details for the BlineSlide device, based on the provided FDA 510(k) clearance letter:
Acceptance Criteria and Device Performance
1. A table of acceptance criteria and the reported device performance:
| Metric | Acceptance Criteria (Implied) | Reported Device Performance |
|---|---|---|
| Sensitivity | Not explicitly stated, but high agreement expected | 0.91 (95% CI: 0.88 – 0.94) |
| Specificity | Not explicitly stated, but high agreement expected | 0.84 (95% CI: 0.81 – 0.86) |
Note: The FDA 510(k) summary does not explicitly state pre-defined acceptance criteria for statistical metrics like sensitivity and specificity. Instead, the reported performance is presented to demonstrate substantial equivalence to the predicate device. The "implied" acceptance criteria are derived from the need for the device to be "as safe and as effective as the predicate device."
Study Details
2. Sample size used for the test set and the data provenance:
- Sample Size for Test Set: Initially 1005 cines. After exclusions for poor image quality, the final dataset comprised 326 positive class examples (B Line Artifacts Present) and 679 negative class examples (B Line Artifacts Absent), totaling 1005 cines.
- Data Provenance:
- Country of Origin: Not explicitly stated, but mentioned as "various clinical sites in cities with diverse race and ethnicity populations," and "geographically distinct from the data sources used in the development set." This implies a diverse, likely multi-site, geographical origin.
- Retrospective or Prospective: Not explicitly stated, but typical for these types of studies, the data is likely retrospective, collected from existing archives, then curated into a test set.
3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts:
- Number of Experts: "Two or more experts."
- Qualifications of Experts: Not explicitly stated beyond "experts." However, given the context of identifying B line artifacts in lung ultrasound, it can be inferred that these experts would be physicians credentialed to use lung ultrasound clinically, such as intensivists, emergency physicians, pulmonologists, or other clinicians interpreting LUS cines, as described in the "Intended User" section.
4. Adjudication method for the test set:
- Adjudication Method: Consensus agreement of two or more experts. In rare cases where consensus could not be reached due to poor image quality, clips were excluded.
5. If a multi-reader multi-case (MRMC) comparative effectiveness study was done:
- No, a multi-reader multi-case (MRMC) comparative effectiveness study was not explicitly reported in this 510(k) summary. The evaluation focused on the standalone performance of the AI algorithm against expert ground truth.
6. If a standalone (i.e., algorithm only without human-in-the-loop performance) was done:
- Yes, a standalone performance assessment was done. The summary explicitly states: "The performance of the B Line Artifact Detection Module was successfully evaluated on a test dataset..." and "Performance was assessed by measuring agreement using sensitivity and specificity as co-primary endpoints with Cannot Evaluate outputs scored as false predictions." This directly describes standalone performance.
7. The type of ground truth used:
- Type of Ground Truth: Expert consensus (two or more experts).
8. The sample size for the training set:
- The sample size for the training set is not explicitly stated in the provided 510(k) summary. It only mentions that the "test data was entirely separated from that used for development" and the "data sources used in the test set were entirely different and geographically distinct from the data sources used in the development set."
9. How the ground truth for the training set was established:
- How the ground truth for the training set was established is not explicitly stated in the provided 510(k) summary. It is implied that ground truth was established during the development phase to train the "non-adaptive machine learning algorithms." This would typically involve expert annotations or labels, similar to the test set, but the specific methodology is not detailed.
Ask a specific question about this device
(92 days)
The AI Platform is intended for noninvasive processing of ultrasound images to detect, measure, and calculate relevant medical parameters of structures and function of adult patients with suspected disease. The device is intended to be used on images from adult patients.
Exo Al Platform is a software as a medical device (SaMD) that helps qualified users with image-based assessment of ultrasound examinations in adult patients. It is designed to simplify workflow by helping trained healthcare providers evaluate, quantify, and generate reports for ultrasound images. The device is intended to generate images and a report that can be reviewed in a typical standard of care setting.
Al Platform takes as an input imported Digital Imaging and Communications in Medicine (DICOM) images from ultrasound scanners of a specific range and allows users to detect, measure, and calculate relevant medical parameters of structures and function of patients with suspected disease. It provides users with a specific toolset for viewing ultrasound images of the lung and heart, placing landmarks, and creating reports.
Key features of the software are
- LVEF AI: an Al-assisted tool for quantification of ejection on cardiac ultrasound images.
- . Lung Al: an Al-assisted tool to suggest presence of lung structures and artifacts on ultrasound images.
Exo Al Platform does not perform any function that could not be accomplished by a trained user manually. It's important to note that patient management decisions should not be made solely on the results of the Al Platform analysis.
Acceptance Criteria & Device Performance Study for Exo AI Platform (AIP001)
The Exo AI Platform (AIP001) is a software as a medical device (SaMD) intended for noninvasive processing of ultrasound images to detect, measure, and calculate relevant medical parameters of structures and function in adult patients with suspected disease. This document outlines the acceptance criteria and the studies performed to demonstrate the device meets these criteria for both its cardiac (LVEF AI) and lung (Lung AI) functionalities.
1. Table of Acceptance Criteria and Reported Device Performance
For Cardiac Ultrasound (LVEF AI - Ejection Fraction Measurement):
| Acceptance Criteria (Performance Metric) | Target | Reported Device Performance (95% CI) |
|---|---|---|
| Ejection Fraction Parasternal Long-axis | ||
| - Intraclass Correlation Coefficient (ICC) | High | 0.93 (0.89 - 0.96) |
| - Root Mean Square Difference (RMSD) | Low | 6.12 (5.30 - 8.36) |
| Ejection Fraction Apical Biplane | ||
| - Intraclass Correlation Coefficient (ICC) | High | 0.95 (0.90 - 0.98) |
| - Root Mean Square Difference (RMSD) | Low | 4.81 (3.99 - 7.25) |
| Ejection Fraction Apical (AP4) Single Plane | ||
| - Intraclass Correlation Coefficient (ICC) | High | 0.92 (0.88 - 0.95) |
| - Root Mean Square Difference (RMSD) | Low | 6.06 (5.27 - 8.20) |
| Ejection Fraction Apical (AP2) Single Plane | ||
| - Intraclass Correlation Coefficient (ICC) | High | 0.92 (0.87 - 0.95) |
| - Root Mean Square Difference (RMSD) | Low | 6.25 (5.33 - 8.82) |
| Overall Ejection Fraction Measurement (All Views) | ||
| - Intraclass Correlation Coefficient (ICC) | High | 0.93 (0.91 - 0.95) |
| - Root Mean Square Difference (RMSD) | Low | 5.90 (5.35 - 7.23) |
For Lung Ultrasound (Lung AI - A-lines and B-lines detection/quantification):
| Acceptance Criteria (Performance Metric) | Target | Reported Device Performance |
|---|---|---|
| A-lines Presence (Agreement) | High | Kappa = 0.84 |
| B-lines Counts (Reliability) | High | ICC = 0.97 |
(Note: Specific quantitative targets for "High" ICC and "Low" RMSD/Kappa are not explicitly stated in the provided text, but the reported values demonstrate strong performance in common clinical contexts for these metrics.)
2. Sample Size Used for the Test Set and Data Provenance
- LVEF AI (Cardiac Function): 151 subjects
- Lung AI (Lung Function): 125 subjects
Data Provenance: The data was acquired during routine clinical practice from multiple clinical sites in metropolitan cities, ensuring diverse racial patient populations. The data encompassed diverse demographic variables, including gender, age (20-96 years), and BMI (15.3-52.8). The images were acquired from both cart-based and portable ultrasound devices. The test data was explicitly stated to be entirely separated from the training/validation datasets and not used for any part of the training. This suggests a retrospective collection of data designed for independent validation. The countries of origin are not specified, but "metropolitan cities with diverse racial patient populations" implies a multi-site, potentially multi-national, collection or at least a highly diverse domestic setting.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications
- LVEF AI (Ejection Fraction): The ground truth was obtained as the average ejection fraction measurement of three experts.
- Lung AI (A-line Presence): The ground truth was determined by consensus of two or more experts.
- Lung AI (B-line Counts): The ground truth was determined as the average of B-line counts from three experts.
Qualifications of Experts: The document does not explicitly state the specific qualifications of these experts (e.g., number of years of experience, specific board certifications like radiologist or cardiologist). However, the context of "routine clinical practice" and "experts" implies highly qualified medical professionals experienced in interpreting cardiac and lung ultrasound images.
4. Adjudication Method for the Test Set
- LVEF AI (Ejection Fraction): The adjudication method for the reference data (ground truth) was established by taking the average ejection fraction measurement of three experts. This implies a method akin to "average of multiple readers."
- Lung AI (A-line Presence): The adjudication method for the ground truth was determined by consensus of two or more experts. This suggests a qualitative agreement, where at least two experts had to concur.
- Lung AI (B-line Counts): The adjudication method for the ground truth was established by taking the average of B-line counts from three experts. (Similar to LVEF AI).
5. If a Multi Reader Multi Case (MRMC) Comparative Effectiveness Study was done
No, a Multi Reader Multi Case (MRMC) comparative effectiveness study was not done or reported in the provided text. The performance assessment focused on the standalone performance of the AI tool against expert-established ground truth, not on how human readers' performance improved with AI assistance.
6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) was done
Yes, a standalone performance study was done. The reported ICC, RMSD, and Kappa values directly assess the AI Platform's accuracy and reliability in generating measurements and detections independently, against the expert-derived ground truth. The statement that "Exo AI Platform does not perform any function that could not be accomplished by a trained user manually" also reinforces its role as an automated tool, evaluated on its own.
7. The Type of Ground Truth Used
The type of ground truth used was expert consensus / expert measurement.
- For Cardiac Ejection Fraction: Average measurements from three experts.
- For Lung A-line Presence: Consensus of two or more experts.
- For Lung B-line Counts: Average counts from three experts.
8. The Sample Size for the Training Set
The sample size for the training set is not specified in the provided text. The document only explicitly mentions that the test data was entirely separated from the training/validation datasets.
9. How the Ground Truth for the Training Set Was Established
The document does not specify how the ground truth for the training set was established. It only mentions that the AI algorithms (Deep Convolutional Neural Networks) were "trained with clinical data."
Ask a specific question about this device
(70 days)
The Philips Lumify Diagnostic Ultrasound System is intended for diagnostic ultrasound imaging in B (2D), Color Doppler, Combined (B+Color), Pulsed Wave Doppler (PWD), and M-modes.
It is indicated for diagnostic ultrasound imaging and fluid flow analysis in the following applications: Fetal/Obstetric, Abdominal, Pediatric, Cephalic, Urology, Gynecological, Cardiac Fetal Echo, Small Organ, Musculoskeletal, Peripheral Vessel, Carotid, Cardiac, Lung,
The Lumify system is a transportable ultrasound system intended for use in environments where healthcare is provided by healthcare professionals.
The Philips Lumify Diagnostic Ultrasound System (Lumify) is a mobile, durable, and reusable, software-controlled medical device, which is intended to acquire high-resolution ultrasound data and to display the data in B (2D), Pulsed Wave Doppler, Color Doppler, Combined (B+ Color), and M modes.
The Lumify Diagnostic Ultrasound System (Android) utilizes:
- A commercial off-the-shelf (COTS) Android mobile device (smart phone or tablet)
- The Philips Ultrasound Lumify software running as an application on the COTS device
- The Philips C5-2 Curved array USB transducer
- The Philips L12-4 Linear array USB transducer
- The Philips S4-1 Sector array USB transducer
- Lumify Micro B Transducer Cable
- Lumify Micro C Transducer Cable
The Lumify system is compatible with iOS or Android operating systems. The Lumify system software provides various imaging features, including an Android-specific feature with artificial intelligence (AI) based, Auto EF Quantification (ejection fraction) technology during cardiac imaging.
Here's a breakdown of the acceptance criteria and the study details for the Philips Lumify Diagnostic Ultrasound System with Auto EF Quantification, based on the provided FDA 510(k) summary:
1. Table of Acceptance Criteria and Reported Device Performance
| Acceptance Criteria | Reported Device Performance |
|---|---|
| Correlation of LVivo EF Ejection Fraction (EF) measurements with average manual tracing results. | Strong correlation demonstrated: r = 0.82, 95% CI (0.72, 0.88). The endpoint criteria were met. |
| Correlation of LVivo EF End-Diastolic Volume (EDV) measurements with average manual tracing results. | Strong correlation demonstrated: r = 0.95, 95% CI (0.91, 0.96). |
| Correlation of LVivo EF End-Systolic Volume (ESV) measurements with average manual tracing results. | Strong correlation demonstrated: r = 0.94, 95% CI (0.90, 0.96). |
| Percentage of clips successfully processed automatically by LVivo EF. | 76 out of 80 clips (95%) were automatically processed. |
2. Sample Size Used for the Test Set and Data Provenance
- Sample Size for Test Set: 80 patients' Apical 4 Chamber (A4CH) view clips.
- Data Provenance: The data were acquired with the Lumify Diagnostic Ultrasound System, specifically for this clinical performance study. Patients were selected based on eligibility, and data were acquired consecutively for patients with normal and impaired LV function. This suggests a prospective acquisition for the purpose of the study. The document does not specify the country of origin for the data.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications
The ground truth was established by "manual tracing performed by sonographers."
- Number of Experts: The document refers to "sonographers" in the plural, but does not specify the exact number of sonographers involved in the manual tracing.
- Qualifications of Experts: The document implies that these were qualified "sonographers" experienced in echocardiographic LV function evaluation, but does not provide specific qualifications (e.g., years of experience, board certification). It can be inferred that they are healthcare professionals who routinely perform this task.
4. Adjudication Method for the Test Set
The ground truth for EF, EDV, and ESV was established by the "average results by manual tracing." This implies that IF multiple sonographers performed the manual tracings, their results were averaged. However, it does not explicitly state an adjudication method like 2+1 or 3+1 (where discrepancies are resolved by a third expert or consensus). It refers to "the average results by manual tracing," suggesting a quantitative aggregation rather than a specific adjudicative consensus process if multiple readers were used. If only one sonographer performed the tracing for each case, no adjudication would be necessary.
5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study
There is no mention of a Multi-Reader Multi-Case (MRMC) comparative effectiveness study being done to evaluate how much human readers improve with AI vs. without AI assistance. The study focuses on the agreement between the AI's automated measurements and a "manual tracing" ground truth, not on reader performance with and without AI assistance.
6. Standalone (Algorithm Only) Performance
Yes, a standalone study was done. The clinical performance study directly compared the "automated EF evaluation by LVivo EF" (the algorithm's performance) against "Ejection Fraction (EF) evaluation by manual tracing performed by sonographers" (the ground truth). The results (correlation coefficients) reflect the algorithm's performance without a human-in-the-loop scenario. The LVivo EF automatically processed 95% of the clips, indicating its standalone capability.
7. Type of Ground Truth Used
The ground truth used was expert consensus/manual tracing. Specifically, it was defined as "Ejection Fraction (EF) evaluation by manual tracing performed by sonographers" and "the average results by manual tracing" for EF, EDV, and ESV. This is considered an expert-derived ground truth based on conventional, established methods for echocardiographic LV function evaluation.
8. Sample Size for the Training Set
The document explicitly states: "The data used for clinical performance study were completely distinct from that used during training of the algorithm, and there was no overlap between the two data sets." However, it does not provide the sample size for the training set used to develop the LVivo EF algorithm.
9. How the Ground Truth for the Training Set was Established
The document states that the clinical performance study data were "completely distinct from that used during training of the algorithm," but it does not describe how the ground truth for the training set was established. It implies that such a training process occurred ("training of the algorithm"), but details on its ground truth are not provided in this summary.
Ask a specific question about this device
Page 1 of 1