Search Filters

Search Results

Found 17 results

510(k) Data Aggregation

    K Number
    K251455
    Date Cleared
    2025-07-24

    (73 days)

    Product Code
    Regulation Number
    892.1550
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Philips Ultrasound LLC

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    EPIQ Series Diagnostic Ultrasound System: The intended use of EPIQ Ultrasound Diagnostic System is diagnostic ultrasound imaging and fluid flow analysis of the human body, with the following indications for use: Abdominal, Cardiac Adult, Cardiac other (Fetal), Cardiac Pediatric, Cerebral Vascular, Cephalic (Adult), Cephalic (Neonatal), Fetal/Obstetric, Gynecological, Intraoperative (Vascular), Intraoperative (Cardiac), intra-luminal, intra-cardiac echo, Musculoskeletal (Conventional), Musculoskeletal (Superficial), Ophthalmic, Other: Urology, Pediatric, Peripheral Vessel, Small Organ (Breast, Thyroid, Testicle), Transesophageal (Cardiac), Transrectal, Transvaginal, Lung.
    Modes of operation include: B Mode, M Mode, PW Doppler, CW Doppler, Color Doppler, Color M Mode, Power Doppler, and Harmonic Imaging.
    The clinical environments where EPIQ Series Diagnostic ultrasound Systems can be used include clinics, hospitals, and clinical point-of-care for diagnosis of patients.
    When integrated with Philips EchoNavigator, the systems can assist the interventionalist and surgeon with image guidance during treatment of cardiovascular disease in which the procedure uses both live X-ray and live echo guidance.
    The systems are intended to be installed, used, and operated only in accordance with the safety procedures and operating instructions given in the product user information. Systems are to be operated only by appropriately trained healthcare professionals for the purposes for which they were designed. However, nothing stated in the user information reduces your responsibility for sound clinical judgement and best clinical procedure.

    Affiniti Series Diagnostic Ultrasound Systems: The intended use of Affiniti Series Diagnostic Ultrasound Systems is diagnostic ultrasound imaging and fluid flow analysis of the human body, with the following indications for use: Abdominal, Cardiac Adult, Cardiac Other (Fetal), Cardiac Pediatric, Cerebral Vascular, Cephalic (Adult), Cephalic (Neonatal), Fetal/Obstetric, Gynecological, Intraoperative (Vascular), Intraoperative (Cardiac), Musculoskeletal (Conventional), Musculoskeletal (Superficial), Other: Urology, Pediatric, Peripheral Vessel, Small Organ (Breast, Thyroid, Testicle), Transesophageal (Cardiac), Transrectal, Transvaginal, Lung.
    Modes of operation include: B Mode, M Mode, PW Doppler, CW Doppler, Color Doppler, Color M Mode, Power Doppler, and Harmonic Imaging.
    The clinical environments where the Affiniti diagnostic ultrasound systems can be used include clinics, hospitals, and clinical point-of-care for diagnosis of patients. The systems are intended to be installed, used, and operated only in accordance with the safety procedures and operating instructions given in the product user information. Systems are to be operated only by appropriately trained healthcare professionals for the purposes for which they were designed. However, nothing stated in the user information reduces your responsibility for sound clinical judgement and best clinical procedure.

    Device Description

    The purpose of this 510(k) Pre-market Notification is to introduce the SVS v2 Contrast software application with the EPIQ and Affiniti Series Diagnostic Ultrasound Systems as part of the VM13.0 program.
    SVS v2 Contrast is an automated software feature that assists in the selection of images for analysis with the new Philips license options 2D Auto EF Advanced (Adv) developed by DiA Imaging Analysis (K243235), now part of Philips Ultrasound LLC, and existing Philips license options AutoStrain LV; or 2D Auto LV (both K240850) license application in Adult Echo Transthoracic (TTE) examinations.
    As described in 510(k) K240850, this feature automatically classifies each acquired image by view and selects an appropriate set of images for Left ventricle (LV) analysis. The classification is based on a Deep Learning AI inference engine; the selection is a non-AI algorithm that considers the view classification and image depth to select the optimal set of images. The difference in SVS v2 Contrast from the predicate SVS v1 (K240850) is that the algorithm is revised to include the selection of optimal images for analysis when contrast is used in routine TTE exams.
    Users can launch existing 2D Auto EF; 2D Auto EF Adv; AutoStrain LV; or 2D Auto LV with the set of images that have been automatically selected without the need to review the acquired images and manually select the views. Users may select 2D Auto EF Adv, to process the selected views by SVS v2 Contrast. SVS v2 Contrast prioritizes the contrast image pair; however, if an appropriate pair of contrast images is not found, then Auto EF Adv may select non-contrast images. The manual approach to select views is still available and the user can override automatically selected images from SVS v2 Contrast.
    No hardware changes to the EPIQ or Affiniti Series Diagnostic Ultrasound Systems are required when using SVS v2 Contrast, and existing, cleared Philips TTE transducers.
    The SVS v2 Contrast feature is supported by all EPIQ models running software version 13.0 or higher including EPIQ CVx/CVxi, EPIQ Elite Advanced, EPIQ Elite, EPIQ 7, EPIQ 5. The SVS v2 Contrast feature is supported by the Affiniti models running software version VM13.0 or higher, including Affiniti CVx, Affiniti 70, Affiniti 50, and Affiniti 30. The SVS v2 Contrast feature is associated with the cardiac adult indication.

    AI/ML Overview

    Acceptance Criteria and Study Details for SVS v2 Contrast Software

    This document outlines the acceptance criteria and details of the study conducted to demonstrate that the Philips Ultrasound systems (EPIQ and Affiniti Series Diagnostic Ultrasound System) with the SVS v2 Contrast software application meet the established performance benchmarks.

    1. Table of Acceptance Criteria and Reported Device Performance

    CriteriaAcceptance CriteriaReported Device Performance (SVS Selected vs Manually Selected Ground Truth)
    Primary Endpoint: Pearson's correlation coefficient (r) for Biplane EF (Automated Selection vs. Manual Selection)Lower Confidence Bound for the Pearson's correlation coefficient (r) to be > 0.8. (Informed by published literature (Maret, E. B. (2008)) and previous regulatory submissions (K130779, K232500)). Note: The manual selection here refers to "manual contrast clip selection," which was automatically processed within the Contrast EF application, with the automated EF results serving as ground truth.N = 46: r = 0.953 (95% CI: 0.917, 0.974), p-value 0.8, meeting the acceptance criteria.
    Agreement Assessment: Bland-Altman Analysis for Biplane EF (Automated Selection vs. Manual Selection)Acceptable performance for automatic selection of appropriate clips by SVS software and subsequent output of Contrast Enhanced Biplane EF feature compared to the results of Contrast Enhanced Biplane EF from manually selected contrast clips. (No specific numerical thresholds provided for Bland-Altman, but indicated as demonstrating "acceptable performance" if the primary endpoint is met).N = 46: Mean Difference ± SD = 0.71 ± 4.36 (95% CI for Mean Difference: -0.58, 2.01). Lower LoA = -7.83 (95% CI: -10.06, -5.60), Upper LoA = 9.26 (95% CI: 7.03, 11.49). Reported as demonstrating acceptable performance.
    Agreement Assessment: Pearson's correlation coefficient (r) for Biplane EF (Automated Selection vs. Manual Tracing Ground Truth)No explicit independent acceptance criterion for this comparison; serves as an additional supporting analysis.N = 46: r = 0.938 (95% CI: 0.890, 0.965), p-value
    Ask a Question

    Ask a specific question about this device

    K Number
    K250886
    Date Cleared
    2025-06-18

    (85 days)

    Product Code
    Regulation Number
    892.1550
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Philips Ultrasound LLC

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    Intended Use / Indications for Use

    EPIQ:

    The intended use of Philips EPIQ series diagnostic ultrasound systems is diagnostic ultrasound imaging and fluid flow analysis of the human body, with the following indications for use:

    Abdominal, Cardiac Adult, Cardiac other (Fetal), Cardiac Pediatric, Cerebral Vascular, Cephalic (Adult), Cephalic (Neonatal), Fetal/Obstetric, Gynecological, Intra-cardiac Echo, Intra-luminal, Intraoperative (Vascular), Intraoperative (Cardiac), Musculoskeletal (Conventional), Musculoskeletal (Superficial), Ophthalmic, Other: Urology, Pediatric, Peripheral Vessel, Small Organ (Breast, Thyroid, Testicle), Transesophageal (Cardiac), Transrectal, Transvaginal, Lung.

    Modes of operation include: B Mode, M Mode, PW Doppler, CW Doppler, Color Doppler, Color M Mode, Power Doppler, and Harmonic Imaging.

    The clinical environments where Philips EPIQ diagnostic ultrasound systems can be used include clinics, hospitals, and clinical point-of-care for diagnosis of patients.

    When integrated with Philips EchoNavigator, the systems can assist the interventionalist and surgeon with image guidance during treatment of cardiovascular disease in which the procedure uses both live X-ray and live echo guidance.

    The systems are intended to be installed, used, and operated only in accordance with the safety procedures and operating instructions given in the product user information. Systems are to be operated only by appropriately trained healthcare professionals for the purposes for which they were designed. However, nothing stated in the user information reduces your responsibility for sound clinical judgement and best clinical procedure.

    Affiniti:

    The intended use of the Affiniti Series Diagnostic Ultrasound Systems is diagnostic ultrasound imaging and fluid flow analysis of the human body with the following Indications for Use:

    Abdominal, Cardiac Adult, Cardiac other (Fetal), Cardiac Pediatric, Cerebral Vascular, Cephalic (Adult), Cephalic (Neonatal), Fetal/Obstetric, Gynecological, Intraoperative (Vascular), Intraoperative (Cardiac), Musculoskeletal (Conventional), Musculoskeletal (Superficial), Other: Urology, Pediatric, Peripheral Vessel, Small Organ (Breast, Thyroid, Testicle), Transesophageal (Cardiac), Transrectal, Transvaginal, Lung.

    Modes of operation include: B Mode, M Mode, PW Doppler, CW Doppler, Color Doppler, Color M Mode, Power Doppler, and Harmonic Imaging.

    The clinical environments where the Affiniti Diagnostic Ultrasound Systems can be used include Clinics, Hospitals, and clinical point-of-care for diagnosis of patients.

    The systems are intended to be installed, used, and operated only in accordance with the safety procedures and operating instructions given in the product user information. Systems are to be operated only by appropriately trained healthcare professionals for the purposes for which they were designed. However, nothing stated in the user information reduces your responsibility for sound clinical judgment and best clinical procedure.

    Device Description

    The purpose of this Special 510(k) Pre-Market Notification is to expand the Smart View Select (SVS) software application onto the Affiniti Series Diagnostic Ultrasound Systems and to modify the Smart View Select software application onto both the EPIQ Series Diagnostic Ultrasound Systems.

    Smart View Select is an automated software feature that assists the user in selection of images for analysis with the existing Philips AutoStrain LV or 2D Auto LV application in Adult Echo Transthoracic (TTE) examination. This feature automatically classifies each acquired image by view and selects an appropriate set of images for left ventricle (LV) analysis. The classification is based on a Deep Learning AI interface engine; the selection is a non-AI algorithm that considers the view classification and image depth to select the optimal set of images.

    No hardware changes to the EPIQ or Affiniti systems are required when using SVS, and existing, cleared Philips TTE transducers are used with these software applications.

    The SVS v2 feature is supported by all EPIQ models running software version 13.0 or higher including EPIQ CVx/CVxi, EPIQ Elite Advanced, EPIQ Elite, EPIQ 7, EPIQ 5. The SVS v2 feature is supported by the Affiniti models running software version VM13.0 or higher, including Affiniti CVx, Affiniti 70, Affiniti 50, and Affiniti 30. The SVS and SWM software features are associated with the cardiac adult indication.

    AI/ML Overview

    The provided document details the 510(k) clearance for Philips Ultrasound's EPIQ and Affiniti Series Diagnostic Ultrasound Systems with the Smart View Select (SVS) v2 software. The SVS feature is an automated software that assists users in selecting images for Left Ventricle (LV) analysis using existing Philips AutoStrain LV or 2D Auto LV applications in Adult Echo Transthoracic (TTE) examinations. It classifies acquired images by view using a Deep Learning AI interface and then uses a non-AI algorithm to select an optimal set of images.

    Here's an analysis of the acceptance criteria and the study that proves the device meets them:

    1. Table of Acceptance Criteria and Reported Device Performance

    The study aimed to demonstrate agreement between LV analysis outputs (Ejection Fraction - EF, and Global Longitudinal Strain - GLS) derived from manually selected clips (ground truth) and automatically selected clips by the SVS software.

    Acceptance CriteriaReported Device Performance
    Co-primary Endpoint: Lower Confidence Bound for Pearson's correlation coefficient to be > 0.8 for both GLS and EF measurements.Pearson's Correlation Coefficient for EF: 0.891 (95% CI: 0.851, 0.920)
    Lower Confidence Bound: 0.851 (Met criteria)
    Pearson's Correlation Coefficient for GLS: 0.906 (95% CI: 0.871, 0.931)
    Lower Confidence Bound: 0.871 (Met criteria)

    2. Sample Size and Data Provenance

    • Test Set Sample Size: The exact number of patients or cases in the test set is not explicitly stated as a single number. However, the demographic characteristics section indicates n=71 for various demographic variables like Sex, Age, Height, Weight, BMI, Race, LV systolic function, RWMA, Known CAD, Previous reported MI Location, and LV Hypertrophy, suggesting the test dataset comprised data from at least 71 unique patients.
    • Data Provenance: The data was collected from a US-based medical center. The study was a retrospective data analysis.

    3. Number of Experts and Qualifications for Ground Truth

    • Number of Experts: Three (3) reviewers (clinical experts) participated in establishing the ground truth.
    • Qualifications of Experts: They are referred to as "clinical experts." No further specific qualifications (e.g., years of experience, specific board certifications like radiologist/cardiologist) are provided in the document.

    4. Adjudication Method for the Test Set

    The adjudication method used to establish ground truth was consensus/averaging. For each output (GLS and EF), the average across the three reviewers was used as the ground truth.

    5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

    No Multi-Reader Multi-Case (MRMC) comparative effectiveness study was described. The study focused on comparing the AI-selected clips' performance (GLS and EF) against the ground truth established by human experts using manually selected clips. There is no information provided regarding how much human readers improve with AI vs. without AI assistance. The study evaluates the AI's ability to select optimal clips, a step that precedes human analysis with AutoStrain LV.

    6. Standalone Performance Study (Algorithm Only)

    Yes, a standalone performance study was done. The performance of the SVS software was evaluated solely based on its ability to automatically select appropriate clips, and then the subsequent, un-edited evaluation of GLS and EF through AutoStrain LV using these SVS-selected clips was compared against the human-selected clips. This represents the algorithm's performance in its specific task (clip selection) without direct human intervention in the selection process.

    7. Type of Ground Truth Used

    The ground truth used was expert consensus. Specifically, it was the average of GLS and EF measurements obtained from clips manually selected and subsequently semi-automatically processed by three clinical experts using the AutoStrain LV software.

    8. Sample Size for the Training Set

    The document does not provide the sample size used for the training set of the deep learning AI model for image classification. It only states that "the neural network of the subject device was revised as described in attachment 002," implying updates to an existing model rather than a completely new one, but no training data details are given.

    9. How Ground Truth for Training Set was Established

    The document does not explicitly state how the ground truth for the training set was established. It mentions that the "classification is based on a Deep Learning AI interface engine," but details regarding the training data annotation and ground truth establishment are not provided within the excerpt.

    Ask a Question

    Ask a specific question about this device

    K Number
    K243793
    Date Cleared
    2025-05-21

    (162 days)

    Product Code
    Regulation Number
    892.1550
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Philips Ultrasound LLC

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    EPIQ: The intended use of EPIQ Ultrasound Diagnostic System is diagnostic ultrasound imaging and fluid flow analysis of the human body, with the following indications for use: Abdominal, Cardiac Adult, Cardiac other (Fetal), Cardiac Pediatric, Cerebral Vascular, Cephalic (Adult), Cephalic (Neonatal), Fetal/Obstetric, Gynecological, Intraoperative (Vascular), Intraoperative (Cardiac), intra-luminal, intra-cardiac echo, Musculoskeletal (Conventional), Musculoskeletal (Superficial), Ophthalmic, Other: Urology, Pediatric, Peripheral Vessel, Small Organ (Breast, Thyroid, Testicle), Transesophageal (Cardiac), Transrectal, Transvaginal, Lung.
    Affiniti: The intended use of Affiniti Series Diagnostic Ultrasound Systems is diagnostic ultrasound imaging and fluid flow analysis of the human body, with the following indications for use: Abdominal, Cardiac Adult, Cardiac Other (Fetal), Cardiac Pediatric, Cerebral Vascular, Cephalic (Adult), Cephalic (Neonatal), Fetal/Obstetric, Gynecological, Intraoperative (Vascular), Intraoperative (Cardiac), Musculoskeletal (Conventional), Musculoskeletal (Superficial), Other: Urology, Pediatric, Peripheral Vessel, Small Organ (Breast, Thyroid, Testicle), Transesophageal (Cardiac), Transrectal, Transvaginal, Lung.

    Device Description

    The R-Trigger algorithm software feature on Philips EPIQ and Affiniti Ultrasound System is intended to support detection of R-wave peak (R-trigger) as an input to certain TTE clinical applications, initially including AutoStrain LV, AutoEF, 2D Auto LV (collectively referred to as "AutoStrain"), and AutoMeasure applications. The R-trigger algorithm is planned to be implemented as workflow enhancement for transthoracic clinical applications on EPIQ and Affiniti Ultrasound Systems in the VM13 software release. The Auto-Measure and AutoStrain features support users during B-mode (2D), CW-, PW- and TDI-Doppler measurements by automating some of the measurements needed to complete a routine transthoracic echo (TTE) exam for adult patients. The R-trigger feature (non-ECG-based) has been developed to enable clinical users to use AutoMeasure and AutoStrain application without the R-trigger (ECG based) input, which is currently required. There are no hardware changes to the EPIQ and Affiniti systems due to change to the introduction of the R-Trigger software application. The software application is supported by all EPIQ and Affiniti models running software version 13.0 or higher.

    AI/ML Overview

    The provided FDA 510(k) clearance letter describes the R-Trigger software application on Philips EPIQ and Affiniti Ultrasound Systems, which aims to provide an alternative method for detecting R-wave peaks (R-triggers) for cardiac clinical applications like AutoStrain and AutoMeasure, especially when the ECG signal is unavailable or unusable.

    Here's an analysis of the acceptance criteria and the study proving the device meets them:

    1. Table of Acceptance Criteria and Reported Device Performance:

    The primary acceptance criteria for the R-Trigger algorithm are related to the agreement of its R-wave time stamp detection with the ground truth (ECG-based R-trigger) and the subsequent impact on the clinical outputs of AutoMeasure and AutoStrain. These are evaluated using Bland-Altman analysis (for agreement, specifically the Upper and Lower Limits of Agreement, LoA) and Pearson's correlation (for correlation, specifically the Lower Confidence Bound, LCB).

    Endpoint / Outcome ComparisonMeasurement TypeAcceptance Criteria (Upper/Lower LoA or LCB)Reported Device Performance (Upper/Lower LoA or Pearson's r with 95% CI)Met Criteria?
    Endpoint 1: R-trigger
    R-wave peak time stampTime Stamp[-99.5ms, 99.5ms]-58.06ms (-59.34, -56.78) to 69.69ms (68.41, 70.97)Yes (-58.06 > -99.5, 69.69 0.8
    GLSGLS (Correlation)LCB > 0.80.992 (0.990, 0.994)Yes (0.990 > 0.8)
    Endpoint 2: AutoMeasure
    MV E VelPw/cw Doppler velocity[-25%, 25%]-12.00 % (-13.17%, -10.84 %) to 12.98 % (11.81 %, 14.14%)Yes (-12.00 > -25, 12.98 -30, 9.33 -30, 5.35 -29, 17.44 -29, 17.91 -30, 9.39 -25, 14.69 -30, 9.30 -30, 9.55 -29, 14.41 -30, 13.00 -28, 17.97 -28, 17.53 -25, 13.83 -29, 14.77 -30, 10.64 -34, 18.23 -30, 8.83 -46, 32.89 -46, 20.47 -46, 21.51 -28, 21.44 -28, 20.89 -28, 21.62 -40, 13.59 -35, 23.62 -40, 14.21 -30, 14.74 -30, 12.98 -30, 12.68 -30, 16.86 -29, 17.04
    Ask a Question

    Ask a specific question about this device

    K Number
    K251110
    Date Cleared
    2025-05-09

    (28 days)

    Product Code
    Regulation Number
    N/A
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Philips Ultrasound LLC

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    EPIQ: The intended use of Philips EPIQ series diagnostic ultrasound systems is diagnostic ultrasound imaging and fluid flow analysis of the human body, with the following indications for use: Abdominal, Cardiac Adult, Cardiac other (Fetal), Cardiac Pediatric, Cerebral Vascular, Cephalic (Adult), Cephalic (Neonatal), Fetal/Obstetric, Gynecological, Intraoperative (Vascular), Intraoperative (Cardiac), Intra-luminal, Intra-cardiac Echo, Musculoskeletal (Conventional), Musculoskeletal (Superficial), Ophthalmic, Other: Urology, Pediatric, Peripheral Vessel, Small Organ (Breast, Thyroid, Testicle), Transesophageal (Cardiac), Transrectal, Transvaginal, Lung.

    Affiniti: The intended use of the Affiniti Series Diagnostic Ultrasound Systems is diagnostic ultrasound imaging and fluid flow analysis of the human body with the following Indications for Use: Abdominal, Cardiac Adult, Cardiac other (Fetal), Cardiac Pediatric, Cerebral Vascular, Cephalic (Adult), Cephalic (Neonatal), Fetal/Obstetric, Gynecological, Intraoperative (Vascular), Intraoperative (Cardiac), Musculoskeletal (Conventional), Musculoskeletal (Superficial), Other: Urology, Pediatric, Peripheral Vessel, Small Organ (Breast, Thyroid, Testicle), Transesophageal (Cardiac), Transrectal, Transvaginal, Lung.

    Device Description

    The purpose of this Special 510(k) Pre-Market Notification is to modify the Segmental Wall Motion and introduce Auto EF with contrast software application onto the Philips EPIQ Series Diagnostic Ultrasound System and Affiniti Series Diagnostic Ultrasound Systems. SWM algorithm was previously cleared (K243862) and Auto EF contrast algorithm(K243235) was also previously cleared. The current software release version VM 13, replaces the previous version of the segmental wall motion algorithm included in version 11 of the software release with the current cleared version (K243862) without any modifications, and integrates Auto EF contrast algorithm(K243235) without any modifications into one software release.

    The SWM v2 software automatically evaluates the segmental (regional) function of the left ventricle (LV) from adult TTE echo examinations. For input, the SWM algorithm uses 3 apical views (A4C, A2C and A3C) and performs border detection and tracking to identify each of the LV segments based on the three views. The SWM v2 software is a semi-automated quantitative imaging algorithm, as users are generally expected to review and concur with the initial and generated results. The users can also manually edit algorithm-generated segmental wall motion scores for individual segments based on their clinical expertise.

    Auto EF with contrast is an AI based automated software feature that assists clinicians with assessing Left Ventricular Ejection Fraction (LVEF) from images acquired with contrast agent as part of an adult transthoracic echo (TTE) examination. The feature is located within the Philips Auto EF Adv application. Auto EF with contrast uses 2 apical views (Apical four chamber view (A4C), Apical two chamber (A2C)) and provides EF for each view and a biplane Simpsons EF.

    No hardware changes to the EPIQ or Affiniti systems were made due to the SWM v2 and Auto EF with contrast, and existing, cleared Philips TTE transducers are used with these software applications.

    AI/ML Overview

    This FDA 510(k) clearance (K251110) modifies the Segmental Wall Motion (SWM) algorithm and integrates an existing Auto EF with contrast software into Philips EPIQ and Affiniti Series Diagnostic Ultrasound Systems. The study details for each software component are primarily based on retrospective data analyses.

    Here's a breakdown of the acceptance criteria and study information for each feature:

    SWM v2 (Segmental Wall Motion v2)

    Information RequestedDescription
    1. Acceptance Criteria and Reported Device PerformanceAcceptance Criteria: Sensitivity and specificity of WMSI > 0.675 (Lower Bound of the Confidence Interval) based on a predefined prevalence of abnormal cases of 65%. The expected value of the correlation coefficient is 0.8, and the lower bound is 0.675, computed for Sensitivity, with a power of 80%, a one-sided alpha of 0.025, a prevalence of 65%, and a target sensitivity of 0.80. No acceptance criteria were defined specifically for Philips data, but the objective was to ensure similar trends in performance.
    Reported Performance: "The SWM v2 software applied to Philips data shows performance that aligns with previously reported assessment of the algorithm (K243862)." "The reported sensitivity and specificity of the SWM v2 software as compared to visual estimation of WMSI, indicate that the safety and effectiveness of the proposed subject software, SWM v2, is acceptable and aligns with the previously reported performance." (Specific numerical values for sensitivity and specificity for this clearance are not provided, only a statement of alignment with previous clearance K243862).
    2. Sample Size & Data Provenance (Test Set)Sample Size: Not explicitly stated for this particular evaluation, but the study was a retrospective data analysis.
    Data Provenance: Transthoracic (TTE) ultrasound clips obtained from subjects referred for clinical TTE exam. No country of origin is specified, but the data originates from "Philips data." The study was retrospective.
    3. Number & Qualifications of Experts (Ground Truth)Number of Experts: 3.
    Qualifications: "expert cardiologists." (No specific years of experience or subspecialty mentioned other than "cardiologist").
    4. Adjudication Method (Test Set)Two approaches for sensitivity and specificity analyses were tested:
    1. Comparison of the average WMSI from ground truthers to the SWM v2 software's WMSI.
    2. Majority agreement: A minimum of 2 out of 3 ground truthers were required to agree on WMSI = 1 (normal) or WMSI > 1 (abnormal) for the exam, which was then compared to the software's WMSI. |
      | 5. Multi-Reader Multi-Case (MRMC) Study | No, an MRMC comparative effectiveness study was not explicitly described. The study compared the algorithm's performance to expert visual estimation as the ground truth. |
      | 6. Standalone Performance | Yes, this was a standalone (algorithm only) performance evaluation against an expert-established ground truth. Although it is a "semi-automated quantitative imaging algorithm" where "users are generally expected to review and concur," the performance assessment described here focuses on the algorithm's output prior to user editing. |
      | 7. Type of Ground Truth Used | Expert consensus/visual estimation by 3 expert cardiologists. |
      | 8. Training Set Sample Size | Not provided in this document. This clearance refers to a previous clearance (K243862) for the SWM v2 algorithm. |
      | 9. Training Set Ground Truth Establishment | Not provided in this document. This clearance refers to a previous clearance (K243862). |

    Auto EF with Contrast

    Information RequestedDescription
    1. Acceptance Criteria and Reported Device PerformanceAcceptance Criteria: Lower Confidence Bound for the Pearson's correlation to be > 0.75. The expected value of the correlation coefficient is 0.85, and the lower bound is 0.75, computed with 80% power to detect a difference of -0.10 between the null hypothesis correlation of 0.75 and the alternative hypothesis correlation of 0.85 using a one-sided hypothesis test with a significance level of 0.025.
    Reported Performance: The acceptance criteria for the primary endpoint were met. The Pearson's correlation coefficient and associated confidence intervals are 0.952 (95%CI 0.919, 0.972).
    2. Sample Size & Data Provenance (Test Set)Sample Size: Not explicitly stated.
    Data Provenance: Transthoracic (TTE) contrast-enhanced clips obtained from subjects referred for clinical TTE exam. A sub-analysis was performed on data acquired with Philips systems. No country of origin is specified. The study was retrospective.
    3. Number & Qualifications of Experts (Ground Truth)Number of Experts: 3 sonographers for initial assessment and 1 cardiologist for final review.
    Qualifications: "qualified sonographers" and "Cardiologist specializing in echo." (No specific years of experience are provided).
    4. Adjudication Method (Test Set)Consensus with physician review:
    1. Manual selection of clips by an experienced sonographer.
    2. Manual EF assessment using Simpson's method of disks by 3 qualified sonographers.
    3. "Shoulder to shoulder" consensus meetings among the 3 sonographers to review manual measurements, jointly select best traced images ("Best Trace"), and adjust traces if needed.
    4. A cardiologist specializing in echo subsequently reviewed the selected A4C and A2C clips with "Best Trace" and the resulting LV EF measurements, performing manual adjustments if needed. These final measurements were used as ground truth. |
      | 5. Multi-Reader Multi-Case (MRMC) Study | No, an MRMC comparative effectiveness study was not explicitly described. This was a direct comparison of the algorithm's standalone performance against a consensus-derived ground truth. |
      | 6. Standalone Performance | Yes, the study describes the "Contrast EF application to an EF output" in an automated fashion, and "The ground truth EF measurements were compared to the Contrast EF automated results for EF (biplane)." This indicates a standalone performance evaluation. |
      | 7. Type of Ground Truth Used | Expert consensus (between 3 sonographers and 1 cardiologist) using manual EF assessment via Simpson's method of disks. |
      | 8. Training Set Sample Size | Not provided. This clearance refers to a previous clearance (K243235) for the Contrast EF algorithm. |
      | 9. Training Set Ground Truth Establishment | Not provided. This clearance refers to a previous clearance (K243235). |

    Overall Context:

    It's important to note that this 510(k) is a Special 510(k). This type of submission is usually for modifications to a currently cleared device where the changed device does not raise new questions of safety and effectiveness. Both SWM v2 and Auto EF with contrast were previously cleared as standalone applications (K243862 and K243235, respectively). This clearance focuses on integrating these previously cleared algorithms into the Philips EPIQ and Affiniti ultrasound systems and replacing an older SWM algorithm. Therefore, the performance studies described here are primarily to demonstrate that the algorithms maintain their previously established performance when integrated into the new platform, or to provide updated performance data for the newer version of the SWM algorithm.

    Ask a Question

    Ask a specific question about this device

    K Number
    K250030
    Date Cleared
    2025-04-28

    (112 days)

    Product Code
    Regulation Number
    892.1550
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Philips Ultrasound LLC

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The Flash Ultrasound System 5100 Point of Care (5100 POC and 5100 POC Pro) is indicated for diagnostic ultrasound imaging and fluid flow analysis of the human body, with the following indications for use:

    Abdominal, Adult Cephalic, Cardiac Adult, Cardiac Pediatric, Cerebral Vascular, Fetal/OB, Lung, Musculoskeletal (Conventional), Musculoskeletal (Superficial), Neonatal Cephalic, Ophthalmic, Other: Carotid, Other: GYN, Pediatric, Peripheral Vessel, Small Organ (Breast, Thyroid, Testicle), Trans-Esophageal (Cardiac), Trans-Vaginal.

    Modes of operation include B Mode (or 2D), Color Doppler, Color Power Angio Doppler, Continuous Wave Doppler, Pulse Wave Doppler, Tissue Doppler, M-Mode (including anatomical M-Mode), Harmonics (Tissue), and Combined modes.

    The clinical environments where the Flash Ultrasound System 5100 POC may be used are: hospitals, surgery centers, clinics, physicians' offices, diagnostic centers, critical care and emergency room environments, and point-of-care clinical settings for diagnosis of patients.

    The systems are intended to be installed, used, and operated only in accordance with the safety procedures and operating instructions given in the product user information. Systems are to be operated only by appropriately trained healthcare professionals for the purposes for which they were designed. However, nothing stated in the user information reduces the user's responsibility for sound clinical judgment and best clinical procedure.

    Device Description

    The Flash Ultrasound System 5100 Point of Care (POC) device is constructed with assets from the previously cleared 5000 Compact Series hardware platform (K222648) and a new Rhythm software platform that is new to the POC environment.

    The Flash Ultrasound System 5100 POC supports a full touch screen interface on the main display as the primary means of directing the system, leveraging customer familiarity with smart devices and the ease of cleaning and maintenance of a pure glass surface.

    Additionally, Flash Ultrasound System 5100 POC is designed to fit into tight spaces in a crowded Emergency Room (ER) with its small footprint, sleek design, and a large vertical tablet with ergonomic controls. The new Rhythm software offers point-of-contact workflow enhanced with assisted needle visualization, streamline point-of-care workflows such as flexible patient data management and AutoStrain EF. In addition to these POC workflows, the Rhythm software provides enhanced responsiveness with an easy-to-learn user interface as all controls are located in the same plane as the user's eye and hand for working more efficiently with the patient. The Flash Ultrasound System 5100 POC has two models, the 5100 POC and the 5100 POC Pro. The 5100 POC version does not support two transducers, C5-1 and X8-2t; however, the 5100 POC Pro supports all the transducers listed for the system.

    AI/ML Overview

    The provided FDA 510(k) clearance letter and summary for the Flash Ultrasound System 5100 Point of Care do not include detailed information about specific acceptance criteria related to its performance as a diagnostic imaging device (e.g., sensitivity, specificity, resolution), nor does it describe a study specifically designed to prove these performance metrics.

    Instead, the document focuses on demonstrating substantial equivalence to predicate devices through a combination of design features, intended use, fundamental scientific technology, and a comprehensive suite of non-clinical performance and safety testing.

    Here's an analysis based on the provided text, addressing the requested information to the extent possible:


    Acceptance Criteria and Study Proving Device Meets Criteria

    The submission primarily emphasizes compliance with recognized standards and verification testing against system and design specifications, rather than clinical performance metrics in a sense that would typically involve sensitivity, specificity, or human reader improvement with AI assistance.

    1. Table of Acceptance Criteria and Reported Device Performance

    Based on the provided text, the "acceptance criteria" are broad compliance with international standards and internal design specifications, and the "reported device performance" is that these criteria were met.

    Acceptance Criteria CategoryReported Device Performance
    Safety and EffectivenessDemonstrated through non-clinical performance testing and compliance with various IEC and ISO standards. All pre-determined acceptance criteria were met.
    System Level RequirementsAddressed according to system and design specifications.
    Risk Control MeasuresImplemented and verified through Risk Analysis and Risk Management activities (ISO 14971).
    Electromagnetic Compatibility (EMC)Complied with IEC 60601-1-2.
    UsabilityComplied with IEC 60601-1-6 and IEC 62366-1. User interface found safe and effective.
    Software Life Cycle ProcessComplied with IEC 62304.
    Ultrasonics Field Characterization (Thermal/Mechanical Indices)Complied with IEC 62359.
    BiocompatibilityNot needed as patient-contacting materials and manufacturing processes were not impacted, and common parts are used in other cleared systems.
    Design ControlsFollowed (Requirements Review, Risk Analysis, Product Specifications, Design Reviews, Verification).

    2. Sample Size Used for the Test Set and Data Provenance

    • Not explicitly stated for clinical performance. The document states: "The proposed Flash Ultrasound System 5100 POC did not require clinical data for determination of substantial equivalence." This implies that no clinical test set (patient data) was used in a comparative effectiveness study for this submission. The testing was primarily non-clinical.
    • Data Provenance: N/A for clinical performance. For non-clinical testing, the provenance would be internal Philips Ultrasound LLC laboratory testing.

    3. Number of Experts Used to Establish Ground Truth for the Test Set and Qualifications

    • Not applicable. Since clinical data was not required for substantial equivalence, there was no independent expert panel establishing ground truth on patient cases for performance evaluation.

    4. Adjudication Method for the Test Set

    • Not applicable. No clinical test set requiring adjudication was used.

    5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was Done

    • No. The document explicitly states: "The proposed Flash Ultrasound System 5100 POC did not require clinical data for determination of substantial equivalence." Therefore, no MRMC study was conducted to evaluate human reader improvement with AI assistance (as AI assistance is not mentioned as a feature of the device's diagnostic performance, but rather "assisted needle visualization" is a workflow enhancement).

    • Effect size of human readers improve with AI vs without AI assistance: Not applicable, as no such study was performed or needed for this clearance. The "assisted needle visualization" is a feature mentioned, but its impact on reader performance is not quantified in this submission.

    6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) was Done

    • Not applicable for diagnostic performance metrics. The device is an ultrasound system with various imaging modes and "assisted needle visualization." While there is a "new Rhythm software platform," the submission does not present it as a standalone diagnostic algorithm requiring performance metrics like sensitivity/specificity on its own. Its performance is integrated into the ultrasound system's overall functionality.

    7. The Type of Ground Truth Used

    • For non-clinical testing: The ground truth would be defined by the specifications and expected outputs of the system based on physical and engineering principles, verified through testing against known inputs or reference standards (e.g., phantom measurements, electrical signals, safety limits).
    • For diagnostic clinical performance: No clinical ground truth (e.g., expert consensus, pathology, outcomes data) was used or required for this 510(k) submission.

    8. The Sample Size for the Training Set

    • Not applicable. The submission does not describe the development or training of a de-novo AI algorithm that would require a "training set" in the context of generating diagnostic performance metrics. The "Rhythm software" is mentioned, and "assisted needle visualization" is a feature, but the document focuses on its equivalence and compliance, not on a machine learning training paradigm.

    9. How the Ground Truth for the Training Set was Established

    • Not applicable. As no training set for a diagnostic AI algorithm in the context of performance evaluation was described, the method for establishing its ground truth is not provided.
    Ask a Question

    Ask a specific question about this device

    K Number
    K250177
    Date Cleared
    2025-04-10

    (78 days)

    Product Code
    Regulation Number
    892.1550
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Philips Ultrasound LLC

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    EPIQ: The intended use of EPIQ Ultrasound Diagnostic System is diagnostic ultrasound imaging and fluid flow analysis of the human body, with the following indications for use: Abdominal, Cardiac Adult, Cardiac other (Fetal), Cardiac Pediatric, Cerebral Vascular, Cephalic (Adult), Cephalic (Neonatal), Fetal/Obstetric, Gynecological, Intraoperative (Vascular), Intraoperative (Cardiac), intra-luminal, intra-cardiac echo, Musculoskeletal (Conventional), Musculoskeletal (Superficial), Ophthalmic, Other: Urology, Pediatric, Peripheral Vessel, Small Organ (Breast, Thyroid, Testicle), Transesophageal (Cardiac), Transrectal, Transvaginal, Lung. When integrated with Philips EchoNavigator, the systems can assist the interventionalist and surgeon with image guidance during treatment of cardiovascular disease in which the procedure uses both live X-ray and live echo guidance.

    Affiniti: The intended use of Affiniti Series Diagnostic Ultrasound Systems is diagnostic ultrasound imaging and fluid flow analysis of the human body, with the following indications for use: Abdominal, Cardiac Adult, Cardiac Other (Fetal), Cardiac Pediatric, Cerebral Vascular, Cephalic (Adult), Cephalic (Neonatal), Fetal/Obstetric, Gynecological, Intraoperative (Vascular), Intraoperative (Cardiac), Musculoskeletal (Conventional), Musculoskeletal (Superficial), Other: Urology, Pediatric, Peripheral Vessel, Small Organ (Breast, Thyroid, Testicle), Transesophageal (Cardiac), Transrectal, Transvaginal, Lung.

    Device Description

    The purpose of this Traditional 510(k) Pre-Market Notification is to introduce Remote Software Management (RSM) software feature onto the EPIQ and Affiniti Series Diagnostic Ultrasound Systems. The proposed EPIQ Series Diagnostic Ultrasound System and Affiniti Series Diagnostic Ultrasound Systems with new RSM software feature, which is a workflow-enhancement software feature, is equivalent to predicate device, K242020. The Philips RSM feature provides the capabilities to remotely upgrade EPIQ/Affiniti Systems, with the existing RSM capabilities, only patch upgrade was possible, and full upgrade (including OS components) was not supported. The full RSM feature provides the capabilities to perform a remote upgrade to EPIQ/Affiniti Systems. The RSM feature is capable of deploying following packages onto the system: OS Packages, Device Drivers, Printer Drivers, BIOS/UEFI version, Application Packages, Service Application Packages, Automatic backup/restore of existing system settings. Along with the above functionalities, it also supports Automatic and Scheduled software downloads/Installation. No hardware changes to the EPIQ or Affiniti Systems are required when using RSM software feature, and existing, commercialized Philips transducers are used for the RSM software feature. The feature is supported by EPIQ and Affiniti models running software version 12.0.

    AI/ML Overview

    The provided FDA 510(k) clearance letter (K250177) describes the Philips EPIQ and Affiniti Series Diagnostic Ultrasound Systems with a new feature: Remote Software Management (RSM). The submission focuses on demonstrating substantial equivalence to a predicate device (K242020), specifically highlighting the enhancements to the RSM feature.

    Here's an analysis of the acceptance criteria and study information, based on the provided document:


    Acceptance Criteria and Device Performance

    The document describes the acceptance criteria in terms of the RSM feature's capabilities and its performance in comparison to the predicate device's existing RSM. The key acceptance criteria revolve around the ability to perform comprehensive remote software upgrades without compromising safety or effectiveness.

    Table 1: Acceptance Criteria and Reported Device Performance for Remote Software Management (RSM)

    Acceptance Criteria (Derived from "Application Description" and "Application performance" under Comparison)Reported Device Performance (as stated in the document)
    Ability to remotely upgrade to major software releases (full upgrade including OS components).The full RSM feature provides the capabilities to perform a remote upgrade to EPIQ/Affiniti Systems, including OS Packages, Device Drivers, Printer Drivers, BIOS/UEFI version, Application Packages, and Service Application Packages.
    Support for automatic backup/restore of existing system settings during upgrades.Supports "Automatic backup/restore of existing system settings."
    Support for automatic and scheduled software downloads/installation."Along with the above functionalities, it also supports Automatic and Scheduled software downloads/Installation."
    User interface facilitates download and installation process."The user can go into Philips Support Connect and navigate the download and installation process for system updates and upgrades. Additionally, Remote Software Management supports automatic and scheduled software downloads and installations."
    Verification of retention of all system settings and customizations post-installation."Remote Service Engineer performs verification post installation, verify all settings and customizations are retained."
    Installation verification via Philips Remote Service portal."Installation is verified through the Philips Remote Service portal."
    Overall application performance is equivalent to the predicate device."Verification and Validation Testing has been conducted on the RSM feature to support the Application performance is equivalent to the predicate device."

    Study Details for Demonstrating Equivalence and Meeting Criteria

    The provided document does not describe a clinical study or a comparative diagnostic performance study in the traditional sense, as the submission focuses on a software workflow enhancement feature (Remote Software Management). Instead, the "study" for this feature is a series of non-clinical performance tests and a demonstration of substantial equivalence.

    1. Sample sizes used for the test set and the data provenance:

    • Test Set Sample Size: Not explicitly stated as a numerical sample size of patient data or images. The "test set" in this context refers to the simulated testing environments or actual ultrasound systems used to validate the RSM feature.
    • Data Provenance: Not applicable in the context of diagnostic image data. The validation would have involved testing the software functionality on the EPIQ and Affiniti platforms. The document mentions "Philips Internal Procedures" for testing.

    2. Number of experts used to establish the ground truth for the test set and the qualifications of those experts:

    • Not applicable as this submission is for a software management feature, not a diagnostic algorithm that requires ground truth established by medical experts. The validation would have been performed by software/system engineers and subject matter experts in software deployment and system functionality.

    3. Adjudication method for the test set:

    • Not applicable for this type of submission. The "adjudication" would be internal verification and validation against functional and performance requirements by the development and quality assurance teams.

    4. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:

    • No MRMC comparative effectiveness study was done. This submission is for a Remote Software Management feature, which is a workflow enhancement for system maintenance, not a diagnostic AI tool that assists human readers.

    5. If a standalone (i.e. algorithm only without human-in-the loop performance) was done:

    • The "standalone" performance here refers to the RSM feature functioning correctly on its own in deploying software updates. The document states:
      • "All software verification tests met the acceptance criteria."
      • "Results of these tests show that the proposed Remote Software Management software feature meets the intended use."
      • This implies that the algorithm/feature was tested to ensure it performs its intended function (remote upgrades, backups, scheduled downloads) accurately and reliably.

    6. The type of ground truth used (expert consensus, pathology, outcomes data, etc.):

    • Not applicable in the medical/diagnostic sense. The "ground truth" for the RSM feature would be the successful execution of its defined functional and performance requirements (e.g., a software package is correctly installed, system settings are retained, the system remains operational after an upgrade).

    7. The sample size for the training set:

    • Not applicable. This is not a machine learning or AI algorithm in the context of diagnostic interpretation that requires a "training set" of patient data.

    8. How the ground truth for the training set was established:

    • Not applicable as there is no training set for a diagnostic algorithm.

    Summary of the Study and Equivalence Argument:

    The "study" described in K250177 for the Remote Software Management (RSM) feature primarily consisted of non-clinical performance testing and software verification/validation.

    • Approach: Philips evaluated the RSM feature against internal procedures, adhering to software lifecycle processes (IEC 62304) and risk management (ISO 14971).
    • Comparison Basis: The proposed RSM feature was compared to the predicate device's existing, more limited RSM capabilities (which only supported bug fixes and patch upgrades). The new feature expands this to include major software releases, OS components, drivers, BIOS/UEFI versions, application packages, service application packages, and automatic backup/restore.
    • Conclusion of Testing: "All software verification tests met the acceptance criteria." and "Results of these tests show that the proposed Remote Software Management software feature meets the intended use."
    • Substantial Equivalence Argument: The document argues that this enhancement is substantially equivalent to the predicate device because it does not introduce new questions of safety or effectiveness. The core function of the ultrasound system (diagnostic imaging) remains unchanged, and the RSM feature is purely a workflow enhancement for system maintenance. No hardware changes are required, and existing transducers are used. The comparison table directly addresses the differences and highlights how the improved RSM capabilities are an extension of the predicate's feature, not a fundamentally new diagnostic function.
    Ask a Question

    Ask a specific question about this device

    K Number
    K241659
    Date Cleared
    2025-02-10

    (245 days)

    Product Code
    Regulation Number
    892.2050
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Philips Ultrasound LLC

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    Indications for use of the product are quantification and reporting of cardiovascular, fetal, and abdominal structures and function of patients with suspected disease to support the physician in the diagnosis.

    Device Description

    The purpose of this Traditional 510(k) Pre-market Notification is to introduce the SWM, 3D Auto TV and 3D Auto CFQ software applications as well as compatibility of VeriSight ICE / Pro ICE Probe data with the subject device Ultrasound Workspace Version 6.0.

    The semi-automated Segmental Wall Motion feature (SWM) evaluates the segmental (regional) function of the left ventricle (LV) from adult TTE echo examinations. It performs border detection and tracking to identify each of the LV seqments, provides segmental wall motion scores for each segments of the LV by using machine learning algorithms and calculates an overall wall motion score index (WMSI) as the average of the segmental scores.

    3D Auto TV software enables semi-automated quantification of the tricuspid valve. At a high level, this is accomplished through automatically derived measurements from a segmented model of the tricuspid valve annulus formed by the software through model-based segmentation of the acquired ultrasound images.

    3D Auto CFQ provides semi-automated quantification of Mitral Requrgitation (MR) volume and peak flow rate based on 3D color flow images. This application uses a known fluid dynamic model of flow that is adapted to the acquired color information. This allows quantitative assessment of mitral valve leakage during systole. The derived result supports the assessment of mitral regurgitation volume and peak flow rate.

    Data Compatibility of the VeriSight ICE / Pro ICE Probe, transducers cleared for the EPIQ Series Diagnostic Ultrasound System (K202216), will be introduced for Ultrasound Workspace 6.0.

    General software architecture of the previously cleared version TOMTEC-ARENA remains unchanged. Two new clinical application packages will be introduced with UWS6.0: 3D Auto TV and 3D Auto CFQ. An existing feature AutoStrain Left Ventricle (AutoStrain LV) gains additional functionality by integration of Segmental Wall Motion (SWM) feature. The module using AutoStrain LV together with SWM is named 2D Auto LV.

    AI/ML Overview

    Here's a breakdown of the acceptance criteria and study information for the Philips Ultrasound Workspace (UWS 6.0) based on the provided text:

    1. Table of Acceptance Criteria and Reported Device Performance

    Feature/MetricAcceptance CriteriaReported Device Performance
    Segmental Wall Motion (SWM)
    Pearson's correlation coefficient for WMSI (compared to LVivo SWM)Lower Confidence Bound > 0.80.957 (95%CI 0.933, 0.972). Met acceptance criteria.
    3D Auto TV
    Limits of Agreement (LoA) for annulus size (distance) (compared to 4D Cardio-View)Within ± 46%LoA for annulus size within acceptance criteria.
    Limits of Agreement (LoA) for annulus shape (circumference) (compared to 4D Cardio-View)Within ± 52%LoA for annulus shape within acceptance criteria.
    Relative bias for distance (size) (compared to inter-observer variability)Within +/- 17.37%Met.
    Relative bias for circumference (shape) (compared to inter-observer variability)Within +/- 23.68%Met.
    Mean relative error of measurement primitives on in-silico phantomsWithin +/- 1%Met.
    Limits of Agreement for measurement primitives on in-silico phantomsWithin +/- 5%Met.
    3D Auto CFQ
    Maximum allowable difference (Δ) for regurgitant volume (compared to CMR)61.6 mLLower end of 95% Cl for LoA was -58.37, upper end of 95% Cl for LoA was 34.18. Met acceptance criteria.
    Mean difference (bias) for regurgitant volume (compared to CMR)Within +/- 19.2 mLMet.
    Pearson's correlation for peak regurgitant flow (compared to 2D PISA)Upper and lower bounds of 95% confidence interval > 0.8Exceeded acceptance criteria. Met acceptance criteria.

    2. Sample Size and Data Provenance

    • Segmental Wall Motion (SWM):

      • Test Set Sample Size: Not explicitly stated as a number, but the study involved "subjects referred for clinical TTE exam."
      • Data Provenance: Retrospective, from transthoracic (TTE) ultrasound clips. Country of origin not specified.
    • 3D Auto TV:

      • Test Set Sample Size: Not explicitly stated as a number, but involved "subjects whose clips contributed to the study." These subjects "represented a broad range of demographics, body habitus, and their severity of tricuspid regurgitation."
      • Data Provenance: Not explicitly stated as retrospective or prospective, but used "transesophageal echocardiography (TEE) cardiac clips." Country of origin not specified.
    • 3D Auto CFQ:

      • Test Set Sample Size: Not explicitly stated as a number, but involved "the same subjects" for comparisons between 3D Auto CFQ and 2D PISA.
      • Data Provenance: Not explicitly stated as retrospective or prospective. Used "acquired 3D color flow images" and compared to Cardiac Magnetic Resonance Imaging (CMR). Country of origin not specified.

    3. Number of Experts and Qualifications for Test Set Ground Truth

    • Segmental Wall Motion (SWM): Not applicable for SWM's primary validation as it was compared against another software application (LVivo SWM) as ground truth.
    • 3D Auto TV: 3 clinical experts (reviewers). Qualifications for these experts are not explicitly stated beyond "clinical experts (reviewers)."
    • 3D Auto CFQ: Not applicable for 3D Auto CFQ's primary validation as it was compared against CMR as ground truth, and for peak flow, against 2D PISA methodology.

    4. Adjudication Method for the Test Set

    • Segmental Wall Motion (SWM): Not applicable, as the comparison was algorithm-to-algorithm.
    • 3D Auto TV: No explicit mention of an adjudication method among the three experts. The text states "results compared to manual measurements by the same reviewers performed within 4D Cardio-View application, used as a ground truth." This implies individual expert measurements were used for comparison, but not necessarily adjudicated for consensus beyond the individual performing the manual measurement.
    • 3D Auto CFQ: Not applicable, as the comparison was against objective measures (CMR) and an accepted methodology (2D PISA).

    5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

    • No MRMC comparative effectiveness study is mentioned that measures the effect size of how much human readers improve with AI vs without AI assistance. The studies performed were for standalone performance (SWM, 3D Auto TV, 3D Auto CFQ algorithms) compared to established ground truths or other methods. A summative evaluation for 2D Auto LV, including SWM, indicated that "16 target users completed the critical tasks... with a success rate of 97.7%," but this is a user experience/usability study, not a comparative effectiveness study measuring improved human performance with AI.

    6. Standalone (Algorithm Only) Performance Study

    • Yes, standalone performance studies were done for each new feature:
      • SWM: The SWM algorithm's performance was evaluated against the LVivo SWM application ("ground truth"). This is a standalone algorithm-to-algorithm comparison.
      • 3D Auto TV: The 3D Auto TV software's performance was evaluated by comparing its derived measurements to manual measurements performed by clinical experts using the 4D Cardio-View application ("ground truth"). Although experts performed the "ground truth" measurements, the focus was on the algorithm's accuracy relative to these manual measurements.
      • 3D Auto CFQ: The 3D Auto CFQ software's performance was evaluated by comparing its regurgitant volume output to Cardiac Magnetic Resonance Imaging (CMR) ("ground truth") and its peak regurgitant flow output to the 2D PISA methodology. These are standalone evaluations of the algorithm's outputs.

    7. Type of Ground Truth Used

    • Segmental Wall Motion (SWM): Ground truth was established by comparing the SWM algorithm's output to the LVivo SWM (DiA Imaging Analysis) application. This is an algorithm-to-algorithm comparison where the comparator software is considered the ground truth.
    • 3D Auto TV: Ground truth was established by manual measurements performed by clinical experts within the 4D Cardio-View application. This represents expert-derived measurements from a reference software application. In-silico phantoms with known dimensions were also used for accuracy and precision of underlying measurement primitives.
    • 3D Auto CFQ:
      • For regurgitant volume: Cardiac Magnetic Resonance Imaging (CMR) regurgitant volume (RVol) was used. This is considered an outcomes data/reference standard.
      • For peak regurgitant flow: 2D PISA methodology was used. This is an expert-derived methodology/reference method.

    8. Sample Size for the Training Set

    • The document does not explicitly state the sample sizes used for training the machine learning algorithms for SWM, 3D Auto TV, or 3D Auto CFQ. It only refers to the retrospective nature of some of the test data.

    9. How the Ground Truth for the Training Set Was Established

    • The document does not explicitly describe how the ground truth for the training set was established for any of the machine learning algorithms. It mentions the "use of machine learning algorithms" but focuses on the validation (test set) ground truth.
    Ask a Question

    Ask a specific question about this device

    K Number
    K243794
    Date Cleared
    2025-02-06

    (58 days)

    Product Code
    Regulation Number
    892.1550
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Philips Ultrasound LLC

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    EPIQ: The intended use of EPIQ Ultrasound Diagnostic System is diagnostic ultrasound imaging and fluid flow analysis of the human body, with the following indications for use: Abdominal, Cardiac Adult, Cardiac other (Fetal), Cardiac Pediatric, Cerebral Vascular, Cephalic (Adult), Cephalic (Neonatal), Fetal/Obstetric, Gynecological, Intraoperative (Vascular), Intraoperative (Cardiac), intra-luminal, intra-cardiac echo, Musculoskeletal (Conventional), Musculoskeletal (Superficial), Ophthalmic, Other: Urology, Pediatric, Peripheral Vessel, Small Organ (Breast, Thyroid, Testicle), Transesophageal (Cardiac), Transrectal, Transvaginal, Lung. Modes of operation include: B Mode, M Mode, PW Doppler, CW Doppler, Color Doppler, Color M Mode . Power Doppler and Harmonic Imaging. The clinical environments where EPIQ Series Diagnostic Ultrasound Systems can be used include clinics, hospitals, and clinical point-of-care for diagnosis of patients. When integrated with Philips EchoNavigator, the systems can assist the interventionalist and surgeon with image guidance during treatment of cardiovascular disease in which the procedure uses both live X-ray and live echo quidance. The systems are intended to be installed, used, and operated only in accordance with the safety procedures and operating instructions given in the product user information. Systems are to be operated only by appropriately trained healthcare professionals for the purposes for which they were designed. However, nothing stated in the user information reduces your responsibility for sound clinical judgement and best clinical procedure.

    Affiniti: The intended use of Affiniti Series Diagnostic Ultrasound Systems is diagnostic ultrasound imaging and fluid flow analysis of the human body, with the following indications for use. Abdominal, Cardiac Adult, Cardiac Other (Fetal), Cardiac Pediatric, Cerebral Vascular, Cephalic (Adult), Cephalic (Neonatal), Fetal/Obstetric, Gynecological, Intraoperative (Vascular), Intraoperative (Cardiac), Musculoskeletal (Conventional), Musculoskeletal (Superficial), Other: Urology, Pediatric, Peripheral Vessel, Small Organ (Breast, Thyroid, Testicle), Transesophageal (Cardiac), Transrectal, Transvaginal, Lung. Modes of operation include: B Mode, M Mode, PW Doppler, CW Doppler, Color Doppler, Color M Mode , Power Doppler and Harmonic Imaging. The clinical environments where the Affiniti diagnostic ultrasound systems can be used include clinics, hospitals, and clinical point-of-care for diagnosis of patients. The systems are intended to be installed, used, and operated only in accordance with the safety procedures and operating instructions given in the product user information. Systems are to be operated only by appropriately trained healthcare professionals for the purposes for which they were designed. However, nothing stated in the user information reduces your responsibility for sound clinical judgement and best clinical procedure.

    Device Description

    The purpose of this Traditional 510(k) Pre-Market Notification is to introduce the change in AutoMeasure V3 software application onto the EPIQ Series Diagnostic Ultrasound Systems and Affiniti Series Diagnostic Ultrasound Systems. Philips AutoMeasure feature provides the end user semi-automated 2D, Doppler and M-mode measurements with an adult cardiology transthoracic transducer and acquisitions that includes an electrocardiogram (ECG). The Auto Measure feature is designed to provide semi-automated and editable measures during an echocardiography. When Auto Measure is enabled, the healthcare professional performs an echocardiography with a workflow that provides the user with a semiautomated measurement that can be edited, accepted, or rejected. AutoMeasure is available in the Adult Echo analysis applications with ECG. Availability is also controlled by transducer and preset via the EPM. The software applications are supported by all EPIQ and Affiniti models running software version 13.0 or higher.

    AI/ML Overview

    Here's an analysis of the acceptance criteria and study proving the device meets those criteria, based on the provided FDA 510(k) summary for Philips AutoMeasure V3 software.

    Overview of the Device and Study:
    The Philips AutoMeasure V3 software is an optional feature for EPIQ and Affiniti Series Diagnostic Ultrasound Systems. It provides semi-automated 2D, Doppler, and M-mode measurements during adult transthoracic echocardiography (TTE) using an AI-algorithm trained via machine learning. The study aimed to evaluate the performance of AutoMeasure V3 compared to standard of care (SOC) measurements.


    1. Table of Acceptance Criteria and Reported Device Performance

    The document doesn't explicitly list a table of acceptance criteria in numerical ranges for specific performance metrics (e.g., "accuracy > X%"). Instead, it describes a general acceptance methodology:

    Acceptance Criteria for AutoMeasure V3 Software:
    "meeting the pre-defined acceptance criteria for the study. Taken together, the results of the study demonstrated clinically reasonable, relevant and meaningful performance of the AutoMeasure V3 software supporting automation of measurements during cardiac TTE exams. Specifically, success on the hypotheses testing for AutoMeasure V3 agreement with ground truth measurements indicate that the safety and effectiveness of the proposed software is acceptable and aligns with previously reported agreement for cardiac assessment. Since the acceptance criteria were based on inter-observer data for echocardiographic measurements, the AutoMeasure V3 performance supports the conclusion that the algorithm behaves like any average human observer. Therefore, the clinical acceptability of AutoMeasure V3 is met."

    This implies that the acceptance criteria for each of the 32 tested hypotheses were based on achieving agreement within the confidence intervals typically observed between human observers for echocardiographic measurements. The specific numerical thresholds for these confidence intervals are not provided in the summary.

    Reported Device Performance:
    The study concluded: "The results of the 32 hypotheses tested, demonstrated high agreement of AutoMeasure V3 software with Standard of Care Measurements (ground truth) obtained during initial subject exam, by producing confidence intervals for the limits of agreement, for each parameter (hypothesis) tested, meeting the pre-defined acceptance criteria for the study."

    This indicates that for all 32 tested parameters, the AutoMeasure V3's performance was within the pre-defined limits of agreement, deemed comparable to human inter-observer variability.


    2. Sample Size Used for the Test Set and Data Provenance

    • Test Set Sample Size: 7127 transthoracic echocardiography (TTE) cardiac clips from 3964 subjects.
    • Data Provenance: Retrospective, multi-institutional.
      • Country of Origin: USA, Asia, and Europe.
      • Retrospective/Prospective: "Subjects were enrolled at institutions between 2015 and June 2024, and the timeframes varied for different hospitals." This indicates retrospective data collection from existing patient records/imaging archives.
      • Nature of Data: "Patients referred for clinical TTE as well as healthy volunteers were invited to participate."

    3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications

    • Number of Experts: Not explicitly stated as a specific number of unique experts who reviewed the test set for adjudication. The document states "Standard of Care (SOC) measurements obtained during initial subject visit, performed by qualified healthcare professional(s)." This implies that the ground truth was established by the original healthcare professional(s) performing the TTE exam in clinical practice.
    • Qualifications of Experts: "qualified healthcare professional(s)". Specific qualifications (e.g., radiologist, cardiologist, sonographer, years of experience) are not detailed beyond "qualified". Given the context of echocardiography, these would likely be sonographers or cardiologists.

    4. Adjudication Method for the Test Set

    • Adjudication Method: Not explicitly described. The ground truth was based on "Standard of Care (SOC) measurements obtained during initial subject visit." This suggests a single reader paradigm where the initial clinical measurement serves as the ground truth, rather than a multi-reader consensus process specifically for the study.

    5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done

    • MRMC Study: No, a traditional MRMC comparative effectiveness study where multiple human readers systematically re-read cases with and without AI assistance was not explicitly described. The study focused on the agreement between the AI's measurements and existing Standard of Care human measurements.
    • Effect Size of Human Improvement with AI Assistance: Not applicable, as this type of MRMC study was not performed. The study aimed to show that the AI's measurements were comparable to typical human variability.

    6. If a Standalone (Algorithm Only) Performance Study Was Done

    • Standalone Performance: Yes, implicitly. The "Performance Validation Study" evaluated "the performance of the AutoMeasure V3 software... compared to ground truth." While the user can edit the semi-automated measurements, the study's focus on "agreement of AutoMeasure V3 software with Standard of Care Measurements" suggests an evaluation of the algorithm's initial output before human intervention, establishing its standalone capability. The document states, "AutoMeasure V3 is created semi-automatically using machine learning algorithm without user interaction."

    7. The Type of Ground Truth Used

    • Type of Ground Truth: Expert consensus (implicitly, as SOC measurements by "qualified healthcare professional(s)"). More specifically, it is "Standard of Care (SOC) measurements obtained during initial subject visit". This suggests reliance on clinical practice measurements rather than a separate, dedicated "gold standard" panel review or pathological confirmation.

    8. The Sample Size for the Training Set

    • Training Set Sample Size: Not explicitly stated in this 510(k) summary. The document mentions "training via machine-learning techniques" but does not give the size of the dataset used for this training.

    9. How the Ground Truth for the Training Set Was Established

    • Training Set Ground Truth Establishment: Not explicitly stated in this 510(k) summary. However, it's highly probable that the training data's ground truth was also established by human expert annotation or existing clinical measurements, similar to how the test set ground truth was derived.
    Ask a Question

    Ask a specific question about this device

    K Number
    K242020
    Date Cleared
    2024-12-12

    (154 days)

    Product Code
    Regulation Number
    892.1550
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Philips Ultrasound LLC

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    EPIQ:
    The intended use of EPIQ Ultrasound Diagnostic System is diagnostic ultrasound imaging and fluid flow analysis of the human body, with the following indications for use:

    Abdominal, Cardiac Adult, Cardiac other (Fetal), Cardiac Pediatric, Cerebral Vascular, Cephalic (Neonatal), Fetal/Obstetric, Gynecological, Intraoperative (Cardiac), intra-luminal, intra-luminal, intra-luminal, intra-cardiac echo, Musculoskeletal (Conventional), Musculoskeletal (Superficial), Ophthalmic, Other: Urology, Pediatric, Peripheral Vessel, Small Organ (Breast, Thyroid, Testicle), Transesophageal (Cardiac), Transveginal, Lung.

    Modes of operation include: B Mode, PW Doppler, CW Doppler, Color Doppler, Color M Mode, Power Doppler, and Harmonic Imaging.

    The clinical environments where EPIQ Series Diagnostic ultrasound Systems can be used include clinics, hospitals, and clinical point-of-care for diagnosis of patients.

    When integrated with Philips EchoNavigator, the systems can assist the interventionalist and surgeon with image guidance during treatment of cardiovascular disease in which the procedure uses both live X-ray and live echo guidance.

    The systems are intended to be installed, used, and operated only in accordance with the safety procedures and operating instructions given in the product user information. Systems are to be operated only by appropriately trained healtheare professionals for the purposes for which they were designed. However, nothing stated in the user information reduces your responsibility for sound clinical judgement and best clinical procedure.

    Affiniti:
    The intended use of Affiniti Series Diagnostic Ultrasound Systems is diagnostic ultrasound imaging and fluid flow analysis of the human body, with the following indications for use:

    Abdominal, Cardiac Adult, Cardiac Other (Fetal), Cardiac Pediatric, Cerebral Vascular, Cephalic (Neonatal), Fetal/Obstetric, Gynecological, Intraoperative (Vascular), Intraoperative (Cardiac), Musculosketal (Conventional), Musculoskeletal (Superficial), Other: Urology, Pediatric, Peripheral Vessel, Small Organ (Breast, Thyroid, Testicle), Transesophageal (Cardiac), Transrectal, Transvaginal, Lung.

    Modes of operation include: B Mode, PW Doppler, CW Doppler, Color Doppler, Color M Mode, Power Doppler, and Harmonic Imaging.

    The clinical environments where the Affiniti diagnostic ultrasound systems can be used include clinics, hospitals, and clinical point-of-care for diagnosis of patients.

    The systems are intended to be installed, used, and operated only in accordance with the safety procedures and operating instructions given in the product user information. Systems are to be operated only by appropriately trained healtheare professionals for the purposes for which they were designed. However, nothing stated in the user information reduces your responsibility for sound clinical judgement and best clinical procedure.

    Device Description

    The purpose of this Traditional 510(k) Pre-Market Notification is to introduce the Auto ElastQ software feature onto the EPIQ and Affiniti Series Diagnostic Ultrasound Systems. The proposed EPIQ Series Diagnostic Ultrasound System and Affiniti Series Diagnostic Ultrasound Systems with new Auto ElastQ software feature, which is a workflow-enhancement software feature, is equivalent to predicate device, K240850.

    The Auto ElastQ software feature is intended to assist users in making stiffness measurements using 2D-SWE in the liver by recommending specific frames and ROI positions to the user.

    No hardware changes to the EPIQ or Affiniti Systems are reguired when using the Auto ElastQ software feature, and existing, commercialized Philips transducers are used for the Auto ElastQ software feature. The feature is supported by EPIQ and Affiniti models running software version 12.0.

    AI/ML Overview

    Here's a summary of the acceptance criteria and the study conducted for the Philips Auto ElastQ software feature, based on the provided FDA 510(k) summary:

    1. Table of Acceptance Criteria and Reported Device Performance

    Acceptance Criteria CategoryAcceptance Criteria (Implicit for high agreement)Reported Device Performance
    Agreement with Manual Elastography MeasurementsHigh agreement between algorithm-generated measurements and manual measurements.Demonstrated high agreement of Auto ElastQ algorithm-generated measurements with manual elastography measurements based on statistical analysis.

    2. Sample Size Used for the Test Set and Data Provenance

    • Test Set Sample Size: Not explicitly stated. The document mentions "a retrospective data analysis study was conducted to evaluate the performance of the Auto ElastQ software compared to manual measurements."
    • Data Provenance: Retrospective data analysis. Country of origin not specified.

    3. Number of Experts Used to Establish Ground Truth for the Test Set and Qualifications

    • Number of Experts: Not explicitly stated. The ground truth was established by "manual measurements performed by expert readers."
    • Qualifications of Experts: Not explicitly stated beyond "expert readers."

    4. Adjudication Method for the Test Set

    • Adjudication Method: Not explicitly stated. The ground truth was established by "manual measurements performed by expert readers," implying an expert consensus or single expert reading for the manual measurements. No information suggestive of a 2+1 or 3+1 method is provided.

    5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

    • MRMC Study: No. This document describes a study comparing the algorithm's performance to expert manual measurements, not a comparative effectiveness study of human readers with and without AI assistance.

    6. Standalone (Algorithm Only) Performance Study

    • Standalone Study: Yes. The "retrospective data analysis study" directly evaluated the performance of the Auto ElastQ software (algorithm) "compared to manual measurements performed by expert readers." This indicates a standalone performance assessment of the algorithm.

    7. Type of Ground Truth Used

    • Ground Truth Type: Expert consensus/manual measurements. The summary states, "with the manual measurements used as ground truth for the study."

    8. Sample Size for the Training Set

    • Training Set Sample Size: Not explicitly stated. The document focuses on the performance study and does not detail the training set size for the AI algorithm.

    9. How Ground Truth for the Training Set Was Established

    • Training Set Ground Truth Establishment: Not explicitly stated. The document describes the "Auto ElastQ software feature is intended to assist users in making stiffness measurements using 2D-SWE in the liver by recommending specific frames and ROI positions to the user." While the testing involves expert manual measurements as ground truth, the method for establishing ground truth for the training data used to develop the algorithm is not detailed in this summary.
    Ask a Question

    Ask a specific question about this device

    K Number
    K242800
    Date Cleared
    2024-11-15

    (59 days)

    Product Code
    Regulation Number
    892.1550
    Reference & Predicate Devices
    Why did this record match?
    Applicant Name (Manufacturer) :

    Philips Ultrasound LLC

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The intended use of the 5000 Compact series ultrasound systems is diagnostic ultrasound imaging and fluid flow analysis of the human body with the following Indications for Use:Abdominal, Cardiac Adult, Cardiac Pediatric, Carotid, Cerebral Vascular, Cephalic (Adult),Cephalic (Neonatal), Fetal Echo, Fetal/Obstetric, Gynecological, Intraoperative (Vascular), Lung, Musculoskeletal (Conventional), Musculoskeletal (Superficial), Ophthalmic, Pediatric, Peripheral Vessel, Small Parts, Transesophageal (Cardiac), Transrectal, Transvaginal, and Urology.

    Device Description

    The purpose of this Traditional 510(k) Pre-Market Notification is to introduce the Auto Measure Artificial Intelligence-Machine Learning software feature onto the 5000 Compact Series Ultrasound Systems.

    The Auto Measure feature utilizes machine learning to provide a subset of semi-automated and editable measures during an echocardiography or when reviewing an already acquired echocardiography. When Auto Measure Version 2 is enabled, the healthcare professional performs an echocardiography with a workflow that provides the user with a semi-automated measurement that can be edited, accepted, or rejected.

    Philips has designed Auto Measure as a "locked" algorithm prior to marketing. As defined by FDA in the discussion paper Proposed Requlatory Framework for Modifications to AI/ML Based Software as a Medical Device (SaMD) published April 2, 2019, this "locked" algorithm provides the same result each time the same input is applied to it and does not change with use.

    The Auto Measure software feature does not introduce new modes, presets, measurements, or system components (e.g. transducers) to the Philips 5000 Compact Series Ultrasound Systems K222648.

    No hardware changes to the 5000 Compact Series Ultrasound Systems K222648 are required when using the Auto Measure feature, and existing, commercialized Philips transducers are used for the Auto Measure feature.

    5000 Compact Series Ultrasound Systems are part of the VM platform product family, The Auto Measure Version 1 feature was originally cleared (K211597) on EPIQ and Affiniti models running software version 9.0 (VM9.0). The Auto Measure feature is also available to all software releases following VM9.0.

    Since the initial Auto Measure feature initial clearance (Version 1.0), a subset of integrated measurement detectors has been trained with additional training data in the Auto Measure feature (Version 2) which is scope of this submission

    Auto Measure for this premarket notification utilizes the same software version platform VM as the Reference Device, Affiniti Diagnostic Ultrasound Systems K211597.

    AI/ML Overview

    This document describes the Philips 5000 Compact Series Ultrasound Systems with the new Auto Measure Version 2 AI-Machine Learning software feature. The information provided focuses on the performance data to demonstrate substantial equivalence.

    1. Table of Acceptance Criteria and Reported Device Performance

    The acceptance criteria for each measurement detector are based on the Checked Limits of Agreement (LoAs), derived from clinical literature on human interobserver variability. The reported device performance is the Measured Limits of Agreement (LoA) between the detector's prediction and the manual ground truth. Each detector met its specified acceptance criteria.

    ParameterDetectorN (Sample Size)Checker Limits of Agreement (LoAs)Measured Limits of Agreement (LoA) (detector prediction vs manual ground truth)
    Ao Sinus DiameterDETECTOR_ID_BMOD E_AO_AOSV308[-35.0%, 35.0%][-11.0022%, 11.2816%]
    Ao STJ DiameterDETECTOR_ID_BMOD E_AO_AOSTJ301[-35.0%, 35.0%][-11.4181%, 13.1139%]
    Asc Ao DiameterDETECTOR_ID_BMOD E_AO_AOASC204[-35.0%, 35.0%][-14.7794%, 15.9598%]
    IVSdDETECTOR_ID_BMOD E_LV_LVDISTANCE_S AME_LINE305[-35.0%, 35.0%][-33.2114%, 28.1632%]
    LVIDdDETECTOR_ID_BMOD E_LV_LVDISTANCE_S AME_LINE457[-35.0%, 35.0%][-14.1564%, 12.4223%]
    LVIDsDETECTOR_ID_BMOD E_LV_LVID_ES469[-35.0%, 35.0%][-23.4752%, 26.0242%]
    LVOT DiameterDETECTOR_ID_BMOD E_LV_LVOT453[-35.0%, 35.0%][-17.729%, 16.1588%]
    LVPWdDETECTOR_ID_BMOD E_LV_LVDISTANCE_S AME_LINE305[-35.0%, 35.0%][-33.1364%, 29.9544%]
    RV BaseDETECTOR_ID_BMOD E_RV_RVD_BASE302[-35.0%, 35.0%][-16.1373%, 25.9079%]
    RV MidDETECTOR_ID_BMOD E_RV_RVD_MID243[-35.0%, 35.0%][-25.0913%, 30.2573%]
    RV LengthDETECTOR_ID_BMOD E_RV_RVL117[-35.0%, 35.0%][-14.6089%, 13.3871%]
    TV AnnulusDETECTOR_ID_BMOD E_RV_TVANN53[-35.0%, 35.0%][-19.3628%, 18.0347%]
    MV Decel. TimeDETECTOR_ID_DOPPLER_MV_DECEL_E_DURATION136[-25.0%, 25.0%][-23.5717%, 22.8591%]
    MV Peak A VelDETECTOR_ID_DOPPLER_MV_VMAX_A_VELOCITY229[-24.0%, 24.0%][-12.3694%, 15.2363%]
    MV Peak E VelDETECTOR_ID_DOPPLER_MV_VMAX_E_VELOCITY136[-24.0%, 24.0%][-9.2081%, 9.1223%]
    AV VTIDETECTOR_ID_DOPPLER_AV_VTI247[-22.0%, 22.0%][-21.5393%, 19.8925%]
    LVOT VTIDETECTOR_ID_DOPPLER_LVOT_VTI234[-22.0%, 22.0%][-17.267%, 17.2093%]
    PV VTIDETECTOR_ID_DOPPLER_PV_VTI66[-22.0%, 22.0%][-20.6140%, 21.0567%]

    2. Sample Sizes Used for the Test Set and Data Provenance

    The test set consisted of a total of 500 studies, with one study per subject. This included 200 known normal subjects and 300 patients with a confirmed pathology.

    The data provenance is described as:

    • Anonymized transthoracic echocardiography DICOM data and metadata.
    • Data recorded by multiple sonographers and physicians qualified in echocardiography.
    • Large sample of adults of various ethnicities.
    • Echocardiographic recordings acquired according to guideline-standard echocardiographic procedures between 2010 and 2021.
    • Data collected from 20 centers and 16 countries.

    The number of studies used for validation (N) per specific detector varied, as not all measurements are performed in all studies, ranging from 53 to 469 as shown in the table above.

    3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts

    The ground truth for the test set was established by clinical experts during routine care. While the exact number is not specified for the test set's ground truth, it is stated that "All detector models were trained from the ground up... Training of the detectors was based on manual measurements performed by human experts done for diagnostic purpose." This implies the ground truth for both training and testing was established by qualified human experts performing manual measurements for diagnostic purposes. The data was collected by "multiple sonographers and physicians qualified in echocardiography."

    4. Adjudication Method for the Test Set

    The adjudication method is not explicitly described as a formal 'X+Y' consensus method. The document states that the Auto Measure results were "compared to ground truth measurements established by clinical experts during routine care." This suggests that the established clinical measurements served as the ground truth directly for comparison, rather than a separate adjudication process of multiple readers for the test set.

    5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done, and the Effect Size of How Much Human Readers Improve with AI vs. Without AI Assistance

    A Multi-Reader Multi-Case (MRMC) comparative effectiveness study was not explicitly detailed in this summary. The study focuses on evaluating the standalone performance of the Auto Measure feature against expert manual measurements, using human-human interobserver variability data from clinical studies as a benchmark for acceptance criteria, not for direct comparison of human performance with and without AI assistance. The document mentions that the feature is a "workflow improvement" and that "the operator is responsible for the final result and has to apply manual edits to the automated output whenever required."

    6. If a Standalone (Algorithm Only Without Human-in-the-Loop Performance) Was Done

    Yes, a standalone performance study was done. The "Detector performance results" table directly compares the "detector prediction" against "manual ground truth." The text further clarifies: "Auto Measure analyzed a set of new, previously images, and its automated results were compared to ground truth measurements established by clinical experts during routine care. Both the manual and automated measurements were performed on the same images without any adjustments to the software's output or the clinical data used as ground truth." This indicates a direct evaluation of the algorithm's output without human intervention in the Auto Measure readings during the test phase.

    7. The Type of Ground Truth Used

    The ground truth used was expert consensus / manual measurements performed by clinical experts during routine care for diagnostic purposes. These manual measurements are considered the "current gold standard" against which the Auto Measure output is compared.

    8. The Sample Size for the Training Set

    The total training pool comprises more than 6000 studies.

    9. How the Ground Truth for the Training Set Was Established

    The ground truth for the training set was established through manual measurements performed by human experts for diagnostic purposes. The data was collected by "qualified medical [personnel] in echocardiography using TTA software (versions TTA2.31.00 and TTA2.50.00) or various Philips ultrasound systems annotation and following established guidelines (Mitchel et al 2019)." These data were then used for training and tuning in a cross-validation framework.

    Ask a Question

    Ask a specific question about this device

    Page 1 of 2