Search Results

EchoSolv AS is a machine learning (ML) and artificial intelligence (AI) based decision support software indicated for use as an adjunct to echocardiography for assessment of severe aortic stenosis (AS).

When utilized by an interpreting physician, this device provides information to facilitate rendering an accurate diagnosis of AS. Patient management decisions should not be made solely on the results of the EchoSolv AS analysis.

EchoSolv AS includes both the algorithm based AS phenotype analysis, and the application of recognized AS clinical practice quidelines.

Limitations: EchoSolv AS is not intended for patients under the age of 18 years or those who have previously undergone aortic valve replacement surgery

EchoSolv AS is a standalone, cloud-based decision support software which is intended to be used certified cardiologist to aid in the diagnosis of Severe Aortic Stenosis. EchoSolv AS analyzes basic patient demographic data and measurements obtained from a transthoracic echo examination to provide a categorical assessment as to whether the data are suggestive of a high, medium or low probability of Severe AS. EchoSolv AS is intended for patients who 18 years or older who have an echocardiogram performed as part of routine clinical care (i.e., for the evaluation of structural heart disease).

Patient demographic and echo measurement data is automatically processed through the artificial intelligence algorithm which provides an output regarding the probability of a Severe AS phenotype to aid in the clinical diagnosis of Severe AS during the review of the patient echo study and generation of the final study report, according to current clinical practice guidelines. The software provides an output on the following assessments:

1. Severe AS Phenotype Probability

Whether the patient has a high, medium, or low probability of exhibiting a Severe AS phenotype, based on analysis by the EchoSolv AS proprietary Al algorithm, that the determined predicted AVA is ≤1.0cm². The Al probability score requires a minimum set of data inputs to provide a valid output but is based on all available echocardiographic measurement data and does not rely on the traditional LVOT measurements used to in the continuity equation.

2. Severe AS Guideline Assessment

Whether the patient meets the definition for Severe AS based on direct evaluation of provided echocardiogram data measurements (AV Peak Velocity, AV Mean Gradient and AV Area) with current clinical practice guidelines (2020 ACC/AHA Guideline for the Management of Patients with Valvular Heart Disease).

EchoSolv AS is intended to be used by board-certified cardiologists who review echocardiograms during the evaluation and diagnosis of structural heart disease, namely aortic stenosis. EchoSolv AS is intended to be used in conjunction with current clinical practices and workflows to improve the identification of Severe AS cases.

Here's an analysis of the acceptance criteria and study detailed in the provided document for the EchoSolv AS device:

1. Table of Acceptance Criteria and Reported Device Performance

The document does not explicitly state "acceptance criteria" in a tabulated format. However, based on the performance data presented, the implicit acceptance criteria can be inferred from the reported performance and comparison to a predicate device. The performance metrics reported are AUROC, Sensitivity, Specificity, Diagnostic Likelihood Ratios (DLR), and improvement in reader AUROC and concordance in the MRMC study.

2. Sample Size Used for the Test Set and Data Provenance

• Standalone Performance Test Set:
  • Sample Size: 6,268 studies.
  • Data Provenance: The document states the dataset for model development was randomly split into training and test sets. The standalone performance testing was performed on an "independent retrospective cohort study" meaning the data was collected from past records. The country of origin for this specific retrospective cohort is not explicitly stated, but it's implied to be within a clinical setting that would allow for US board-certified cardiologists to review and verify the data.
• Clinical Performance (MRMC) Test Set:
  • Sample Size: 200 retrospective transthoracic echocardiogram (TTE) studies (100 disease cases, 100 control studies).
  • Data Provenance: Retrospective, performed at "one investigational site in the US."

3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts

• Standalone Performance Test Set:
  • Number of Experts: More than one, implied by "US board certified cardiologists" (plural).
  • Qualifications: "US board certified cardiologists." No specific years of experience are mentioned.
• Clinical Performance (MRMC) Test Set:
  • Number of Experts: Two.
  • Qualifications: "board certified cardiologists." No specific years of experience are mentioned.

4. Adjudication Method for the Test Set

• Standalone Performance Test Set: The ground truth was established by "US board certified cardiologists, who reviewed and verified the echocardio data and hemodynamic profile... and were blinded to the device output." This implies a consensus or majority rule adjudication among the "cardiologists" if multiple were involved per case. There is no explicit "2+1" or "3+1" method mentioned, but rather a verification process.
• Clinical Performance (MRMC) Test Set: "The total test dataset was reviewed by two board certified cardiologists to confirm the presence and severity of Severe AS." This suggests a 2-reader agreement for the ground truth. If there was disagreement, an implied adjudication process (e.g., a third reader or consensus discussion) would be needed, but it is not specified.

5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done, If So, What Was the Effect Size of How Much Human Readers Improve with AI vs. Without AI Assistance

• Yes, a MRMC comparative effectiveness study was done.
• Effect Size of Improvement:
  • Mean AUROC Improvement: 0.018 (95% CI: 0.037-0.001; p=0.064).
  • Reader Concordance Improvement: 0.027 (from 0.641 unassisted to 0.667 assisted).

6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) Was Done

• Yes, a standalone performance testing was performed. The objective was to assess the "native system performance of the EchoSolv AS model in its ability to detect Severe AS."

7. The Type of Ground Truth Used

• Standalone Performance Test Set: Expert consensus based on "the assessment of the presence of severe aortic stenosis (defined as an AVA≤1 cm²) by US board certified cardiologists, who reviewed and verified the echocardio data and hemodynamic profile." This combines clinical assessment using a specific echocardiographic measurement (AVA) and expert review.
• Clinical Performance (MRMC) Test Set: Expert consensus. "The total test dataset was reviewed by two board certified cardiologists to confirm the presence and severity of Severe AS."

8. The Sample Size for the Training Set

• 442,276 individuals (from a total dataset of 631,824 individuals).

9. How the Ground Truth for the Training Set Was Established

The document states: "The EchoSolv AS Al Model was developed on a dataset consisting of 631,824 individuals with 1,077,145 transthoracic echocardiograms (TTE)." It also notes that the model was trained "to detect severe AS cases." While implied that the training set also used ground truth related to severe AS detection, the specific methodology for establishing ground truth for the training set is not explicitly detailed in the provided text. It is reasonable to infer it would be similar to the test set ground truth (expert clinical assessment based on echocardiographic data), but this is not directly stated.

Ask a specific question about this device

1. EchoSK and EchoSGyn Modules are additional software/hardware modules for EchoS Family devices and they are additions in terms of indication for use of the legally marketed EchoS Family.

2. EchoSK optional module for EchoS Family devices is intended to provide images of, or signals from, inside the body acquired by an appropriately trained professional in a clinical setting for musculoskeletal applications. The EchoSK module can be used both with a convex or a linear probe.

3. EchoSGyn optional module for EchoS Family devices is intended to provide images of, or signals from, inside the body acquired by an appropriately-trained professional in a clinical setting for Fetal and OB/GYN (useful for visualization of the ovaries, follicles, uterus and other pelvic structures) applications. The EchoSCyn module can be used both with a convex or with an endocavitary probe.

EchoSK and EchoSGyn are optional modules for EchoS Family devices.

EchoSK is an optional module of the EchoStudio software that allows the operator to visualize echographic images for musculoskeletal applications. The EchoSK module can be used both with a convex or a linear probe.

EchoSGyn is an optional module of EchoStudio that allows the operator to visualize echographic images for gynecological/obstetric applications. EchoSGyn module can be used both with a convex or with an endocavitary probe.

The provided FDA 510(k) summary (K212851) does not contain information regarding objective performance criteria that the device (EchoSK and EchoSGyn Modules for EchoS Family devices) meets through a specific clinical study with a test set, ground truth, and expert adjudication.

Instead, the submission focuses on demonstrating substantial equivalence to predicate devices (K202683 and K202514) based on:

• Intended Use: The new modules extend the existing EchoS Family devices to include musculoskeletal (EchoSK) and OB/GYN (EchoSGyn) applications, which are functions already performed by the primary predicate, the ACUSON Sequoia Diagnostic Ultrasound System.
• Technological Characteristics: The subject device shares similar hardware (EchoS and EchoStation) and software (EchoStudio) with the additional predicate device (EchoS Family K202514). It also operates similarly to the primary predicate in terms of transmitting, receiving, and displaying ultrasound echo data.
• Non-Clinical Performance Data: The summary lists non-clinical testing performed, including:
  • Biocompatibility (ISO 10993)
  • Electrical Safety and Electromagnetic Compatibility (EN 60601-1 and EN 60601-1-2)
  • Software Validation (ISO 62304)
  • Usability (IEC 62366-1:2015)

The document explicitly states "PERFORMANCE TESTING - CLINICAL: None" and "ANIMAL STUDIES: None". This indicates that the substantial equivalence determination for K212851 was not based on a clinical performance study with defined acceptance criteria for diagnostic accuracy, sensitivity, specificity, or other performance metrics typically associated with an AI-driven or diagnostic device.

Therefore, the requested information elements related to clinical performance criteria and studies cannot be extracted from this document. The device's acceptance is based on its similarity to legally marketed predicate devices, and the demonstration that any differences do not raise new questions of safety or effectiveness, as supported by the non-clinical testing mentioned above.

Ask a specific question about this device

1. EchoS Family is a non-invasive ultrasound (US) bone sonometer. EchoS Family works together with EchoStudio software. EchoStudio analyzes the ultrasound signals in order to compute the diagnostic parameters (BMDus, T-score, and Z-score). The BMDus Index is a clinical measure based on ultrasound variables of the lumbar spine or femoral neck which is highly correlated with the value of BMD of the same anatomical location as provided by DXA (BMDDXA), with a standard error of the estimate of 0.044grams/cm^2 for lumbar spine and 0.038 grams/cm^2 for femoral neck measurements.

BMDus Index is expressed in grams/cm^2 and as a T- and Z-score, derived from comparison to a normative x-ray absorptiometry reference database. BMDus Index has a precision comparable to that of x-ray absorptiometry, which makes it suitable for monitoring bone changes in women and men.

2. The EchoStudio software includes an optional tool called Fragility Score, which is intended to provide an assessment of 5-year fracture risk. The optional tool Fragility Score provides an estimate of 5-year probability of hip fracture and 5-year probability of a major osteoporotic fracture (clinical spine, forearm, hip or shoulder fracture). This estimate takes into account the patient's age, sex, ethnicity, height, and the vertebraffemur neck ultrasound spectra and is computed using a proprietary algorithm. The tool has been validated for men and women between 30 and 90 years old.

The output is provided in a separate screen display and report that can be viewed or exported to an optional physician report generator tool. The results can be used by a physician, in conjunction with other clinical risk factors, as an aid in the diagnosis of osteoporosis and medical conditions leading to increased bone fragility, and ultimately in the assessment of fracture risk.

3. EchoS Family, when used with the optional Body Composition module of EchoStudio software, is indicated to estimate total body fat percentage (%BF). EchoS Family, together with Body Composition software module, is intended to be used only on generally healthy adults and is not for disease or condition. Body Composition software is indicated for the calculation of the Body Mass Index (BMI) and the Basal Metabolic Rate (BMR). Body Composition software module generates a report which displays the calculated values of Body FAT, BMR, and Body Mass Index (BMI).

The EchoS Family is an ultrasound device intended primarily for the diagnosis of osteoporosis. EchoS, through the ultrasound scan of the lumbar or femoral site of interest, picks up the ultrasound signal (RF) and performs an estimate of the bone mineral density (BMD).

The device therefore allows not only the visualization of ultrasound images, but also the real-time sampling of the RF signal and its appropriate treatment to make it usable for diagnostic algorithms.

The EchoS Family consists in two different configurations: EchoS (portable version) and the EchoStation (cart version). Each version consists of two main parts: the equipment device (EchoS and EchoStation) with its own probe and the software EchoStudio.

EchoStudio is a biomedical software that, used in combination with EchoS Family, allows the evaluation of bone mineral density (BMD) by means of the proprietary method REMS (Radiofrequency Echographic Multi Spectrometry) densitometry.

By using EchoStudio, it is possible to assess the key diagnostic parameters directly on the anatomical sites with increased fracture risk, such as lumbar spine and proximal femur.

EchoStudio analyzes the ultrasound signals and echographic images in order to compute the diagnostic parameters (BMD, T-score, and Z-score) and to estimate the fracture risk by means of the Echolight diagnostic algorithms and non-ionizing technique.

The provided FDA 510(k) summary for the EchoS Family device describes clinical performance studies related to its three Indications for Use (IFUs):

IFU 1: Diagnostic parameters (BMDus, T-score, and Z-score)
This IFU relates to the device's ability to compute diagnostic parameters based on ultrasound signals from the lumbar spine or femoral neck, correlating with DXA BMD.

IFU 2: Fragility Score for 5-year fracture risk assessment
This IFU relates to an optional tool that provides an estimate of 5-year probability of hip fracture and major osteoporotic fracture.

IFU 3: Body Composition module for total body fat percentage (%BF), BMI, and BMR
This IFU relates to an optional module for estimating body fat percentage, and calculating Body Mass Index (BMI) and Basal Metabolic Rate (BMR).

However, the summary does not provide a table of and does not explicitly state numerical acceptance criteria for each IFU, nor does it present the reported device performance in a direct comparative table. Instead, it describes general claims of correlation and mentions clinical trial reports.

Here's a breakdown of the available information based on your requested categories, acknowledging the limitations from the provided text:

Acceptance Criteria and Reported Device Performance

As noted, the document does not contain a specific table of acceptance criteria with numerical targets. However, the descriptions of the clinical studies imply the intended performance.

Study Details

The document mentions several clinical studies but often refers to "Performance Evaluation Protocol" and "Data Evaluation Report" documents rather than providing the detailed study results within the 510(k) summary itself. Therefore, specific details for all your requested points are limited or not available in the provided text.

1. Sample sizes used for the test set and the data provenance:

• IFU 1 (Diagnostic parameters):

  • One study produced a publication "Radiofrequency echographic multi spectrometry for the prediction of incident fragility fractures: A 5-year follow-up study."
  • A second study produced a "Performance Evaluation Protocol" and a "Data Evaluation Report" titled "ECHOLIGHT: Comparative Performance Evaluation Report Echos System Vs. DXA in a male population aged 30-90 years".
  • Sample Size: Not explicitly stated for either study in this document.
  • Data Provenance: Not explicitly stated (e.g., country of origin, retrospective/prospective). However, the publication title "5-year follow-up study" suggests a prospective or longitudinal study in some capacity for the first study mentioned. The second study compared to DXA, implying live patient data.

• IFU 2 (Fragility Score):

  • "a dedicated clinical study was conducted."
  • Sample Size: Not explicitly stated.
  • Data Provenance: Not explicitly stated.

• IFU 3 (Body Composition):

  • Three clinical studies were conducted for %BF, BMR, and BMI respectively.
  • Sample Size: Not explicitly stated for any of these three studies.
  • Data Provenance: Not explicitly stated. The comparison to BIA and pocket calculator suggests live patient data.

2. Number of experts used to establish the ground truth for the test set and the qualifications of those experts:

• Not explicitly stated in the provided text for any of the studies.
• For IFU 1, DXA is used as the reference/ground truth, which is a widely accepted diagnostic method, implying established medical standards rather than expert consensus on images.
• For IFU 3, Bioelectrical Impedance Analysis (BIA) and a pocket calculator (for BMI) are used as references, which are also established methods, not typically requiring expert image review.

3. Adjudication method (e.g., 2+1, 3+1, none) for the test set:

• Not explicitly stated in the provided text for any of the studies. Given the nature of the ground truth (DXA, BIA), expert adjudication of images or diagnoses might not have been the primary method.

4. Multi-reader multi-case (MRMC) comparative effectiveness study:

• No MRMC comparative effectiveness study involving human readers with/without AI assistance is mentioned. The device appears to be a diagnostic tool providing objective measurements, not an AI assisting human interpretation of complex images.

5. Standalone (i.e., algorithm only without human-in-the-loop performance) study:

• Yes, the performance data presented is for the algorithm/device itself. The device computes diagnostic parameters, fracture risk estimates, and body composition values. This implies standalone performance, where the output is directly generated by the EchoS Family and EchoStudio software.

6. Type of ground truth used:

• IFU 1 (Diagnostic parameters): DXA (Dual-energy X-ray Absorptiometry) for BMD, which is a clinical gold standard for bone mineral density measurement.
• IFU 2 (Fragility Score): Clinical outcomes (incident fragility fractures within 5 years).
• IFU 3 (Body Composition): Bioelectrical Impedance Analysis (BIA) for %BF and BMR; results from a pocket calculator for BMI.

7. Sample size for the training set:

• Not explicitly stated in the provided text for any of the algorithms (BMD, Fragility Score, Body Composition).

8. How the ground truth for the training set was established:

• Not explicitly stated in the provided text. However, it can be inferred that for algorithms correlating with DXA or BIA, similar methods to the test set ground truth would have been used for training. For the Fragility Score, based on its purpose, the training likely used historical patient data with documented fracture outcomes and associated clinical/ultrasound data.

Ask a specific question about this device

The EchoSure diagnostic ultrasound system and its transducer are in clinical examinations of blood vessels that are marked with an EchoMark LP implant. The system provides measurements and information about blood flow.

The system is intended for use by trained medical health care professionals in support of clinical diagnosis.

EchoSure is a portable diagnostic ultrasound system which applies the latest technologies to produce optimal images and provide information about blood flow in vessels. Various image parameter adjustments, dual high-resolution displays, and a custom probe are configured to provide clear and stable images. The system operates in B-Mode and Color Flow Doppler Mode. EchoSure is comprised of the EchoSure Ultrasound, the EchoSure Application, and the EchoSure Probe.

This document describes the Sonavex EchoSure Diagnostic Ultrasound System, which is intended for clinical examinations of blood vessels marked with an EchoMark or EchoMark LP implant. The system provides measurements and information about blood flow and is intended for use by trained medical healthcare professionals in support of clinical diagnosis.

Here's a breakdown of the acceptance criteria and study information provided:

1. Table of Acceptance Criteria & Reported Device Performance:

The document doesn't explicitly state "acceptance criteria" in a tabulated format with corresponding performance metrics as would typically be seen for a new device claiming improved performance. Instead, the submission focuses on demonstrating substantial equivalence to a predicate device (K173265, WinProbe UltraVision 2 Diagnostic Ultrasound System) by outlining similar technical characteristics and adherence to relevant safety and performance standards.

The table below summarizes key comparisons between the EchoSure and its predicate, acting as implicit "acceptance criteria" through comparative equivalence:

2. Sample Size Used for the Test Set and Data Provenance:

The document states: "Clinical studies are not required to support equivalence for these conventional ultrasound systems." This implies that there was no specific clinical test set used for the EchoSure device itself to prove its performance in human subjects, beyond the non-clinical safety and performance data. The FDA clearance is based on substantial equivalence to a predicate device and adherence to recognized standards.

Therefore, information regarding sample size for a test set and data provenance (country of origin, retrospective/prospective) is not applicable as no clinical studies were performed for this specific submission.

3. Number of Experts Used to Establish Ground Truth for the Test Set and Their Qualifications:

As no clinical test set was required or performed for direct evaluation of the EchoSure device's performance in a clinical setting, there's no information about experts establishing ground truth for a test set. The submission relies on the established safety and performance of the predicate device and compliance with standards.

4. Adjudication Method for the Test Set:

Since a clinical test set was not used to evaluate device performance, an adjudication method for a test set is not applicable.

5. If a multi-reader multi-case (MRMC) comparative effectiveness study was done:

No MRMC comparative effectiveness study was done, as confirmed by the statement "Clinical studies are not required."

6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done:

The EchoSure is a diagnostic ultrasound system, not an algorithm-only device. Its performance is intrinsically tied to human operation and interpretation. Therefore, a "standalone algorithm only" performance study is not applicable in this context. The document emphasizes its use "by trained medical health care professionals."

7. The type of ground truth used:

Given the reliance on substantial equivalence and non-clinical testing, the "ground truth" for the EchoSure's clearance is primarily based on:

• Compliance with recognized electrical, mechanical, safety, EMC, acoustic output, and biocompatibility standards (e.g., ISO 10993, IEC 60601 series). These standards serve as the "ground truth" for ensuring the device meets fundamental safety and engineering performance requirements.
• Demonstrated performance specifications during bench testing. These tests confirm that risk controls were properly implemented, design outputs meet design inputs, and the device is suitable for its intended use within a laboratory/engineering context.

8. The sample size for the training set:

The EchoSure is a conventional diagnostic ultrasound system, not an AI/ML-driven device that requires a "training set" in the machine learning sense. Therefore, information about a training set sample size is not applicable.

9. How the ground truth for the training set was established:

As the device does not utilize a machine learning algorithm requiring a training set, this question is not applicable.

Ask a specific question about this device

EchoS is a non-invasive ultrasound (US) bone sonometer. EchoS works together with EchoStudio software. EchoStudio analyzes the ultrasound signals in order to compute the diagnostic parameters (BMD13, T-sore, and Z-sore) and to assess fracture risk through the integrated FRAX® software.

The BMDgs Index is a clinical measure based on ultrasound variables of the lumbar spine or femoral neck which is highly correlated with the value of BMD as provided by DXA at the same anatomical location (BMDnxA), with a standard error of the estimate of 0.044 grams/cm² for lumbar spine and 0.038 grams/cm² for femoral neck measurements. BMDris Index is expressed in grams/cm² and it is based on a proprietary internal database, obtained from clinical data on adult white females and males, while T- and Z-score are derived from comparison to a normative X-ray absorptiometry reference database (NHANES). BMDus Index has a precision comparable to that of x-ray absorptiometry, which makes it suitable for monitoring bone changes in women.

The subject device, EchoS, consists of two main parts: the equipment EchoS device with its own probe and the software EchoStudio.

• The EchoS device consists of EchoS device together with its probe,
• . The software EchoStudio: user interface and algorithmic calculation software provided in installation disc.

The EchoS device is connected to the computer via the USB port, and it is controlled by the EchoStudio to send the transmitting parameters to the EchoS device and to acquire the ultrasound (US) signals from EchoS device in order to calculate the BMDus and the other diagnosis parameters.

The EchoS System is a PC-based device that employs an ultrasound probe to collect ultrasound (RF) signals for echographic applications. During the measurement, the ultrasound convex probe, connected by a standard connector to the EchoS device, is applied directly to the skin in correspondence of the lumbar vertebrae or proximal femur, applying a thin layer of ultrasound gel between the probe surface and the skin to facilitate acoustic coupling. The ultrasound waves emitted by the probe are reflected by the bone, and then detected by the same probe.

During the scan, the algorithm automatically detects the bone interfaces and calculates the region of interest (ROIs) for data analysis. The automatic data processing is performed through the following steps: a custom developed signal pre-processing chain performs filtering, amplification and A/D conversion operations on the RF signals that are then passed to the EchoStudio software.

EchoStudio includes RF signal analysis and spectral comparison with reference models for the calculation of diagnostic parameters (BMDus, T-score, Z-score), and generation of the final medical report. The relevant scan depth, focus position, and visualization parameter settings can be adjusted and set by the interface of the software - EchoStudio.

EchoStudio software provides BMDus (in g/cm²), T-score and Z-score. It also estimates the 10-year osteoporotic fracture risk calculated with the original FRAX® algorithm that is integrated in the device.

Here's a breakdown of the acceptance criteria and the study information for the EchoS device, based on the provided text:

EchoS Acceptance Criteria and Device Performance

1. Table of Acceptance Criteria and Reported Device Performance

The acceptance criteria for the EchoS device are primarily based on its correlation with DXA measurements, particularly the standard error of the estimate (SEE) for BMD.

Study Proving Device Meets Acceptance Criteria:

The key study for proving the device meets the acceptance criteria for BMD correlation is a clinical performance test comparing EchoS to DXA.

2. Sample Size Used for the Test Set and Data Provenance:

• Test Set Sample Size: The document does not explicitly state the numerical sample size for the test set used in the comparative performance test against DXA. It mentions "Clinical data has been collected by Echolight on the intended patient population for the subject device" and "real data from intended patient population are used to compare results of FRAX® original algorithm."
• Data Provenance: The data was collected prospectively by Echolight. The country of origin is not specified, but Echolight S.p.a. is based in Italy, suggesting the data may have been collected in Italy or Europe. The patient population described for the proprietary internal database is "adult white females and males."

3. Number of Experts Used to Establish Ground Truth for the Test Set and Their Qualifications:

• Number of Experts: The document does not specify the number of experts used.
• Qualifications of Experts: The document does not specify the qualifications of the experts involved in establishing the ground truth.

4. Adjudication Method for the Test Set:

• The document does not describe an adjudication method (e.g., 2+1, 3+1, none) for the test set. The ground truth seems to be established by the reference device (DXA) itself, not through an expert consensus requiring adjudication.

5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done:

• No, a Multi-Reader Multi-Case (MRMC) comparative effectiveness study was not conducted. The studies described are comparing the device's output (BMD, T-score, Z-score) to a gold standard (DXA), and the FRAX® algorithm's output using EchoS data versus DXA data. There is no mention of human readers improving with AI assistance.

6. If a Standalone (Algorithm Only Without Human-in-the-Loop Performance) Was Done:

• Yes, a standalone performance assessment was done. The "comparative performance test of EchoS vs DXA" and the comparison of FRAX® using EchoS-estimated T-score against DXA-measured T-score are examples of standalone algorithm performance. The device analyzes ultrasound signals and computes diagnostic parameters independently.

7. The Type of Ground Truth Used:

• The primary ground truth used for the device's diagnostic parameters (BMDus, T-score, Z-score) is DXA measurements (X-ray Densitometry), which is referred to as "a recognized gold standard for bone densitometry applications."
• For the FRAX® algorithm comparison, the ground truth for comparison was the FRAX® original algorithm using DXA-measured femoral neck T-Score.

8. The Sample Size for the Training Set:

• The document does not explicitly state the numerical sample size for the training set. It mentions "Clinical data has been collected by Echolight on the intended patient population for the subject device, in order to create the proprietary internal database for the different ages and BMI."

9. How the Ground Truth for the Training Set Was Established:

• The ground truth for the training set (referred to as the "proprietary internal database") was established through clinical data collection by Echolight. This would involve measuring BMD using DXA (the gold standard) and correlating these measurements with the ultrasound variables collected by the EchoS device across a diverse patient population (adult white females and males of different ages and BMI). This process allows the algorithm to learn the relationship between ultrasound signals and DXA-derived BMD values.

Ask a specific question about this device

The Echostar Comfort 1.5T MRI System is a whole-body magnetic resonance imaging (MRI) system intended for general diagnostic use. Transverse, sagittal, coronal and oblique planes may be imaged. MRI images produced by the Echostar Comfort system reflect the spatial distribution for the density of hydrogen nuclei (protons) spin-lattice relaxation time (T1), spin-spin relaxation time (T2) and flow. When interpreted by a trained physician, these images yield information that can be useful in the determining of a diagnosis.

The Echostar Comfort 1.5T MRI System and Echostar Spica 1.5T MR system are indicated for use as a whole body magnetic resonance diagnostic device (MRDD) that uses transverse, sagittal, coronal and oblique planes to image internal structures or functions of the body including head and extremities. MRI images correspond to the spatial distribution of protons (hydrogen nuclei) that exhibit nuclear magnetic resonance (NMR). The NMR properties of body tissues and fluids are hydrogen density, spin-lattice relaxation time (T1), spin-spin relaxation time (T2) and flow dynamics. These images, when interpreted by a trained physician, yield information that can be useful in diagnosis.

The Echostar Comfort 1.5T MRI System represents a modification to the previously cleared Echostar Spica 1.5T MR system (K113511); both utilize a superconducting magnet, gradients, RF transmission, various sequences and reconstruction algorithms to acquire 2D single slice, multi-slice and 3D volume images. The data acquisition system supports multiple coil elements including a body coil, head coil, spine coil, cspine (neck) coil, shoulder coil, knee coil, small-4 element torso coil, large-12 element torso coil, wrist coil, medium-8 element torso coil, small flex coil and large flex coil.

This document describes the Echostar Comfort 1.5T MRI System, which is a modification of a previously cleared device (Echostar Spica 1.5T MR system). The submission focuses on demonstrating substantial equivalence to the predicate device rather than presenting a de novo performance study with specific acceptance criteria directly related to clinical diagnostic accuracy.

Therefore, much of the requested information regarding clinical study design, sample sizes, expert adjudication, MRMC studies, and standalone performance for diagnostic tasks is not explicitly available within this 510(k) summary. The summary focuses on engineering and regulatory compliance, ensuring the modified device maintains the same safety and effectiveness as its predicate.

Here's an analysis based on the provided document:

1. Table of Acceptance Criteria and Reported Device Performance

The document does not explicitly state quantitative acceptance criteria for diagnostic performance (e.g., sensitivity, specificity for a specific condition) for the Echostar Comfort 1.5T MRI System. Instead, the acceptance criteria are based on technical and safety standards compliance and equivalence to the predicate device.

2. Sample Size Used for the Test Set and Data Provenance

The document states: "Sample phantom and clinical images, and test reports are presented for the changes, demonstrating conformance with the standard and equivalent performance with the predicate device."

• Sample Size for Test Set: Not specified quantitatively. It mentions "sample phantom and clinical images," implying a limited set used for technical verification rather than a large-scale clinical trial to establish diagnostic accuracy against a ground truth.
• Data Provenance: Not explicitly stated (e.g., country of origin). It mentions "clinical images," suggesting real patient data, but whether it was retrospective or prospective is not detailed. Given the context of a 510(k) for a modified device, it's likely images were collected to demonstrate equivalence, possibly from a mix of retrospective and prospective technical validation scans.

3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications

This information is not provided. The assessment appears to be primarily technical validation (phantom images, engineering tests) and a comparison of image characteristics to the predicate device, rather than a clinical study requiring expert diagnosis against a clinical ground truth for the new device. The Indications for Use state, "When interpreted by a trained physician, these images yield information that can be useful in the determining of a diagnosis," implying that the interpretation relies on existing medical expertise once the image quality is deemed acceptable.

4. Adjudication Method for the Test Set

Since a formal clinical study with a diagnostic ground truth is not detailed, an adjudication method is not applicable or described in this summary. The assessment focuses on meeting technical standards and demonstrating image quality equivalence.

5. If a Multi Reader Multi Case (MRMC) Comparative Effectiveness Study was done

No, a Multi-Reader Multi-Case (MRMC) comparative effectiveness study comparing human readers with and without AI assistance was not done or described. This submission is for an MRI system, not an AI-powered diagnostic algorithm alongside human interpretation.

6. If a Standalone (i.e. algorithm only without human-in-the loop performance) was done

No, a standalone performance study for an algorithm was not done or described. This device is an MRI hardware and basic software system, not an AI or standalone diagnostic algorithm.

7. The Type of Ground Truth Used

For the technical performance aspects, the "ground truth" would be established through:

• Physical Phantoms: Known physical properties and structures within phantoms are used to assess image quality metrics (signal-to-noise ratio, spatial resolution, contrast, uniformity, etc.) according to NEMA standards.
• Predicate Device Performance: The primary "ground truth" for the new device's performance is its substantial equivalence to the performance of the legally marketed predicate device (Echostar Spica 1.5T MR system), which itself would have demonstrated diagnostic capability in general use.
• Clinical Image Evaluation: As mentioned, "clinical images" were presented, which would implicitly be evaluated by qualified personnel for acceptable diagnostic quality, even if not against a specific pathological ground truth within this particular submission.

8. The Sample Size for the Training Set

Not applicable/Not mentioned. This document describes an MRI hardware system, not a device that relies on a trained algorithm or AI model. Therefore, there is no "training set" in the context of machine learning.

9. How the Ground Truth for the Training Set was Established

Not applicable/Not mentioned. As there is no training set for an AI model, this question does not apply to this submission.

Ask a specific question about this device

EchoSoft™ is a software calculation package that is used with diagnostic ultrasound images to provide mechanical information about tendon-like tissues of interest that may be used by a physician, along with other medical data, to assist in clinical diagnosis. The software is intended to be used by trained professionals only.

The Echometrix, LLC software, EchoSoft, is an image processing algorithm that, when used with diagnostic ultrasound images, provides qualitative information about the mechanical characteristics of the deforming material by tracking motion, deformation, and ultrasonic echo magnitude change within a given region. This technology can be used by a physician to gather information about the mechanical and functional properties of soft tissues which, in conjunction with standard medical data, can be used to assist in clinical diagnosis.

The provided text does not contain detailed information about specific acceptance criteria, comprehensive device performance data, detailed study methodologies, or comparative effectiveness studies for EchoSoft™. However, based on the information provided, I can construct an answer with the available details and identify where information is missing.

Here's a breakdown of the acceptance criteria and study information, as much as can be gleaned from the text:

1. A table of acceptance criteria and the reported device performance

The document does not explicitly list quantitative acceptance criteria in a dedicated table format or specific performance metrics with target values. It broadly states that the software was evaluated to "verify the ability of the algorithm to distinguish between materials with different mechanical properties" and to "verify performance parameters such as resolution, sensitivity and precision." No actual numbers for these parameters are provided.

2. Sample size used for the test set and the data provenance (e.g., country of origin of the data, retrospective or prospective)

• Sample Size (Test Set): The exact sample size for the test set is not specified. The document mentions "multiple studies" including "laboratory measurements on phantoms," "several studies conducted on bovine tendons," and "sample clinical images." The number of phantoms, bovine tendons, or clinical images is not quantified.
• Data Provenance:
  • Phantoms: Laboratory measurements.
  • Bovine Tendons: Implies laboratory or research setting, likely not patient data.
  • Clinical Images: Described as "sample clinical images" with "previously diagnosed injuries." There is no indication of the country of origin.
  • Retrospective/Prospective: Not explicitly stated for any of the data types. "Previously diagnosed injuries" for clinical images suggests a retrospective collection, but this is not confirmed.

3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g., radiologist with 10 years of experience)

This information is not provided in the document.

4. Adjudication method (e.g., 2+1, 3+1, none) for the test set

This information is not provided in the document. Given the nature of the studies (phantom, bovine tissue, and "sample clinical images"), formal expert adjudication methods commonly seen in human-in-the-loop clinical trials are unlikely to have been detailed in this regulatory submission.

5. If a multi-reader multi-case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

There is no indication that an MRMC comparative effectiveness study involving human readers with and without AI assistance was performed or reported in this submission. The device is a software calculation package designed to provide "mechanical information," not primarily to improve human reader diagnostic accuracy in a comparative setting described for MRMC studies. The software is intended to "assist in clinical diagnosis," implying its output is used by a physician in conjunction with other data, but its effect on reader performance is not quantified.

6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done

Yes, the studies described are characteristic of standalone algorithm testing.

• "The EchoSoft 100 software was evaluated with multiple studies to verify the ability of the algorithm to distinguish between materials with different mechanical properties."
• "The studies consisted of laboratory measurements on phantoms containing materials with varying elastic properties to verify performance parameters such as resolution, sensitivity and precision."
• "Several studies were conducted on bovine tendons to demonstrate performance on tissue samples with known defects."
• "Sample clinical images were also provided to demonstrate performance of the software on tendons with previously diagnosed injuries."

These describe direct evaluations of the algorithm's output against known properties or diagnoses, without explicit human reader interaction within the performance metrics.

7. The type of ground truth used (expert consensus, pathology, outcomes data, etc.)

The ground truth used varied depending on the type of study:

• Phantoms: "Materials with varying elastic properties." The ground truth would be the known mechanical properties (e.g., stiffness/elasticity) of these engineered phantom materials.
• Bovine Tendons: "Tissue samples with known defects." The ground truth would be the known presence or absence and characteristics of these defects, likely established through direct inspection, mechanical testing, or other means.
• Clinical Images: "Tendons with previously diagnosed injuries." The ground truth was the existing clinical diagnosis for these injuries. The method of establishing this clinical diagnosis (e.g., expert clinical assessment, MRI, surgery, pathology) is not specified.

8. The sample size for the training set

This information is not provided in the document. The submission focuses on the evaluation (test) studies, with no mention of the training data used to develop the algorithm.

9. How the ground truth for the training set was established

This information is not provided in the document, as the training set itself is not discussed.

Ask a specific question about this device

The Echostar 1.5T and Echostar Spica 1.5 T MR Systems are indicated for use as a whole body magnetic resonance diagnostic device (MRDD) that uses transverse, sagittal, coronal and oblique planes to image internal structures or functions of the body, including head and extremities. MRI images correspond to the spatial distribution of protons (hydrogen nuclei) that exhibit nuclear magnetic resonance (NMR). The NMR properties of body tissues and fluid are hydrogen density, spin-lattice relaxation time (T1), spin-spin relaxation time (T2) and flow dynamics. These images, when interpreted by a trained physician, yield information that can be useful in diagnosis. The device is intended for prescription use only.

The Echostar Spica 1.5T MR System is a whole-body magnetic resonance imaging (MRI) system intended for general diagnostic use. Transverse, sagittal, coronal and oblique planes may be imaged. MRI Images produced by the Echostar Spica system reflect the spatial distribution fo the density of hydrogen nuclei (protons) spin-lattice relaxation time (T1), spin-spin relaxation time (T2), and flow. When interpreted by a trained physician, these images yield information that can be useful in the determining of a diagnosis. This device is intended for prescription use only.

The Echostar Spica 1.5 T MR System represents a modification to the previously cleared Echostar 1.5 T (K082100); both utilize a superconducting magnet, gradients, RF transmission, various sequences and reconstruction algorithms to acquire 2D single slice, multi-slice and 3D volume images. The data acquisition system supports multiple coil elements including, a body coil, head coil, spine coil, c-spine (neck) coil, shoulder coil, knee coil, small - 4 element torso coil, large - 12 element torso coil and wrist coil.

The provided 510(k) summary for the Alltech Echostar Spica 1.5 T MR System does not contain the detailed information requested regarding specific acceptance criteria for device performance and the study proving it meets these criteria in the context of diagnostic accuracy. Instead, the submission focuses on demonstrating substantial equivalence to a predicate device (Alltech EchoStar 1.5 T) based on technological characteristics and safety.

Here's a breakdown of the available information in relation to your request:

1. Table of Acceptance Criteria and Reported Device Performance:

The document does not provide a table with explicit acceptance criteria for diagnostic performance (e.g., sensitivity, specificity, accuracy for specific pathologies) nor does it report these metrics for the device. The "performance testing" described refers to engineering and safety verifications rather than clinical diagnostic outcome measures.

2. Sample Size Used for the Test Set and Data Provenance:

No information is provided regarding a specific "test set" for evaluating diagnostic accuracy. The performance testing mentioned involves "sample phantom and clinical images." The provenance of these clinical images (e.g., country of origin, retrospective/prospective) is not disclosed, and the sample size is not specified beyond "sample" images.

3. Number of Experts Used to Establish Ground Truth for the Test Set and Qualifications:

Since no diagnostic accuracy study using a specific test set is detailed, there's no information on the number or qualifications of experts used to establish a ground truth for such a set.

4. Adjudication Method:

Given the lack of a diagnostic accuracy study, there's no mention of an adjudication method (e.g., "2+1", "3+1") for establishing ground truth.

5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study:

No MRMC study comparing human readers with and without AI assistance is mentioned. This device is an MRI system, not an AI-powered diagnostic tool, so such a study would not be applicable in this context.

6. Standalone (Algorithm Only) Performance:

This submission concerns an MRI system, not an AI algorithm. Therefore, "standalone (algorithm only)" performance is not evaluated or reported.

7. Type of Ground Truth Used:

For the performance testing that was conducted (NEMA standards, IEC 60601-2-33), the "ground truth" would relate to quantitative measurements from phantoms and qualitative assessment of image quality from clinical images, rather than a clinical diagnostic ground truth like pathology or outcomes data.

8. Sample Size for the Training Set:

This information is not applicable. The device is an MRI scanner, and the submission does not describe a machine learning algorithm with a training set.

9. How the Ground Truth for the Training Set Was Established:

This information is not applicable for the same reason as above.

Summary of Device Evaluation in the 510(k):

The 510(k) submission for the Echostar Spica 1.5 T MR System focuses on demonstrating substantial equivalence to a previously cleared predicate device (Alltech EchoStar 1.5 T, K082100). The changes introduced in the Spica system (additional RF coils, removal of amplifier option, optional respiratory gating, magnet manufacturer change, software/sequence updates) are presented as minor and not impacting the fundamental scientific technology, intended use, indications for use, design principles, performance effectiveness, or safety.

The "performance testing" described in the document primarily verifies that the modified device adheres to relevant engineering and safety standards (NEMA standards and IEC 60601-2-33), and that image quality (from "sample phantom and clinical images") remains comparable to the predicate device. This is a typical approach for demonstrating substantial equivalence for modifications to existing medical imaging hardware, where direct clinical diagnostic accuracy studies are often not required if the core technology and intended use remain unchanged.

Ask a specific question about this device

Havel's electrically insulated anesthesia conduction needles are used to puncture the tissue in order to gain entry and locally inject anesthetics to induce regional anesthesia. An electrical stimulus may be applied to the needle via a cable and connector to assist the physician to pinpoint the area of application.

Drawings and a bill of materials for the EchoStim device are attached.

This 510(k) document describes a medical device called the EchoStim Facet Tip, which is an electrically insulated anesthesia conduction needle. The submission is for substantial equivalence to existing predicate devices, not for a novel device requiring extensive performance studies as might be seen for AI/ML-based devices.

Therefore, the requested information regarding acceptance criteria, study details, sample sizes, ground truth establishment, expert involvement, and comparative effectiveness studies is not present in this document. This document focuses on demonstrating that the EchoStim Facet Tip is substantially equivalent to already marketed devices based on materials, technological characteristics, and intended use.

Here's why each specific requested point is not applicable or not found in the provided text:

1. A table of acceptance criteria and the reported device performance: Not applicable. For a substantial equivalence submission of this type of medical device, the "acceptance criteria" are primarily met by demonstrating similarity to predicate devices, rather than through specific performance metrics outlined like a diagnostic accuracy table. There is no performance data reported in this document.
2. Sample size used for the test set and the data provenance: Not applicable. There is no "test set" in the context of performance evaluation for this type of device in this submission. The evaluation is based on comparison to existing devices.
3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts: Not applicable. There is no ground truth establishment needed for a test set as described here.
4. Adjudication method: Not applicable. No adjudication method is mentioned as there's no diagnostic decision-making process being evaluated.
5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance: Not applicable. This is a needle, not an AI/ML device, so MRMC studies and AI assistance are irrelevant.
6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done: Not applicable. This is a physical medical device, not an algorithm.
7. The type of ground truth used: Not applicable. No ground truth in the context of diagnostic accuracy is relevant here.
8. The sample size for the training set: Not applicable. There is no training set for a traditional medical device like this needle.
9. How the ground truth for the training set was established: Not applicable. There is no training set.

Summary based on the provided document:

The provided document is a 510(k) premarket notification for an anesthesia conduction needle. The focus is on demonstrating substantial equivalence to predicate devices. There are no performance studies, acceptance criteria for performance metrics, or data related to AI/ML device evaluation within this document. The "performance" in this context refers to the device meeting its intended use by being similar to already approved needles.

Key information present related to comparison:

• Predicate Devices:
  • UniPlex Cannula, K000722, Pajunk Gmbh.
  • Plexalong Set, K013041, Pajunk Gmbh.
• Basis for Substantial Equivalence: "The EchoStim Facet Tip Needle is substantially equivalent to the Pajunk needle predicated devices in that it is similar with respect to materials, technological characteristics and intended use."
• Comparison Data: "A comparison chart of the two devices is attached." (though not provided in the excerpt)

Ask a specific question about this device

The Medstrat echoeSYSTEM™ is intended to enable the communication, storage, viewing and manipulation of diagnostic medical images and data. The echoeSYSTEM™ can show images on workstations locally and/or across computer networks at widely distributed locations. The echoeSYSTEM™ software is intended for assisting healthcare professionals in preoperative planning and postoperative evaluation of orthopedic surgery. The device allows for overlaying of prosthesis templates on radiological images, and includes tools for performing measurements on the image and positioning the templates. The typical echoeSYSTEM™ users are trained professionals such as orthopedic surgeons, referring and collaborating physicians, and other authorized medical professionals.

It is the user's responsibility to bear in mind the display monitor's quality, ambient light conditions and the tradeoff between image compression ratio and clinical effectiveness for specific image study indications.

ECHOES™ is a client-server software system designed to allow viewing access to medical images on a personal computer by authorized medical professionals. This product is designed to function with off-the-shelf hardware and software products including standard communications products. It does not require specialized, or nonstandard, devices of any type.

Image acquisition is via the industry standard DICOM 3.0 protocol allowing the images to be produced from the digital data originated by the imaging modality.

The software will run on standard off-the-shelf hardware and system configurations,

The provided text is a 510(k) Summary for the Medstrat echoeSYSTEM™, a Picture Archiving and Communication System (PACS). This document focuses on demonstrating substantial equivalence to predicate devices rather than proving a device meets specific acceptance criteria through a performance study with quantitative results.

Therefore, many of the requested sections (e.g., specific acceptance criteria, sample sizes for test/training sets, number of experts, adjudication methods, MRMC studies, standalone performance, and ground truth establishment) are not present in the provided text.

The summary describes the device's intended use and compares its features to two predicate devices to establish substantial equivalence. It does not contain information about a study designed to evaluate the statistical performance of the device against predefined acceptance criteria for clinical accuracy or efficacy.

Here's an analysis of what can be extracted based on the provided text:

1. Table of Acceptance Criteria and Reported Device Performance:

There are no explicit acceptance criteria or quantitative performance metrics reported in the provided document. The analysis focuses on substantial equivalence to predicate devices based on shared features and intended use.

2. Sample size used for the test set and the data provenance:

• Not provided. The document describes a comparison to predicate devices' features and intended use, not a clinical performance study with a test set.

3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts:

• Not provided. No test set or ground truth establishment process is described.

4. Adjudication method (e.g., 2+1, 3+1, none) for the test set:

• Not provided. No test set or adjudication method is described.

5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:

• No, an MRMC study was not done/reported. The device is a PACS system for viewing and manipulation; it's not described as an AI-powered diagnostic aid that would typically undergo such a study for "human reader improvement."

6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done:

• Not applicable/Not provided. The echoeSYSTEM™ is described as a client-server software system and PACS for viewing and manipulation, not a standalone AI algorithm with independent diagnostic performance. Its primary function is displaying and managing images and providing tools for human professionals.

7. The type of ground truth used (expert consensus, pathology, outcomes data, etc):

• Not provided. No clinical ground truth is mentioned as a basis for validating the device's performance, as the submission focuses on substantial equivalence of functionality.

8. The sample size for the training set:

• Not provided. There is no mention of a training set, as the device is not an AI/machine learning system in the sense of requiring a "training set."

9. How the ground truth for the training set was established:

• Not provided/Not applicable. As no training set is mentioned, the method for establishing its ground truth is also not applicable.

Ask a specific question about this device