Search Results
Found 135 results
510(k) Data Aggregation
(89 days)
Name:** Eko Foundation Analysis Software with Transformers (EFAST)
Regulation Number: 21 CFR 870.1875
Name:** Eko Foundation Analysis Software with Transformers (EFAST)
Regulation number: 21 CFR 870.1875
Name:** Eko Foundation Analysis Software with Transformers (EFAST)
Regulation number: 21 CFR 870.1875
Ask a specific question about this device
(270 days)
| II | Same as predicate and reference |
| Regulation | 21 CFR 868.2375 | 21 CFR 868.2375 | 21 CFR 870.1875
The RTM Vital Signs RTMsense is indicated for use by healthcare professionals in healthcare facilities, such as post-operative care and general wards, to monitor breathing in adult (at least 22 years old) patients.
RTMsense is a non-invasive system that graphically displays respiratory function against time and reports respiratory rate.
RTMsense measurements are used as an adjunct to other clinical information sources.
The RTMsense Respiratory Monitoring System is a single use wearable device consisting of a wearable trachea sound sensor (TSS) and software that continuously measures a patient's respiratory rate by analyzing the sounds of air flow within the proximal trachea during inhalation and exhalation. The acoustic signal is transmitted wirelessly to a Lenovo Tablet, and the respiratory measurement values are displayed on the tablet after analysis of the acoustic data by a proprietary software algorithm.
The RTMsense software application has three parts: firmware on the TSS, a web-based application on the Lenovo tablet, and a cloud-based proprietary software algorithm. The TSS securely transmits acoustic data wirelessly to the local, Bluetooth low energy enabled Lenovo tablet. The tablet uses a web-based application to securely transmit the acoustic data to the cloud for analysis in RTM's proprietary cloud-based algorithm. The web application retrieves the processed data from the algorithm to display respiratory rate on the tablet.
The device will be used by healthcare professionals in healthcare facilities such as post-operative care or general wards. The RTMsense respiratory measurements are used as an adjunct to other clinical information sources.
The TSS is held in place by a flexible wearable carrier adhered to the patient's proximal trachea with commercially available medical grade adhesive. The TSS contains the audio sensor, onboard processing, wireless communications technology, and Lithium-ion coin cell rechargeable battery. A custom charger is provided to charge the battery.
The provided FDA 510(k) clearance letter and summary for the RTM Sense (A-0001) device details several aspects of its performance and validation. However, it does not explicitly provide a table of acceptance criteria for specific metrics, instead focusing on overall "passing" of predefined performance criteria. The information regarding ground truth establishment for the training set, number and qualifications of experts, and adjudication methods is also limited.
Based on the provided text, here's an attempt to reconstruct the information:
Overview of RTM Sense (A-0001) Performance Study
The RTM Sense (A-0001) is a non-invasive respiratory monitoring system that continuously measures a patient's respiratory rate by analyzing tracheal sounds. The device, intended for use by healthcare professionals in healthcare facilities, underwent non-clinical and clinical performance testing to demonstrate its safety and effectiveness and establish substantial equivalence to predicate devices.
1. Acceptance Criteria and Reported Device Performance
While explicit acceptance criteria are not presented in a table format within the document, the "Clinical Performance Testing" section describes primary endpoints that serve as de facto acceptance criteria. The results indicate that the device met these criteria.
Metric (Implied Acceptance Criteria) | RTMsense Performance (Study #1) | RTMsense Performance (Study #2) |
---|---|---|
Accuracy (Mean Absolute Error) | 0.58 b/min ($\le$ 1 BPM) | 0.38 b/min ($\le$ 1 BPM) |
Mean Accuracy Error (%) | 2.30% ( |
Ask a specific question about this device
(165 days)
| DSH; DQD | DSH; DQD | DQD |
| Regulation Number | 21 CFR 870.2800 | 21 CFR 870.2800 | 21 CFR 870.1875
The AeviceMD is a non-invasive battery-operated device, including a wearable component, intended to longitudinally acquire, record and store lung sounds from pediatric patients (aged 3 years and above) in a clinical or non-clinical setting. The device stores the data for later playback, review, and analysis by a clinician and comparison with earlier data from the same patient.
The AeviceMD is designed as an electronic stethoscope to acquire and record lung sounds from users for healthcare professionals (HCP) to playback and interpret the sounds recorded. AeviceMD does not contain any alarm feature and it is not intended for emergency use. It is also not a sleep apnea device. The device is not intended for self-diagnosis.
The AeviceMD consists of hardware and embedded software. It is a five-part system that includes the following components:
- AeviceMD Sensor – an embedded electronic wearable device that detects and records lung sounds and transmits data to an electronic gateway via Bluetooth.
- AeviceMD Silicone Patch – silicone patch that houses and attaches the Sensor to the user's body (i.e., chest). This silicone patch undergoes biocompatibility testings which allow AeviceMD Sensor to be worn on the skin.
- AeviceMD Docking Station – gateway device that serves as a computational hub and linkage from the Sensor to the Cloud Platform, and as a charger for the Sensor.
- AeviceMD App (for patients) / AeviceMD HCP Web App (for healthcare professionals) - The AeviceMD App is a mobile app that downloads the post-processed information from the Cloud Platform and presents users with their recorded lung sounds at the auscultation locations which they can share with their HCP during their next consultation. A separate app, AeviceMD HCP Web App is tailored for HCP to review their patient's data in a clinical setting.
- AeviceMD Cloud Platform – secure cloud server that receives data from gateway units and analyzes user's data using meaningful output information.
I'm sorry, but the provided FDA 510(k) Clearance Letter for AeviceMD (K243603) does not contain the detailed information necessary to fully answer your request.
Specifically, the document does not include any acceptance criteria or a study demonstrating that the device meets such criteria. It primarily focuses on:
- Substantial Equivalence: Comparing the AeviceMD to a predicate device (AeviceMD K223382) and a reference device (Eko CORE K200776) to establish similar intended use and technological characteristics.
- Non-Clinical Performance Data: Listing the standards and additional testing performed (e.g., biocompatibility, electrical safety, usability, shipping validation, cleaning validation, frequency response test, stethoscope performance test). However, it does not provide the results of these tests or specific performance metrics that could be construed as acceptance criteria.
- Indications for Use: Defining what the device is intended for.
Therefore, I cannot extract the following information from the provided text:
- A table of acceptance criteria and the reported device performance: This information is not present.
- Sample size used for the test set and the data provenance: While a "Stethoscope Performance Test against a 510(k) cleared reference stethoscope" is mentioned, no details about the sample size, data provenance, or the results are provided. The statement "The reference device was used to demonstrate effective performance in a pediatric population aged 3 years and above" suggests a study was done, but no details are given.
- Number of experts used to establish the ground truth for the test set and the qualifications of those experts: Not mentioned.
- Adjudication method: Not mentioned.
- If a multi-reader multi-case (MRMC) comparative effectiveness study was done, and the effect size: Not mentioned. The device is for recording and analysis by a clinician, but no study on AI assistance is detailed.
- If a standalone performance (i.e., algorithm only without human-in-the-loop performance) was done: The document describes the device as recording sounds for later "playback, review, and analysis by a clinician," implying human-in-the-loop. However, it also mentions the "AeviceMD Cloud Platform" analyzes user data using "meaningful output information," which could hint at an algorithm, but no standalone performance data for such an algorithm is provided.
- The type of ground truth used: Not mentioned.
- The sample size for the training set: Not mentioned.
- How the ground truth for the training set was established: Not mentioned.
In summary, the provided document from the FDA clearance process primarily focuses on demonstrating substantial equivalence through comparison with existing devices and compliance with safety and performance standards, rather than detailing a specific clinical performance study with acceptance criteria and results.
Ask a specific question about this device
(60 days)
Re: K242971
Trade/Device Name: AccurSound Electronic Stethoscope (AS101) Regulation Number: 21 CFR 870.1875
Electronic Stethoscope |
| Classification name: | Electronic Stethoscope (21 CFR 870.1875
| |
| Regulatory
number | 870.1875
| 870.1875
The AS-101 is an electronic stethoscope intended for the detection and amplification of sounds associated with the heart, lungs, arteries, veins, and other internal organs. It can be used on any person undergoing a physical assessment. The device is intended to be operated only by healthcare professionals for diagnostic decision support in clinical settings.
This submission is for device "The AccurSound Electronic Stethoscope AS-101 ("AS-101")". This submission expands upon a previously 510(k)-cleared device(K221805) by introducing two new reusable sensors, whereas the original device only included disposable sensors..
The AccurSound Electronic Stethoscope AS-101 ("AS-101") in this submission is a device designed for healthcare professionals used in clinical settings. The AS-101 can detect and amplify the sounds of the heart, lungs, arteries, veins, and other internal organs.
The microphone-equipped sensor detects and amplifies the sounds from the patient's body. The auscultation sound is digitally processed and filtered, electronically amplified in the hub unit. The anti-noise function reduces ambient noise and echoes, then transferred to the earpiece.
The multi-channel design allows healthcare professionals to attach disposable sensors or reusable sensors onto patient's body, by switching modes from handheld single-channel recording to four-channel stationery and continuously auscultation based on different requirements of clinical applications or physical assessments.
The provided text is a 510(k) Premarket Notification for the AccurSound Electronic Stethoscope (AS101), which is a modification of a previously cleared device (K221805). The modification involves the introduction of two new reusable sensors, whereas the original device only included disposable sensors. Based on the document, here's an analysis of the acceptance criteria and supporting studies:
1. Table of Acceptance Criteria and Reported Device Performance
The submission does not explicitly present a table of acceptance criteria with corresponding performance results for specific clinical metrics. Instead, it relies on non-clinical testing and the substantial equivalence to the predicate device. The performance tests mentioned are general and not detailed with specific quantitative acceptance criteria in this document.
However, based on the information provided, the following non-clinical tests were conducted to ensure safety and performance:
Acceptance Criteria Category | Reported Device Performance (Compliance) |
---|---|
Electrical Safety | In compliance with ANSI/AAMI ES60601-1:2005/(R)2012/A1:2012, C1:2009/(R)2012/A2:2010/(R)2012 |
EMC (Electromagnetic Compatibility) | In compliance with ANSI/AAMI/IEC 60601-1-2:2014 |
Biocompatibility | In compliance with ISO 10993-1 |
Software Verification & Validation | Documentation provided as recommended by FDA's Guidance for Industry and FDA Staff, "Guidance for the Content of Premarket Submissions for Software Contained in Medical Devices" |
Risk Management | According to ISO 14971:2019 |
Human Factor Engineering | In compliance with IEC 62366-1: 2015 |
Performance Test | Conducted (details not provided) |
Cleaning Robustness Test | Conducted (details not provided) |
2. Sample Size Used for the Test Set and Data Provenance
The document explicitly states: "This submission does NOT include animal or clinical performance testing." Therefore, there is no clinical test set, sample size, or data provenance (country of origin, retrospective/prospective) to report for the primary evaluation of this device (the modified AS-101 with reusable sensors). The assessment relies on non-clinical bench testing and the substantial equivalence to the predicate device.
3. Number of Experts Used to Establish Ground Truth for the Test Set and Qualifications
As there was no clinical study conducted for this submission (specifically for the modified device), there is no information on experts used to establish ground truth.
4. Adjudication Method for the Test Set
Not applicable as there was no clinical test set.
5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study
No MRMC comparative effectiveness study was done. The document states: "This submission does NOT include animal or clinical performance testing."
6. Standalone (Algorithm Only Without Human-in-the-Loop Performance) Study
Not applicable. This device is an electronic stethoscope intended for use by healthcare professionals for direct patient assessment, not an AI algorithm acting in a standalone capacity. The "diagnosis decision support" refers to the device aiding the human professional, not replacing them or offering an automated diagnosis.
7. Type of Ground Truth Used
For the non-clinical tests conducted, the "ground truth" would be established by the industry standards and regulatory requirements themselves (e.g., passing specific electrical safety thresholds, demonstrating biocompatibility as per ISO standards, software functioning as specified). There is no "ground truth" in the sense of clinical reference diagnoses (e.g., pathology, outcomes data, expert consensus) because no clinical performance testing was performed for this submission.
8. Sample Size for the Training Set
Not applicable. The AccurSound Electronic Stethoscope is a hardware device for sound amplification and filtering. It does not appear to incorporate machine learning or AI that would require a "training set" in the conventional sense of AI/ML algorithms. The software mentioned is for device control and processing, verified through standard software validation, not through learning from data.
9. How the Ground Truth for the Training Set Was Established
Not applicable, as there is no training set mentioned or implied.
Ask a specific question about this device
(170 days)
Lucasville, NS B4B0X3 Canada
Re: K240901
Trade/Device Name: Stethophone Pro Regulation Number: 21 CFR 870.1875
Classification: Electronic Stethoscope 21 CFR 870.1875(b) Class II Product Code: DQD, DQC Panel: Cardiovascular
Product Code: DQD
Classification: 870.1875 | 510(k) Number: K213794
Product Code: DQD, DQC, DPS
Classification: 870.1875 |
| 10. | Comparison to Predicates: | The
used as part of Eko
App |
| US FDA
Regulation | 21 CFR 870.1875
Stethophone Pro is an electronic stethoscope that enables detection, filtering, and transmission of auscultation sound data (heart and lungs).
Stethophone Pro is intended to provide decision support to clinicians in their evaluation of patients heart sounds. The software analyzes heart sounds and phonocardiograms and can automatically detect murmurs that may be present, sound timing and character, including S1, S2, and the absence of a heart murmur.
Stethophone Pro is not intended to be used as a sole means of diagnosis and is for use in environments where health care is provided by clinicians. The interpretations offered by the software are meant only to provide decision support to the clinician, who may use the result in conjunction with their own evaluation and clinical judgment. The interpretations are not diagnoses. Stethophone Pro is intended for use on adult patients.
Stethophone Pro is an electronic stethoscope software application that operates on smartphones. Stethophone Pro is designed for use by healthcare professionals or on the order of healthcare professionals.
Stethophone Pro enables the capture and amplification of chest sounds for real-time or recorded listening. Cloud storage with sound record sending capabilities, filtering for selected frequency ranges, and visualization all assist with sound analysis.
Stethophone Pro is designed to assist healthcare professionals in both hearing and visualizing heart and lung sounds during a physical examination of a patient and in storing recorded sounds in the cloud for later analysis. It also enables home users to record and send chest sounds to their physicians.
Stethophone Pro can be used for the assessment of chest sounds of adult patients in clinical and non-clinical environments. Assessment is performed by healthcare professionals, while sound capturing can be performed by both healthcare professionals and home users.
Stethophone Pro performs basic analysis of heart sounds allowing to detect the presence of murmurs, locate heartbeats on the timeline (S1/S2), and calculate timing between them.
Key product features:
- Capturing chest sounds using the smartphone microphone:
- Real-time listening to chest sounds,
- Recording of chest sounds,
- Sending examinations to specialists for assessment,
- Two modes of sound visualization: oscillogram and spectrogram,
- Detecting murmurs, timing for S1 and S2 sounds, and calculating heart rate,
- Selecting from three audio filters for listening:
- Bell: Traditional filter used in stethoscopes for low frequency sounds,
- Diaphragm: Traditional filter used for higher frequency sounds of heart and lungs, and
- Starling: Filter for listening to the full frequency of chest sounds.
Collectively, these features enable users to acquire heart sounds and receive basic reporting, so as enable healthcare professionals to examine and monitor patients on site and remotely, seek out second opinions from specialists, and use the device in a telemedicine context.
Here's a breakdown of the acceptance criteria and study details for the Stethophone Pro, based on the provided text:
1. Table of Acceptance Criteria and Reported Device Performance
The document does not explicitly state acceptance criteria in a pass/fail form (e.g., "must achieve >X% sensitivity"). Instead, it presents the reported performance metrics. For this response, I will list the reported performance metrics as the de facto "met performance" from the validation study.
Metric (Heart Sound Analysis) | Dataset | Reported Performance (95% CI) |
---|---|---|
S1 Precision | America | 97.1 (96.7 to 97.5) |
Multi-Device | 96.9 (96.6 to 97.3) | |
S1 Sensitivity (Recall) | America | 97.3 (97.0 to 97.7) |
Multi-Device | 97.9 (97.7 to 98.1) | |
S2 Precision | America | 97.5 (97.2 to 97.9) |
Multi-Device | 97.1 (96.7 to 97.4) | |
S2 Sensitivity (Recall) | America | 96.5 (96.1 to 97.0) |
Multi-Device | 97.7 (97.5 to 97.9) | |
Murmur Detection Sensitivity | America | 88.7 (87.2 to 89.8) |
Multi-Device | 93.0 (91.9 to 94.2) | |
Murmur Detection Specificity | America | 89.2 (87.2 to 91.3) |
Multi-Device | 94.4 (93.7 to 95.4) | |
Murmur Detection Accuracy | America | 88.8 (87.6 to 89.8) |
Multi-Device | 93.8 (93.2 to 94.6) | |
Murmur Detection ROC AUC | America | 96.9 (96.1 to 97.3) |
Multi-Device | 97.9 (97.5 to 98.3) | |
Heart Rate MAE (bpm) | America | 0.482 (0.418 to 0.557) |
Multi-Device | 0.389 (0.346 to 0.430) |
2. Sample Size Used for the Test Set and Data Provenance
- Sample Size (Test Set): 7,304 heart sound recordings from 2,277 adult subjects.
- Data Provenance: The data consisted of both proprietary and public clinical data. 4,396 recordings were from a proprietary dataset, recorded using various devices including smartphones and commercially available stethoscopes. Data appears to be from adult subjects ranging from 18 to 91 years old. Ethnicity representation: 86.1% white, 6.1% Latino, 5.0% Asian, and 2.7% African American. The country of origin for the "America" dataset or "Multi-Device" dataset is not explicitly stated but implies a broad representation. The study was retrospective.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications
- Number of Experts: "Multiple expert cardiologists." The exact number is not specified beyond "multiple".
- Qualifications: "Expert cardiologists." Specific experience levels (e.g., "10 years of experience") are not provided.
4. Adjudication Method for the Test Set
The document states that "Each recording in a testing dataset was annotated by multiple expert cardiologists." It does not explicitly describe an adjudication method (such as 2+1 or 3+1 consensus). It simply states they were annotated by multiple experts, implying that their annotations formed the ground truth, likely through consensus or independent review that established the final label.
5. If a Multi Reader Multi Case (MRMC) Comparative Effectiveness Study was done, and the effect size of how much human readers improve with AI vs without AI assistance
- No, a Multi Reader Multi Case (MRMC) comparative effectiveness study was not explicitly stated or described. The performance data presented is for the standalone algorithm.
6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) was done
- Yes, a standalone performance study was done. The results presented in the tables (S1 precision, S2 sensitivity, Murmur detection, etc.) are for the "Stethophone Pro algorithms for heart sound analysis," without mentioning human-in-the-loop performance. The preamble to the performance data states: "Stethophone Pro underwent a thorough testing process to ensure its safety, reliability and effectiveness. Testing included both software verification and validation, as well as clinical validation." And "Stethophone Pro algorithms for heart sound analysis have been validated in both retrospective and clinical performance testing..." This confirms standalone algorithm performance.
7. The Type of Ground Truth Used
- Expert Consensus: The ground truth for heart sound analysis (presence of murmur, S1/S2 timings) was established by "multiple expert cardiologists" who annotated each recording.
8. The Sample Size for the Training Set
- The sample size for the training set is not provided in the document. It only states that there was "no overlap between subjects and recordings included in the testing and training data."
9. How the Ground Truth for the Training Set Was Established
- The document does not specify how the ground truth for the training set was established. It only mentions that the "validation was performed after the algorithm development and training was finalized."
Ask a specific question about this device
(125 days)
| 21 CFR 870.1875
The Tyto Insights for Crackles Detection is an over-the-counter artificial intelligence (AI) enabled decision support software system used in the evaluation of lung sounds in adults and pediatrics (2 years and older). It automatically analyzes the acoustic signal of the lung as recorded by the FDA 510k cleared compatible Tyto Stethoscope and identifies recordings where a specific abnormal lung sound suggestive of "Crackle" is suspected. It is not intended to detect other abnormal or normal lung sounds. A licensed health care professional’s advice is required to understand the meaning of the Tyto Insights for Crackles Detection result. Healthcare providers should consider the device result in conjunction with recording and other relevant patient data.
The Tyto Insights for Crackles Detection is a web-based (AI) enabled software system designed to aid in the clinical assessment of lungs auscultation sound data by analyzing recorded lung sounds to determine whether a Crackle is detected within the recorded sound data. The Tyto Insights for Crackles Detection Software is intended to process recordings from the FDA-cleared compatible Tyto Stethoscope (Tyto Stethoscope, K181612). The acquisition of the acoustic data (recordings) is carried out by a professional user in a clinical environment or by a lay- user in a non-medical environment, in compliance with the labeling of the Tyto Stethoscope. The system is composed of the following sub-systems:
- The Tyto Insights for Crackles Detection Application Server (APS) communicates with 1. the Tyto Insights for Crackles Detection Algorithm Server (ALS) and implements an application programming interface (API) for communication with the telehealth server.
- The Tyto Insights for Crackles Detection Algorithm Server (ALS) receives an audio file 2. as input and returns an analysis result of positive or negative regarding whether a Crackles was detected as output.
- The Tyto Insights for Crackles Detection Web Server (WBS) provides a graphic 3. indication whether a Crackles is detected in the recording. It can be utilized both in patient and clinician side.
All the software subsystems (servers and storage) are hosted in the cloud and communicate through IP network.
Here's a breakdown of the acceptance criteria and the study proving the device meets them, based on the provided FDA 510(k) summary for "Tyto Insights for Crackles Detection":
Product Information:
- Trade/Device Name: Tyto Insights for Crackles Detection
- Regulation Number: 21 CFR 868.1900
- Regulation Name: Diagnostic Pulmonary-Function Interpretation Calculator
- Regulatory Class: Class II
- Product Code: PHZ
- Intended Use/Indications for Use: An over-the-counter AI-enabled decision support software system for evaluating lung sounds (adults and pediatrics 2+ years) recorded by the compatible Tyto Stethoscope. It identifies recordings where "Crackle" is suspected. It is not intended to detect other abnormal/normal lung sounds. Requires a licensed healthcare professional's advice to interpret results, which should be considered with other patient data.
1. Table of Acceptance Criteria and Reported Device Performance
Parameter | Acceptance Criteria (from PCCP) | Reported Device Performance (Stand-Alone) | Reported Device Performance (Clinical Accuracy vs. Readers) |
---|---|---|---|
Co-Primary Endpoints | |||
Sensitivity (Se) | LCI > 0.6279 (for modifications) | 0.72 (0.63-0.79) | Not directly comparable (Clinical Readers AUC is a composite measure) |
Specificity (Sp) | LCI > 0.9668 (for modifications) | 0.99 (0.97-1.00) | Not directly comparable (Clinical Readers AUC is a composite measure) |
AUC (Area Under the Curve) | Not explicitly defined as a direct acceptance criterion for the initial submission, but non-inferiority margin used for comparison. | Not applicable (standalone metrics are Se, Sp, PPV, NPV) | Tyto Insights for Crackles Detection AUC: 0.97 (0.95–0.98) |
Difference in AUC | Lower bound of 95% two-sided CI for (Device AUC - Clinical Readers AUC) > -0.05 (non-inferiority margin) | Not applicable | 0.2 (0.17–0.23). Meets criterion: 0.17 is > -0.05. |
Secondary Endpoints | |||
Positive Predictive Value (PPV) | (for modifications) | 0.63 (0.4-0.87) | Not applicable |
Negative Predictive Value (NPV) | (for modifications) | 0.99 (0.98-0.99) | Not applicable |
Repeatability (Software vs. Readers) | Not explicitly defined | Software kappa: 1.0, agreement: 100% | Readers kappa: 0.42 (0.35 -0.49) |
Note: The acceptance criteria for Sensitivity and Specificity (LCI > 0.6279 and LCI > 0.9668, respectively) are specifically laid out in the "Predetermined Change Control Plan (PCCP)" section for modifications to the device. For the initial submission, the primary endpoint focused on the non-inferiority of the device's AUC compared to clinical readers. The reported standalone sensitivity and specificity are actual performance metrics from the validation study.
2. Sample Size Used for the Test Set and Data Provenance
- Test Set Sample Size: 446 recordings (120 Crackles positive, 326 Crackles negative). This corresponded to a total of 445 patients.
- Data Provenance: Retrospective validation dataset. Recordings were obtained from the real-world use of the Tyto Care FDA-cleared compatible Tyto Stethoscope (K181612). The document does not specify the country of origin for the data.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of those Experts
- Number of Experts: Three (3) blinded experienced Pulmonologists.
- Qualifications: "Experienced Pulmonologists" are specified. Further details on years of experience or specific board certifications are not provided in the summary.
4. Adjudication Method for the Test Set
- Adjudication Method: Binary ground truth was determined by a majority vote of the three blinded Pulmonologists. This is a form of 3+ Consensus.
5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance
- MRMC Study Done?: A comparative effectiveness study was done comparing the device (AI) performance to "clinical readers" (Physicians non-Pulmonologists). However, this was an AI-only vs. human-only comparison, not a "human reading with AI assistance vs. human reading without AI assistance" MRMC study.
- Effect Size of Human Improvement with AI: This study did not assess how much human readers improve with AI assistance. It directly compared the AI algorithm's performance to human clinical readers.
- Device AUC: 0.97 (0.95–0.98)
- Clinical Readers AUC: 0.77 (0.73–0.8)
- Difference in AUC (Device - Clinical Readers): 0.2 (0.17–0.23). This indicates the AI algorithm significantly outperformed the clinical readers in this specific comparison, establishing non-inferiority (and superiority) based on the defined margin.
6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) was done
- Standalone Study Done?: Yes.
- Performance Metrics:
- Sensitivity: 0.72 (0.63-0.79)
- Specificity: 0.99 (0.97–1.00)
- Positive Predictive Value (PPV): 0.63 (0.4-0.87)
- Negative Predictive Value (NPV): 0.99 (0.98-0.99)
7. The Type of Ground Truth Used
- Type of Ground Truth: Expert Consensus. Specifically, a majority vote of three blinded experienced Pulmonologists on the presence or absence of "Crackle" in the lung sound recordings.
8. The Sample Size for the Training Set
- The document does not specify the exact sample size for the training set. It mentions that the device utilizes a CRNN (Convolutional Recurrent Neural Network) model and that "Each network is trained based on the target clinical class." However, it only provides details for the retrospective validation dataset.
9. How the Ground Truth for the Training Set Was Established
- The document does not explicitly describe how the ground truth for the training set was established. It primarily focuses on the ground truth establishment for the validation set used for performance evaluation. It's generally assumed that similar expert-driven annotation methods would be used for training data, but this is not detailed in the provided summary.
Ask a specific question about this device
(194 days)
4442157 Israel
Re: K233313
Trade/Device Name: Keikku Electronic stethoscope Regulation Number: 21 CFR 870.1875
Electronic Stethoscope Common or Usual Name: Keikku Electronic Stethoscope Classification Name: 21 CFR 870.1875
cleared under K200776, Classification name Electronic stethoscope, Product code: DQD, Regulation: 21 CFR 870.1875
cleared under K083903, Classification name Electronic stethoscope, Product code: DQD, Regulation: 21 CFR 870.1875 |
---|
Regulation number and |
Product Code |
The Keikku is an electronic stethoscope that enables amplification, filtering, and transmission of auscultation data of the patient (heart, lungs, bowel, arteries, and veins), whereby a clinician at one location on a network can listen to the auscultation data of a patient on site or at a different location on the network. The Keikku is intended for use on pediatric and adult patients. The Keikku is intended to be used by professional users in a clinical environment or by lay users in a nonclinical environment. The device is not intended for self-diagnosis.
The Keikku (Rx) is a digital stethoscope device designed for use by health care professionals in clinical settings and by lay users in non-clinical environments under healthcare provider supervision. The Keikku electronically amplifies, filters and transfers body sounds through the accompanying mobile application and is used for storage, sharing and transmitting the data for telemedicine use. It also enables lay users, under supervision from a healthcare provider, to listen to their body sounds (lungs, heart, arteries, veins, gastrointestinal tract, etc.), record and share it with their physicians during telehealth sessions. The Keikku consists of two primary components: 1. The Keikku device is an electronic stethoscope. The Keikku device is used for recording audio, converting it to digital data, and transmitting the data to a mobile device via Bluetooth®. It includes volume adjustment via rotation, tap feature for starting and ending the recording, and an LED light indicator for indicating the status of the device. 2. The Keikku App. The app captures audio data from the Keikku device and provides data visualization and annotation, secure data storage, audio playback, and sharing features. These features enable a healthcare professional to monitor patients, seek second opinions from a specialist or use the device for telemedicine use.
The provided text describes the Keikku Electronic Stethoscope and its substantial equivalence determination to predicate devices. However, it does not contain specific acceptance criteria or a detailed study that proves the device meets such criteria in the format explicitly requested.
The document states that "The test passed and met the predefined acceptance criteria" for performance testing related to audio frequency and NSR response, but it does not specify what those acceptance criteria were or present the reported device performance in a table. It also refers to usability evaluation as having "passing results" without detailing the study or its criteria.
Therefore, I cannot fully complete the requested table and answer all questions due to the lack of explicit information in the provided text.
Based on the available information, here is what can be extracted and what is missing:
1. A table of acceptance criteria and the reported device performance
Acceptance Criteria (Not explicitly stated in document) | Reported Device Performance (Implied) |
---|---|
Performance Testing: Audio frequency response similar to predicate and reference devices. | Passed (similar to Eko Core and 3M Littmann electronic stethoscope in terms of audio frequency and NSR response). |
Performance Testing: NSR (Noise-to-Signal Ratio) response similar to predicate and reference devices. | Passed (similar to Eko Core and 3M Littmann electronic stethoscope in terms of audio frequency and NSR response). |
Biocompatibility: Compliance with ISO 10993-1. | Passed (evaluated in compliance with ISO 10993-1). |
Cleaning and Disinfection: Validation successful. | Passed (All tests successfully completed). |
Software Validation: Compliance with FDA's "Content of Premarket Submissions for Device Software Functions" guidance. | Passed (Software verification and validation testing were conducted, and documentation was provided as recommended). |
Electrical Safety: Compliance with IEC 60601-1. | Passed (conducted on the Keikku Electronic Stethoscope). |
EMC: Compliance with IEC 60601-1-2. | Passed (conducted on the Keikku Electronic Stethoscope). |
Usability: Passing results. | Passed (Usability study was conducted with passing results). |
2. Sample size used for the test set and the data provenance (e.g., country of origin of the data, retrospective or prospective)
- Sample Size for Test Set: Not specified in the provided text for any of the performance studies.
- Data Provenance: Not specified in the provided text.
3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g., radiologist with 10 years of experience)
- Not specified. The document repeatedly refers to "tests" and "evaluations" but does not mention expert involvement in establishing ground truth for any test sets beyond general usability studies.
4. Adjudication method (e.g. 2+1, 3+1, none) for the test set
- Not specified.
5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance
- No MRMC comparative effectiveness study is mentioned. The device's primary function is as an electronic stethoscope for amplification, filtering, and transmission of auscultation data, not an AI-assisted diagnostic tool for human readers.
6. If a standalone (i.e. algorithm only without human-in-the loop performance) was done
- This question is not directly applicable in the context of an electronic stethoscope as described. The device itself (Keikku Electronic Stethoscope) performs sound capture, amplification, and filtering. It is inherently a "standalone" device in its primary functionality. However, it works with an accompanying mobile application for data visualization, storage, and sharing, and facilitates human practitioners' listening. There's no separate "algorithm only" performance reported that would be distinct from the device's inherent operation.
7. The type of ground truth used (expert consensus, pathology, outcomes data, etc)
- The document primarily describes engineering and validation testing (biocompatibility, cleaning/disinfection, electrical safety, EMC, software). For the "Performance Testing," it states the purpose was "to verify the Keikku's performance is similar to that of its predicate and reference devices, Eko Core and 3M Littmann electronic stethoscope, in terms of audio frequency and NSR response." This implies the "ground truth" for performance was defined by the established performance characteristics of the predicate and reference devices, rather than a clinical ground truth like pathology or expert consensus on clinical diagnoses.
8. The sample size for the training set
- Not applicable as the document does not describe any machine learning models that would require a "training set." The Keikku device provides amplification, filtering, and transmission, but it's not described as having an AI component that is "trained" in the typical sense.
9. How the ground truth for the training set was established
- Not applicable (see point 8).
Ask a specific question about this device
(136 days)
California 94608
Re: K233609
Trade/Device Name: CORE 500 Digital Stethoscope Regulation Number: 21 CFR 870.1875
DEVICE INFORMATION
Trade/Proprietary Name: CORE 500 Digital Stethoscope Regulation number: 21 CFR 870.1875
|
| Regulation
Number | 21 CFR 870.1875
| 21 CFR 870.1875
| 21 CFR 870.1875
The CORE 500 Digital Stethoscope is intended to be used by clinicians or lay users to electronically amplify, filter, and transfer body sounds and three lead electrocardiogram (ECG) waveforms. The CORE 500 Digital Stethoscope also displays ECG waveforms and heart rate on the display and accompanying mobile application (when prescribed or used under the care of a clinician or by lay users).
A lay user is not intended to interpret or take clinical action based on the device output without consulting with a qualified healthcare professional.
CORE 500 Digital Stethoscope (CORE 500) is an electronic stethoscope with integrated electrodes for electrocardiogram (ECG). The device consists of a chestpiece, detachable earpiece (Eko Earpiece) and a mobile application (Eko App) and is intended as a digital auscultation tool on patients requiring physical assessment by the clinicians or lay users. CORE 500 provides the ability to amplify, filter, and transfer body sounds with the chestpiece diaphragm, and three lead ECG through electrodes integrated around the chestpiece. The device can be used in a professional healthcare facility and for home use.
CORE 500 features three auscultation modes for a better auscultation experience by filtering acoustic data and enhancing the primary frequency range of particular body sounds: Cardiac Mode for heart sounds, Pulmonary Mode for lung sounds, and Wide Band Mode for general auscultation. CORE 500 also detects and computes the heart rate in real time based on the phonocardiogram (PCG) data.
This FDA 510(k) summary for the Eko Health, Inc. CORE 500 Digital Stethoscope (K233609) describes the device's technical specifications and how it compares to a predicate device. Regarding acceptance criteria and detailed study results, the document provides a general overview rather than specific performance metrics.
Here's an analysis of the provided information concerning acceptance criteria and study details:
1. A table of acceptance criteria and the reported device performance
The document does not provide a table of acceptance criteria with corresponding reported device performance values for the CORE 500 Digital Stethoscope in the way one might expect for a clinical performance study. Instead, it lists the types of nonclinical testing performed and asserts that the device complies with standards or demonstrates performance.
Here's a summary of the reported performance without specific numerical acceptance criteria from the document:
Acceptance Criteria (Inferred from testing type) | Reported Device Performance |
---|---|
Biocompatibility (ISO 10993-1:2018) | Concluded that the CORE 500 Digital Stethoscope is biocompatible. |
Electrical safety (IEC 60601-1-11, IEC 60601-2-47) | Demonstrated compliance with standards for safety. |
Electromagnetic Compatibility (EMC) (IEC 60601-1-2) | Demonstrated compliance with standards for EMC. |
Software Verification and Validation (FDA guidance for Content of Premarket Submissions for Device Software Functions) | Software is verified and validated. |
Usability Testing (IEC 62366-1) | Intended users are able to achieve intended use with Instructions for Use. |
Audio performance | Rigorous bench testing demonstrated product performance. |
Electrical and mechanical function verification | Rigorous bench testing demonstrated product performance. |
Heart rate measurement | Rigorous bench testing demonstrated product performance. |
2. Sample size used for the test set and the data provenance (e.g., country of origin of the data, retrospective or prospective)
The document does not provide specific sample sizes for test sets, data provenance, or whether studies were retrospective or prospective. The performance data section focuses on nonclinical testing.
3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g., radiologist with 10 years of experience)
This information is not provided in the document. The performance data is described as "nonclinical testing" and does not appear to involve expert-adjudicated ground truth as typically found in clinical studies assessing diagnostic accuracy.
4. Adjudication method (e.g., 2+1, 3+1, none) for the test set
This information is not provided. As the document focuses on nonclinical performance, an adjudication method on a clinical test set is not described.
5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance
The document does not mention a multi-reader multi-case (MRMC) comparative effectiveness study. The device, the CORE 500 Digital Stethoscope, is primarily an electronic stethoscope for amplifying, filtering, and transferring body sounds and ECG waveforms, and displaying ECG and heart rate. It is not described as having an AI diagnostic interpretation component that would typically be evaluated in an MRMC study with human readers.
6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done
The document does not explicitly state that a standalone (algorithm only) performance study was done for any specific AI functionality. The device displays ECG waveforms and heart rate, but the document does not describe it as having an autonomous diagnostic algorithm for complex conditions.
7. The type of ground truth used (expert consensus, pathology, outcomes data, etc.)
Given that the performance data described is "nonclinical testing" (bench testing, biocompatibility, electrical safety, software V&V, usability), the concept of "ground truth" as it applies to clinical diagnostic accuracy (e.g., expert consensus, pathology) is not applicable or described in this section. The testing would have focused on meeting technical specifications and regulatory standards.
8. The sample size for the training set
The document does not mention a training set or its sample size. This type of information would typically be provided for devices involving machine learning or AI algorithms with extensive training phases, which is not the primary focus of the performance data in this submission.
9. How the ground truth for the training set was established
Since no training set is mentioned (see point 8), there is no information on how ground truth for a training set was established.
Summary of Device and Performance Context:
The K233609 submission for the CORE 500 Digital Stethoscope primarily focuses on demonstrating substantial equivalence to its predicate device (K230111) and a reference device (K200776), particularly for its expanded "Over-The-Counter Use" and inclusion of "lay users." The performance data provided are centered on foundational nonclinical tests to ensure safety, efficacy, and compliance with general device regulations and standards. It's not a submission for a novel diagnostic AI algorithm requiring extensive clinical performance studies with ground truth establishment by experts. The "nonclinical testing" confirms the device's technical functionality, biocompatibility, electrical safety, software validation, and usability for its intended purpose of amplifying, filtering, and transferring body sounds and ECG waveforms, and displaying basic heart rate and ECG.
Ask a specific question about this device
(138 days)
| 21 CFR 870.1875
The Tyto Insights for Wheeze Detection is an over the-counter artificial intelligence (Al) enabled decision support software system used in the evaluation of lung sounds in adults and pediatrics (2 years and older). It automatically analyzes the acoustic signal of the lung as recorded by the FDA cleared compatible Tyto Stethoscope and identifies recordings where a specific abnormal lung sound suggestive of "Wheeze" is suspected. It is not intended to detect other abnormal or normal lung sounds. A licensed health care professional's advice is required to understand the meaning of the Tyto Insights for Wheeze Detection result. Healthcare providers should consider the device result in conjunction with recording and other relevant patient data.
The Tyto Insights for Wheeze Detection is a web-based (AI) enabled software system designed to aid in the clinical assessment of lungs auscultation sound data by analyzing recorded lung sounds to determine whether a Wheeze is detected within the recorded sound data.
The Tyto Insights for Wheeze Detection Software is intended to process recordings from the FDA-cleared compatible Tyto Stethoscope (Tyto Stethoscope, K181612). The acquisition of the acoustic data (recordings) is carried out by a professional user in a clinical environment or by a lay- user in a non-medical environment, in compliance with the labeling of the Tyto Stethoscope. The system is composed of the following sub-systems:
-
- The Tyto Insights for Wheeze Detection Application Server (APS) communicates with the Tyto Insights for Wheeze Detection Algorithm Server (ALS) and implements an application programming interface (API) for communication with the telehealth server.
-
- The Tyto Insights for Wheeze Detection Algorithm Server (ALS) receives an audio file as input and returns an analysis result of positive or negative regarding whether a wheeze was detected as output.
- The Tyto Insights for Wheeze Detection Web Server (WBS) provides a graphic 3. indication whether a wheeze is detected in the recording. It can be utilized both in patient and clinician side.
All the software subsystems (servers and storage) are hosted in the cloud and communicate through IP network.
Here's a breakdown of the acceptance criteria and study details for the "Tyto Insights for Wheeze Detection" device, based on the provided FDA 510(k) summary:
1. Table of Acceptance Criteria and Reported Device Performance
The document doesn't explicitly state "acceptance criteria" as a pass/fail threshold, but rather focuses on comparing the device's performance to its predicate and demonstrating non-inferiority. The key performance metrics are sensitivity, specificity, and Area Under the Curve (AUC).
Performance Metric | Acceptance Criterion (Implicit) | Reported Device Performance (Tyto Insights for Wheeze Detection) |
---|---|---|
Primary Endpoint | Non-inferiority to the predicate device (TytoCare Lung Sounds Analyzer K221614) based on AUC. Specifically, the lower bound of the 95% two-sided CI for the difference in AUCs (Insights - Analyzer) must be higher than a non-inferiority margin of -0.05. | Insights - Analyzer: 0.0570 (LCI: 0.0289, UCI: 0.0917) |
Standalone Sensitivity | Not explicitly defined as a pass/fail criterion in the document, but provided as a secondary endpoint. | 0.54 (95% CI: 0.43 - 0.65) |
Standalone Specificity | Not explicitly defined as a pass/fail criterion in the document, but provided as a secondary endpoint. | 0.98 (95% CI: 0.97 - 0.99) |
Positive Predictive Value (PPV) | Not explicitly defined as a pass/fail criterion. | 0.72 (95% CI: 0.48 - 0.89) |
Negative Predictive Value (NPV) | Not explicitly defined as a pass/fail criterion. | 0.97 (95% CI: 0.97 - 0.98) |
Overall Diagnostic Accuracy | The document states "The overall diagnostic performance show overall good diagnostic accuracy." This is a qualitative statement summarizing the quantitative metrics. | Demonstrated by the above metrics and non-inferiority of AUC. |
Conclusion regarding acceptance criteria: The device met the primary endpoint of non-inferiority to the predicate device based on AUC, as the lower bound of the 95% CI for the difference in AUCs (0.0289) was well above the non-inferiority margin of -0.05.
2. Sample Size Used for the Test Set and Data Provenance
- Sample Size for Test Set: 371 recordings, corresponding to 359 patients. (86 recordings were Wheeze positive and 285 negative).
- Data Provenance: Retrospective validation dataset sourced from real-world use of the FDA cleared compatible Tyto Stethoscope. The country of origin is not explicitly stated, but Tyto Care Ltd. is based in Israel.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications
- Number of Experts: Three blinded experienced Pulmonologists.
- Qualifications of Experts: Described as "experienced Pulmonologists." Specific details like years of experience are not provided.
4. Adjudication Method for the Test Set
- Adjudication Method: Binary ground truth was determined by a majority vote of the three blinded Pulmonologists. This implies a "3+1" approach where if at least two out of three experts agreed on the presence or absence of wheeze, that was considered the ground truth.
5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was Done
- There is no indication of a Multi-Reader Multi-Case (MRMC) comparative effectiveness study being performed with human readers with and without AI assistance. The study focused on the stand-alone performance of the AI algorithm and its non-inferiority to a predicate device's algorithm, not on the improvement of human readers with AI assistance.
6. If a Standalone Study (Algorithm Only Without Human-in-the-Loop Performance) was Done
- Yes, a standalone study was done. The performance evaluation section explicitly states: "For the characterization of the stand-alone accuracy, the automated binary result of the software has been compared to ground truth and specificity and sensitivity were calculated." and "The primary end point was area under the Curve (AUC) for the detection of wheezes by the proposed device compared to the TytoCare Lung Sounds Analyzer (K221614)".
7. The Type of Ground Truth Used
- Type of Ground Truth: Expert consensus. Specifically, the binary ground truth was determined by a majority vote of three blinded experienced Pulmonologists.
8. The Sample Size for the Training Set
- The sample size for the training set is not explicitly provided in the document. The text states: "The AI Algorithm was trained with recordings acquired by the real-world use of the compatible Tyto Stethoscope."
9. How the Ground Truth for the Training Set Was Established
- The document states that the AI algorithm was "trained with recordings acquired by the real-world use of the compatible Tyto Stethoscope." However, it does not explicitly detail how the ground truth for this training set was established. It can be inferred that a similar expert labeling process might have been used, but this is not confirmed in the provided text.
Ask a specific question about this device
(150 days)
BZQ) O
- Electrocardiograph (21 CFR §870.2340 Product Code: DPS) O
- Stethoscope, Electronic (21 CFR §870.1875
The SimpleSense Platform is intended for use at home, a healthcare facility, or medical research organization under the direction of a licensed medical professional to record, display, and store the following physiological data: a) 2 leads of Electrocardiogram; b) Respiration rate measured through thoracic impedance; c) Heart Sounds; d) Activity including posture; e) Systolic and Diastolic Blood Pressure and f) other validated data sources. The SimpleSense Platform is intended for use when the licensed medical professional decides to evaluate the physiologic signals of adult patients as an aid to diagnosis and treatment. The SimpleSense Platform is intended to be used by patients at rest with a stationary torso. ECG recordings are indicated for the manual assessment of cardiac rhythm disturbances.
The SimpleSense Platform does not produce alarms and is not intended for active patient monitoring. The SimpleSense Platform is not intended for use as life supporting equipment on high-risk patients such as critical care patients. The SimpleSense Platform is not intended for use in the presence of a pacemaker.
The SimpleSense-BP software application is intended to estimate, display and store blood pressure data on adult patients who are twenty two (22) years and older. The SimpleSense-BP can be used after a clinician determines the user's hypertension classification via an auscultatory blood pressure cuff measurement. The Blood Pressure algorithm uses patient specific information (age, gender, height and weight) and the blood pressure measurement as inputs. SimpleSense-BP is used to provide blood pressure estimations derived from physiological sensors to qualified medical personnel as a complimentary physiological feature for the purposes of assessing a patient's cardiac health and variance.
The SimpleSense-BP Software Application accesses the physiological parameters like ECG, heart sounds, and thoracic impedance captured by the SimpleSense Device for processing into the vital sign outputs of the product which includes estimation of Systolic and Diastolic blood pressure. The software uses recorded data from the SimpleSense electronics module as inputs into a validated computational model for estimating blood pressure over the period of wear. The system samples blood pressure while the user is at rest. In addition, SimpleSense-BP Software utilizes inputs such as demographic information (age, weight, height, and gender) and a blood pressure measurement for clinical stratification to the algorithm. The blood pressure outputs are returned to the SimpleSense Mobile Application and/or SimpleSense webserver for display, review and interpretation by a physician.
The Nanowear SimpleSense system is a non-invasive, wearable, and portable medical device for the evaluation and monitoring of patients. It utilizes physiologic and biometric sensors embedded in a garment and an electronics module to gather the heart health data. The specific physiological parameters recorded by the device include: two vectors of Electrocardiogram (ECG), respiratory rate though thoracic impedance, heart sounds, and activity including posture. The signals are recorded by the electronics module on a removable data storage card and are periodically transferred to a smartphone mobile application that connects to the electronics module over a wireless Bluetooth connection. The mobile application provides the functionality of transferring the data collected by the electronics module then relaying the data to the Nanowear web server for display of the data by a physician.
The provided text describes the acceptance criteria and study proving the performance of the SimpleSense-BP software application for blood pressure estimation.
Here's an organized breakdown of the requested information:
Acceptance Criteria and Device Performance
1. Table of Acceptance Criteria and Reported Device Performance
The acceptance criteria for the SimpleSense-BP algorithm are based on the ISO 81060-2 standard for non-invasive sphygmomanometers. The reported performance refers to the accuracy of the device's blood pressure estimations compared to reference measurements.
Measured Parameter | Acceptance Criteria (ISO 81060-2) | Reported Device Performance (Mean Difference (MD) ± Standard Deviation (SD)) |
---|---|---|
Blood Pressure | ||
Overall Performance (All Protocol Timepoints) | ||
Systolic (SBP) | MD ≤ ±5 mmHg; SD ≤ 8 mmHg | 0.09 ± 4.08 mmHg (N=147 subjects) |
Diastolic (DBP) | MD ≤ ±5 mmHg; SD ≤ 8 mmHg | 0.35 ± 3.32 mmHg (N=147 subjects) |
Performance with Nominal Changes (SBP Change ≤ ±15 mmHg; DBP Change ≤ ±10 mmHg) | ||
Systolic (SBP) | MD ≤ ±5 mmHg; SD ≤ 8 mmHg | 0.10 ± 3.88 mmHg (N=147 subjects) |
Diastolic (DBP) | MD ≤ ±5 mmHg; SD ≤ 8 mmHg | 0.46 ± 3.17 mmHg (N=147 subjects) |
Performance with Significant Induced Changes | ||
SBP Increase ≥ 15 mmHg | MD ≤ ±5 mmHg; SD ≤ 8 mmHg | -4.65 ± 2.62 mmHg (N=77 subjects) |
SBP Decrease ≤ -15 mmHg | MD ≤ ±5 mmHg; SD ≤ 8 mmHg | 4.20 ± 2.87 mmHg (N=72 subjects) |
DBP Increase ≥ 10 mmHg | MD ≤ ±5 mmHg; SD ≤ 8 mmHg | -2.54 ± 2.98 mmHg (N=73 subjects) |
DBP Decrease ≤ -10 mmHg | MD ≤ ±5 mmHg; SD ≤ 8 mmHg | 3.36 ± 3.36 mmHg (N=25 subjects) |
Accuracy over Calibration Period (Weekly Performance against ISO 81060-2) | ||
Systolic | MD ≤ ±5 mmHg; SD ≤ 8 mmHg | |
Week-1 | -1.7 ± 5.13 mmHg (N=91 subjects) | |
Week-2 | -1.71 ± 5.05 mmHg (N=91 subjects) | |
Week-3 | -0.88 ± 4.94 mmHg (N=91 subjects) | |
Week-4 | -2.94 ± 4.82 mmHg (N=91 subjects) | |
Diastolic | MD ≤ ±5 mmHg; SD ≤ 8 mmHg | |
Week-1 | -0.41 ± 4.19 mmHg (N=91 subjects) | |
Week-2 | -0.23 ± 4.12 mmHg (N=91 subjects) | |
Week-3 | 0.22 ± 4.05 mmHg (N=91 subjects) | |
Week-4 | -0.77 ± 3.75 mmHg (N=91 subjects) |
2. Sample Size Used for the Test Set and Data Provenance
- Sample Size for Induced Change Test: 149 subjects in total were identified, with 147 subjects having usable data. The study ensured at least 10 subjects had a change in BP of at least 15 mmHg systolic or 10 mmHg diastolic for each of the 4 models used by the device.
- Sample Size for Accuracy over Calibration Period Test: 91 subjects. The study enrolled subjects until at least 85 subjects were included and at least 21 subjects in each clinical stratification (Normal, Prehypertension, Stage 1 hypertension, and Stage 2 hypertension) were represented.
- Data Provenance: The document does not explicitly state the country of origin. It indicates that blood pressure variations were induced using physical activity and thermal stimuli, and auscultatory reference measurements were used for validation, suggesting a prospective study design.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts
The document states that "auscultatory reference measurements were used to validate the SimpleSense-BP algorithm." This implies a clinical setting where blood pressure is manually measured by trained personnel, typically healthcare professionals, using a cuff. However, the exact number of experts, their specific qualifications (e.g., "radiologist with 10 years of experience"), or the method of their involvement (e.g., individual readings, consensus) are not specified in the provided text.
4. Adjudication Method for the Test Set
The document does not describe a formal adjudication method (e.g., 2+1, 3+1, none) for the test set. The ground truth was established by "auscultatory reference measurements," which usually implies direct clinical measurement rather than adjudicated review of digital data.
5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done
No. The provided text describes a standalone performance study comparing the device's output to a gold standard (auscultatory measurements), not a comparative effectiveness study involving human readers with and without AI assistance. Therefore, there is no mention of an effect size for human reader improvement with AI assistance.
6. If a Standalone (i.e., Algorithm Only Without Human-in-the-Loop Performance) Was Done
Yes. The entire performance testing section (Section 11) is dedicated to evaluating the "SimpleSense-BP algorithm" against auscultatory reference measurements. This represents a standalone (algorithm only) performance evaluation.
7. The Type of Ground Truth Used
The type of ground truth used is auscultatory blood pressure cuff measurements, which is considered the gold standard for non-invasive blood pressure measurement.
8. The Sample Size for the Training Set
The sample size for the training set is not specified. The document explicitly states, "There was no overlap of subjects between the training and test data sets i.e., none of the measurements from subjects in the training data set were included in the test data set and vice versa," confirming that a training set was used but not detailing its size.
9. How the Ground Truth for the Training Set Was Established
The document does not explicitly state how the ground truth for the training set was established. However, given that the validation uses "auscultatory reference measurements" as the gold standard, it is highly probable that the training data's ground truth was established using the same (or a similar and equally robust) method of auscultatory blood pressure measurements.
Ask a specific question about this device
Page 1 of 14