Search Results
Found 4 results
510(k) Data Aggregation
(184 days)
The Somfit system is a non-invasive prescription device for home use with patients suspected to have sleep-related breathing disorders. The Somfit is a diagnostic aid for the detection of sleep-related breathing disorders, sleep staging (REM, N1, N2, N3, Wake), and snoring level. The Somfit system acquires electrical data from three frontal electrodes, triaxial accelerometer data, acoustic and plethysmographic data. The Somfit calculates and reports to clinicians EEG/EOG channels, Sleep Stages, SpO2, Peripheral Arterial Tonometry (PAT) signal, pulse rate, and snoring level. The Somfit calculates and reports to clinicians derived parameters such as PAT-derived Apnea Hypopnea Index, Obstructive Desaturation Index; and hypnogram-derived indices such as time in each sleep stage. Somfit data is not intended to be used as the sole or primary basis for diagnosing any sleep-related breathing disorder, prescribing treatment, or determining whether additional diagnostic assessment is warranted. The Somfit is not intended for use as life support equipment, for example vital signs monitoring in intensive care unit. The Somfit is a prescription device indicated for adult patients aged 21 years and over.
The Somfit is a home-based sleep monitoring device which records signals from the patient's forehead and surrounding environment. Somfit is a wearable, low voltage, battery operated device which is attached to subject forehead via a self-adhesive and disposable skin electrode patch. The electrodes are placed on the anterior Prefrontal cortex (PFC) at the Fp1 and Fp2 positions according to the 10/20 EEG system. The device allows for recording of two frontal EEG signals, pulse rate, SPO2, Peripheral Arterial Tonometry (PAT), PPG, motion, and snore. Somfit uses a mobile phone application to acquire data wirelessly via Bluetooth LE technology, then transfer into a secure cloud, for management, storage and postprocessing. The software reports measured parameters in a format compatible with AASM guidelines, including sleep time, pAHI and conventional graphical displays such as a hypnogram.
The Somfit device underwent rigorous testing to establish its performance against predefined acceptance criteria, particularly for its ability to detect sleep stages and related parameters.
Here's a breakdown of the acceptance criteria and the supporting study:
1. Table of Acceptance Criteria and Reported Device Performance
The document does not explicitly present a formal "acceptance criteria" table with specific thresholds for each metric. However, the clinical performance section implicitly defines acceptance by demonstrating non-inferiority to the predicate device (Watch-PAT300) and superior or comparable performance against the gold standard (PSG) for key metrics.
Based on the provided text, here's a table summarizing the performance metrics that act as implicit acceptance criteria:
Implicit Acceptance Criteria & Reported Device Performance for Somfit
Metric | Implicit Acceptance Criteria (Comparative) | Reported Somfit Performance | Reported Watch-PAT300 Performance | Ground Truth (PSG) |
---|---|---|---|---|
PAT-derived AHI (pAHI) | Non-inferiority to predicate (Watch-PAT300) compared to PSG. | Mean difference with Watch-PAT300: 0.294 (95% CI: -2.661, 2.074). | ||
Mean difference with PSG: 0.658 (CI: -1.012, 2.326). | Mean difference with PSG: 2.499 (CI: 0.732, 4.265). | Polysomnography (PSG) | ||
Obstructive Desaturation Index (ODI) | Superior or comparable accuracy to predicate. | Mean difference with PSG: 0.658 (CI: -1.012, 2.326). | Mean difference with PSG: 2.499 (CI: 0.732, 4.265). | Polysomnography (PSG) |
N1/N2 Merged Sleep Stages Agreement | High agreement with PSG; superior to predicate. | 80.92% agreement (95% CI: 79.96, 81.89) | 61.77% agreement (95% CI: 60.99, 62.55) | Polysomnography (PSG) (consensus of three scoring sleep technologists) |
NREM/REM/Wake Stage Differential Agreement | High agreement with PSG; superior to predicate. | 86.79% agreement (95% CI: 85.76, 87.81) | 74.42% agreement (95% CI: 73.51, 75.32) | Polysomnography (PSG) (consensus of three scoring sleep technologists) |
Sleep/Wake Determination Agreement | High agreement with PSG; superior to predicate. | 89.45% agreement (95% CI: 88.53, 90.38) | 82.09% agreement (95% CI: 81.37, 82.82) | Polysomnography (PSG) (consensus of three scoring sleep technologists) |
SpO2 Accuracy (ARMS) | Maintain or outperform predicate, satisfy ISO 80601-2-61. | 1.46% | 1.88% (Watch-PAT300) | Gold standard SaO2 (invasive controlled desaturation study) |
Pulse Rate Accuracy | Satisfy ISO 80601-2-61. | 1.91 BPM (vs Masimo), 1.81 BPM (vs Nellcor) | Not explicitly compared here | Masimo and Nellcor reference oximeters |
2. Sample Size and Data Provenance
- Test Set Sample Size: 92 subjects for the comparative clinical study involving Somfit, Watch-PAT300, and PSG.
- Data Provenance: The subjects were recruited from 3 site locations in Australia. The study was a prospective clinical study conducted to compare the devices' performance.
3. Number of Experts and Qualifications for Ground Truth
- Number of Experts: Three scoring sleep technologists.
- Qualifications of Experts: The document states they were "scoring sleep technologists." Specific educational background or years of experience are not provided, but their role implies expertise in polysomnography scoring.
4. Adjudication Method for the Test Set
The adjudication method for sleep staging ground truth was expert consensus. The PSG epochs were classified based on the "consensus of three scoring sleep technologists." This implies a form of 3-way consensus. Further details on how discrepancies were resolved (e.g., majority rule, discussion to reach agreement) are not provided.
5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study
No, a traditional MRMC comparative effectiveness study was not explicitly described in the provided text in the context of human readers improving with AI vs. without AI assistance. The study evaluated the device's performance (Somfit and Watch-PAT300) against a human-scored gold standard (PSG), rather than measuring the improvement of human readers assisted by AI. The Somfit system is described as a diagnostic aid that calculates and reports parameters to clinicians, implying that clinicians review the output, but the study design was not focused on measuring changes in human reader performance.
6. Standalone (Algorithm Only) Performance
Yes, the study primarily evaluated the standalone performance of the Somfit algorithm (and Watch-PAT300) in deriving parameters like pAHI and sleep stages, comparing its output directly to the gold standard PSG and the predicate device. There was no human-in-the-loop component as part of the evaluated performance for regulatory submission.
7. Type of Ground Truth Used
The primary ground truth used for the clinical study was Polysomnography (PSG), which is considered the gold standard technology for diagnosing sleep disorders. Specifically, for sleep staging, it was expert consensus-scored PSG data. For SpO2, it was gold standard SaO2 data obtained from an invasively controlled desaturation study.
8. Sample Size for the Training Set
The document does not provide information on the sample size for the training set for the Somfit algorithms. It focuses solely on the clinical validation/test set.
9. How the Ground Truth for the Training Set Was Established
As the training set details are not provided, the method for establishing its ground truth is also not mentioned in the document.
Ask a specific question about this device
(129 days)
AcuPebble Ox100 is a wearable device intended for use in the recording, analysis, displaying, exporting, and storage of biophysical parameters to aid in the evaluation of adult patients with, or with suspected, obstructive sleep apnea (OSA). The device is primarily intended for home settings use (although can also be used in healthcare settings) under the direction of a Healthcare Professional (HCP).
AcuPebble Ox100 is prescribed by a Health Care Professional for the patient to use in the home as a 'home sleep apnea test' (HSAT). AcuPebble Ox100 comprises: 1- A small physiological sensing device, identical to the previously cleared device AcuPebble SA100 (K210480) that is worn on the front of the neck around the suprasternal notch area (the "AcuPebble SA100 sensor"), and attaches with a single use biocompatible adhesive tape (same one as for "AcuPebble SA100" too); 2- Another physiological wireless sensing device ("AcuPebble finger oximetry sensor") worn on the finger; 3- A mobile device app (the "AcuPebble Ox100 app") that guides the patient through the steps of the test, collects the data from the sensor (continuously in the case of the "AcuPebble SA100 sensor", and at the end of the test in the case of the "AcuPebble finger oximetry sensor"), and uploads them in the cloud ; 4- A cloud-based software that analyses the signals from the "AcuPebble SA100 sensor" (already cleared as part of K210480); 5- A web app user interface for healthcare professionals where they can set up a study and see the results, including different physiological channel traces and OSA diagnostic parameters. Outputs of the device relevant to its intended use are further described in the comparison table below.
The provided text describes the AcuPebble Ox100 device and its substantial equivalence to a predicate device (AcuPebble SA100, K210480) based on various performance data and testing. However, it does not contain a detailed study specifically proving that the device meets defined acceptance criteria for its effectiveness in aiding the evaluation of Obstructive Sleep Apnea (OSA).
The information provided primarily focuses on:
- Comparison to Predicate and Reference Devices: Highlighting similarities in indications for use, regulation, target population, environment of use, and certain performance metrics previously claimed for the predicate or a reference device (NightOwl, K191031).
- Compliance with Recognized Consensus Standards: For biocompatibility, electrical safety (EMC), home healthcare safety, risk management, and software development.
- High-level performance metrics: AHI, ODI, Diagnostic LR+, LR-, Sensitivity, Specificity, and Pulse rate/SpO2 performance, which appear to be inherited or similar to the predicate/reference device claims rather than outcomes of a new primary study for AcuPebble Ox100's specific combination of sensors.
Information NOT explicitly available in the provided text:
- A dedicated table of acceptance criteria for AcuPebble Ox100 with its own reported performance to demonstrate compliance.
- Detailed information about a specific clinical study conducted for AcuPebble Ox100 to prove its diagnostic performance. The diagnostic metrics listed (Sensitivity, Specificity, etc.) are presented as "Same" compared to the predicate, implying these are existing claims rather than results from a new study specific to Ox100 to justify a de novo clearance.
- Sample sizes for a test set specifically for demonstrating the performance of AcuPebble Ox100 in diagnosing OSA.
- Data provenance (country of origin, retrospective/prospective) for a study validating AcuPebble Ox100's diagnostic capabilities.
- Number of experts, their qualifications, or adjudication methods for establishing ground truth of a test set for AcuPebble Ox100's diagnostic performance.
- Whether a Multi-Reader Multi-Case (MRMC) comparative effectiveness study was done for AcuPebble Ox100, or any effect size of AI assistance.
- The type of ground truth used for a study validating AcuPebble Ox100's diagnostic capabilities.
- Sample size and ground truth establishment for the training set of AcuPebble Ox100's diagnostic algorithm.
Based on the provided text, here's what can be extracted, and what is missing or implied:
1. A table of acceptance criteria and the reported device performance:
The document doesn't explicitly present a standalone table of "acceptance criteria" for the AcuPebble Ox100 followed by "reported device performance" from a new study of this specific device. Instead, it compares the AcuPebble Ox100's characteristics and performance to its predicate (AcuPebble SA100) and a reference device (NightOwl) in a tabular format. The performance metrics listed are presented as "Same" to the predicate, implying that these are the established performance levels from the predicate device that the AcuPebble Ox100 is deemed to meet by being substantially equivalent.
Here's a reconstruction of the relevant performance metrics mentioned, noting that these are largely presented as being "Same" as the predicate:
Performance Metric | Acceptance Criteria (Implied / From Predicate) | Reported Device Performance (Likely Inherited from Predicate) |
---|---|---|
Diagnostic LR+ | Not explicitly stated as acceptance criteria, but listed as 29.36 /32.29 for predicate | 29.36 /32.29 (Stated as "Same") |
Diagnostic LR- | Not explicitly stated as acceptance criteria, but listed as 0.08 /0.04 for predicate | 0.08 /0.04 (CI- 0.03 to 0.19/0.01 to 0.16) (Stated as "Same") |
Diagnostic Sensitivity | Not explicitly stated as acceptance criteria, but listed as 92.73% /95.92% for predicate | 92.73% /95.92% (CI-82.41% to 97.98% /86.02% to 99.50%) (Stated as "Same") |
Diagnostic Specificity | Not explicitly stated as acceptance criteria, but listed as 96.84% /97.03% for predicate | 96.84% /97.03% (Stated as "Same") |
Pulse rate (from heart sounds) | Not explicitly stated as acceptance criteria, but listed as 50-120bpm for predicate | 50-120bpm (3.62bpm validation accuracy) (Stated as "Same") |
Pulse rate (from PPG) | ±2bpm or ±2% | Meets requirement of ±2bpm or ±2%. |
SpO2 performance (80%-100% range) | Compliant with ISO 80601-2-61 (2% root-mean-square difference) | 2% root-mean-square difference |
SpO2 performance (70%-79% range) | Compliant with ISO 80601-2-61 (3% root-mean-square difference) | 3% root-mean-square difference |
SpO2 performance (70-100% SaO2) | Compliant with ISO 80601-2-61 (≤4% root-mean-square difference) (from reference device) | (Implied to meet this based on specific ranges above) |
Biocompatibility | ISO 10993 requirements (sensitization, irritation, cytotoxicity, USP class VI) | Complies (passing results for finger sensor, neck sensor same as cleared predicate) |
General Safety and EMC | IEC 60601-1:2005:MOD, IEC 60601-1-2:2014 | Complies |
Home Healthcare Environment Safety | IEC 60601-1-11:2015 | Complies |
Risk Management | ISO 14971:2019 | Complies |
Software Verification and Validation | IEC 62304:2006/A1:2016, FDA Cybersecurity Guidance | Complies (software level of concern: "moderate") |
2. Sample size used for the test set and the data provenance:
- Not specified for a new effectiveness study of AcuPebble Ox100. The performance metrics (Diagnostic LR+, LR-, Sensitivity, Specificity) are stated to be the "Same" as the predicate device (AcuPebble SA100). Therefore, any sample size and data provenance would refer to the previous clearance of K210480. This information is not provided in the document for K210480.
- For the SpO2 performance, compliance with ISO 80601-2-61 is stated. Such compliance typically requires specific testing against a reference oximeter in a clinical setting with a certain number of subjects across defined SpO2 ranges, but the specific sample size, country of origin, or retrospective/prospective nature of this verification for AcuPebble Ox100 is not detailed.
3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts:
- Not specified for a new effectiveness study of AcuPebble Ox100. This information would be relevant for the diagnostic performance metrics, which are stated to be "Same" as the predicate. Details for the predicate (K210480) are not in this document.
4. Adjudication method (e.g., 2+1, 3+1, none) for the test set:
- Not specified for a new effectiveness study of AcuPebble Ox100. This would relate to the diagnostic performance metrics, which are stated to be "Same" as the predicate. Details for the predicate (K210480) are not in this document.
5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:
- No such study is mentioned or described for AcuPebble Ox100. The device is intended to aid in evaluation, but no comparative effectiveness study with human readers (with vs. without AI assistance) is detailed.
6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done:
- The diagnostic performance metrics listed (Sensitivity, Specificity, LR+, LR-) usually reflect standalone algorithm performance against a gold standard. However, these are listed as "Same" to the predicate device (AcuPebble SA100). The document does not provide details of a new standalone study for AcuPebble Ox100 itself to derive these numbers. The "cloud-based software that analyses the signals" and "web app user interface for healthcare professionals" suggest an algorithmic analysis component.
7. The type of ground truth used (expert consensus, pathology, outcomes data, etc.):
- Not specified for a new effectiveness study of AcuPebble Ox100. For diagnostic assessments of OSA, polysomnography (PSG) scored by experts according to AASM guidelines is the typical gold standard/ground truth. However, the document does not confirm this for a specific study validating AcuPebble Ox100's performance.
8. The sample size for the training set:
- Not specified. The document refers to "A cloud-based software that analyses the signals" but does not provide details on its training set or how it was developed for AcuPebble Ox100.
9. How the ground truth for the training set was established:
- Not specified.
Ask a specific question about this device
(147 days)
The Sunrise device is a non-invasive home care aid in the evaluation of obstructive sleep apnea (OSA) in patients 18 years and older with suspicions of sleep breathing disorders.
The Sunrise device is a cloud-based software device that analyzes data from a sensor (Sunrise sensor 1 or Sunrise sensor 2) placed on the patient's chin. The device detects respiratory events, identifies sleep stages and position. The device generates sleep parameters, e.g. apnea hypopnea index "Sunrise AHI", and position discrete states. Data collected by the device is integrated in a report for further interpretation by the healthcare provider.
The provided text details the performance data for the Sunrise device to support its substantial equivalence determination. However, it does not explicitly state "acceptance criteria" in a表格 format as requested. Instead, it describes performance metrics (e.g., median measurement bias and LOA, sensitivity, specificity, global accuracy, and RMS values) for various parameters against pre-determined thresholds of clinical acceptability or against a gold standard (PSG).
Based on the provided information, I will infer the acceptance criteria from the reported performance, as these are the values the device did achieve and were deemed sufficient for substantial equivalence.
Here's a breakdown of the requested information:
1. Table of Acceptance Criteria and Reported Device Performance
As explicit acceptance criteria thresholds are not stated, the "Acceptance Criteria" column will reflect the reported performance that was deemed acceptable for substantial equivalence. The "Reported Device Performance" will reiterate these values.
Parameter | Acceptance Criteria (Inferred from Reported Performance) | Reported Device Performance |
---|---|---|
Study 1 (Belgium, n=289) | ||
TST Median Bias & LOA | Median bias within -4.50 min and LOA of -41.74 to +35.67 | -4.50 min (-41.74 to +35.67) |
AHI Median Bias & LOA | Median bias within -0.46 event/h and LOA of -13.52 to +9.00 | -0.46 event/h (-13.52 to +9.00) |
ORDI Median Bias & LOA | Median bias within +0.15 event/h and LOA of -10.70 to +10.12 | +0.15 event/h (-10.70 to +10.12) |
Sensitivity (AHI>=5) | >= 0.99 | 0.99 |
Sensitivity (AHI>=15) | >= 0.92 | 0.92 |
Sensitivity (AHI>=30) | >= 0.81 | 0.81 |
Specificity (AHI>=5) | >= 0.86 | 0.86 |
Specificity (AHI>=15) | >= 0.94 | 0.94 |
Specificity (AHI>=30) | >= 0.99 | 0.99 |
Study 2 (France, n=31) | ||
TST Median Bias & LOA | Median bias within -10.50 min and LOA of -37.42 to +25.79 | -10.50 min (-37.42 to +25.79) |
AHI Median Bias & LOA | Median bias within +0.20 event/h and LOA of -12.30 to +6.30 | +0.20 event/h (-12.30 to +6.30) |
ORDI Median Bias & LOA | Median bias within +1.01 event/h and LOA of -11.24 to +6.21 | +1.01 event/h (-11.24 to +6.21) |
Sensitivity (AHI>=5) | >= 1.00 | 1.00 |
Sensitivity (AHI>=15) | >= 0.94 | 0.94 |
Sensitivity (AHI>=30) | >= 0.87 | 0.87 |
Specificity (AHI>=5) | >= 0.75 | 0.75 |
Specificity (AHI>=15) | >= 1.00 | 1.00 |
Specificity (AHI>=30) | >= 1.00 | 1.00 |
Study 3 (Belgium, n=10) | ||
Position Discrete States Global Accuracy | >= 93% | 93% |
Study 4 (SpO2 & Pulse Rate Accuracy) | ||
SpO2 Accuracy (RMS) |
Ask a specific question about this device
(137 days)
AcuPebble SA100 is indicated to sense, record, and interpret a patient's physiological signals (including respiratory pattern) during sleep for the purpose of prescreening patients for obstructive sleep apnea (OSA) syndrome. The designed for use in home-screening of adults with suspected possible sleep breathing disorders (although it can also be used in clinic). Results are used to assist the healthcare professional's in the patient's evaluation.
The system is not intended as a substitute for full polysomnography when additional parameters such as sleep stages, limb movements, or EEG activity are required.
AcuPebble SA100 comprises a sensor that is worn on the front of the neck around the suprasternal notch area (the "AcuPebble SA100 sensor"), a mobile device app that guides the patient through the steps of the test, collects the data from the sensor, and uploads them in the "AcuPebble SA100 app"), and a cloud-based analysis software (the "AcuPebble SA100 algorithms". The "AcuPebble SA100 Sensor" consists of a small biocompatible enclosure with very low power sensors and electronics inside. It is attached to the front of the neck (somewhere between the Adam's apple and the suprasternal notch area) by single-use biocompatible adhesive tape. The sensor measures physiological body sounds. The data sensed is streamed via a Bluetooth link to the "AcuPebble SA100 app" on a smart device (mobile phone/tablet). The data can be uploaded into the cloud where it is analyzed, any time after the sleep study test is finished at the tap of a button in the app. AcuPebble SA100 signal processing algorithms produce a number of OSA diagnostic traces and parameters. These can be accessed by the Health Care Professional through a healthcare professional portal, which can be accessed from any computer or smart device with an Internet connection.
AcuPebble SA100 is not intended to be used with patients with pacemakers or other implantable devices, or with patients with known or suspected arrhythmias. This device has not been validated in patients with congestive heart failure or patients with neuromuscular disorders. Patients with significant cardiopulmonary or neurological disorders need to be excluded from using the device.
Here's a breakdown of the acceptance criteria and the study proving the device meets them, based on the provided text:
Device Name: AcuPebble SA100
Intended Use: To sense, record, and interpret a patient's physiological signals (including respiratory pattern) during sleep for the purpose of prescreening patients for obstructive sleep apnea (OSA) syndrome. Designed for home-screening of adults with suspected possible sleep breathing disorders to assist healthcare professionals in patient evaluation. Not a substitute for full polysomnography.
1. Table of Acceptance Criteria and Reported Device Performance
The document does not explicitly state pre-defined "acceptance criteria" with numerical thresholds for diagnostic accuracy (PPV, NPV, LR+, LR-). Instead, it presents the results of the clinical validation study for several diagnostic indices (AHI3, AHI4, ODI3, ODI4) and heart rate accuracy. The implicit acceptance is that these values demonstrate substantial equivalence to the predicate device.
Implicit Acceptance Criteria (Performance Benchmarks from Predicate/Context): Not explicitly stated with numerical targets in the provided text. The submission focuses on demonstrating substantial equivalence to the predicate (Drowzle, K173974) and reference devices (NightOwl, K191031; Sleep Strip II, K112822). The reported values in the table are the result of meeting the substantial equivalence standard, rather than being against pre-set numerical acceptance criteria.
Reported Device Performance:
Diagnostic Index | Positive Predictive Value (PPV) | Negative Predictive Value (NPV) | Positive Likelihood Ratio (LR+) | Negative Likelihood Ratio (LR-) |
---|---|---|---|---|
AHI3 (for airflow reductions and 3% desaturations) | 94.44% (CI 84.78%- 98.11%) | 95.83% (CI 89.94%- 98.34%) | 29.36 (CI 9.62 to 89.64) | 0.08 (CI 0.03 to 0.19) |
AHI4 (for 4% desaturations) | 94.00% (CI 83.69%- 97.95%) | 98.00% (CI 92.65% to 99.48%) | 32.29 (CI 10.58 to 98.59) | 0.04 (CI 0.01 to 0.16) |
ODI3 (considering 3% desaturations) | 93.42% (CI 85.87%- 97.07%) | 90.54% (CI 82.48%- 95.11%) | 13.11 (CI 5.61 to 30.62) | 0.10 (CI 0.05 to 0.20) |
ODI4 (considering 4% desaturations) | 85.71% (CI 75.50%- 92.11%) | 98.94% (CI 93.03%- 99.85%) | 12.37 (CI 6.35-24.08) | 0.02 (CI 0.00-0.15) |
Heart Rate Accuracy:
Bias (µ) ≤ ±1 bpm | Bias (µ) ≤ ±3 bpm | Bias (µ) ≤ ±5 bpm | Standard Deviation (σ) ≤ 2 bpm | Standard Deviation (σ) ≤ 5 bpm | Standard Deviation (σ) ≤ 8 bpm |
---|---|---|---|---|---|
62.0% | 94.0% | 98.7% | 28.7% | 93.3% | 98.7% |
2. Sample Size Used for the Test Set and Data Provenance
- Sample Size for Test Set: 150 consecutive evaluation patients.
- Data Provenance: Not specified in terms of country of origin. The study was a "Clinical Investigation," conducted in accordance with ISO 14155:2011 and 21 CFR 812.28(a)(1) (GCP for clinical investigations). This implies a prospective study design for data collection, as it refers to "consecutive evaluation patients."
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications
- The document does not specify the number or qualifications of experts used to establish the ground truth. It states that the ground truth for diagnostic accuracy was based on "the AASM for airflow reductions and desaturations" and "established thresholds, for OSA (i.e. 5, 15 and 30)". For heart rate, the ground truth was the "PPG signal of the polygraphy system." This implies that the ground truth was derived from a gold-standard PSG (Polysomnography) system, rather than expert interpretation of the device's output alone.
4. Adjudication Method for the Test Set
- The document does not mention any specific adjudication method (e.g., 2+1, 3+1, none) for the test set. Ground truth appears to be derived from the gold standard PSG, rather than expert review of the device's output.
5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was Done
- No, an MRMC comparative effectiveness study involving human readers with and without AI assistance was not described. The clinical validation focuses on the device's accuracy compared to a polysomnography system, not on assisting human readers.
6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) was Done
- Yes, the clinical validation study appears to be a standalone performance evaluation. The device (AcuPebble SA100) generates diagnostic indices (AHI, ODI) and heart rate output, and these are compared directly against a polygraphy system, which serves as the ground truth. The role of a human healthcare professional is described as using the results to "assist" in patient evaluation, implying the device provides direct outputs.
7. The Type of Ground Truth Used
- Type of Ground Truth: The ground truth for OSA diagnostic indices (AHI, ODI) was established using definitions from the "AASM" (American Academy of Sleep Medicine) for airflow reductions and desaturation criteria (3% and 4%). This indicates comparison against polysomnography (PSG), which is the gold standard for sleep apnea diagnosis. For heart rate, the ground truth was "the heart rate obtained from the PPG signal of the polygraphy system," further confirming PSG as the reference.
8. The Sample Size for the Training Set
- The document does not specify the sample size used for the training set. The clinical validation section only refers to the "150 consecutive evaluation patients" used for the accuracy validation clinical study (i.e., the test set).
9. How the Ground Truth for the Training Set Was Established
- The document does not specify how the ground truth for the training set was established, as the training set details are not provided.
Ask a specific question about this device
Page 1 of 1