Search Filters

Search Results

Found 4 results

510(k) Data Aggregation

    K Number
    K140862
    Date Cleared
    2014-08-27

    (146 days)

    Product Code
    Regulation Number
    884.2720
    Reference & Predicate Devices
    Predicate For
    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The Monica Novii Pod is an intrapartum maternal-fetal monitor that non-invasively measures and displays fetal heart rate (FHR), uterine activity (UA) and maternal heart rate (MHR). The Novii Pod acquires and displays the FHR tracing from abdominal surface electrodes that pick up the fetal ECG (fECG) signal. Using the same surface electrodes, the Pod also acquires and displays the UA tracing from the uterine electromyography (EMG) signal and the MHR tracing from the maternal ECG signal (mECG). The Pod is indicated for use on women who are at >36 completed weeks, in labor, with singleton pregnancies, using surface electrodes on the maternal abdomen.

    The Novii Patch is an accessory to the Novii Pod that connects directly to the Novii Pod and contains the surface electrodes that attach to the abdomen.

    The Novii Interface is an accessory to the Novii Pod which provides a means of interfacing the wireless output of the Novii Pod to the transducer inputs of a CTG Fetal monitor. The Novii Interface enables signals collected by the Novii Pod to be printed and displayed on a CTG Fetal Monitor and sent on to a central network, if connected.

    The Novii Pod maternal-fetal monitor and its accessories are intended for use by healthcare professionals in a clinical setting

    Device Description

    The Monica Novii Pod Fetal-Maternal Monitor is designed as an ambulatory device for the monitoring of a pregnant mother. The monitor enables the abdominal electrophysiological signal to be picked up from three different positions on the maternal abdomen using the 5 electrodes on the Monica Novii Patch. The monitor filters the abdominal signals, converts the abdominal electrophysiological data into a digital format and then processes it in real time to extract the fetal heart rate, maternal heart rate and uterine activity. The result of the processing is transmitted via the Bluetooth connection to the Monica Novii CTG Interface device that is a Monica Approved accessory to the Monica Novii Pod.

    AI/ML Overview

    Here's a breakdown of the acceptance criteria and the studies that prove the Monica Novii Wireless Patch System meets them, based on the provided text:

    1. Table of Acceptance Criteria and Reported Device Performance

    The document provides acceptance criteria for non-clinical tests (Data Transfer Validation and Data Extraction Validation).

    Acceptance Criteria CategorySpecific MetricAcceptance CriteriaReported Device Performance
    Non-Clinical Testing
    Data Transfer ValidationBias difference for Fetal Heart Rate (FHR)Less than 1 BPMDemonstrated compliance (implies bias difference was < 1 BPM). The system achieves "reliability and accuracy of the data transfer... by demonstrating it meets pre-set thresholds i.e. a bias difference less of than 1 BPM for fetal heart rate and a maximum loss of transmitted to recorded data of 2%".
    Maximum loss of transmitted to recorded data2%Demonstrated compliance (implies loss was < 2%). Same as above.
    Data Extraction ValidationEquivalence with predicate for FHR, MHR, UA data (via statistical analysis)Demonstrated by statistical analysis including Positive Percent Agreement (PPA), Percentage Equivalence, and Sensitivity. Implicitly, these metrics met predefined thresholds for equivalence, though specific numerical thresholds are not provided in the summary.The results of the extracted data from the Novii Pod were compared to the output of the predicate Monica AN24 device, and "demonstrate equivalence by statistical analysis including; Positive Percent Agreement (PPA), Percentage Equivalence and Sensitivity." This implies the device met the criteria for equivalence.
    Clinical TestingEquivalence in clinical performance of FHR, MHR, UA with predicateSubstantial equivalence to the Ambu electrodes attached to the Monica AN24 predicate device.The results "demonstrated that the Monica Novii Patch is substantially equivalent to the Ambu electrodes attached to the Monica AN24 predicate device." (Specific quantitative metrics or detailed statistical results from the clinical study are not provided in this summary, but the conclusion states equivalence was demonstrated).

    2. Sample Sizes Used for the Test Set and Data Provenance

    • Clinical Study (Test Set):
      • Sample Size: 31 patients. The study was conducted in two stages:
        • 24 subjects recruited into three BMI groups.
        • 7 subjects where the Novii Patch was deliberately misplaced.
      • Data Provenance: The document does not explicitly state the country of origin for the clinical study data but implies it was collected in a clinical environment. Given Monica Healthcare is based in the UK, it's probable the study took place there. The study was prospective in nature, comparing the Novii Patch directly against a predicate device in a clinical setting.
    • Non-Clinical Data Extraction Validation (Test Set):
      • Sample Size: Ten (10) simulated data files.
      • Data Provenance: The simulated data files were "based on data collected from the maternal abdomen in previous fetal ECG trials" of the predicate Monica AN24 device (K101801). This is retrospective in terms of the original data used to create the simulations, but the testing itself was performed using these pre-existing simulated data sets.

    3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications

    • Clinical Study: The document does not specify the number of experts or their qualifications for establishing ground truth in the clinical study. It mentions the study monitored "clinical performance" implicitly against the predicate device's readings, suggesting the predicate device served as the reference rather than independent expert adjudication of the Novii's output alone.
    • Non-Clinical Studies: Ground truth for the non-clinical tests (Data Transfer and Data Extraction) was established by comparing the device's output against known input signals or the predicate device's output. No human experts were involved in establishing ground truth for these simulated tests.

    4. Adjudication Method for the Test Set

    • Clinical Study: The document does not describe a formal adjudication method by experts for the clinical study beyond comparing the Novii Patch's performance directly to that of the predicate device (Monica AN24 with Ambu electrodes).
    • Non-Clinical Studies: Adjudication was purely technical/automated, comparing device output to known inputs or predicate device output.

    5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

    • No, an MRMC comparative effectiveness study was not explicitly mentioned or implied. The studies described focus on the device's performance characteristics and its equivalence to a predicate device, rather than how human readers' diagnostic accuracy or efficiency might improve with or without AI assistance. The Monica Novii Wireless Patch System appears to be a monitoring device that outputs raw data (FHR, MHR, UA tracings) rather than an AI-driven interpretive tool requiring human reader studies.

    6. Standalone (Algorithm Only) Performance Study

    • Yes, standalone performance was assessed in the non-clinical "Data Extraction Validation." In this test, the Novii Pod's ability to extract FHR, MHR, and UA data from simulated electrophysiological signals was directly compared to the predicate device's output using the same inputs. This assesses the algorithm's performance in isolation from the clinical environment where a human might interpret the data.

    7. Type of Ground Truth Used

    • Clinical Study: The ground truth was effectively the output of the predicate device (Monica AN24 with Ambu electrodes), as the study aimed to demonstrate substantial equivalence to this legally marketed device. This is a form of comparative ground truth against a recognized standard.
    • Non-Clinical Data Transfer Validation: Ground truth was the locally stored extracted data on the Novii Pod's Micro-SD card, compared against the transmitted data. This is a form of internal consistency ground truth.
    • Non-Clinical Data Extraction Validation: Ground truth was the output of the predicate Monica AN24 device when fed the same simulated inputs. This is also a form of comparative ground truth against a known standard.

    8. Sample Size for the Training Set

    • The document does not provide any explicit details about a training set size. The Monica Novii Wireless Patch System's detection technology is explicitly stated to be "identical to the Monica AN24 predicate device in that it use the same electronic components, the same signal processing software." This suggests it reuses the established algorithms from the predicate device, rather than relying on a newly trained (e.g., machine learning) algorithm that would require a distinct training set. The simulated data used in testing was based on "previous fetal ECG trials" of the predicate, which could be considered data from which the original algorithms were developed, but not a "training set" in the context of a new algorithm.

    9. How the Ground Truth for the Training Set Was Established

    • As there's no explicit mention of a new "training set" for a novel algorithm, the document doesn't detail how ground truth for a training set was established. The algorithms are inherited from the predicate device. The simulated data used for non-clinical testing was "based upon data collected in a trial of the predicate Monica AN24 device (K101801)" and "data collected from the maternal abdomen in previous fetal ECG trials" – these historical data sets would have had their own ground truth established via methods relevant to those original trials, likely involving expert review or known physiological parameters.
    Ask a Question

    Ask a specific question about this device

    K Number
    K112390
    Device Name
    MONICA AN24
    Date Cleared
    2012-07-13

    (330 days)

    Product Code
    Regulation Number
    884.2720
    Reference & Predicate Devices
    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The Monica AN24 is an intrapartum maternal-fetal monitor that non-invasively measures and displays fetal heart rate (FHR), maternal heart rate (MHR) and uterine activity (UA). The AN24 acquires and displays the FHR & MHR tracing from abdominal surface electrodes that pick up the fetal ECG (fECG) and maternal ECG (mECG) signal. Using the same surface electrodes, the AN24 also acquires and displays the UA tracing from the uterine electromyography (EMG) signal. The AN24 is indicated for use on women who are at term (>36 completed weeks), in labor, with singleton pregnancies, using surface electrodes on the maternal abdomen.

    The AN24 maternal-fetal monitor is intended for use by healthcare professionals in a clinical setting.

    Device Description

    The Monica AN24™ is a small, battery-powered device for L&D surveillance of fetal well-being. The AN24™ is designed to passively monitor Fetal Heart Rate (FHR)), maternal heart rate (MHR) and Uterine Activity (UA) during pregnancy and can be used at any time from > 36 completed weeks gestation in laboring patients. The AN24™ is suitable for singleton pregnancies only.

    The Monica AN24 is a small, battery powered electrophysiological monitor (specifically fetal ECG, maternal ECG and uterine EMG). The electrical signals are passively monitored on three channels using five electrodes placed on the pregnant abdomen in specific locations. From these electrical signals the Fetal Heart Rate (FHR), maternal heart rate (MHR) and Uterine Activity (UA) are continuously extracted and displayed in the same standard format as the predicate device.

    AI/ML Overview

    Here's an analysis of the Monica AN24 device's acceptance criteria and study, based on the provided 510(k) summary:

    Monica AN24 Device Acceptance Criteria and Study Analysis

    The Monica AN24 is an intrapartum maternal-fetal monitor. This 510(k) summary focuses on demonstrating the substantial equivalence of the Monica AN24's Maternal Heart Rate (MHR) monitoring capability to a predicate SPO2 pulse oximeter (Philips M1191A). The FHR and UA monitoring capabilities had previously been cleared (K101801).


    1. Table of Acceptance Criteria and Reported Device Performance

    The study aimed to demonstrate non-inferiority of the Monica AN24's MHR monitoring compared to the predicate SPO2 pulse oximeter.

    Acceptance Criterion (Null Hypothesis of Inferiority, Alternative Hypothesis of Non-Inferiority)Reported Device Performance (Monica AN24 vs. Predicate SPO2)Outcome
    Reliability: Success Rate Ratio (Lower limit of CI > 0.8)Mean SR Ratio (AN24/SPO2): 1.16 CI: 1.08 - 1.21Met
    Accuracy: RMS Error (Upper limit of 95% CI for RMS error < 7 BPM)Combined RMS error (AN24 vs. SPO2): 4.49 BPM CI: 3.46 - 5.52 BPM Upper limit of 95% CI: 5.381 BPM (from conclusion)Met
    Correlation between AN24 and SPO2 MHR tracesMean: 0.90 CI: 0.87 - 0.93N/A (Secondary)
    95% Limits of Agreement-11.47 bpm to +11.62 bpmN/A (Descriptive)

    2. Sample Size Used for the Test Set and Data Provenance

    • Sample Size (for MHR study): 33 women (from the initial 60 enrolled women). This specific study focuses on MHR data.
    • Data Provenance: The study was conducted at two clinical sites: QHC, New York, and Temple University, Philadelphia, in the USA. The study was prospective.

    3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications

    The ground truth for the MHR study was established by a predicate SPO2 pulse oximeter (Philips M1191A) connected to a series 50 fetal monitor. The study does not mention the use of human experts to establish ground truth for MHR. Instead, it relies on the established accuracy and reliability of the predicate medical device.


    4. Adjudication Method for the Test Set

    Since the ground truth for MHR was established by a predicate medical device (SPO2 pulse oximeter) and not human experts, there was no adjudication method described or necessary in the traditional sense (e.g., 2+1, 3+1). The AN24's MHR readings were directly compared to the SPO2 readings.


    5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was Done

    No, a multi-reader multi-case (MRMC) comparative effectiveness study was not conducted for the MHR monitoring capability. The study evaluates the performance of the AN24 device itself against a predicate device, not the improvement of human readers with AI assistance.


    6. If a Standalone (Algorithm Only Without Human-in-the-Loop Performance) Was Done

    Yes, a standalone performance evaluation was conducted. The study directly compares the MHR outputs of the Monica AN24 device (algorithm only, as it's an automated measurement) against the outputs of the predicate SPO2 pulse oximeter. There is no human intervention in the MHR measurement process for either device in this comparative study.


    7. The Type of Ground Truth Used

    The ground truth for the MHR was the measurement from a predicate medical device: a SPO2 pulse oximeter (Philips M1191A) known to produce an MHR trace. Additionally, maternal heart rate was monitored by a pulse oximeter as part of the overall study design.


    8. The Sample Size for the Training Set

    The document does not specify a separate training set or its sample size. This type of submission (510(k) for a device with established underlying technology for FHR/UA and comparing a new MHR method) usually focuses on validation rather than demonstrating the development of a novel algorithm from scratch. It's possible the MHR algorithm in the AN24 was developed using internal data not disclosed in this summary, or it relies on well-established ECG signal processing techniques that don't require training in the machine learning sense. The clinical study described here is for validation/testing purposes.


    9. How the Ground Truth for the Training Set Was Established

    As no separate training set is explicitly mentioned or detailed, the method for establishing its ground truth is also not provided in this summary.

    Ask a Question

    Ask a specific question about this device

    K Number
    K112163
    Device Name
    MONICA IF24
    Manufacturer
    Date Cleared
    2011-08-30

    (34 days)

    Product Code
    Regulation Number
    884.2720
    Reference & Predicate Devices
    Predicate For
    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The Monica IF24 CTG Interface Device is an accessory to the Monica AN24 which provides a means of interfacing the wireless output of the Monica AN24 to the transducer inputs of a CTG Fetal monitor. The Monica IF24 CTG Interface Device enables signals collected by the Monica AN24 to be printed and displayed on a CTG Fetal Monitor and sent on to a central network, if connected. The device is intended for use by healthcare professionals in a clinical setting.

    Device Description

    The Monica IF24 CTG Interface Device is an interface device that allows an AN24 to send data to a standard Fetal Monitor. The Monica AN24™ is a small, battery-powered device for L&D surveillance of fetal well-being. The AN24™ is designed to passively monitor Fetal Heart Rate (FHR) from the fetal electrocardiogram (fECG) and Uterine Activity (UA) from the Electrohysterogram (EHG) during pregnancy and can be used at any time from > 36 completed weeks gestation in laboring patients. The AN24™ is suitable for singleton pregnancies only.

    The Monica IF24 CTG Interface Device is a small, low-voltage device that receives the monitored parameters from the Monica AN24 Fetal Monitor and converts the wireless digital signal to analogue for inputting into a CTG Monitor. It has a touch screen for:

    • Selection of the appropriate CTG monitor
    • Calibration with the CTG Monitor
    • Display AN24 battery power
    • Display Bluetooth connectivity between the AN24 & IF24
    AI/ML Overview

    The Monica IF24 CTG Interface Device is an accessory designed to interface the wireless output of the Monica AN24 Fetal Monitor with a standard CTG (Cardiotocography) Fetal monitor. This allows signals collected by the AN24 to be displayed, printed, and potentially sent to a central network via the CTG monitor.

    Here's an analysis of the provided text regarding acceptance criteria and the study that proves the device meets them:

    1. Table of Acceptance Criteria and Reported Device Performance:

    The document primarily focuses on non-clinical testing and substantial equivalence rather than explicit performance metrics with acceptance criteria for clinical efficacy. The acceptance criteria are broadly implied as compliance with relevant voluntary standards and accurate data reception/transmission.

    Acceptance Criteria (Implied)Reported Device Performance
    Electrical Safety (Compliance with EN60601-1)"The Monica IF24 CTG Interface Device and Accessories comply with voluntary standards. The standards were employed in the following areas: Electrical Safety." "The non clinical tests used voluntary standards to demonstrate that the Monica IF24 CTG Interface Device is as safe and effective in performance to the predicate device, the main standards employed were EN60601-1 electrical safety."
    EMC (Electromagnetic Compatibility) (Compliance with EN60601-1-2, FCC CFR47)"The Monica IF24 CTG Interface Device and Accessories comply with voluntary standards. The standards were employed in the following areas: EMC." "The non clinical tests used voluntary standards to demonstrate that the Monica IF24 CTG Interface Device is as safe and effective in performance to the predicate device, the main standards employed were EN60601-1-2 EMC, FCC CFR47 EMC."
    Material Safety/Biocompatibility (Compliance with ISO10993)"The Monica IF24 CTG Interface Device and Accessories comply with voluntary standards. The standards were employed in the following areas: Material Safety." "The non clinical tests used voluntary standards to demonstrate that the Monica IF24 CTG Interface Device is as safe and effective in performance to the predicate device, the main standards employed were ISO10993 Biocompatibility."
    Software Validation (Compliance with EN 62304)"The Monica IF24 CTG Interface Device and Accessories comply with voluntary standards. The standards were employed in the following areas: Software Validation." "The non clinical tests used voluntary standards to demonstrate that the Monica IF24 CTG Interface Device is as safe and effective in performance to the predicate device, the main standards employed were EN 62304 Software."
    Usability (Compliance with IEC 62366)"The Monica IF24 CTG Interface Device and Accessories comply with voluntary standards. The standards were employed in the following areas: Usability." "The non clinical tests used voluntary standards to demonstrate that the Monica IF24 CTG Interface Device is as safe and effective in performance to the predicate device, the main standards employed were IEC 62366 Usability."
    Quality Management System (Compliance with ISO13485)"The non clinical tests used voluntary standards to demonstrate that the Monica IF24 CTG Interface Device is as safe and effective in performance to the predicate device, the main standards employed were ISO13485 QMS."
    Accurate data reception and transmission"The Monica IF24 CTG Interface Device accurately receives and transmits the correct data." (Demonstrated through "software validation and performance bench testing").
    Substantial Equivalence to predicate devices"The conclusions drawn from the nonclinical tests, performance tests and the validation demonstrate that the Monica IF24 CTG Interface Device is substantially equivalent to the legally marketed predicate device."

    2. Sample Size Used for the Test Set and Data Provenance:

    The document does not explicitly state a "test set" in the context of clinical data for the IF24 device. The regulatory submission is primarily based on non-clinical tests (electrical safety, EMC, material safety, software validation, usability, and performance bench testing) to demonstrate substantial equivalence to predicate devices (Monica AN24, Philips Avalon CTS).

    • Sample Size for Test Set: Not applicable or not specified in terms of patient data. The testing involves engineering and software validation tests.
    • Data Provenance: Not applicable in terms of patient data. The testing is described as non-clinical and performance bench testing, likely conducted in a laboratory or engineering environment. The manufacturer is Monica Healthcare Ltd, based in Nottingham, UK.

    3. Number of Experts Used to Establish Ground Truth for the Test Set and Qualifications of Those Experts:

    This information is not provided in the document. Given the non-clinical nature of the testing described, it's unlikely that "experts" (e.g., radiologists) in the typical sense for medical image interpretation were used for establishing ground truth for a clinical test set. The experts involved would likely be engineers, software testers, and regulatory compliance specialists responsible for executing and evaluating the non-clinical tests.

    4. Adjudication Method for the Test Set:

    Not applicable. There is no mention of an adjudication method for a clinical test set because the provided information focuses on non-clinical and bench testing.

    5. If a Multi Reader Multi Case (MRMC) Comparative Effectiveness Study was done:

    No, an MRMC comparative effectiveness study is not mentioned in the provided text. The submission focuses on demonstrating substantial equivalence through non-clinical testing of the interface device itself, not on comparing human reader performance with or without AI assistance.

    6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) was done:

    The concept of "standalone performance" as typically applied to an AI algorithm making a diagnosis or performing a task without human intervention doesn't directly apply here. The Monica IF24 is an interface device; its "performance" is in accurately receiving and transmitting data, not in making clinical interpretations. The "algorithm" in this context refers to the software controlling the device's functionality (e.g., conversion of wireless digital signal to analog), which was validated through "software validation and performance bench testing" to ensure accurate data handling.

    7. The Type of Ground Truth Used (expert consensus, pathology, outcomes data, etc.):

    For the non-clinical tests, the "ground truth" would be established by:

    • Compliance with published standards: For electrical safety, EMC, material safety, software, usability, and QMS, the ground truth is simply adherence to the requirements outlined in the specified standards (e.g., EN60601-1, IEC 62366).
    • Expected data values/behavior: For "accurate data reception and transmission," the ground truth would be the known input data values from the AN24 and the expected output values and waveform fidelity on the CTG monitor, verified through performance bench testing.

    8. The Sample Size for the Training Set:

    Not applicable. The Monica IF24 is an interface device, not an AI model that requires a training set in the conventional sense of machine learning for classification or prediction tasks. The software involved handles data conversion and communication, which is validated, not "trained."

    9. How the Ground Truth for the Training Set was Established:

    Not applicable, as there is no mention of a training set for an AI model.

    Ask a Question

    Ask a specific question about this device

    K Number
    K101801
    Device Name
    MONICA AN24
    Manufacturer
    Date Cleared
    2011-02-03

    (220 days)

    Product Code
    Regulation Number
    884.2720
    Reference & Predicate Devices
    N/A
    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The Monica AN24 is an intrapartum maternal-fetal monitor that non-invasively measures and displays fetal heart rate (FHR) and uterine activity (UA). The AN24 acquires and displays the FHR tracing from abdominal surface electrodes that pick up the fetal ECG (fECG) signal. Using the same surface electrodes, the AN24 also acquires and displays the UA tracing from the uterine electromyography (EMG) signal. The AN24 is indicated for use on women who are at term (>36 completed weeks), in labor, with singleton pregnancies, using surface electrodes on the maternal abdomen.

    The AN24 maternal-fetal monitor is intended for use by healthcare professionals in a clinical setting.

    Device Description

    The Monica AN24™ is a small, battery-powered device for L&D surveillance of fetal well-being. The AN24™ is designed to passively monitor Fetal Heart Rate (FHR) from the fetal electrocardiogram (fECG) and Uterine Activity (UA) from the Electrohysterogram (EHG) during pregnancy and can be used at any time from > 36 completed weeks gestation in laboring patients. The AN24™ is suitable for singleton pregnancies only.

    The Monica AN24 is a small, battery powered electrophysiological monitor (specifically fetal ECG and uterine EMG). The electrical signals are passively monitored on three channels using five electrodes placed on the pregnant abdomen in specific locations. From these electrical signals the Fetal Heart Rate (FHR) and Uterine Activity (UA) are continuously extracted and displayed in the same standard format as the predicate device.

    AI/ML Overview

    Here's a breakdown of the acceptance criteria and the study details for the Monica AN24 device, based on the provided text:

    1. Table of Acceptance Criteria and Reported Device Performance

    The acceptance criteria are not explicitly stated as distinct thresholds in the document, but rather implied by the non-inferiority comparison to the predicate device and the reported outcomes from the clinical study. The study aimed to demonstrate that the Monica AN24 is at least as accurate and reliable as the predicate device. Therefore, the "acceptance criteria" can be inferred as performance greater than or equal to the predicate device for each metric.

    MetricImplied Acceptance Criteria (relative to Predicate)Reported Monica AN24 PerformanceReported Predicate Performance (Philips 50XM)
    Fetal Heart Rate (FHR) Interpretability (PPA)≥ 72%85%72%
    FHR Accuracy (RMS Error)≤ 12 bpm5 bpm12 bpm
    Uterine Activity (UA) Interpretability (PPA)≥ 67%97%67%
    UA Sensitivity Accuracy (Sensitivity for Contractions)≥ 55%89%55%
    UA Timing Accuracy (Mean Timing Difference for Contractions)≤ 3.3 seconds lag2.5 seconds lag3.3 seconds lag

    2. Sample Sizes and Data Provenance

    • Test Set (Clinical Study):
      • Total Subjects Enrolled: 60 women.
      • Evaluable Data Subjects: 34 subjects.
      • FHR Study Subjects: 33 women.
      • UA Study Subjects: 30 women.
      • Data Provenance: The study was conducted at two clinical sites: QHC, New York, and Temple University, Philadelphia. This indicates prospective data collection in the USA.
      • Training Set Sample Size: Not explicitly stated. The document describes a "clinical equivalence trial" and a "subsequent Multi-Reader-Multi-Case (MRMC) study," which are generally used for validation/testing.

    3. Number of Experts and Qualifications for Ground Truth (Test Set)

    • Number of Experts: Four.
    • Qualifications of Experts: Board Certified Obstetricians. (Specific years of experience are not mentioned).

    4. Adjudication Method (Test Set)

    • Uterine Activity (UA): The uterine activity data was "independently reviewed in a Multi-Reader Study by four Board Certified Obstetricians who independently indicated on randomized trace segments." The results were "averaged" to establish the ground truth for UA. This aligns with a form of consensus-based adjudication, likely an average or 4/4 agreement model, though the exact decision rule isn't specified beyond "average of 4 board certified obstetricians."
    • Fetal Heart Rate (FHR): The ground truth for FHR was established directly by the "Direct fetal Scalp ECG (second Phillips Series 50XM device)," which served as the gold standard. No expert adjudication was mentioned for FHR.

    5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

    • Was an MRMC study done? Yes, a "Multi-Reader-Multi-Case (MRMC) study" was integral to the evaluation of Uterine Activity (UA).
    • Effect Size of Human Readers' Improvement with AI vs. without AI assistance: The document focuses on the performance of the device itself (Monica AN24 or predicate) compared to the gold standard, with human readers involved in establishing the ground truth for UA and in reviewing "False Positives." It does not describe a comparative effectiveness study where human readers interpret tracings with and without AI assistance to measure reader improvement. The MRMC study in this context refers to multiple readers evaluating the output of different devices (Monica AN24, TOCO, IUPC) to derive ground truth and compare device performance.

    6. Standalone (Algorithm Only) Performance Study

    • Yes, the study primarily assessed the standalone performance of the Monica AN24 device (algorithm only), comparing its output directly against established gold standards (fetal scalp ECG for FHR, IUPC for UA). The metrics (PPA, RMS error, sensitivity, timing accuracy) are all measures of the device's inherent performance.

    7. Type of Ground Truth Used

    • Fetal Heart Rate (FHR): Direct fetal Scalp ECG (from a second Philips Series 50XM device). This is a direct physiological measurement considered the gold standard.
    • Uterine Activity (UA): Intrauterine Pressure Catheter (IUPC) (from a Philips Series 50XM device), with expert consensus from four Board Certified Obstetricians used to interpret the tracings and mark contractions. This is a combination of direct physiological measurement and expert consensus/adjudication.

    8. Sample Size for the Training Set

    • The document does not explicitly state the sample size used for training the Monica AN24 device's algorithms. The described study is a clinical equivalence trial used for validation of the device's performance against a gold standard and a predicate, not for training.

    9. How Ground Truth for the Training Set was Established

    • The document does not provide information on how ground truth was established for the training set, as the focus is on the clinical validation study for regulatory submission.
    Ask a Question

    Ask a specific question about this device

    Page 1 of 1