K Number
K191301
Manufacturer
Date Cleared
2019-09-11

(120 days)

Product Code
Regulation Number
882.1400
Reference & Predicate Devices
AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
Intended Use

The Ceribell Pocket EEG Device is intended to record and to present the EEG signals in visual and audible formats in real time. The visual and audible signals assist trained medical staff to make neurological diagnoses. The Pocket EEG Device is intended to be used in a professional healthcare facility environment.

Additionally, the EEG Recording Viewer Software component of the Pocket EEG Device incorporates a Seizure Detection component that is intended to mark previously acquired sections of EEG recordings in patients greater than or equal to 18 years of age that may correspond to electrographic seizures in order to assist qualified clinical practitioners in the assessment of EEG traces. The Seizure Detection component provides notifications to the user when detected seizure prevalence is "Frequent," "Abundant," or "Continuous," per the definitions of the American Clinical Neurophysiology Society Guideline 14. Notifications include an on-screen display on the Pocket EEG Device and the optional sending of an e-mail message to a clinician. Delays of up to several minutes can occur between the beginning of a seizure and when the Seizure Detection notifications will be shown to a user.

The Pocket EEG Device does not provide any diagnostic conclusion about the subject's condition and Seizure Detection notifications cannot be used as a substitute for real time monitoring of the underlying EEG by a trained expert.

Device Description

The Ceribell Pocket EEG Device is a previously cleared EEG monitoring system which includes a portable 8-channel system that is being upgraded in this 510(k) notification K191301 to include a seizure detection module. The device connects to 10 patient electrodes (5 left, 5 right), which are used to form the 8 channels. The device may be used with any scalp EEG electrodes, and the system includes the following components:

  • Pocket EEG Device: a portable, battery powered, 8-channel EEG monitoring system.
  • Power adapter: 100-240 V AC power adapter used to charge the Pocket EEG Device.
  • Micro-USB cable: cable used to connect Pocket EEG Device to power adapter for charging and to connect to a computer to transfer EEG recording files. When the Pocket EEG Device is connected to a power adapter of a computer, all EEG acquisition functions are automatically disabled.
  • EEG Recording Viewer Software: EEG review software for viewing EEG recordings on a computer. The EEG Recording Viewer Software includes a Seizure Detection software module that assists qualified users in reviewing and annotating EEG by marking previously acquired sections of EEG that may correspond to electrographic seizures.
AI/ML Overview

Here's a breakdown of the acceptance criteria and the study proving the device meets them, based on the provided text:

1. Table of Acceptance Criteria and Reported Device Performance

Test DescriptionAcceptance CriteriaReported Device Performance (PPA, 95% CI Lower Bound)Conformance to PPA Acceptance CriteriaReported Device Performance (FP/hr, 95% CI Upper Bound)Conformance to FP/hr Acceptance Criteria
"Frequent" seizure activity notifications (≥10% seizure burden), PPA and FP/hrCeribell non-inferior to Persyst 13 with 10% non-inferiority marginNot directly reported in tableN/A (non-inferiority not in table)Not directly reported in tableN/A (non-inferiority not in table)
"Frequent" seizure activity notifications (≥10% seizure burden), PPA and FP/hrPPA: 95% CI lower bound ≥ 70%90.00%PASS0.351PASS
"Abundant" seizure activity notifications (≥50% seizure burden), PPA and FP/hrFP/hr: 95% CI upper bound ≤ 0.446
"Abundant" seizure activity notifications (≥50% seizure burden), PPA and FP/hrPPA: 95% CI lower bound ≥ 70%81.39%PASS0.381PASS
"Continuous" seizure activity notifications (≥90% seizure burden), PPA and FP/hrFP/hr: 95% CI upper bound ≤ 0.446
"Continuous" seizure activity notifications (≥90% seizure burden), PPA and FP/hrPPA: 95% CI lower bound ≥ 70%78.26%PASS0.272PASS
FP/hr: 95% CI upper bound ≤ 0.446
Seizure Burden output, L1-distance vs. reference standardCeribell non-inferior to Persyst 13 with 10% non-inferiority marginNot directly reported in tableN/ANot directly reported in tableN/A

2. Sample Size Used for the Test Set and Data Provenance

  • Sample Size: 60 subjects (30 from ICU dataset and 30 from EMU dataset).
  • Data Provenance: Retrospective. Data was obtained from previous studies that retrospectively reviewed all adult EEGs from patients who underwent inpatient EEG monitoring over a period of time. Data from one hospital was used for ICU EEG data, and data from a second hospital was used for EMU EEG data. The study states the validation dataset was "from previous studies" and "retrospectively obtained from pre-existing EEG databases." The specific country of origin is not explicitly stated, but the submission is to the U.S. FDA, implying the data is likely from the U.S.

3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications

  • Number of Experts: An "expert panel" was used, with an agreement between "at least two neurologists required." The exact number of individual experts beyond "at least two" is not specified.
  • Qualifications of Experts: EEG trained neurologists (physicians who have obtained fellowship training in epilepsy or neurophysiology). They were affiliated with "multiple different institutions."

4. Adjudication Method for the Test Set

  • The ground truth was established by an "expert panel, with agreement between at least two neurologists required to determine the reference standard." This indicates an adjudication method where agreement between at least two experts was necessary. It suggests a form of consensus-based ground truth.

5. Was a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Done? If so, what was the effect size of how much human readers improve with AI vs without AI assistance?

  • No, a multi-reader, multi-case (MRMC) comparative effectiveness study with human readers assisting the AI or vice-versa was not explicitly described in this document. The study compared the Ceribell device's performance to a predicate device (Persyst 13) and a consensus-based ground truth established by experts. The device's role is to "assist qualified clinical practitioners" but the study format does not evaluate the improvement of human readers with AI assistance.

6. If a Standalone (i.e. algorithm only without human-in-the loop performance) was done?

  • Yes, a standalone performance evaluation of the Ceribell Seizure Detection module was done. The module was run on the validation dataset and its performance metrics (PPA and FP/hr) were calculated against the established reference standard. While the device's intended use is to "assist trained medical staff," the validation primarily assessed the algorithm's ability to detect seizures independently.

7. The Type of Ground Truth Used

  • The ground truth used was expert consensus. It was established by "EEG trained neurologists who reviewed and annotated the EEG recordings for seizure episodes." Specifically, "Each seizure episode was manually annotated by an expert panel, with agreement between at least two neurologists required to determine the reference standard."

8. The Sample Size for the Training Set

  • The sample size for the training set is not specified in the provided document. The document explicitly states that the validation dataset was "completely separate and independent from the data used to design and train the algorithm," and "No patients from the validation dataset were used for algorithm training or development," but it does not provide details on the training data itself.

9. How the Ground Truth for the Training Set Was Established

  • The document does not provide details on how the ground truth for the training set was established. It only emphasizes that the validation dataset was separate from the training data.

{0}------------------------------------------------

Image /page/0/Picture/0 description: The image shows the logo of the U.S. Food and Drug Administration (FDA). The logo consists of two parts: a symbol on the left and the text "FDA U.S. FOOD & DRUG ADMINISTRATION" on the right. The symbol on the left is a stylized image of a human figure, and the text on the right is in blue. The text is arranged in three lines, with "FDA" on the first line, "U.S. FOOD & DRUG" on the second line, and "ADMINISTRATION" on the third line.

Ceribell, Inc. Josef Parvizi Chairman 2483 Old Middlefield Way, Suite 120 Mountain View, California 94043

Re: K191301

Trade/Device Name: Ceribell Pocket EEG Device Regulation Number: 21 CFR 882.1400 Regulation Name: Electroencephalograph Regulatory Class: Class II Product Code: OMB, OMC, GWQ Dated: May 13, 2019 Received: May 14, 2019

Dear Josef Parvizi:

We have reviewed your Section 510(k) premarket notification of intent to market the device referenced above and have determined the device is substantially equivalent (for the indications for use stated in the enclosure) to legally marketed predicate devices marketed in interstate commerce prior to May 28, 1976, the enactment date of the Medical Device Amendments, or to devices that have been reclassified in accordance with the provisions of the Federal Food, Drug, and Cosmetic Act (Act) that do not require approval of a premarket approval application (PMA). You may, therefore, market the device, subject to the general controls provisions of the Act. Although this letter refers to your product as a device, please be aware that some cleared products may instead be combination products. The 510(k) Premarket Notification Database located at https://www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfpmn/pmn.cfm identifies combination product submissions. The general controls provisions of the Act include requirements for annual registration, listing of devices, good manufacturing practice, labeling, and prohibitions against misbranding and adulteration. Please note: CDRH does not evaluate information related to contract liability warranties. We remind you, however, that device labeling must be truthful and not misleading.

If your device is classified (see above) into either class II (Special Controls) or class III (PMA), it may be subject to additional controls. Existing major regulations affecting your device can be found in the Code of Federal Regulations, Title 21, Parts 800 to 898. In addition, FDA may publish further announcements concerning your device in the Federal Register.

Please be advised that FDA's issuance of a substantial equivalence determination does not mean that FDA has made a determination that your device complies with other requirements of the Act or any Federal statutes and regulations administered by other Federal agencies. You must comply with all the Act's requirements, including, but not limited to: registration and listing (21 CFR Part 807); labeling (21 CFR Part

{1}------------------------------------------------

801); medical device reporting of medical device-related adverse events) (21 CFR 803) for devices or postmarketing safety reporting (21 CFR 4, Subpart B) for combination products (see https://www.fda.gov/combination-products/guidance-regulatory-information/postmarketing-safety-reportingcombination-products); good manufacturing practice requirements as set forth in the quality systems (QS) regulation (21 CFR Part 820) for devices or current good manufacturing practices (21 CFR 4. Subpart A) for combination products; and, if applicable, the electronic product radiation control provisions (Sections 531-542 of the Act); 21 CFR 1000-1050.

Also, please note the regulation entitled, "Misbranding by reference to premarket notification" (21 CFR Part 807.97). For questions regarding the reporting of adverse events under the MDR regulation (21 CFR Part 803), please go to https://www.fda.gov/medical-device-safety/medical-device-reportingmdr-how-report-medical-device-problems.

For comprehensive regulatory information about medical devices and radiation-emitting products, including information about labeling regulations, please see Device Advice (https://www.fda.gov/medicaldevices/device-advice-comprehensive-regulatory-assistance) and CDRH Learn (https://www.fda.gov/training-and-continuing-education/cdrh-learn). Additionally, you may contact the Division of Industry and Consumer Education (DICE) to ask a question about a specific regulatory topic. See the DICE website (https://www.fda.gov/medical-device-advice-comprehensive-regulatoryassistance/contact-us-division-industry-and-consumer-education-dice) for more information or contact DICE by email (DICE@fda.hhs.gov) or phone (1-800-638-2041 or 301-796-7100).

Sincerely,

Jay Gupta Assistant Director DHT5A: Division of Neurosurgical, Neurointerventional and Neurodiagnostic Devices OHT5: Office of Neurological and Physical Medicine Devices Office of Product Evaluation and Quality Center for Devices and Radiological Health

Enclosure

{2}------------------------------------------------

Indications for Use

510(k) Number (if known) K191301

Device Name Ceribell Pocket EEG Device

Indications for Use (Describe)

The Ceribell Pocket EEG Device is intended to record and to present the EEG signals in visual and audible formats in real time. The visual and audible signals assist trained medical staff to make neurological diagnoses. The Pocket EEG Device is intended to be used in a professional healthcare facility environment.

Additionally, the EEG Recording Viewer Software component of the Pocket EEG Device incorporates a Seizure Detection component that is intended to mark previously acquired sections of EEG recordings in patients greater than or equal to 18 years of age that may correspond to electrographic seizures in order to assist qualified clinical practitioners in the assessment of EEG traces. The Seizure Detection component provides notifications to the user when detected seizure prevalence is "Frequent," "Abundant," or "Continuous," per the definitions of the American Clinical Neurophysiology Society Guideline 14. Notifications include an on-screen display on the Pocket EEG Device and the optional sending of an e-mail message to a clinician. Delays of up to several minutes can occur between the beginning of a seizure and when the Seizure Detection notifications will be shown to a user.

The Pocket EEG Device does not provide any diagnostic conclusion about the subject's condition and Seizure Detection notifications cannot be used as a substitute for real time monitoring of the underlying EEG by a trained expert.

Type of Use (Select one or both, as applicable)
Prescription Use (Part 21 CFR 801 Subpart D) Over-The-Counter Use (21 CFR 801 Subpart C)

CONTINUE ON A SEPARATE PAGE IF NEEDED.This section applies only to requirements of the Paperwork Reduction Act of 1995.

DO NOT SEND YOUR COMPLETED FORM TO THE PRA STAFF EMAIL ADDRESS BELOW.

The burden time for this collection of information is estimated to average 79 hours per response, including the time to review instructions, search existing data sources, gather and maintain the data needed and complete and review the collection of information. Send comments regarding this burden estimate or any other aspect of this information collection, including suggestions for reducing this burden, to:

Department of Health and Human Services Food and Drug Administration Office of Chief Information Officer Paperwork Reduction Act (PRA) Staff PRAStaff@fda.hhs.gov

"An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB number."

{3}------------------------------------------------

K191301 510(k) Summary

This 510(k) summary was prepared on 9/11/2019 to provide an understanding of the basis for a determination of substantial equivalence in accordance with the requirements outlined in 21 CFR 807.92.

Submitter Information

Ceribell, Inc. 2483 Old Middlefield Way Suite 120 Mountain View, California 94043 1(800)436-0826

Contact Person

Dr. Josef Parvizi, MD, PhD Chairman Telephone: (650) 521-7003 E-mail: josef@ceribell.com

Subject Device Information

Trade Name:Ceribell Pocket EEG Device
Classification Name:Electroencephalograph
Regular Description:EEG or Electroencephalograph
Device Class:Class II; 882.1400
Product Code:OMB
OMB Device:Automatic Event Detection Software for Full-Montage Electroencephalograph
Additional Pro Codes:OMC, GWQ (full-montage standard electroencephalograph)

Predicate Device

Primary Predicate:K170363Ceribell Pocket EEG Device882.1400, OMC (reduced- montage standard electroencephalograph), GWQ
Secondary PredicateK151929Persyst 13 (P13)882.1400, OMB, OLT (non-normalizing quantitative electroencephalographsoftware)

Device Description

The Ceribell Pocket EEG Device is a previously cleared EEG monitoring system which includes a portable 8-channel system that is being upgraded in this 510(k) notification K191301 to include a seizure detection module. The device connects to 10 patient electrodes (5 left, 5 right), which are used to form the 8 channels. The device may be used with any scalp EEG electrodes, and the system includes the following components:

  • Pocket EEG Device: a portable, battery powered, 8-channel EEG monitoring system.
  • Power adapter: 100-240 V AC power adapter used to charge the Pocket EEG Device. ●
  • . Micro-USB cable: cable used to connect Pocket EEG Device to power adapter for charging and to connect to a computer to transfer EEG recording files. When the Pocket EEG Device is connected to a power adapter of a computer, all EEG acquisition functions are automatically

{4}------------------------------------------------

disabled.

  • EEG Recording Viewer Software: EEG review software for viewing EEG recordings on a ● computer. The EEG Recording Viewer Software includes a Seizure Detection software module that assists qualified users in reviewing and annotating EEG by marking previously acquired sections of EEG that may correspond to electrographic seizures.

Intended Use

The Ceribell Pocket EEG Device is a portable EEG monitoring system that records, stores and presents EEG signals in visual and audible formats in real time. The visual and audible signals assist trained medical staff to make neurological diagnoses. The Pocket EEG Recording Viewer software incorporates a Seizure Detection component that is intended to mark previously acquired sections of EEG recordings in patients greater than or equal to 18 years of age that may correspond to electrographic seizures in order to assist qualified clinical practitioners in the assessment of EEG traces. The device does not provide any diagnostic conclusion about the subject's condition and Seizure Detection notifications cannot be used as a substitute for real time monitoring of the underlying EEG by a trained expert.

Table 1: Comparison of Indications for Use
Subject Device K191301 (Rx only)Predicate K170363 (Rx only)Predicate K151929 (Rx only)
The Ceribell Pocket EEG Device isintended to record and store EEGsignals, and to present the EEG signals invisual and audible formats in real time.The visual and audible signals assisttrained medical staff to makeneurological diagnoses. The Pocket EEGDevice is intended to be used in aprofessional healthcare facilityenvironment.Additionally, the EEG Recording ViewerSoftware component of the Pocket EEGDevice incorporates a Seizure Detectioncomponent that is intended to markpreviously acquired sections of EEGrecordings in patients greater than orequal to 18 years of age that maycorrespond to electrographic seizures inorder to assist qualified clinicalpractitioners in the assessment of EEGtraces. The Seizure Detection componentprovides notifications to the user whendetected seizure prevalence is"Frequent," "Abundant," or"Continuous," per the definitions of theAmerican Clinical NeurophysiologySociety Guideline 14. Notificationsinclude an on-screen display on thePocket EEG Device and the optionalsending of an e-mail message to aclinician. Delays of up to several minutescan occur between the beginning of aseizure and when the Seizure Detectionnotifications will be shown to a user.The Ceribell Pocket EEG Device isintended to record and store EEGsignals, and to present the EEGsignals in visual and audibleformats in real time. The visual andaudible signals assist trainedmedical staff to make neurologicaldiagnoses. The Pocket EEG Devicedoes not provide any diagnosticconclusion about the subject'scondition and does not provide anyautomated alerts of an adverseclinical event. The Pocket EEGDevice is intended to be used in aprofessional healthcare facilityenvironment.1. Persyst 13 EEG Review and AnalysisSoftware is intended for the review,monitoring and analysis of EEGrecordings made byelectroencephalogram (EEG) devicesusing scalp electrodes and to aidneurologists in the assessment of EEG.This device is intended to be used byqualified medical practitioners who willexercise professional judgment in usingthe information.2. The Seizure Detection component ofPersyst 13 is intended to mark previouslyacquired sections of adult (greater than orequal to 18 years) EEG recordings thatmay correspond to electrographic seizures,in order to assist qualified clinicalpractitioners in the assessment of EEGtraces. EEG recordings should be obtainedwith a full scalp montage according to thestandard 10/20 system.3. The Spike Detection component of Persyst13 is intended to mark previously acquiredsections of the patient's EEG recordingsthat may correspond to spikes, in order toassist qualified clinical practitioners in theassessment of EEG traces. The SpikeDetection component is intended to beused in patients at least one month old.Persyst 13 Spike Detection performancehas not been assessed for intracranialrecordings.4. Persyst 13 includes the calculation anddisplay of a set of quantitative measuresintended to monitor and analyze the EEGwaveform. These include FFT.

{5}------------------------------------------------

Comparison of Intended Use and Technological Characteristics with Predicates K170363 & K151929

The subject device and predicate K170363 Ceribell Pocket EEG Device share intended use as a portable EEG monitoring system that records, stores, and presents EEG signals in visual and audible formats. The recorded EEG signals assist trained medical staff to make neurological diagnoses. The subject device and K170363 are identical with exception of the modification to introduce the EEG Recording Viewer Software to K170363 in order to include an additional Seizure Detection software module.

The subject device and K151929 Persyst 13 (P13) share the same intended use for analyzing EEG files to identify possible seizure episodes and then mark previously acquired sections of adult EEG. The subject

{6}------------------------------------------------

device and K151929 differ only by the number of patient electrodes used for seizure detection, the manner of the presentation of seizure detection output, and the types of seizure detection notifications provided.

Non-clinical Performance Data

The following non-clinical performance data were submitted to support a determination of substantial equivalence:

  • IEC 60601-1:2005+A1:2012, edition 3.1, Medical electrical equipment Part 1: 1. General requirements for basic safety and essential performance. This test report also includes national differences testing to the FDA recognized consensus standard, ANSI/AAMI ES60601- 1:2005+A1:2012, C1:2009, A2:2010.
    1. IEC 60601-2-26:2012, edition 1.0, Medical electrical equipment - Part 2-26: Requirements for the basic safety and essential performance of electroencephalographs.
  • IEC 60601-1-6:2010+A1:2013, edition 3.1, Medical electrical equipment Part 1-6: 3. General requirements for basic safety and essential performance - Collateral standard: Usability.
    1. IEC 62366:2007, edition 1.0, Medical devices - Application of usability engineering to medical devices.
    1. IEC 62133:2012, edition 2.0, Secondary cells and batteries containing alkaline or other nonacid electrolytes - Safety requirements for portable sealed secondary sells, and for batteries made from them, for use in portable applications.
  • IEC 60601-1-2:2007, edition 3.0: Medical electrical equipment Part 1-2: General 6. requirements for basic safety and essential performance - Collateral standard: Electromagnetic compatibility. The table below compares the Wi-Fi modules between K170363 and K191301. The subject device Wi-Fi communications module has been upgraded to a more recent version within the same family; the new Wi-Fi module is the ST Microelectronics model SPWF04SA, the previous module in the predicate device was the ST Microelectronics model SPWF01SA. There are no other hardware differences between the subject device and the predicate Pocket EEG Device of K170363.

{7}------------------------------------------------

Table 2: Specifications of Previous and Updated Wi-Fi Modules
Predicate Device (K170363) ModuleST Microelectronics SPWF01SASubject Device (K191301) ModuleST Microelectronics SPWF04SA
WiFi frequency/standard2.4 GHz IEEE 802.11 b/g/n2.4 GHz IEEE 802.11 b/g/n
Transmit power18.3 dBm @ 1 Mbps DSSS13.7 dBm @ 54 Mbps OFDM18.3 dBm @ 1 Mbps DSSS13.7 dBm @ 54 Mbps OFDM
Receive sensitivity-96.0 dBm @ 1 Mbps DSSS-74.5 dBm @ 54 Mbps OFDM-96.0 dBm @ 1 Mbps DSSS-74.5 dBm @ 54 Mbps OFDM
Antenna typeIntegratedIntegrated
Form factor/dimensionsSurface mount PCB module26.92 x 15.24 x 2.35 mmSurface mount PCB module26.92 x 15.24 x 2.35 mm
Integrated processor andmemorySTM32 ARM Cortex-M3 processorwith 64 kB RAMSTM32 ARM Cortex-M4 processorwith 256 KB RAM
FCC approvalFull modular approvalFCC ID: VRA-SG9011203Full modular approvalFCC ID: S9NSPWFS04

Clinical Performance Data

The following clinical performance data were submitted to support a determination of substantial equivalence:

Demographics

The demographics of Ceribell's seizure detection validation dataset are as follows:

Table 3: Seizure Detection Validation Dataset Demographics
Total subjects60
GenderMale: 29 (48.3%)Female: 31 (51.7%)
AgeAverage: 56.5Minimum: 22Maximum: 88

Patient Baseline Characteristics

The validation dataset had no inclusion/exclusion criteria related to patient baseline characteristics. In general, ICU patients who receive EEG monitoring present with one or more neurological diagnoses that are potentially indicate an increased risk of seizures. EMU patients typically have a prior history of seizures that warrants EEG monitoring.

Enrollment

The validation dataset was obtained from previous studies that retrospectively reviewed all adult EEGs from patients who underwent inpatient EEG monitoring over a period of time. Data from one hospital was used for ICU EEG data, and data from a second hospital was used for EMU EEG data. From the ICU and EMU source datasets, a total of 60 subjects aged 18 or older were randomly selected for inclusion in the Ceribell seizure detection validation study; 30 from the ICU dataset and 30 from the EMU dataset.

Masking

All of the EEG data used for Ceribell's seizure detection vas retrospectively obtained from pre-existing EEG databases. The EEG trained neurologists who reviewed the data to provide the clinical reference were masked. The EEGs used for the validation protocol were selected with

{8}------------------------------------------------

no knowledge of how the Ceribell or Persyst 13 seizure detection would perform. No patients from the validation dataset were used for algorithm training or development.

General Summary

The following is a summary of the validation procedure performed:

  • A validation dataset of full montage EEG recordings obtained from adult (18 years and older) . patients were chosen for validation testing. This dataset was completely separate and independent from the data used to design and train the algorithm.
  • A reference standard was established for the validation dataset by EEG trained neurologists ● who reviewed and annotated the EEG recordings for seizure episodes.
  • . Both Ceribell Pocket EEG Device and predicate Persyst 13 (K151929) Seizure Detection modules were run on the validation dataset and performance metrics were calculated for each as compared to the reference standard established per above.
  • Statistical analysis was performed on the results to evaluate and compare the performance to the ● predetermined acceptance criteria.

Selection of Validation Sets

The validation was performed as a retrospective analysis of EEG data gathered from patients in the Intensive Care Unit (ICU) and Epilepsy Monitoring Unit (EMU). These two locations are representative of EEGs taken throughout the hospital environment and thus reflect the intended use of the subject device.

For the validation data set, 50% of the data was from the ICU and 50% was from the EMU. The reference standard for the validation data set was obtained by having trained experts review and annotate the EEG files for onset and conclusion of seizure episodes.

The expert EEG reviewers used to generate the reference standard were affiliated with multiple different institutions. All were fellowship trained in epilepsy or clinical neurophysiology. To validate seizure detection notifications, positive percent agreement (PPA) and false positives/ hour (FP/hr) were calculated for the Ceribell Seizure Detection module and Persyst 13 with respect to the reference standard.

The three levels of seizure detection notification for Ceribell ("Frequent," "Abundant," and "Continuous") are additive – the "Frequent" notification must always occur first before the "Abundant" or "Continuous" notification. Therefore, it is most relevant to compare the Ceribell "Frequent" notification output to the Persyst 13 seizure notification output. The Ceribell "Frequent" notification output represents the detection of 30 seconds or more of seizure activity within a 5-minute moving window. The Persyst 13 seizure notification output represents the detection of 11 seconds or more of continuous seizure activity. There is no clinically relevant distinction between these two types of notifications. The validation protocol requires that the PPA and FP/hr for the Ceribell "Frequent" notification output must be statistically non-inferior to the Persyst 13 seizure detection notification output. Additionally, to assess device effectiveness and clinical utility, performance of all Ceribell's notification levels, "Frequent," "Abundant," and "Continuous," with respect to the reference standard are calculated and presented with the results along with their 95% confidence intervals. The criteria for minimally acceptable device performance was to have a positive percent agreement with a 95% CI lower bound above 70% and a false positive rate with a 95% CI upper bound below 0.446 per hour.

Page 6 of 9

{9}------------------------------------------------

Validation was based upon demonstrating that Ceribell was non-inferior to Persyst 13 with a 10% noninferiority Margin.

Results of Clinical Performance Testing

Table 4: Contingency Table of Ceribell Device Output For "Abundant" Notification With Respect To Clinical Reference ForThe Validation Dataset
Clinical Reference(Review and Annotation of validation datasets by EEG-trained neurologists)
No seizure or SeizureDuration < 150 seconds150 seconds ≤Seizure Duration270 secondsSeizure Duration≥ 270 secondsTotal
CeribellDeviceOutputBelow 50%Threshold (no"Abundant"notificationprovided)NA213
Above 50%Threshold("Abundant"notificationprovided)FP/hr = 0.1996182240
TotalNA202343
SensitivityNA90.0%95.6%93.02%
Table 5: Contingency Table of Ceribell Device Output For "Continuous" Notification With Respect To Clinical Reference ForThe Validation Dataset
CeribellDeviceOutputClinical Reference(Review and Annotation of validation datasets by EEG-trained neurologists)
No seizure or SeizureDuration < 270 secondsSeizure Duration ≥ 270secondsTotal
Below 90%Threshold (no"Continuous"notificationprovided)NA22
Above 90%Threshold("Continuous"notificationprovided)FP/hr = 0.12472121
TotalNA2323
SensitivityNA91.3%91.3%

{10}------------------------------------------------

Reference Standards

For both the ICU and EMU datasets:

The neurologist reviews are completed prior to the start of any validation testing, and the same reference standard is used to test the performance of both the Ceribell seizure detection feature and the Persyst 13 seizure detection. Therefore, it is not possible for a neurologist to bias his or her review in a way that affects the outcome of the validation testing. EEG trained neurologists (physicians who have obtained fellowship training in epilepsy or neurophysiology) reviewed and annotated the EEG recordings for seizure episodes. Each seizure episode was manually annotated by an expert panel, with agreement between at least two neurologists required to determine the reference standard.

Pass Fail Criteria

The seizure detection notification tests performed and their acceptance criteria are summarized below in Table 6. The seizure burden output validation tests performed and their acceptance criteria are summarized below in Table 7.

Table 6: Summary of Validation Testing for Seizure Notifications
Test DescriptionAcceptance Criteria
"Frequent" seizure activity notifications(≥10% seizure burden), PPA and FP/hrCeribell non-inferior to Persyst 13 with10% non-inferiority margin
"Frequent" seizure activity notifications(≥10% seizure burden), PPA and FP/hrPPA: 95% CI lower bound ≥ 70%FP/hr: 95% CI upper bound ≤ 0.446
"Abundant" seizure activity notifications(≥50% seizure burden), PPA and FP/hrPPA: 95% CI lower bound ≥ 70%FP/hr: 95% CI upper bound ≤ 0.446
"Continuous" seizure activity notifications(≥90% seizure burden), PPA and FP/hrPPA: 95% CI lower bound ≥ 70%FP/hr: 95% CI upper bound ≤ 0.446
Table 7: Summary of Validation Testing for Seizure Burden Output
Test DescriptionAcceptance Criteria
Seizure Burden output, L1-distance vs. reference standardCeribell non-inferior to Persyst 13 with 10% non-inferiority margin

Results

Table 8 below summarizes the results for performance metrics, PPA and FP/hr for all three Ceribell's seizure notification levels of "Frequent," "Abundant," and "Continuous" along with their 95% confidence intervals. The percentage agreement for the three notification levels ranged from 91.30% to 94.67%. The false positive rate ranged from 0.1247 to 0.2145.

{11}------------------------------------------------

Table 8: Performance Metrics for Seizure Notifications for All Three of Ceribell's Level of Seizure ActivityNotification, As Compared To Reference Standard
Ceribell SeizureActivity NotificationLevelPPAPPA95% CIConformance to PPAAcceptance CriteriaFP/hrFP/hr95% CIConformance to FP/hrAcceptance Criteria
"Frequent"94.67%[90.00%,97.33%]90.00% > 70%,therefore, PASS0.2145[0.119, 0.351]0.351 < 0.446, therefore,PASS
"Abundant"93.02%[81.39%, 100%]81.39% > 70%,therefore, PASS0.1996[0.093, 0.381]0.381 < 0.446, therefore,PASS
"Continuous"91.30%[78.26%, 100%]78.26% > 70%,therefore, PASS0.1247[0.054, 0.272]0.272 < 0.446, therefore,PASS

Conclusion

The Ceribell Pocket EEG Device has the same intended use as the predicate devices. In addition, it has similar technological characteristics. Evaluation of the results and the test methods to account for different technological characteristics of the submitted performance data demonstrated that differences in technological characteristics between the subject device and predicates do not raise different questions of safety or effectiveness. Therefore, the Ceribell Pocket EEG Device is substantially equivalent to the predicates.

§ 882.1400 Electroencephalograph.

(a)
Identification. An electroencephalograph is a device used to measure and record the electrical activity of the patient's brain obtained by placing two or more electrodes on the head.(b)
Classification. Class II (performance standards).