K Number
DEN120015
Device Name
EEVA 2.0
Manufacturer
Date Cleared
2014-06-06

(651 days)

Product Code
Regulation Number
884.6195
Reference & Predicate Devices
Predicate For
N/A
AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
Intended Use

The Eeva System is indicated to provide adjunctive information on events occurring during the first two days of development that may predict further development to the blastocyst stage on Day 5 of development. This adjunctive information aids in the selection of embryo(s) for transfer on Day 3 when, following morphological assessment on Day 3, there are multiple embryos deemed suitable for transfer or freezing.

Device Description

The Eeva System provides image recording and automated analysis of cell division from high resolution time-lapse images collected until day 3 (72 hours) of development. Results of cell division timing parameters (time from first to second mitosis: and time from second to third mitosis) are provided to the user in addition to a prediction of the likelihood that an embryo will develop to the blastocyst stage. These timing parameters are based on those published in a study by Wong, et. al. (2010).

The Eeva System incorporates: (1) a set of up to four time-lapse image microscopes that automatically take darkfield microscopy images of embryos at regular intervals (every 5 minutes) while the embryos remain in the incubator environment, (2) Eeva Computer and other components (Control Box, Station, Scope Screen and Printer), (3) system software for image capture and recording, user interface, and patient database and (4) image analysis software that automatically identifies embryo development events, compares their times to specified timing parameters and makes a prediction of embryo development to the blastocyst stage. The system is installed in an In Vitro Fertilization (IVF) laboratory, and is to be used as an adjunct to the traditional morphological method to identify the embryos that are more likely to develop into blastocysts.

AI/ML Overview

The Eeva™ System is indicated as an adjunct to traditional morphology evaluation to aid in the selection of embryo(s) for transfer on Day 3 when multiple embryos are deemed suitable for transfer or freezing. It helps predict the likelihood of an embryo developing to the blastocyst stage on Day 5/6.

1. Table of Acceptance Criteria & Reported Device Performance:

The document primarily focuses on clinical performance characteristics rather than specific hard-coded acceptance thresholds for every metric. However, for "Software Validation," a clear acceptance criterion is defined and met. For the primary and secondary endpoints in the Pivotal Adjunct Use Study, the outcome of statistical significance against stated objectives serves as the "acceptance."

MetricAcceptance CriteriaReported Device Performance
Software ValidationSpecificity of Eeva System software non-inferior to embryologist measurements; Lower limit of 95% CI for specificity of Eeva System software ≥ 65%.Eeva System specificity: 85.12%. Embryologist specificity: 82.64%. Lower limit of 95% CI for Eeva specificity: 77.71%. Met.
Pivotal Adjunct Use Study (Primary Endpoint)Blastocyst Odds Ratio (OR) for adjunct prediction (for Good/Fair embryos) statistically significantly greater than 1.Overall OR for adjunct prediction: 2.56 (95% CI: [1.75, 3.74], p<.0001) using pre-specified analysis; 2.57 (95% CI: [1.88, 3.51]) using GLMM. Both significantly greater than 1. Met.
Pivotal Adjunct Use Study (Secondary Endpoints - Accuracy Measures)Improve specificity and maintain acceptable sensitivity while showing improved PPV and comparable NPV/NLR. The primary goal was to enhance selection among already good/fair embryos.Specificity (from morphology alone to adjunct): 39% to 76% (37% improvement). Sensitivity (from morphology alone to adjunct): 72% to 45% (27% decrease). PPV (from morphology alone to adjunct): 43% to 54% (11% improvement). NPV (from morphology alone to adjunct): 68% to 68% (no change). PLR (from morphology alone to adjunct): 1.21 to 1.86 (improvement). NLR (from morphology alone to adjunct): 0.73 to 0.73 (no change). Overall, the results indicate improved selection effectiveness where intended.
Simulated Use (System Operation)The Eeva System shall operate successfully in a simulated use procedure and incubator door opening shall not impact image capture or embryo prediction.Pass
Algorithm ReproducibilityThe software must generate repeatable outputs across multiple Eeva Systems, given the same set of input image data.Pass

2. Sample Sizes and Data Provenance:

  • Test Set (Pivotal Adjunct Use Study):
    • Number of Subjects: 54 subjects.
    • Number of Embryos: Not explicitly stated as a total count for the test set, but it refers to "a subject's cohort of embryos" and "multiple embryos per subject."
    • Data Provenance: Prospective, multi-center clinical study conducted at five sites in the United States. Data was collected on embryos cultured to cleavage stage (Day 3) or blastocyst (Day 5/6) stage. This was a non-interventional study, meaning the Eeva output was not used for real-time patient management.

3. Number of Experts and Qualifications for Ground Truth:

  • Software Validation Phase (for Eeva System Software's ability to predict blastocyst formation):
    • Number of Experts: A panel of three embryologists.
    • Qualifications: "Embryologists" are mentioned, with no further specific details on their years of experience or board certification. Their role was to review image series and identify start/stop times of development parameters.
  • Pivotal Adjunct Use Study (for morphological and adjunct assessments):
    • Number of Experts: A panel of 5 clinical embryologists.
    • Qualifications: "Currently in practice, representing a range of geographical areas and level of experience." No further specific expertise (e.g., years of experience) is provided.

4. Adjudication Method for the Test Set:

  • Software Validation: The document states that a panel of three embryologists reviewed the image series to identify start/stop times. The results of their measurements were compared to the Eeva System measurements. This implies a comparison against the consensus or individual expert findings, but it doesn't explicitly detail a formal adjudication method (e.g., majority vote, or a specific process for resolving disagreements between the three). It presents the embryologists' aggregate specificity for comparison.
  • Pivotal Adjunct Use Study: For the morphological and adjunct assessments, each of the five panelists independently provided their assessments and embryo selections. There is no mention of an adjudication method to establish a single "expert ground truth" for these assessments among the five panelists. Instead, the study analyzed the impact of the Eeva System on each panelist's predictions and selections, and then reported overall odds ratios and performance metrics that appear to aggregate or model across the panelists' individual responses. The primary endpoint analysis used complex statistical procedures (pre-specified method and GLMM) to address the "complex structure of the data (multiple embryos per subject, five panelists evaluating all embryos by both traditional morphology and sequential adjunctive use of Eeva)."

5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study:

  • Yes, a form of MRMC was done. The "Pivotal Adjunct Use Study" serves as this, comparing human readers (embryologists) with and without AI assistance (Eeva System). The "readers" are the 5 clinical embryologists.
  • Effect Size:
    • Odds Ratio for Blastocyst Prediction:
      • Traditional Morphology: 1.66 (95% CI: [0.78, 3.51]) by pre-spec analysis; 1.68 (95% CI: [1.29, 2.19]) by GLMM.
      • Adjunct Prediction (with Eeva): 2.56 (95% CI: [1.75, 3.74], p<.0001) by pre-spec analysis; 2.57 (95% CI: [1.88, 3.51]) by GLMM.
      • Improvement: The odds of an embryo forming a blastocyst were 2.56-2.57 times higher with adjunct use compared to traditional morphology alone (1.66-1.68). This is a substantial improvement in the informativeness of the prediction.
    • Specificity: Improved by 37% (from 39% to 76%) with adjunct prediction.
    • Positive Predictive Value (PPV): Improved by 11% (from 43% to 54%) with adjunct prediction.
    • Positive Likelihood Ratio (PLR): Improved (from 1.21 to 1.86) with adjunct prediction.
    • Note on Sensitivity: Sensitivity decreased by 27% (from 72% to 45%). However, the document argues this trade-off is expected and acceptable because the Eeva System's role is to aid in selecting among already morphologically suitable embryos, making specificity and PPV more critical for this use case.

6. Standalone (Algorithm Only) Performance Study:

  • Yes, in the "Software Validation" phase. This phase directly assessed the Eeva System Software's ability to predict blastocyst formation independently.
    • The Eeva System software’s specificity was 85.12%, compared to the embryologists’ 82.64%. The lower limit of the 95% CI for Eeva was 77.71%. This demonstrates the algorithm's standalone prediction capability against expert "measurements."
    • The document states, "The results of the embryologists' measurements were compared to the Eeva System measurements to validate the software." This indicates a direct comparison of the software's output against the expert observations.

7. Type of Ground Truth Used:

  • For Blastocyst Formation: The ultimate ground truth for blastocyst formation was the actual biological outcome – whether the embryo progressed to the blastocyst stage (Day 5/6) or arrested. This is an objective outcome based on embryo development.
  • For Software Validation of Timing Parameters: The ground truth for validating the software's ability to identify cell division start/stop times was based on the measurements/observations of the panel of three embryologists.
  • For Clinical Study Assessments: The ground truth for the panels' predictions was the actual blastocyst outcome. The panels were given morphological data collected by clinical site embryologists and, in the adjunct arm, the Eeva parameters.

8. Sample Size for the Training Set:

  • Software Development Phase: 63 subjects. This data was used to "further develop the Eeva System Software" and identify the parameters for P2 (time from first to second mitosis) and P3 (time from second to third mitosis) that were implemented. This effectively served as the training/development set for the algorithm's specific predictive windows.

9. How the Ground Truth for the Training Set was Established:

  • For the "Software Development" phase (training set), "Imaging data was collected on embryos cultured to cleavage stage (Day 3) or blastocyst stage (Day 5/6)." This implies the ground truth for blastocyst formation was established by the actual development outcome of these embryos (i.e., did they reach blastocyst stage or not). This outcome data was then used by the developers to determine the optimal timing parameters (P2 and P3) that formed the basis of the Eeva System's prediction model.

{0}------------------------------------------------

DE NOVO CLASSIFICATION REQUEST FOR Eeva™ System

REGULATORY INFORMATION

FDA identifies this generic type of device as:

Assisted Reproduction Embryo Image Assessment System: An assisted reproduction embryo image assessment system is a prescription device that is designed to obtain and analyze light microscopy images of developing embryos. This device provides information to aid in the selection of embryo(s) for transfer when there are multiple embryos deemed suitable for transfer or freezing.

NEW REGULATION NUMBER: 21 CFR 884.6195

CLASSIFICATION: II

PRODUCT CODE: PBH

BACKGROUND

DEVICE NAME: Eeva™ System

SUBMISSION NUMBER: K120427

DATE OF DE NOVO: AUGUST 24, 2012

  • CONTACT: Auxogyn, Inc. Lissa Goldenstein President & CEO 1490 O'Brien Drive Suite A Menlo Park, CA 94025

REQUESTER'S RECOMMENDED CLASSIFICATION: II

INDICATIONS FOR USE

The Eeva System is indicated to provide adjunctive information on events occurring during the first two days of development that may predict further development to the blastocyst stage on Day 5 of development. This adjunctive information aids in the selection of embryo(s) for transfer on Day 3 when, following morphological assessment on Day 3, there are multiple embryos deemed suitable for transfer or freezing.

{1}------------------------------------------------

LIMITATIONS

The sale, distribution, and use of the device are restricted to prescription use in accordance with 21 CFR 801.109.

The Eeva™ System is limited to adjunct use on embryos graded as good or fair based on morphology on Day 3 of development.

WARNING: The Eeva System is not to be used as a substitute for traditional morphology evaluation. When using the Eeva System, always conduct traditional morphology evaluation first to identify the embryos that are suitable for transfer or freezing. The Eeva System evaluation begins only after embryos that are morphologically, good/fair have been identified. The Eeva System is then used to assist in predicting potential arrested embryos out of the selected embryos.

Precautions

Determination of good/fair embryo retention (cryopreservation) should be made according to traditional morphology only (not based on the Eeva Test Result).

The Eeva Blastocyst Prediction does not provide any information on embryo genetic quality beyond providing information about the embryo's likelihood to progress to the blastocyst stage.

The adjunctive value of the Eeva Test to predict which embryo is likely to achieve implantation and live birth has not been evaluated.

Users of the Eeva System should be trained in, and familiar with, standard in vitro fertilization (IVF) and incubator operating procedures. Only users trained on the use of the Eeva System should use the Eeva System. The Eeva System training is provided by an authorized Auxogyn trainer during the installation process or may be given by a trained member of the site personnel.

PLEASE REFER TO THE LABELING FOR A MORE COMPLETE LIST OF WARNINGS AND PRECAUTIONS.

DEVICE DESCRIPTION

Device Name: Eeva™ System

Device Model(s): EVS2000

The Eeva System provides image recording and automated analysis of cell division from high resolution time-lapse images collected until day 3 (72 hours) of development. Results of cell division timing parameters (time from first to second mitosis: and time from second to third mitosis) are provided to the user in addition to a prediction of the likelihood that an embryo will

{2}------------------------------------------------

develop to the blastocyst stage. These timing parameters are based on those published in a study by Wong, et. al. (2010)4.

The Eeva System incorporates: (1) a set of up to four time-lapse image microscopes that automatically take darkfield microscopy images of embryos at regular intervals (every 5 minutes) while the embryos remain in the incubator environment, (2) Eeva Computer and other components (Control Box, Station, Scope Screen and Printer), (3) system software for image capture and recording, user interface, and patient database and (4) image analysis software that automatically identifies embryo development events, compares their times to specified timing parameters and makes a prediction of embryo development to the blastocyst stage (Figure 1 and Table 1). The system is installed in an In Vitro Fertilization (IVF) laboratory, and is to be used as an adjunct to the traditional morphological method to identify the embryos that are more likely to develop into blastocysts.

Image /page/2/Figure/2 description: This image shows a diagram of the Eeva system. The diagram shows one Eeva station, one Eeva printer, one Eeva control box, one Eeva computer, one Eeva scope screen, and four Eeva scopes in one incubator. The Eeva system is a medical device used for in vitro fertilization.

Figure 1: Eeva and its Hardware Components

The Eeva System is designed to be used with the Eeva Dish, which is 510(k) cleared (K103028). Figure 2 below shows the Eeva Dish on the Eeva Scope. The Eeva Dish is a standard-size petri dish with individual micro-wells arrayed in the center of the dish. Each dish accommodates a single patient's developing embryos. The Eeva Dish fits in only one position on the Eeva Scope stage, and each micro-well is identified to facilitate embryo tracking. The user aligns the orientation of the dish with help from fiducial markers. Figure 3 shows an image of the Eeva microwell screen after imaging is complete.

1 Wong, C. et al. Non-invasive imaging of human embryos before embryonic genome activation predicts development to the blastocyst stage. Nat Biotechnol 28, 1115-1121 (2010)

{3}------------------------------------------------

Figure 2: Eeva Scope

Image /page/3/Picture/1 description: The image shows a laboratory instrument, possibly a cell culture imaging system. The device has a white and gray color scheme with a display screen on the front. The screen is dark, but it appears to be displaying some red text or numbers. The instrument has a compartment above the screen where a petri dish or similar container can be placed for imaging.

Figure 3: Eeva Microwell Screen (After Imaging Complete)

Image /page/3/Picture/3 description: The image shows a screenshot of the Eeva 2.0 software interface, displaying information about a patient and an embryo. The interface includes patient details such as ID, date of birth (1977-05-25), and analysis results, indicating a 'Complete' analysis. The Eeva prediction is 'High', with specific time predictions for cell divisions: 10.67 hours for 2-cell to 3-cell and 0.17 hours for 3-cell to 4-cell. A microscopic image of an embryo is displayed on the right side of the screen.

The Eeva Scope is an inverted microscope that performs darkfield microscopy at regular intervals using a low intensity LED lighting system. The microscope uses a 625nm wavelength red LED to image the embryos under darkfield illumination. Light from the illumination LED is collimated and passed through a diffuser before focusing through a dark stop and onto the Eeva dish. The microscope uses a set of objective lenses housed inside the microscope to project the image of the embryos onto an image sensor. The effective optical magnification of the Eeva System is 2.5x with a working distance of approximately 10 mm.

The Eeva System controls the illumination LED power to achieve a consistent average exposure level on the imaging sensor. In use, the typical optical power measured at the dish is 0.22mW/cm2, with a maximum of 0.7mW/cm². In contrast a typical IVF microscope has an optical power of 7.6mW/cm². A typical image requires 0.6 seconds of light exposure or 0.13mJ/cm² of energy. Over a 3 day (72 Hour) imaging session, embryos are exposed to 114mJ/cm'. A worst-case analysis indicates a total exposure of 363mJ/cm'; equivalent to

{4}------------------------------------------------

approximately 48 seconds on an IVF microscope. By comparison, in a typical IVF cycle, embryos are exposed to light for approximately 3300 seconds.

The Eeva System software runs on the Eeva Computer. The software tracks embryo features within each image frame. This information is used to generate an embryo model that includes an estimate of the number of cells in the embryo. The software quantifies the development timeline as the embryo divides. After measuring cell division times, the software compares the resulting two and three cell stage durations (parameters) to the Eeva System's predictive windows for the time from first to second mitosis and from second to third mitosis.

If all parameters measured fit within the predictive windows, then the software predicts the embryo to have a high probability of reaching the blastocyst stage. If any of the parameters measured falls outside of the predictive windows, then the software predicts that the embryo has a low probability of reaching the blastocyst stage. If incomplete imaging data is present for the embryo, a "no result" finding will be presented for that embryo.

ComponentQuantityImageDescription
Eeva Computer1Image: Eeva ComputerOperates the four Eeva Scopes, the Eeva Station and the Eeva Scope Screen(s). Runs the Eeva Analysis and computes the Eeva Blastocyst Prediction.Stores images and patient data for Eeva Patient Sessions.
Eeva Control Box1Image: Eeva Control BoxReceives commands from the Eeva Computer and operates the Eeva Scopes accordingly.Provides power to the Eeva Scopes and continuously monitors the Eeva Scope power consumption. If the power consumption exceeds normal operating limits, then a hardware error is triggered and the Eeva Control Box turns off the power to the scope. The Eeva Control Box reports errors to the Eeva Computer and the user is alerted on the Eeva Station and the Eeva Scope Screen
Eeva Scopes4Image: Eeva ScopesAn assisted reproductive microscope with a platform designed to hold the Eeva Dish. It houses the optics and provides illumination needed to create dark field image capture.
Eeva Scope Screen(s)1 or 2Image: Eeva Scope Screen(s)The Eeva Scope Screen is a touchscreen display that is used to select and operate the Eeva Scope for the Eeva Patient Session. Via the Eeva Scope Screen, the user can enter patient data and initiate, pause or stop the image capture and/or Eeva Analysis for that Eeva Patient Session. The Eeva Scope Screen can also be used to view the most recent image captured for each active Eeva Scope.The Eeva Scope Screen is mounted on the incubator door.

Table 1: Eeva System Components

{5}------------------------------------------------

Eeva Station1Image: Eeva StationA large touchscreen monitor that allows the user to manage the Eeva Patient Session data stored on Eeva. Via the Eeva Station, the user can view the status of each Eeva Scope(s), review and export images and videos, and print and export reports.
Stopper1Image: StopperProvides a thru-hole for the Eeva Scope cables to pass from the Eeva Scope inside the incubator to the Eeva Control Box outside the incubator, while maintaining the incubator environment.
Connection Cords4Image: Connection CordsConnects the Eeva Scope to the Eeva Control Box, supplying power to the Eeva scope and communication channels.
Uninterruptable Power Supply (UPS)1Image: Uninterruptable Power Supply (UPS)An uninterruptible power supply to provide backup power to Eeva.
Eeva Printer1Image: Eeva PrinterA black and white printer for printing Eeva reports.

Please refer to the Instructions for Use for the Eeva System for additional details on the device.

BIOCOMPATIBILITY/MATERIALS

Eeva System materials do not come in direct or indirect contact with the patient during use. Therefore, biocompatibility testing of device materials was not necessary to assess device safety.

SHELF LIFE/STERILITY

The Eeva System is a non-sterile device. Therefore, sterilization information was not necessary to assess device safety. The device does not have a stated shelf life, which, based upon the nature of the device components, is acceptable.

With the exception of the Eeva Dish, previously cleared through 510(k), all other components of the Eeva System are reusable, and the user manual includes validated cleaning and disinfection instructions for reusable device components. The validation testing is described in the Summary of Non-Clinical /Bench Studies.

SOFTWARE

The Eeva System's proprietary software controls the individual microscopes, coordinates image acquisition and patient data management. The Eeva System software also quantifies the development timeline as the embryo divides, and classifies the resulting two and three cell stage durations into either high or low probability of reaching a blastocyst.

{6}------------------------------------------------

All the elements of software information corresponding to moderate level of concern devices, as outlined in FDA's Guidance for the Content of Premarket Submissions for Software Contained in Medical Devices (May 11, 2005), have been provided.

The testing conducted to validate device software is described in the Summary of Non-Clinical /Bench Studies and Summary of Clinical Information.

SUMMARY OF NON-CLINICAL/BENCH STUDIES

In addition to the testing described above, the sponsor conducted a series of non-clinical performance testing to demonstrate that the Eeva System would perform as anticipated. Nonclinical testing included device effects on embryo growth and development, cleaning and disinfection, electromagnetic compatibility (EMC) and electrical safety testing, package integrity testing, simulated use testing, light output and safety evaluation, hardware and software testing. Testing is summarized in Table 2, below.

TestPurposeAcceptance CriteriaResults
Embryotoxicity AssessmentMouse EmbryoAssay (MEA)To evaluate whether the Eeva Systemoffers appropriate conditions withinthe incubator for embryo culture.Testing was performed in Auxogyn'slaboratory and at 4 clinical sites.(b)(4) TS/CCIPass
Cleaning and DisinfectionCleaningTo evaluate the reprocessingprocedures for the Eeva System(microscope, cable, stopper) to ensureit can be properly cleaned by manualmethods (referenceAAMI TIR12: 2010 & AAMITIR30:2011).Test samples shall be inspected with anunaided eye and determined to be visiblyclean with no soil detected.The level of protein after cleaning shall be(b)(4) TS/CCI.The carbohydrate level after cleaning shall(b)(4) TS/CCIsamples.Pass
DisinfectionTo evaluate the reprocessingprocedures to ensure they are adequateto properly disinfect the Eeva System(microscope, cable, stopper) (referenceAAMI TIR12: 2010 & AAMITIR30:2011).Test samples shall demonstrate a(b)(4) TS/CCIto the positivecontrol samples.Test samples shall demonstrate a(b)(4) TS/CCIcompared tothe positive control sample.Pass
Media SpillTo evaluate the process for cleaningthe Eeva Scope in case of a media spilland to ensure it is sealed from anyThe Eeva Scope shall remain functionaland provide usable images after mediaPass
TestPurposeAcceptance CriteriaResults
ingress of fluid that would impactfunctionality.spill and subsequent cleaning.
Package Integrity and Transit Testing
Eeva SystemTo evaluate if the Eeva Systempalletized shipping configuration canwithstand simulated transit per ASTMD 4169-09.Upon completion of the testing, the EevaSystem packaging shall be intact. TheEeva System must be fully functional aftertesting.Pass
EMC and Electrical Safety Testing
EMC TestingTo evaluate whether the Eeva Systemmeets the EMC requirements ofEN/IEC 60601-1-2:2007.(Medical electrical equipment – Part 1-2: General requirements for safety andessential performance - Collateralstandard: Electromagneticcompatibility - Requirements andtests)EMC requirements, as defined in EN/IEC60601-1-2:2007.Pass
Electrical SafetyTestingTo evaluate whether the Eeva Systemmeets the product safety requirementsof BS EN 60601-1: 2006 + A11:2011.(Medical electrical equipment -General requirements for basic safetyand essential performance)Electrical safety requirements, as definedin BS EN 60601-1: 2006 + A11:2011.Pass
Simulated Use
InstallationVerificationTo verify that the Eeva System can beinstalled and functionality verified inless than 8 hours.The Eeva System shall be installed andoperational in less than 8 hours.Pass
System UsabilityTo verify that the Instructions for Usecan be understood by the user and thatthe results of each action are stated inthe IFU.The Instructions for Use can be understoodby the user and the results of each actionare stated in the IFU.Pass
Simulated UseTo verify the Eeva Systemsuccessfully operates in a real timesimulated use procedures, and toverify that intermittent incubator dooropening does not negatively impactimaging and embryo prediction.The Eeva System shall operatesuccessfully in a simulated use procedureand incubator door opening shall notimpact image capture or embryoprediction.Pass
Performance Testing - Bench
HardwareLight Exposureand OutputTo document the amount of lightexposure from the Eeva microscopecompared to a traditional IVFmicroscope(b)(4) TS/CCIPass
TestPurposeAcceptance CriteriaResults
HardwareControlsTo verify that the hardware controls inthe Eeva System properly limit themicroscope lamp LED, alignmentLED and LCD, camera and motor, andturn them off if the limits areexceeded.(b)(4) TS/CCIPass
Microscope,Scope Screen,ComputerHardware,UninterruptablePower Supply, andPrinterTo verify various microscope,incubator interface, scope screen,computer storage, accessoryparameters and interactions.System components conform to designspecifications.Pass
Eeva SystemSoftwareVerificationTo verify integrated system operationand various camera, workflow andEeva Station component requirements.The software conforms to all designspecifications.Pass
Software Fail-SafeVerificationTo verify safety related parameters forthe LED, LCD, Camera and Motor, aswell as various requirements of theconfiguration, microscope userinterface, focus motor, LCD displayand Eeva Station softwarecomponents.The safety-related parameters verifiedincluded: fail-safe status from the lampLED, alignment LED and LCD,camera power monitor and motorpower hardware controls; continuouson time of the lamp LED, alignmentLED and LCD; camera -free run time;and control or lamp brightness andpower.The software conforms to all safety-related specifications.Pass
AlgorithmSoftwareValidationTo validate the ability of the Eevasoftware to predict blastocystformation.(b)(4) TS/CCIPass
TestPurposeAcceptance CriteriaResults
of embryologists.
AlgorithmSoftwareVerificationTo verify the Eeva System imageanalysis algorithms.(b)(4) TS/CCIPass
AlgorithmReproducibilityTo evaluate the reproducibility of theEeva System algorithm software.The software must generate repeatableoutputs across multiple Eeva Systems,given the same set of input image data.Pass

Table 2: Summary of Non-Clinical/Bench Studies

{7}------------------------------------------------

{8}------------------------------------------------

{9}------------------------------------------------

PERFORMANCE TESTING - ANIMAL

In vivo animal studies were not conducted in support of the Eeva System nor deemed necessary to support the safety and effectiveness of the Eeva System.

{10}------------------------------------------------

SUMMARY OF CLINICAL INFORMATION

The safety and effectiveness of the Eeva System was studied through the Eeva System Clinical Study. This study was a prospective, single arm, multicenter clinical study conducted at five sites in the United States. This was a non-interventional clinical study in which the Eeva output was not used in patient management. The purpose of the study was to collect data to characterize the safety and effectiveness of the Eeva System in predicting which embryos are more likely to develop to the blastocyst stage. The study design evaluated the Eeva System as an adjunct to traditional morphology grading. Imaging data was collected on embryos cultured to the cleavage stage (Day 3) or blastocyst (Day 5/6) stage. Embryologists were masked to Eeva sequential images of the developing embryos, except for the most recent image recorded. The Eeva System Clinical Study enrolled a total of 160 subjects that were allotted to different parts of the study (Table 3).

Eeva System Clinical Study Sub-PartNumber of Subjects
Training12
Software Development63
Software Validation21
Pivotal Adjunct Use54
Additional Development10*
Total160

Table 3: Eeva System Clinical Study Enrollment

*subjects excluded from use in the Pivotal Adjunct Use Study due to incomplete Day 5/6 embryo cohort data

The Eeva System Clinical Study had the following sub-parts:

    1. Training: This group consisted of the first subjects enrolled in the study from all sites. The purpose of this part of the study was to allow the sites to become familiar with the Eeva System and the study protocol. Data from this group was not used for endpoint analysis.
    1. Software Development: This part of the study was to further develop the Eeva System Software. Imaging data was collected on embryos cultured to cleavage stage (Day 3) or blastocyst stage (Day 5/6).
    1. Software Validation: This part of the study was used to validate the ability of the Eeva System Software to predict blastocyst formation.
    1. Pivotal Adjunct Use: This part of the study was to evaluate the use of the Eeva System, when used as an adjunct to the traditional Day 3 morphological grading compared to traditional Day 3 morphological embryo grading methods alone.

Six adverse events in six subjects (3.75%, 6/160) were determined to be related to the Eeva System, specifically to the Eeva Dish. None of these adverse events were serious. These events were embryo damage during pipetting and embryo transfer into/out of the dish (3.13%, 5/160) and embryo loss during the Day 4 dish change (0.63%, 1/160). These events were anticipated and can occur with handling of embryos in the process of IVF cvcle with standard IVF equipment.

{11}------------------------------------------------

Training

Consistent with the approved protocol, these data were not used as part of the analysis that follows but rather were solely for purposes of ensuring familiarity with the protocol and the Eeva System.

Software Development

This study explored several types of blastocyst prediction models. In addition to cell division parameters, other factors were considered, but it was determined that two prediction values (termed P2 and P3) dominated the prediction. At the end of the software development phase, the results identified the parameters for P2 (time from first to second mitosis) and P3 (time from second to third mitosis) that were implemented into the Eeva System software.

Software Validation

A panel of three embryologists reviewed the image series of each embryo to identify the start/stop times of the two development parameters. The results of the embryologists' measurements were compared to the Eeva System measurements to validate the software. The study protocol required the specificity of the Eeva System software to be non-inferior to the specificity of the panel embryologist measurements and also required the lower limit of the 95% confidence interval for specificity of the Eeva System software to be greater than or equal to 65%. The specificity of the Eeva System software was 85.12%, while the specificity of the embryologists was 82.64%. The lower limit of the 95% confidence interval for the Eeva System was 77.71%. Both acceptance criteria were met and the software was deemed validated.

Pivotal Adjunct Use Study

This study utilized a panel of 5 clinical embryologists currently in practice, representing a range of geographical areas and level of experience. Each panelist provided a morphological assessment and an adjunct assessment for each subject, as follows:

Morphological assessment: Each panelist reviewed the Day 3 morphology data from a subject's cohort of embryos collected by clinical site embryologists (from Case Report Forms). The data included the number of cells, fragmentation (0%, <10%, 10-25%, >25%) and symmetry (Perfect, Moderately Asymmetric, Severely Asymmetric). Additionally, the age of subject or egg donor was provided. The panel then performed the following:

    1. Assigned an embryo category (A: Good, B: Fair+, C: Fair-, D: Poor).
    1. Assigned a prediction (Blastocyst; Arrested)
    1. Chose the Top 2 embryos from the subject's complete cohort of embryos (Top 1, Top 2)

Adjunct assessment: For the adjunct assessment, the panelists were provided with the same information as in the traditional morphology session, with the addition of Eeva parameter values (P2 and P3), and an Eeva prediction of "High, Low." Panelists were asked to follow pre-defined recommendations in order to assign a prediction outcome (Blastocyst; Arrested). Panelists then chose the Top 2 embryos for a given subject.

In this study, the panel of embryologists did not collect the morphological data, but were instead presented with the data collected by clinical site embryologists. Therefore, this study was not designed to consider variation among embryologists in embryo data collection.

{12}------------------------------------------------

Primary Endpoint

The primary endpoint for this study was to assess the association between the adjunct prediction of blastocyst outcome and the actual blastocyst outcome. The purpose was to determine if Eeva is informative for embryos graded as an A. B. or C using Day 3 morphology category assignment). For Good/Fair embryos, the blastocyst Odds Ratio (OR) for the adjunct prediction was required to be statistically significantly greater than 1 to demonstrate that adjunctive use of Eeva led to embryologist predictions for Day 5 that were informative for outcome (i.e., Arrested; Blastocyst).

The primary endpoint for the study was met with statistical significance. For the pre-specified analysis, the overall OR for adjunct prediction was calculated by the sponsor to be 2.56 and significantly greater than 1 (95% CI: [1.75, 3.74], p<.0001). These results were based on a novel statistical procedure that the sponsor had pre-specified in an attempt to address the complex structure of the data (multiple embryos per subject, five panelists evaluating all embryos by both traditional morphology and sequential adjunctive use of Eeva).

To determine if the results were robust to alternative statistical approaches that could have been used for the analysis, the data for the primary endpoint were re-analyzed with a generalized linear mixed model (GLMM) model. For the primary endpoint, the GLMM model results were comparable to the initial analysis in that the estimate of the overall OR for adjunct prediction was nearly the same (2.57) and was again significantly greater than 1 (95% CL: [1.88, 3.51]). Thus, the primary endpoint was also met with the GLMM analysis.

Embryo-Level Diagnostic Performance Measures (Secondary Endpoints)

By comparison, the overall OR for traditional morphology prediction was estimated to be 1.66 (95% CI: [0.78, 3.51]) by the pre-specified analysis. The GLMM estimate of the overall OR for traditional prediction was nearly the same (1.68) but with narrower 95% CI [1.29, 2.19].

Additionally, when the data for each panelist were considered separately, blastocyst prediction was more informative (OR greater) for adjunct use than for morphology alone for every panelist (Figure 4).

Image /page/12/Figure/7 description: This bar graph compares the odds ratio of morphology and adjunct across 5 panelists. For panelist 1, morphology has an odds ratio of 1.14, while adjunct has an odds ratio of 2.51. For panelist 2, morphology has an odds ratio of 2.20, while adjunct has an odds ratio of 2.78. The odds ratio for morphology is lower than the odds ratio for adjunct for all 5 panelists.

Figure 4: Traditional Morphology and Adjunct Blastocyst OR by Panelist

{13}------------------------------------------------

Specificity (proportion of embryos that did not form blastocysts that were predicted to not form blastocysts) increased from 39% for morphology alone prediction to 76% for adjunct prediction, an improvement of 37%. However, sensitivity (proportion of embryos forming blastocysts that were predicted to form blastocysts) decreased from 72% for morphology alone prediction to 45% for adjunct prediction, a decline of 27%. While the increase in specificity comes with a decrease in sensitivity, this trade-off is not unexpected. As morphological selection already identified embryos deemed suitable for transfer, the sensitivity of Eeva is a less relevant performance measure, as long as Eeva predictions are informative.

The negative predictive value or NPV (proportion of embryos predicted to not form blastocysts that did not form blastocysts) was the same for adjunct and traditional prediction (68%). However, the positive predictive value or PPV (proportion of embryos predicted to form blastocysts that did so) was larger for adjunct prediction (54%) than traditional prediction (43%), an 11% improvement. The improved PPV and similar NPV indicate that adjunct use of Eeva was better than traditional morphology at predicting blastocyst status.

The negative likelihood ratio or NLR [(1 – sensitivity) ÷ specificity] was the same for adjunct and traditional predictions (0.73). However, the positive likelihood ratio or PLR [sensitivity + (1 specificity)] was higher (better) for adjunct prediction (1.86) than traditional prediction (1.21). The improved PLR and similar NLR indicate that adjunct use of Eeva was better than traditional morphology at predicting blastocyst status.

These findings demonstrate that adjunct prediction improved the selection of embryos for transfer over morphology alone. In particular, among embryos deemed suitable for transfer by morphology assessment, adjunctive use of Eeva improved specificity. This increase in specificity translated to an improved PPV, that is, an improved likelihood that selection of an embryo for transfer will go on to form a blastocyst.

Top 2 Embryo Analysis (Secondary Endpoint)

This analysis included the top 2 embryos selected by each panelist based on morphology alone. Among these embryos, the adjunct OR was estimated to be 2.26. indicating that Eeva was informative for Day 5 blastocyst status even in this selective group of embryos. The OR 2.26 among the top 2 embryos is consistent with the overall adjunct OR 2.56. However, for this odds ratio, the reported 95% confidence interval was (0.67, 7.57). Therefore, the benefit of Eeva cannot be said to be established in the subset of the two highest quality embryos available for each subject (Top 2 Analysis) as determined by traditional morphology.

Subject Level Analysis Evaluations (Secondary Endpoints)

The sponsor conducted two subject level analyses on study data (see summaries below). For the subject level performance assessment, the following definitions were used:

  • True Positive (TP)
    • o 1-2 embryos from the subject are predicted as "Blastocyst," and one of these forms a blastocyst, or

{14}------------------------------------------------

  • o >2 embryos are predicted as "Blastocyst," and at least one of the Top 2, as selected by the panelist, forms a blastocyst.
  • False Negative (FN) ●
    • o None of the embryos from the subject are predicted as "Blastocyst," but at least one forms a blastocyst, or
    • 1-2 embryos are predicted as "blastocyst," but none forms a blastocyst, and at least O one other embryo forms a blastocyst, or
    • o >2 embryos are predicted as "Blastocyst," but none in the Top 2, as selected by the panelist, forms a blastocyst, and at least one not in the Top 2 forms a blastocyst.
  • False Positive (FP) ●
    • o Some embryos from the subject are predicted as "Blastocyst," but none of the embryos from the subject forms a blastocyst.
  • True Negative (TN)
    • None of the embryos from the subject are predicted as "Blastocyst." and none form o a blastocyst.

Subject-Level Performance

Among 54 subjects, only one subject for panelists 2 and 4 and two subjects for panelists 1, 3, and 5 had zero blastocysts among the cohort of A, B, and C embryos for that panelist. Thus, subject level specificity was based on only one or two subjects. For this reason, the subject level analysis for specificity, and for related performance measures such as PLR, NLR, and OR that depend on specificity, is limited and not meaningful.

Subject level sensitivity is based on either 52 or 53 subjects for whom at least one embryo formed a blastocyst among the cohort of A, B, and C embryos for a panelist. Among the five panelists, subject level sensitivity ranged from 69.2% to 75.0% for traditional morphology and 71.2% to 81.1% for adjunct prediction. Although adjunct prediction is designed to rule out some embryos selected by traditional morphology, subject level sensitivity can be larger for adjunct prediction because the top 2 embryos remaining after some of the embryos are ruled out may be more likely to form a blastocyst. For four of the panelists, subject level sensitivity was larger for adjunct prediction than for traditional morphology. Differences in sensitivities were -1.9%, 3.8%, 3.9%, 5.8%, and 11.3%, for an average of 4.6% improvement in sensitivity.

LABELING

Labeling provided includes Instructions for Use, package labels, and training documents. The Eeva System Instructions for Use includes the indications for use, warnings, precautions, and instructions for the safe use of the device. The labeling satisfies the requirements of 21 CFR Part 801.109 Prescription devices.

Please see the Limitations section above for important Warnings and Precautions presented in the device labeling.

The Eeva System Training documents are consistent with the Instructions for Use.

{15}------------------------------------------------

RISKS TO HEALTH

Table 4 below identifies the risks to health that may be associated with use of an Assisted Reproduction Embryo Image Assessment System and the measures necessary to mitigate these risks.

Identified RiskMitigation Measures
Damage or Destructionof the EmbryoNon-Clinical Performance TestingSoftware Verification, Validation & Hazards AnalysisClinical TestingElectromagnetic Compatibility TestingElectrical Safety TestingLabelingTraining
Infection (Contamination ofDevice, Labware, andIncubator)Cleaning and Disinfection ValidationLabelingTraining
Incorrect Embryo DevelopmentPredictionNon-Clinical Performance TestingSoftware Verification, Validation & Hazards AnalysisClinical TestingLabelingTraining
ElectromagneticInterference/Electrical SafetyIssuesElectromagnetic Compatibility TestingElectrical Safety TestingLabeling
User ErrorLabelingTraining

Table 4: Risks to Health and Mitigation Measures

SPECIAL CONTROLS:

In combination with the general controls of the Food, Drug &Cosmetic Act, Assisted Reproduction Embryo Image Assessment Systems are subject to the following special controls:

    1. Clinical performance testing must demonstrate the safety and effectiveness of the device to predict embryo development. Classification performance (sensitivity and specificity) and predictive accuracy (Positive Value and Negative Predictive Value) must be assessed at the subject and embryo levels.
    1. Software validation, verification, and hazard analysis must be provided.
    1. Non-clinical performance testing data must demonstrate the performance characteristics of the device. Testing must include the following:
    • Total light exposure and output testing a.
    • b. A safety analysis must be performed based on maximum (worst-case) light exposure to embryos, which also includes the safety of the light wavelength(s) emitted by the device

{16}------------------------------------------------

  • Simulated-use testing C.
  • d. Mouse Embryo Assay (MEA) testing to assess whether device operation impacts growth and development of mouse embryos to the blastocyst stage
  • Cleaning and disinfection validation of reusable components e.
  • f. Package integrity and transit testing
  • g. Hardware fail-safe validation
  • h. Electrical equipment safety and electromagnetic compatibility testing
  • i. Prediction algorithm reproducibility
    1. Labeling must include the following:
    • a. A detailed summary of clinical performance testing, including any adverse events
    • b. Specific instructions, warnings, precautions, and training needed for safe use of the device
    • Appropriate electromagnetic compatibility information C.
    • d. Validated methods and instructions for cleaning and disinfection of reusable components.
    • e. Information identifying compatible cultureware and explain how they are used with the device

BENEFIT/RISK DETERMINATION

The risks of the device are based on the non-clinical laboratory studies as well as the data collected in the clinical studies described above. In the clinical studies, no device-related serious adverse events were observed, while six device-related non-serious adverse events were observed. In five of the six device-related non-serious adverse events, the subject's embryos were damaged during pipetting and embryo transfer in/out of the dish. In the remaining case, the subject's embryos were lost during the Day 4 dish change. In all cases, the IVF cycle continued with the remaining embryos for each subject. No device-related serious adverse events are anticipated with the use of the Eeva System and all non-serious adverse events are expected to be rare and are typical of those expected during IVF procedures. There are no additional procedure-related risks with the introduction of the Eeva System.

The primary clinical risks associated with the use of the Eeva System are a false positive (false Eeva = 'High') result or a false negative (false Eeva = 'Low') result. The risk of a false negative is the potential to "de-select" an embryo that would go on to form a blastocyst; however, this risk is mitigated by the likelihood that embryos with favorable morphology would be frozen for subsequent use. The risk of a false positive is that a sub-optimal embryo may be selected for transfer. However, Eeva test results are used only as an adjunct to morphology assessment, which identifies the good/fair embryos that are suitable for transfer.

The probable benefits of the device are based on the data collected in the clinical studies described above. The majority of patients studied had more embryos deemed suitable for transfer based on morphology grading than would be transferred. The Eeva test results provide a method to help narrow the selection of embryos post morphological selection. Results from the Pivotal Adjunct Study showed that the Eeva System offers a significant 37% improvement in specificity, the proportion of arrested embryos that were de-selected, when used as a sequential adjunctive tool to

{17}------------------------------------------------

morphology compared with morphology alone. This increased specificity was accompanied by an improved likelihood that an embryo will go on to form a blastocyst when the set of embryos are narrowed to those with an Eeva 'High' prediction. In sequential adjunct use of Eeva with morphology data on Day 3, the odds of an embryo forming a blastocyst on Day 5 were 2.6 times higher among embryos predicted to form a blastocyst than among embryos predicted to arrest. Because the majority of subjects in the clinical study had more embryos graded by morphology that were suitable for transfer than would be typically transferred, patients with multiple good embryos could benefit from the use of the Eeva System as an aid in identifying embryos not likely to form blastocysts, to help narrow the selection among those deemed suitable by morphologic grading. The maximum duration of benefit was not directly measured in the clinical study because observation ended with blastocyst formation. However, regardless of longer-term pregnancy outcomes, the potential duration of benefit can be approximated in terms of lost IVF cycles, if no embryos are selected for transfer that go on to form blastocysts.

In conclusion, given the information above, the data support a favorable benefit / risk profile for the Eeva System when it is used in a sequential adjunctive manner to Day 3 morphology assessment as an aid in the selection of embryo(s) for transfer, when multiple embryos are deemed suitable for transfer or freezing. The data support the conclusion that the probable benefits of using the Eeva System outweigh the probable risks. The device provides substantial benefits, and the risks can be mitigated by the use of general and the identified special controls.

CONCLUSION

The de novo for the Eeva System is granted and the device is classified under the following:

Product Code: PBH Device Type: Assisted Reproduction Embryo Image Assessment System Class: II (Special Controls) Regulation: 21 CFR 884.6195

§ 884.6195 Assisted Reproduction Embryo Image Assessment System.

(a)
Identification. An Assisted Reproduction Embryo Image Assessment System is a prescription device that is designed to obtain and analyze light microscopy images of developing embryos. This device provides information to aid in the selection of embryo(s) for transfer when there are multiple embryos deemed suitable for transfer or freezing.(b)
Classification. Class II (special controls). The special control(s) for this device are:(1) Clinical performance testing must demonstrate a reasonable assurance of safety and effectiveness of the device to predict embryo development. Classification performance (sensitivity and specificity) and predictive accuracy (Positive Predictive Value and Negative Predictive Value) must be assessed at the subject and embryo levels.
(2) Software validation, verification, and hazard analysis must be provided.
(3) Non-clinical performance testing data must demonstrate the performance characteristics of the device. Testing must include the following:
(i) Total light exposure and output testing;
(ii) A safety analysis must be performed based on maximum (worst-case) light exposure to embryos, which also includes the safety of the light wavelength(s) emitted by the device;
(iii) Simulated-use testing;
(iv) Mouse Embryo Assay testing to assess whether device operation impacts growth and development of mouse embryos to the blastocyst stage;
(v) Cleaning and disinfection validation of reusable components;
(vi) Package integrity and transit testing;
(vii) Hardware fail-safe validation;
(viii) Electrical equipment safety and electromagnetic compatibility testing; and
(ix) Prediction algorithm reproducibility.
(4) Labeling must include the following:
(i) A detailed summary of clinical performance testing, including any adverse events;
(ii) Specific instructions, warnings, precautions, and training needed for safe use of the device
(iii) Appropriate electromagnetic compatibility information;
(iv) Validated methods and instructions for cleaning and disinfection of reusable components; and
(v) Information identifying compatible cultureware and explain how they are used with the device.