(268 days)
Not Found
Yes
The device description explicitly states that the software "uses machine learning algorithms" and the intended use section mentions that imaging features are synthesized by an "artificial intelligence algorithm".
No.
This device is a diagnostic software that assists clinicians in assessing brain tissue abnormalities and providing an ASPECTS score. It does not directly treat or prevent a disease or condition.
Yes
Explanation: The "Intended Use" section explicitly states that "Brainomix 360 e-ASPECTS is a computer-aided diagnosis (CADx) software device used to assist the clinician in the assessment and characterization of brain tissue abnormalities using CT image data." This indicates its role in aiding diagnosis.
Yes
The device description explicitly states "Brainomix 360 e-ASPECTS is a stand-alone software device". While it processes image data from CT scanners and interacts with PACS, it is presented as a software product without any associated hardware components being part of the device itself.
Based on the provided information, this device is not an IVD (In Vitro Diagnostic).
Here's why:
- IVD Definition: In Vitro Diagnostic devices are used to examine specimens (like blood, urine, or tissue) taken from the human body to provide information for diagnosis, monitoring, or screening.
- Brainomix 360 e-ASPECTS Function: This device analyzes medical images (CT scans) of the brain. It does not analyze biological specimens.
- Intended Use: The intended use clearly states it's a "computer-aided diagnosis (CADx) software device used to assist the clinician in the assessment and characterization of brain tissue abnormalities using CT image data." This is consistent with medical imaging analysis, not in vitro diagnostics.
Therefore, Brainomix 360 e-ASPECTS falls under the category of medical imaging software or a computer-aided diagnosis device, not an In Vitro Diagnostic device.
No
The letter does not state that the FDA has reviewed and approved or cleared a Predetermined Change Control Plan (PCCP) for this specific device.
Intended Use / Indications for Use
Brainomix 360 e-ASPECTS is a computer-aided diagnosis (CADx) software device used to assist the clinician in the assessment and characterization of brain tissue abnormalities using CT image data.
The software automatically registers images and uses an Atlas to segment and analyze ASPECTS regions. Brainomix 360 e-ASPECTS extracts image data from individual voxels in the image to provide analysis and computer and relates the analysis to the atlas defined ASPECTS regions. The imaging features are then synthesized by an artificial intelligence algorithm into a single ASPECTS (Alberta Stroke Program Early CT) Score.
Brainomix 360 e-ASPECTS is indicated for evaluation of patients presenting for diagnostic imaging workup with known MCA or ICA occlusion, for evaluation of extent of disease. Extent of disease refers to the number of ASPECTS regions affected which is reflected in the total score. Brainomix 360 e-ASPECTS provides information that may be useful in the characterization of ischemic brain tissue injury during image interpretation (within 6 hours from time last known well).
Brainomix 360 e-ASPECTS provides a comparative analysis to the ASPECTS standard of care radiologist assessment by providing highlighted ASPECTS regions and an automated editable ASPECTS score for clinician review. Brainomix 360 e-ASPECTS additionally provides a visualization of the voxels contributing to the automated ASPECTS score and the voxels excluded from the automated ASPECTS score.
Limitations:
- Brainomix 360 e-ASPECTS is not intended for primary interpretation of CT images. It is used to assist physician evaluation.
- Brainomix 360 e-ASPECTS has been validated in patients with known MCA or ICA occlusion prior to ASPECTS scoring.
- Brainomix 360 e-ASPECTS is not suitable for use on brain scans displaying neurological pathologies other than acute stroke, such as tumours or abscesses, haemorrhagic transformation and hematoma.
- Use of Brainomix 360 e-ASPECTS Module in clinical settings other than brain ischemia within 6 hours from time last known well, caused by known ICA or MCA occlusions has not been tested.
- Brainomix 360 e-ASPECTS has only been validated and is intended to be used in patient populations aged over 21.
- Brainomix 360 e-ASPECTS has been validated and is intended to be used on Siemens Somatom Definition scanners.
- Brainomix 360 e-ASPECTS is not intended for mobile diagnostic use. Images viewed on a mobile platform are compressed preview images and not for diagnostic interpretation.
Contraindications/Exclusions/Cautions:
- Patient motion: Excessive patient motion leading to artifacts that make the scan technically inadequate.
- Haemorrhagic Transformation, Hematoma.
Product codes (comma separated list FDA assigned to the subject device)
POK
Device Description
Brainomix 360 e-ASPECTS is a stand-alone software device which uses machine learning algorithms to automatically process NCCT (Non-contrast CT scans) brain image data to provide an output ASPECTS score based on the Alberta Stroke Program Early CT Score (ASPECTS) guidelines.
The post-processing image results and ASPECTS score are identified based on regional imaging features and overlayed onto brain scan images. e-ASPECTS provides an automatic ASPECTS score based on the input CT data for the physician. The score includes which ASPECTS regions are identified based on regional imaging features derived from non-contrast computed tomography (NCCT) brain image data. The results are generated based on the Alberta Stroke Program Early CT Score (ASPECTS) guidelines and provided to the clinician for review and verification. At the discretion of the clinician, the scores may be adjusted based on the clinician's judgment.
Brainomix 360 e-ASPECTS can connect with other DICOM-compliant devices, for example to transfer NCCT scans from a Picture Archiving and Communication System (PACS) to Brainomix 360 e-ASPECTS software for processing.
Results and images can be sent to a PACS via DICOM transfer and can be viewed on a PACS workstation or via a web user interface on any machine contained and accessed within a hospital network and firewall and with a connection to the Brainomix 360° e-ASPECTS software (e.g. a LAN connection).
Brainomix 360 e-ASPECTS notification capabilities enable clinicians to preview images through via email notification with result image attachments.
Images that are previewed via e-mail are compressed, are for preview purposes only, and not intended for diagnostic use beyond notification.
Brainomix 360 e-ASPECTS is not intended for mobile diagnostic use. Notified clinicians are responsible for viewing non-compressed images on a diagnostic viewer and engaging in appropriate patient evaluation and relevant discussion with a treating physician before making care-related decisions or requests.
Brainomix 360 e-ASPECTS provides an automated workflow which will automatically process image data received by the system in accordance with pre-configured user DICOM routing preferences.
Once received, image processing is automatically applied. Once any image processing has completed, notifications are sent to pre-configured users to inform that the image processing results are ready. User can then access and review the results and images via the Web User Interface case viewer or PACS viewer.
Brainomix 360 e-ASPECTS principal workflow for NCCT includes the following key steps:
- NCCT Image Loading.
- Automated image analysis and processing to identify and visualize the voxels which have been included in the ASPECTS score and the voxels which have been excluded from the ASPECTS score (Also referred to as a 'heat map').
- Automated image analysis and processing to register the subject image to an atlas to segment and highlight ASPECTS regions and to display whether or not each region is qualified as contributing to the ASPECTS score.
- Notifications and alerts to users.
- Generation of a summary results report.
- Presentation of results for review and analysis by users.
Once the physician has been notified of availability of the ASPECTS score, the system requires that the physician confirms that the case in question is for an ICA occlusion. The ASPECTS results, including the ASPECTS score, indication of affected side, affected ASPECTS regions and voxel-wise analysis (shown as a heatmap of voxels 'contributing to e-ASPECTS score' and a heat map of voxels 'excluded from e-ASPECTS score') can be exported as a report and/or sent to the Picture Archiving and Communications System (PACS).
Mentions image processing
Yes
Mentions AI, DNN, or ML
Yes
Input Imaging Modality
CT
Anatomical Site
Brain/Head
Indicated Patient Age Range
Over 21 years
Intended User / Care Setting
Neuroradiologist/Clinician, Clinical/Hospital environment
Description of the training set, sample size, data source, and annotation protocol
Not Found
Description of the test set, sample size, data source, and annotation protocol
Stand-alone Performance Testing:
Sample Size: 256 non-contrast CT scans
Data Source: From patients with suspected and later confirmed acute ischemic stroke with available follow up imaging at 24 hours, from 8 different USA institutions. Patients were admitted between March 2014 and March 2020.
Annotation Protocol: Ground truth ASPECTS score was 6 in 213 patients.
Digital phantom testing:
Sample Size: 200 digital phantom dataset
Data Source: Synthetic digital phantom data created to provide a ground truth against which the performance of the heatmaps can be assessed and demonstrated.
Annotation Protocol: Not explicitly stated, but implies a ground truth for hypodensities.
Clinical Studies (MRMC study):
Sample Size: 54 clinically representative NCCT retrospective scans
Data Source: Patients with acute ischemic stroke affecting the middle cerebral artery territory and eligible for acute reperfusion therapy. Patients must have had no evidence of intracranial hemorrhage and imaging data had to be of adequate quality with associated demographic and follow up imaging available.
Annotation Protocol: Data truthing was performed by three expert neuroradiologists with access to clinical data and follow up imaging.
Summary of Performance Studies (study type, sample size, AUC, MRMC, standalone performance, key results)
Software Verification and Validation Testing:
Study type: Software testing/Algorithm validation testing
Sample size: Not specified
Key results: Complies with DICOM. Met all design requirements and specifications.
Stand-alone Performance Testing:
Study type: Stand-alone performance testing
Sample size: 256 non-contrast CT scans
AUC: 83% (81-85, 95% Cl)
Key results: Performance generalizes to a range of image acquisition and reconstruction parameters, scanner types, and manufacturers. Consistent performance in subgroups dichotomised by median age and sex. Performance was slightly lower in the non-proximal vessel occlusion subgroup (AUC, 78% versus 84%) but not statistically significant. Consistent performance observed between grouped cortical ASPECTS regions and grouped basal ganglia ASPECTS regions, though individual region performance varied.
Digital phantom testing:
Study type: Digital phantom testing
Sample size: 200 digital phantom dataset
Key results: Showed a correlation (r>=0.95) between the volumes of the e-ASPECTS heatmaps and the volumes of synthetic hypodensities generated in the phantom dataset.
Clinical Studies:
Study type: Multiple reader multiple case (MRMC) cross-over study
Sample size: 54 clinically representative NCCT retrospective scans read by 10 clinical readers (4 neurologists and 6 radiologists)
MRMC: Yes
AUC: Statistically significant improvement of 0.02 from 0.81 to 0.83 (p=0.028) when readers were assisted by Brainomix 360 e-ASPECTS compared to unassisted reading.
Key results: Improved AUC driven by an increase in sensitivity (66 to 70%) and a small improvement in specificity (96%). Overall percentage agreement (accuracy) improved from 93% to 94%. Consistent impact across neuroradiologist and neurologist readers. Greater magnitude of AUC increases for users with lower unassisted performances. Overall ASPECTS score was more consistent between readers with use of e-ASPECTS. Reduction in performance variation between different readers when Brainomix 360 e-ASPECTS outputs are available. Impact consistent in both deep and cortical ASPECTS regions.
Key Metrics (Sensitivity, Specificity, PPV, NPV, etc.)
Stand-alone Performance Testing:
Sensitivity: 68% (57-72)
Specificity: 97% (86-98)
Clinical Studies (MRMC study):
Sensitivity (positive percentage agreement): from 66% to 70% (aided vs unaided)
Specificity (negative percentage agreement): 96% (aided vs unaided, small improvement)
Accuracy (overall percentage agreement): 93% to 94% (aided vs unaided)
Predicate Device(s): If the device was cleared using the 510(k) pathway, identify the Predicate Device(s) K/DEN number used to claim substantial equivalence and list them here in a comma separated list exactly as they appear in the text. List the primary predicate first in the list.
Reference Device(s): Identify the Reference Device(s) K/DEN number and list them here in a comma separated list exactly as they appear in the text.
Not Found
Predetermined Change Control Plan (PCCP) - All Relevant Information for the subject device only (e.g. presence / absence, what scope was granted / cleared under the PCCP, any restrictions, etc).
Not Found
§ 892.2060 Radiological computer-assisted diagnostic software for lesions suspicious of cancer.
(a)
Identification. A radiological computer-assisted diagnostic software for lesions suspicious of cancer is an image processing prescription device intended to aid in the characterization of lesions as suspicious for cancer identified on acquired medical images such as magnetic resonance, mammography, radiography, or computed tomography. The device characterizes lesions based on features or information extracted from the images and provides information about the lesion(s) to the user. Diagnostic and patient management decisions are made by the clinical user.(b)
Classification. Class II (special controls). The special controls for this device are:(1) Design verification and validation must include:
(i) A detailed description of the image analysis algorithms including, but not limited to, a detailed description of the algorithm inputs and outputs, each major component or block, and algorithm limitations.
(ii) A detailed description of pre-specified performance testing protocols and dataset(s) used to assess whether the device will improve reader performance as intended.
(iii) Results from performance testing protocols that demonstrate that the device improves reader performance in the intended use population when used in accordance with the instructions for use. The performance assessment must be based on appropriate diagnostic accuracy measures (
e.g., receiver operator characteristic plot, sensitivity, specificity, predictive value, and diagnostic likelihood ratio). The test dataset must contain sufficient numbers of cases from important cohorts (e.g., subsets defined by clinically relevant confounders, effect modifiers, concomitant diseases, and subsets defined by image acquisition characteristics) such that the performance estimates and confidence intervals of the device for these individual subsets can be characterized for the intended use population and imaging equipment.(iv) Standalone performance testing protocols and results of the device.
(v) Appropriate software documentation (
e.g., device hazard analysis; software requirements specification document; software design specification document; traceability analysis; and description of verification and validation activities including system level test protocol, pass/fail criteria, results, and cybersecurity).(2) Labeling must include:
(i) A detailed description of the patient population for which the device is indicated for use.
(ii) A detailed description of the intended reading protocol.
(iii) A detailed description of the intended user and recommended user training.
(iv) A detailed description of the device inputs and outputs.
(v) A detailed description of compatible imaging hardware and imaging protocols.
(vi) Warnings, precautions, and limitations, including situations in which the device may fail or may not operate at its expected performance level (
e.g., poor image quality or for certain subpopulations), as applicable.(vii) Detailed instructions for use.
(viii) A detailed summary of the performance testing, including: Test methods, dataset characteristics, results, and a summary of sub-analyses on case distributions stratified by relevant confounders (
e.g., lesion and organ characteristics, disease stages, and imaging equipment).
0
Image /page/0/Picture/0 description: The image shows the logo for the U.S. Food & Drug Administration (FDA). The logo consists of two parts: the Department of Health & Human Services seal on the left and the FDA acronym followed by the full name of the agency on the right. The FDA part of the logo is in blue, with the acronym in a solid blue square and the agency name in a lighter blue. The text reads "FDA U.S. FOOD & DRUG ADMINISTRATION".
Brainomix Limited % Gwilym Owen Head of Quality and Regulatory Suite 11-14, Suffolk House, 263 Banbury Road Oxford. Oxfordshire OX2 7HN UNITED KINGDOM
February 23, 2023
Re: K221564
Trade/Device Name: Brainomix 360 e-ASPECTS Regulation Number: 21 CFR 892.2060 Regulation Name: Radiological computer-assisted diagnostic software for lesions suspicious of cancer Regulatory Class: Class II Product Code: POK Dated: January 20, 2023 Received: January 23, 2023
Dear Gwilym Owen:
We have reviewed your Section 510(k) premarket notification of intent to market the device referenced above and have determined the device is substantially equivalent (for the indications for use stated in the enclosure) to legally marketed predicate devices marketed in interstate commerce prior to May 28, 1976, the enactment date of the Medical Device Amendments, or to devices that have been reclassified in accordance with the provisions of the Federal Food, Drug, and Cosmetic Act (Act) that do not require approval of a premarket approval application (PMA). You may, therefore, market the device, subject to the general controls provisions of the Act. Although this letter refers to your product as a device, please be aware that some cleared products may instead be combination products. The 510(k) Premarket Notification Database located at https://www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfpmn/pmn.cfm identifies combination product submissions. The general controls provisions of the Act include requirements for annual registration, listing of devices, good manufacturing practice, labeling, and prohibitions against misbranding and adulteration. Please note: CDRH does not evaluate information related to contract liability warranties. We remind you, however, that device labeling must be truthful and not misleading.
If your device is classified (see above) into either class II (Special Controls) or class III (PMA), it may be subject to additional controls. Existing major regulations affecting your device can be found in the Code of Federal Regulations, Title 21, Parts 800 to 898. In addition, FDA may publish further announcements concerning your device in the Federal Register.
Please be advised that FDA's issuance of a substantial equivalence determination does not mean that FDA has made a determination that your device complies with other requirements of the Act or any Federal statutes and regulations administered by other Federal agencies. You must comply with all the Act's requirements, including, but not limited to: registration and listing (21 CFR Part 807); labeling (21 CFR Part 801); medical device reporting of medical device-related adverse events) (21 CFR 803) for
1
devices or postmarketing safety reporting (21 CFR 4, Subpart B) for combination products (see https://www.fda.gov/combination-products/guidance-regulatory-information/postmarketing-safety-reportingcombination-products); good manufacturing practice requirements as set forth in the quality systems (QS) regulation (21 CFR Part 820) for devices or current good manufacturing practices (21 CFR 4, Subpart A) for combination products; and, if applicable, the electronic product radiation control provisions (Sections 531-542 of the Act); 21 CFR 1000-1050.
Also, please note the regulation entitled, "Misbranding by reference to premarket notification" (21 CFR Part 807.97). For questions regarding the reporting of adverse events under the MDR regulation (21 CFR Part 803), please go to https://www.fda.gov/medical-device-safety/medical-device-reportingmdr-how-report-medical-device-problems.
For comprehensive regulatory information about mediation-emitting products, including information about labeling regulations, please see Device Advice (https://www.fda.gov/medicaldevices/device-advice-comprehensive-regulatory-assistance) and CDRH Learn (https://www.fda.gov/training-and-continuing-education/cdrh-learn). Additionally, you may contact the Division of Industry and Consumer Education (DICE) to ask a question about a specific regulatory topic. See the DICE website (https://www.fda.gov/medical-device-advice-comprehensive-regulatoryassistance/contact-us-division-industry-and-consumer-education-dice) for more information or contact DICE by email (DICE@fda.hhs.gov) or phone (1-800-638-2041 or 301-796-7100).
Sincerely.
Jessica Lamb
Jessica Lamb Ph.D. Assistant Director Imaging Software Team DHT8B: Division of Radiological Imaging Devices and Electronic Products OHT8: Office of Radiological Health Office of Product Evaluation and Quality Center for Devices and Radiological Health
Enclosure
2
Indications for Use
510(k) Number (if known) K221564
Device Name Brainomix 360 e-ASPECTS
Indications for Use (Describe)
Brainomix 360 e-ASPECTS is a computer-aided diagnosis (CADx) software device used to assist the clinician in the assessment and characterization of brain tissue abnormalities using CT image data.
The software automatically registers images and uses an Atlas to segment and analyze ASPECTS regions. Brainomix 360 e-ASPECTS extracts image data from individual voxels in the image to provide analysis and computer and relates the analysis to the atlas defined ASPECTS regions. The imaging features are then synthesized by an artificial intelligence algorithm into a single ASPECTS (Alberta Stroke Program Early CT) Score.
Brainomix 360 e-ASPECTS is indicated for evaluation of patients presenting for diagnostic imaging workup with known MCA or ICA occlusion, for evaluation of extent of disease. Extent of disease refers to the number of ASPECTS regions affected which is reflected in the total score. Brainomix 360 e-ASPECTS provides information that may be useful in the characterization of ischemic brain tissue injury during image interpretation (within 6 hours from time last known well).
Brainomix 360 e-ASPECTS provides a comparative analysis to the ASPECTS standard of care radiologist assessment by providing highlighted ASPECTS regions and an automated editable ASPECTS score for clinician review. Brainomix 360 e-ASPECTS additionally provides a visualization of the voxels contributing to the automated ASPECTS score and the voxels excluded from the automated ASPECTS score.
Limitations:
-
Brainomix 360 e-ASPECTS is not intended for primary interpretation of CT images. It is used to assist physician evaluation.
-
Brainomix 360 e-ASPECTS has been validated in patients with known MCA or ICA occlusion prior to ASPECTS scoring.
-
Brainomix 360 e-ASPECTS is not suitable for use on brain scans displaying neurological pathologies other than acute stroke, such as tumours or abscesses, haemorrhagic transformation and hematoma.
-
Use of Brainomix 360 e-ASPECTS Module in clinical settings other than brain ischemia within 6 hours from time last known well, caused by known ICA or MCA occlusions has not been tested.
-
Brainomix 360 e-ASPECTS has only been validated and is intended to be used in patient populations aged over 21.
-
Brainomix 360 e-ASPECTS has been validated and is intended to be used on Siemens Somatom Definition scanners.
-
Brainomix 360 e-ASPECTS is not intended for mobile diagnostic use. Images viewed on a mobile platform are compressed preview images and not for diagnostic interpretation.
Contraindications/Exclusions/Cautions:
· Patient motion: Excessive patient motion leading to artifacts that make the scan technically inadequate.
- · Haemorrhagic Transformation, Hematoma.
Type of Use (Select one or both, as applicable)
Prescription Use (Part 21 CFR 801 Subpart D)
| Over-The-Counter Use (21 CFR 801 Subpart C)
3
CONTINUE ON A SEPARATE PAGE IF NEEDED.
This section applies only to requirements of the Paperwork Reduction Act of 1995.
DO NOT SEND YOUR COMPLETED FORM TO THE PRA STAFF EMAIL ADDRESS BELOW.
The burden time for this collection of information is estimated to average 79 hours per response, including the time to review instructions, search existing data sources, gather and maintain the data needed and complete and review the collection of information. Send comments regarding this burden estimate or any other aspect of this information collection, including suggestions for reducing this burden, to:
Department of Health and Human Services Food and Drug Administration Office of Chief Information Officer Paperwork Reduction Act (PRA) Staff PRAStaff(@fda.hhs.gov
"An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB number."
4
Image /page/4/Picture/0 description: The image shows the logo for BRAINOMIX. The logo consists of a stylized brain icon on the left, followed by the word "BRAINOMIX" in bold, sans-serif font. The brain icon is a gradient of teal and white, while the letters of the word "BRAINOMIX" are dark gray, except for the "AI" which is teal.
510(K) Summary of Safety and Effectiveness
Date of summary: | 23rd February 2023 |
---|---|
Submitter's name: | Brainomix Limited |
Submitter's address: | Brainomix Limited, Suites 11-14 Suffolk House, 263 Banbury Road, |
Oxford. OX2 7HN. United Kingdom | |
Submitter's contact: | Gwilym Owen |
Telephone number: | +44 (0)1865 582730 |
Device Proprietary Name: | Brainomix 360 e-ASPECTS |
Device Common Name(s): | CADx |
Classification Name: | Class II |
Product Code: | POK |
Regulation No: | 21 C.F.R. §892.2060 |
Brainomix 360 e-ASPECTS is Substantially Equivalent to the following Legally Marketed device:
Predicate Devices
510(k) Number | Trade Name | Manufacturer |
---|---|---|
K200760 | Rapid ASPECTS | iSchemaView Inc |
Indications for Use
Brainomix 360 e-ASPECTS is a computer-aided diagnosis (CADx) software device used to assist the clinician in the assessment and characterization of brain tissue abnormalities using CT image data.
The software automatically registers images and uses an Atlas to segment and analyze ASPECTS regions. Brainomix 360 e-ASPECTS extracts image data from individual voxels in the image to provide analysis and computer analytics and relates the analysis to the atlas defined ASPECTS regions. The imaging features are then synthesized by an artificial intelligence algorithm into a single ASPECTS (Alberta Stroke Program Early CT) Score.
Brainomix 360 e-ASPECTS is indicated for evaluation of patients presenting for diagnostic imaging workup with known MCA or ICA occlusion, for evaluation of extent of disease. Extent of disease refers to the number of ASPECTS regions affected which is reflected in the total score. Brainomix 360 e-ASPECTS provides information that may be useful in the characterization of ischemic brain tissue injury during image interpretation (within 6 hours from time last known well).
5
Image /page/5/Picture/0 description: The image shows the logo for BRAINOMIX. The logo consists of a stylized brain icon on the left, followed by the word "BRAINOMIX" in a sans-serif font. The brain icon is teal, and the "A" in "BRAINOMIX" is also teal, while the rest of the letters are dark gray. The overall design is modern and clean.
Suites 11-14 Suffolk House 263 Banbury Road Oxford OX2 7HN
Brainomix 360 e-ASPECTS provides a comparative analysis to the ASPECTS standard of care radiologist assessment by providing highlighted ASPECTS regions and an automated editable ASPECTS score for clinician review. Brainomix 360 e-ASPECTS additionally provides a visualization of the voxels contributing to the automated ASPECTS score and the voxels excluded from the automated ASPECTS score.
Limitations:
- Brainomix 360 e-ASPECTS is not intended for primary interpretation of CT images. It is used 1. to assist physician evaluation.
- Brainomix 360 e-ASPECTS has been validated in patients with known MCA or ICA occlusion 2. prior to ASPECTS scoring.
-
- Brainomix 360 e-ASPECTS is not suitable for use on brain scans displaying neurological pathologies other than acute stroke, such as tumours or abscesses, haemorrhagic transformation and hematoma.
-
- Use of Brainomix 360 e-ASPECTS Module in clinical settings other than brain ischemia within 6 hours from time last known well, caused by known ICA or MCA occlusions has not been tested.
-
- Brainomix 360 e-ASPECTS has only been validated and is intended to be used in patient populations aged over 21.
-
- Brainomix 360 e-ASPECTS has been validated and is intended to be used on Siemens Somatom Definition scanners.
-
- Brainomix 360 e-ASPECTS is not intended for mobile diagnostic use. Images viewed on a mobile platform are compressed preview images and not for diagnostic interpretation.
Contraindications/Exclusions/Cautions:
- Patient motion: Excessive patient motion leading to artifacts that make the scan technically inadequate.
- . Haemorrhagic Transformation, Hematoma.
Device Description
Brainomix 360 e-ASPECTS is a stand-alone software device which uses machine learning algorithms to automatically process NCCT (Non-contrast CT scans) brain image data to provide an output ASPECTS score based on the Alberta Stroke Program Early CT Score (ASPECTS) guidelines.
The post-processing image results and ASPECTS score are identified based on regional imaging features and overlayed onto brain scan images. e-ASPECTS provides an automatic ASPECTS score based on the input CT data for the physician. The score includes which ASPECTS regions are identified based on regional imaging features derived from non-contrast computed tomography (NCCT) brain image data. The results are generated based on the Alberta Stroke Program Early CT
6
Image /page/6/Picture/0 description: The image shows the logo for BRAINOMIX. The logo consists of a stylized brain icon on the left, followed by the word "BRAINOMIX" in bold, sans-serif font. The brain icon is teal, and the "AI" in "BRAINOMIX" is also teal, creating a visual connection between the brain and the concept of artificial intelligence.
Suites 11-14 Suffolk House 263 Banbury Road Oxford OX2 7HN
Score (ASPECTS) guidelines and provided to the clinician for review and verification. At the discretion of the clinician, the scores may be adjusted based on the clinician's judgment.
Brainomix 360 e-ASPECTS can connect with other DICOM-compliant devices, for example to transfer NCCT scans from a Picture Archiving and Communication System (PACS) to Brainomix 360 e-ASPECTS software for processing.
Results and images can be sent to a PACS via DICOM transfer and can be viewed on a PACS workstation or via a web user interface on any machine contained and accessed within a hospital network and firewall and with a connection to the Brainomix 360° e-ASPECTS software (e.g. a LAN connection)
Brainomix 360 e-ASPECTS notification capabilities enable clinicians to preview images through via email notification with result image attachments.
lmages that are previewed via e-mail are compressed, are for preview purposes only, and not intended for diagnostic use beyond notification.
Brainomix 360 e-ASPECTS is not intended for mobile diagnostic use. Notified clinicians are responsible for viewing non-compressed images on a diagnostic viewer and engaging in appropriate patient evaluation and relevant discussion with a treating physician before making care-related decisions or requests.
Brainomix 360 e-ASPECTS provides an automated workflow which will automatically process image data received by the system in accordance with pre-configured user DICOM routing preferences.
Once received, image processing is automatically applied. Once any image processing has completed, notifications are sent to pre-configured users to inform that the image processing results are ready. User can then access and review the results and images via the Web User Interface case viewer or PACS viewer.
Brainomix 360 e-ASPECTS principal workflow for NCCT includes the following key steps:
- NCCT Image Loading.
- . Automated image analysis and processing to identify and visualize the voxels which have been included in the ASPECTS score and the voxels which have been excluded from the ASPECTS score (Also referred to as a 'heat map').
- Automated image analysis and processing to register the subject image to an atlas to segment and highlight ASPECTS regions and to display whether or not each region is qualified as contributing to the ASPECTS score.
- . Notifications and alerts to users.
- Generation of a summary results report.
- Presentation of results for review and analysis by users.
7
Image /page/7/Picture/0 description: The image shows the logo for BRAINOMIX. The logo consists of a stylized brain image on the left, followed by the word "BRAINOMIX" in a sans-serif font. The "A" in "BRAINOMIX" is colored in a gradient from light blue to dark blue, while the rest of the letters are dark gray.
Suites 11-14 Suffolk House 263 Banburv Road Oxford OX2 7HN
Once the physician has been notified of availability of the ASPECTS score, the system requires that the physician confirms that the case in question is for an ICA occlusion. The ASPECTS results, including the ASPECTS score, indication of affected side, affected ASPECTS regions and voxel-wise analysis (shown as a heatmap of voxels 'contributing to e-ASPECTS score' and a heat map of voxels 'excluded from e-ASPECTS score') can be exported as a report and/or sent to the Picture Archiving and Communications System (PACS).
Technological Characteristics
Brainomix 360 e-ASPECTS is a machine learning implementation using the processing pipeline below. Brainomix 360 e-ASPECTS provides an automatic ASPECT score based on the case input file for the physician. The score includes which ASPECT regions are identified based on a voxel-wise of non-contrast computed tomography (NCCT) brain image data based on the random forest machine learning technique. The results are generated based on the Alberta Stroke Program Early CT Score (ASPECTS) guidelines and provided to the clinician for review and verification.
ASPECTS regions are generated as an overlay by registering the subject NCCT scan to an atlas. The Brainomix 360 e-ASPECTS algorithm analyses the voxels in the subject NCCT scan to identify voxels contributing to, or excluded from, the e-ASPECTS score. The regions then contribute towards the determination of an ASPECTS score which must be reviewed by the physician.
ASPECTS regions identified as contributing to the ASPECTS score are highlighted and labelled for the physician. The voxel-wise analysis is visualized for the physician as shaded heat maps showing voxels contributing to the e-ASPECTS score and voxels excluded from the e-ASPECTS score.
Physicians can, at their discretion and depending on their level of agreement with the processing results, manually edit the ASPECTS score by manually selecting ASPECTS regions to be included or excluded from the calculation of the ASPECTS score.
The following figure provides the general layout of the ASPECTS display as presented by Brainomix 360 e-ASPECTS
8
Image /page/8/Picture/0 description: The image shows the logo for BRAINOMIX. The logo consists of a stylized brain icon on the left, followed by the word "BRAINOMIX" in a sans-serif font. The brain icon is a gradient of light blue to dark blue, and the word "BRAINOMIX" is in a dark gray color, with the "AI" in a gradient of light blue to dark blue.
Suites 11-14 Suffolk House 263 Banbury Road Oxford OX2 7HN
Image /page/8/Picture/3 description: The image shows a Brainomix 360 scan with a patient ID of EX127 and a case ID of 7. The scan date is 2018-12-27 09:01:27. The ASPECTS score is 7, with the right side showing M1, Lentiform, and Insula. The image also shows an unannotated scan and results with highlighted regions.
Substantial Equivalence Discussion
Both proposed and predicate devices have the same intended use. Both devices are computer-aided diagnosis (CADx) software devices used to assist clinicians in the assessment and characterization of brain tissue abnormalities using CT image data.
Both devices use an atlas to segment and identify ASPECTS regions and use artificial intelligence algorithms to analyse image data to facilitate the evaluation of extent of disease and to identify and count the affected ASPECTS regions to generate an ASPECTS score. Both devices display and highlight the affected ASPECTS regions along with the automatically generated ASPECTS score
Both devices are not intended for primary interpretation of CT images and both require that cases processed meet pre-requisite criteria such that a primary diagnosis of ICA or MCA occlusion has already been made by clinicians prior to accessing the processing results and the resulting ASPECTS score.
Both devices are indicated for cases within 6 hours from time last known well.
Both devices include a gating condition requiring users to confirm that the case in question is for a confirmed ICA or MCA occlusion before processing results are made available.
Both devices include pre-processing steps to straighten NCCT scans and to register the NCCT scans to an atlas of ASPECTS regions in order to identify and segment ASPECTS regions on the subject NCCT scan.
9
Image /page/9/Picture/0 description: The image shows the logo for BRAINOMIX. The logo consists of a stylized brain icon on the left, followed by the word "BRAINOMIX" in bold, sans-serif font. The brain icon is teal, and the "AI" in "BRAINOMIX" is also teal, creating a visual connection between the brain and the concept of artificial intelligence.
Suites 11-14 Suffolk House 263 Banbury Road Oxford OX2 7HN
In both cases, the algorithms identify signs indicative of ischemic damage and relate these to the segmented ASPECTS regions in order to determine whether or not individual ASPECTS regions are included as contributing to a reduced ASPECTS score.
In both cases, the segmented ASPECTS regions are labelled and presented to users in the software User Interface with the regions highlighted depending on whether they have been determined to affect the e-ASPECTS score or not. In both cases, users can manually edit and override the automated result for one or more ASPECTS regions by selecting the regions.
Both predicate and proposed devices use trained machine learning AI algorithms to analyse NCCT scans to identify signs indicative of ischemic damage. Both devices use a random forest machine learning technique to classify tissue in brains scans to identify both early/acute ischemic changes and old/non-acute ischemic changes to differentiate old or prior signs of stroke from the acute stroke for which the ASPECTS methodology is intended. In both devices, signs of non-acute ischemic change are masked to ensure that these do not contribute towards the determination of the output ASPECTS score.
The following principal difference exists between Brainomix 360 e-ASPECTS and the predicate device:
In addition to highlighting affected ASPECTS regions which is a common technical characteristic of both subject and predicate devices, the Brainomix 360 e-ASPECTS device includes the visualization of the analysis of individual voxels underlying the scoring of ASPECTS regions and the overall ASPECTS score as a heat map.
| Characteristic/Parameter | Brainomix 360 e-ASPECTS -
Proposed Device | iSchemaView Rapid ASPECTS -
Predicate Device (K200760) |
|--------------------------|----------------------------------------------|-----------------------------------------------------------|
| Product Code | POK | POK |
10
Image /page/10/Picture/0 description: The image shows the logo for BRAINOMIX. The logo consists of a stylized brain icon on the left, followed by the word "BRAINOMIX" in a sans-serif font. The "A" in "BRAINOMIX" is a gradient of blue and green, while the rest of the letters are gray.
Suites 11-14 Suffolk House 263 Banburv Road Oxford OX2 7HN
Indications for Use
Brainomix 360 e-ASPECTS is a computer-aided diagnosis (CADx) software device used to assist the clinician in the assessment and characterization of brain tissue abnormalities using CT image data.
The software automatically registers images and uses an Atlas to segment and analyze ASPECTS regions. Brainomix 360 e-ASPECTS extracts image data from individual voxels in the image to provide analysis and computer analytics and relates the analysis to the atlas defined ASPECTS regions. The imaging features are then synthesized by an artificial intelligence algorithm into a single ASPECTS (Alberta Stroke Program Early CT) Score.
Brainomix 360 e-ASPECTS is indicated for evaluation of patients presenting for diagnostic imaging workup with known MCA or ICA occlusion, for evaluation of extent of disease. Extent of disease refers to the number of ASPECTS regions affected which is reflected in the total score.
Brainomix 360 e-ASPECTS provides information that may be useful in the characterization of ischemic brain tissue injury during image interpretation (within 6 hours from time last known well).
Rapid ASPECTS is a computer-aided diagnosis (CADx) software device used to assist the clinician in the assessment and characterization of brain tissue abnormalities using CT image data. The Software automatically registers images and segments and analyzes ASPECTS Regions of Interest (ROIs). Rapid ASPECTS extracts image data for the ROI(s) to provide analysis and computer analytics based on morphological characteristics. The imaging features are then synthesized by an artificial intelligence algorithm into a single ASPECTS (Alberta Stroke Program Early CT) Score. Rapid ASPECTS is indicated for evaluation of patients presenting for diagnostic imaging workup with known MCA or ICA occlusion, for evaluation of extent of disease. Extent of disease refers to the number of ASPECTS regions affected which is reflected in the total score. This device provides information that may be useful in the characterization of early ischemic brain tissue injury during image interpretation (within 6 hours). Rapid ASPECTS provides a comparative analysis to the ASPECTS standard of care radiologist assessment using the ASPECTS atlas definitions and atlas display including highlighted ROIs and numerical scoring.
11
Image /page/11/Picture/0 description: The image shows the word "BRAINOMIX" with a logo to the left. The logo is a teal-colored graphic that resembles a brain. The word "BRAINOMIX" is written in a sans-serif font, with the "A" in "BRAINOMIX" being teal and the rest of the letters being gray.
Suites 11-14 Suffolk House 263 Banbury Road Oxford OX2 7HN
Brainomix 360 e-ASPECTS provides a comparative analysis to the ASPECTS standard of care radiologist assessment by providing highlighted ASPECTS regions and an automated editable ASPECTS score for clinician review. Brainomix 360 e-ASPECTS additionally provides a visualization of the voxels contributing to the automated ASPECTS score and the voxels excluded from the automated ASPECTS score.
Limitations:
- Brainomix 360 e-ASPECTS 1. is not intended for primary interpretation of CT images. It is used to assist physician evaluation.
-
- Brainomix 360 e-ASPECTS has been validated in patients with known MCA or ICA occlusion prior to ASPECTS scoring.
-
- Brainomix 360 e-ASPECTS is not suitable for use on brain scans displaying neurological pathologies other than acute stroke, such as tumors or abscesses, hemorrhagic transformation and hematoma.
-
- Use of Brainomix 360 e-ASPECTS Module in clinical settings other than brain ischemia within 6 hours from time last known well, caused by known ICA or
Limitations:
-
Rapid ASPECTS is not intended for primary interpretation of CT images, it is used to assist physician evaluation.
-
Rapid ASPECTS has been validated in patients with known MCA or ICA Occlusion prior to ASPECTS scoring.
-
Use of the Rapid ASPECTS Module in clinical settings other than early brain ischemia (within 6 hours) caused by known ICA or MCA occlusions has not been tested.
-
Rapid ASPECTS has been validated and is intended to be used on GE Lightspeed VCT Scanners.
Contraindications/Exclusions/Cauti ons:
- Patient Motion: excessive motion leading to artifacts that make the scan technically inadequate.
- Hemorrhagic Transformation, Hematoma
- Very thin or no Ventricles
12
Image /page/12/Picture/0 description: The image shows the logo for BRAINOMIX. The logo consists of a stylized brain icon on the left, followed by the word "BRAINOMIX" in a sans-serif font. The brain icon is teal, and the letters "A" and "I" in "BRAINOMIX" are also teal, while the rest of the letters are gray.
Suites 11-14 Suffolk House 263 Banbury Road Oxford OX2 7HN
| Characteristic/Parameter | Brainomix 360 e-ASPECTS –
Proposed Device | iSchemaView Rapid ASPECTS -
Predicate Device (K200760) |
|--------------------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|-----------------------------------------------------------|
| | MCA occlusions has not
been tested.
5. Brainomix 360 e-ASPECTS
has been validated and is
intended to be used on
Siemens Somatom
Definition scanners.
6. Brainomix 360 e-ASPECTS
has only been validated
and is intended to be used
in patient populations
aged over 21 years.
7. Brainomix 360 e-ASPECTS
is not intended for mobile
diagnostic use. Images
viewed on a mobile
platform are compressed
preview images and not
for diagnostic
interpretation.
Contraindications/Exclusions/Cautions: | |
| | • Patient motion: Excessive
patient motion leading to
artifacts that make the
scan technically
inadequate
• Hemorrhagic
Transformation,
Hematoma | |
| Environment of use | Clinical/Hospital environment | Clinical/Hospital environment |
Environment of use | Clinical/Hospital environment | Clinical/Hospital environment |
---|---|---|
Energy used and/or | ||
delivered | None - software only application. | |
The software application does not | ||
deliver or depend on energy | ||
delivered to or from patients | None – software only application. | |
The software application does not | ||
deliver or depend on energy | ||
delivered to or from patients | ||
Primary Users | Neuroradiologist/Clinician | Neuroradiologist/Clinician |
13
Image /page/13/Picture/0 description: The image shows the logo for BRAINOMIX. The logo consists of a stylized brain icon on the left, followed by the word "BRAINOMIX" in a sans-serif font. The "A" in "BRAINOMIX" is colored in a gradient from blue to green, while the rest of the letters are in a dark gray color.
| Characteristic/Parameter | Brainomix 360 e-ASPECTS –
Proposed Device | iSchemaView Rapid ASPECTS -
Predicate Device (K200760) |
|-----------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------|--------------------------------------------------------------------|
| Clinical
Application/Anatomical Region | Stroke/Head | Stroke/Head |
| Standard of Care
Representation | ASPECTS Scoring | ASPECTS Scoring |
| Design: Modalities for
image processing and
visualization | CT | CT |
| Technical
Implementation | ML/AI/Random Forest | ML/AI/Random Forest |
| Image Overlay | ASPECTS regions, highlighted by
algorithms. Voxel-wise analysis
visualized as a heat map. | ASPECTS Atlas ROIs, highlighted by
algorithms. |
| Gating Conditions | Users must confirm ICA or MCA
occlusion prior to accessing
Brainomix 360 e-ASPECTS results | Users must confirm LVO prior to
accessing Rapid ASPECTS results |
| Design: PACS
functionality | View process and analyze medical
images. performs standard PACS
functions with respect to querying
and listing | same |
| Design: DICOM
compliance | Yes | Yes |
| Design: Computer
Platform | Standard off-the-shelf server or
virtual server | same |
| Design: Data
acquisition | Acquires medical image data from
DICOM compliant imaging devices
and modalities | same |
| Alters Standard of
Care Workflow | In parallel to | In parallel to |
| Materials | N/A – Software only device | same |
| Biocompatibility | N/A – Software only device | same |
| Sterility | N/A – Software only device | same |
| Electrical Safety | N/A – Software only device | same |
| Mechanical Safety | N/A – Software only device | same |
| Chemical Safety | N/A – Software only device | same |
| Thermal Safety | N/A – Software only device | same |
| Radiation Safety | N/A – Software only device | same |
14
Image /page/14/Picture/0 description: The image shows the logo for BRAINOMIX. The logo consists of a stylized brain icon on the left, followed by the word "BRAINOMIX" in a sans-serif font. The brain icon is a gradient of blue and green, while the word "BRAINOMIX" is in a dark gray color, with the "A" in "BRAINOMIX" having a blue gradient.
Brainomix Limited Suites 11-14 Suffolk House 263 Banbury Road Oxford OX2 7HN
Performance Data
The following performance data were provided in support of the substantial equivalence determination.
Software Verification and Validation Testing
Brainomix 360 e-ASPECTS complies with DICOM (Digital Imaging and Communications in Medicine) – Developed by the American College of Radiology and the National Electrical Manufacturers Association. NEMA PS 3.1 - 3.20
Brainomix 360 e-ASPECTS is tested against its user needs and intended use by the successful execution of planned software verification and validation testing included in this submission. Algorithm validation testing has additionally been performed using phantom data with known properties.
The results of software verification and validation and algorithmic testing demonstrate that Brainomix 360 e-ASPECTS has met all design requirements and specifications associated with the intended use of the software.
Stand-alone Performance Testing
Stand-alone performance testing was conducted to comply with special controls for this device type. Stand-alone performance testing demonstrated that the proposed device provides accurate representation of key processing parameters under a range of clinically relevant parameters and perturbations associated with the intended use of the stand-alone performance testing demonstrates the generalized performance for a range of typical patient demographics and a typical range of cases with confounding factors and including radiologically normal cases which is the same as for the predicate device. The standalone performance dataset was additionally enriched to include a greater number of cases within the low ASPECTS and late time-window sub-groups to demonstrate generalizability across these groups.
The stand-alone performance testing dataset comprised 256 non-contrast CT scans from patients with suspected and later confirmed acute ischemic stroke with available follow up imaging at 24 hours, from 8 different USA institutions_Patients were admitted between March 2014 and March 2020. The median age was 71 years, and 45% were female. Median NIHSS was 18 with an interquartile range of 12 to 22. 141 patients presented within 6 hours of time last seen well, 62 presented between 6 and 16 hours and 53 were unknown onset time. 180 patients had a proximal vessel occlusion (internal carotid artery or M1 segment or middle cerebral artery) and 76 were nonproximal. Ground truth ASPECTS score was 6 in 213 patients.
15
Image /page/15/Picture/0 description: The image shows the logo for BRAINOMIX. The logo consists of a stylized brain icon on the left, followed by the word "BRAINOMIX" in a sans-serif font. The brain icon is a gradient of light blue to white. The letters "BRAI" are dark gray, the letters "NO" are a gradient of light blue to dark gray, and the letters "MIX" are dark gray.
Suites 11-14 Suffolk House 263 Banburv Road Oxford OX2 7HN
Overall performance in 256 patients showed an area under the curve of 83% (81-85, 95% Cl), with a sensitivity of 68% (57-72) and a specificity of 97% (86-98).
This stand-alone performance testing demonstrates that e-ASPECTS performance generalises to a range of image acquisition and reconstruction parameters encountered in multiple clinical sites and for a range of scanner types and manufacturers.
Stand-alone performance results were generated to demonstrate generalizable performance for a range of typical patient demographics (including patient sex, age, site of occlusion, and ASPECTS score) and within individual ASPECTS regions. Consistent performance was observed in subgroups dichotomised by median age, and subgroups defined by sex. Performance was slightly lower in the non-proximal vessel occlusion subgroup (AUC, 78% versus 84%) although this was not statistically significant. Consistent performance was also observed between the grouped cortical ASPECTS regions compared to grouped basal ganglia ASPECTS regions, although at the level of the individual ASPECTS region performance did vary. Performance was lower in the M4, M6, and internal capsule regions, although this difference was not statistically significant.
Digital phantom testing
Specific validation has been carried out to test the heatmaps. This testing made use of synthetic digital phantom data created to provide a ground truth against which the performance of the heatmaps can be assessed and demonstrated. For clarity, we report that this testing showed a correlation between the volumes of the e-ASPECTS heatmaps and the volumes of synthetic hypodensities generated in the phantom dataset.
The heatmaps are generated and visualized to provide transparency of the basis of the ASPECTS score. The phantom testing results show a correlation (r>=0.95) between the volumes of e-ASPECTS heatmaps and the volume of synthetic hypodensities generated in the 200 digital phantom dataset.
Clinical Studies
A multiple reader multiple case (MRMC) cross-over study was conducted to assess performance of Brainomix 360 e-ASPECTS. The MRMC study evaluated the performance of 10 clinical readers (4 neurologists and 6 radiologists) when scoring the ASPECTS for 54 clinically representative NCCT retrospective scans with and without the aid of Brainomix 360 e-ASPECTS. Data truthing was performed by three expert neuroradiologists with access to clinical data and follow up imaging.
The MRMC study dataset comprised 54 non-contrast CT scans from patients with acute ischemic stroke affecting the middle cerebral artery territory and eligible for acute reperfusion therapy. Patients must have had no evidence of intracranial hemorrhage and imaging data had to be of adequate quality with associated demographic and follow up imaging available. Patients aged 21 years and younger were excluded. The median age was 72 years, and 48% were female. Median NIHSS was 17 with an interquartile range of 12 to 21. 36 patients presented within 6 hours of time
16
Image /page/16/Picture/0 description: The image shows the logo for Brainomix. The logo consists of a stylized brain icon on the left, followed by the word "BRAINOMIX" in a sans-serif font. The brain icon is a gradient of light blue to white, and the letters "AI" in the word "BRAINOMIX" are also in a light blue gradient, while the rest of the letters are in dark gray.
Suites 11-14 Suffolk House 263 Banburv Road Oxford OX2 7HN
last seen well, 10 presented between 6 and 16 hours and 8 were unknown onset time. 40 patients had a proximal vessel occlusion (internal carotid artery or M1 segment or middle cerebral artery) and 14 were non-proximal. Ground truth ASPECTS score was 6 in 42 patients.
Comparison of the area under the curve (AUC) for each reader with and without the support of the e-ASPECTS tool showed a statistically significant improvement of 0.02 from 0.81 to 0.83 (p=0.028) which was the primary endpoint for the study. When comparing reader performance with the ground truth, the improved AUC in the primary endpoint was driven by an increase in both the sensitivity (positive percentage agreement, from 66 to 70%) and a small improvement in specificity (negative percentage agreement, 96%) when assisted by e-ASPECTS compared to unassisted reading. Overall percentage agreement (accuracy) also improved in line with the AUC result from 93 to 94%. Subgroup analysis based on the clinical training of the reader (radiologist versus neurologist) demonstrates a consistent impact of Brainomix 360 e-ASPECTS across reader groups. Analysis of individual reader ROC curves showed greater magnitude of increases in AUC were observed in users with lower unassisted performances ("lower performers"), and smaller changes in readers with higher unassisted performance ("high performers"). The overall ASPECTS score was more consistent between readers with use of e-ASPECTS. The range in AUC between users was also narrower with Brainomix 360 e-ASPECTS than unassisted indicating a reduction in the variation of performance between different readers when Brainomix 360 e-ASPECTS outputs are available.
Subgroup analysis of the individual regions within the ASPECTS scoring system showed that the impact of e-ASPECTS is consistent in both deep and cortical ASPECTS regions.
As the study used retrospective data, there were no specific safety endpoints in the reader study.
This study demonstrates substantial equivalence of the Brainomix 360 e-ASPECTS software for improving reader accuracy, compared to the predicate device. The results showed statistically significant improvement in the agreement between the readers and a reference standard when using the Brainomix 360 e-ASPECTS software compared to routine clinical practice.
Risk Benefit Summary | |
---|---|
Summary of Benefits | This device provides a systematic, automated |
analysis of NCCT scans of the head to provide a | |
standardized, automated ASPECT score for | |
Stroke workup. | |
The clinical reader study, which included 4 | |
neurologists and 6 neuroradiologists, |
Risk Benefit Analysis
17
Image /page/17/Picture/0 description: The image shows the logo for BRAINOMIX. The logo consists of a stylized brain icon on the left, followed by the word "BRAINOMIX" in a sans-serif font. The "AI" in "BRAINOMIX" is a gradient of blue, while the rest of the letters are gray.
Suites 11-14 Suffolk House 263 Banbury Road Oxford OX2 7HN
demonstrated a statistically significant improvement in the readers' AUC (0.02 increase, with 0.04 sensitivity improvement and 0.01 specificity improvement) when scoring was performed in conjunction with the e-ASPECTS output.
In a subgroup analysis, the benefit of the software was most substantial among the "lower performers" (clinical readers with a lower unaided performance compared to the ground truth) whereas "high performers" were minimally affected by the device output. Both cohorts included a mix of US board certified neurologist and neuroradiologist readers, indicating potential benefit for less experienced clinicians evaluating NCCT for ASPECTS.
It is important to note that ASPECTS evaluations can be challenging, particularly for less experienced clinicians, and studies have shown varying levels of interobserver agreement for ASPECTS evaluation. Overall, the system should provide more consistent and timely benefit of aided reads for lessexperienced or less confident users in the evaluation of overall ASPECTS.
Timely, consistent and accurate assessments of acute ischemic patients with known MCA and ICA occlusions can help ensure that physicians determine appropriate patient management at the right time. ASPECTS may be used in the assessment of patients for consistency with patient selection for neurothrombectomy and other acute stroke therapeutic interventions. Proper and timely patient selection increases the likelihood for successful therapeutic interventions proven to reduce long term disability. The duration of the effect is lifetime.
Based on the data provided it is not possible to accurately predict the exact likelihood of
18
Image /page/18/Picture/0 description: The image shows the logo for BRAINOMIX. The logo consists of a stylized brain icon on the left, followed by the word "BRAINOMIX" in bold, sans-serif font. The brain icon and the "AI" in BRAINOMIX are in a gradient of light blue to dark blue, while the rest of the letters are in dark gray.
Suites 11-14 Suffolk House 263 Banbury Road Oxford OX2 7HN
| | patient benefit. The study demonstrates
improvement in the assessment for readers
interpreting NCCT scans for overall ASPECTS
assessment.
This device additionally also provides
transparent Al processing enabling users tobeen determined and enables users to perform
a more technically informed review of the
automated output. This is a significant benefit
which may help mitigate risks related to false
negatives or false positives in the automated
output, particularly for more challenging cases. |
|-------------------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| Summary of the Risks | There are minimal potential risks associated
with the use of the device. |
| | Incorrect scoring which may result in false
positive results and result to incorrect patient
management with possible adverse effects such
as, unnecessary additional medical imaging
and/or unnecessary additional diagnostic
workup. |
| | Incorrect scoring which may result in false
negative results may lead to complications,
including incorrect diagnosis and delay in
disease management. |
| | The device could be misused to analyze images
from an unintended patient population or on
images acquired with incompatible imaging
hardware or incompatible image acquisition
parameters, leading to inappropriate diagnostic
information being displayed to the user. |
| | Device failure could lead to the absence of
results, delay of results or incorrect results,
which could likewise lead to inaccurate patient
assessment. |
| Summary of additional factors | However, based on the performance data and
the application of mitigating measures
(including but not limited to general controls
and special controls established for this device
type), use of the device is unlikely to decrease
diagnostic performance of the user and
possible misuse of the device does not present
additional risks compared with misuse of
other types of radiological image processing
devices. |
| | The device includes a gating condition in
software to help ensure that the software is not
used on stroke mimics or the incorrect patient
population. |
| | The physician may either confirm or overrule
the device |
| | Heatmap provides additional transparency on
regions evaluated by the ASPECTS, which may
be used by the clinician to qualify or correct
device outputs |
| | The study was enriched to cover the range of
ASPECT scores; and, the readers in practice may
not experience a significant improvement in
determining ASPECTS. |
| | This device may improve the diagnostic
accuracy of less experienced or less confident
physicians in rating NCCT for the ASPECT score
in the context of acute ischemic stroke caused
by ICA or MCA occlusion (confirmed using
vascular imaging such as CTA or MRA). |
| Conclusion | This device shows positive improvement in
diagnostic accuracy in comparison to the
reference standard. |
| | Although some performance data may suggest
that sensitivity for some ASPECTS regions may
be diminished or inconsistent in comparison to
other region however, sample size limitations |
19
Image /page/19/Picture/0 description: The image shows the logo for BRAINOMIX. The logo consists of a stylized brain icon on the left, followed by the word "BRAINOMIX" in a sans-serif font. The "A" in "BRAINOMIX" is a gradient of blue, while the rest of the letters are gray.
Suites 11-14 Suffolk House 263 Banbury Road Oxford OX2 7HN
20
Image /page/20/Picture/0 description: The image shows the logo for BRAINOMIX. The logo consists of a stylized brain icon on the left, followed by the word "BRAINOMIX" in a sans-serif font. The brain icon is a gradient of blue and teal, while the letters "AI" in "BRAINOMIX" are also in a similar gradient, contrasting with the rest of the word which is in a dark gray color.
Suites 11-14 Suffolk House 263 Banburv Road Oxford OX2 7HN
limit conclusions in this regard. The clinical reader study evidence provided demonstrates improvement in the overall performance of aided readers compared to the unaided readers. The greatest benefit was observed for the "lower performers" – bringing them to the level of the "higher performers" while avoiding adversely impacting "high performers" accuracy. The software gating conditions and other warnings integrated in the software UI are expected to be helpful in ensuring appropriate use of the device and directing clinician attention to particular regions which may be more difficult to interpret, both for users and for the device.
Prescriptive Statement
Caution: Federal law restricts this device to sale by of on the order of a physician.
Conclusion
In conclusion, the predicate device has the same intended use and substantially similar indications for use and technological characteristics as Brainomix 360 e-ASPECTS. Performance data demonstrates that Brainomix 360 e-ASPECTS performs as intended within the same clinically relevant parameters for the intended use as the predicate device.
The predicate device was cleared based in part on the results of clinical studies, therefore a clinical study was required to support substantial equivalence. The clinical data demonstrates that Brainomix 360 e-ASPECTS shows a significant improvement in the agreement between the readers and a reference standard when using the Brainomix 360 e-ASPECTS software compared to routine clinical practice. Brainomix 360 e-ASPECTS is intended to improve reader performance in estimating an overall ASPECTS score but may be less sensitive for some ASPECTS regions such as the IC and M4-M6 regions based on the performance data disclosed. The risk/benefit profile of Brainomix 360 e-ASPECTS remains favorable based on the favorable impact on readers' overall aided performance in calculating an ASPECTS score (as measured in the reader study), and the inherent inter-reader variability in identifying individual affected ASPECTS regions.
Brainomix 360 e-ASPECTS has been designed, verified and validated in compliance with 21 CFR Part 820.30 requirements and has been designed to meet the requirements associated with ANSI AAMI
21
Image /page/21/Picture/0 description: The image shows the logo for BRAINOMIX. The logo consists of a stylized brain icon on the left, followed by the word "BRAINOMIX" in a sans-serif font. The "A" in "BRAINOMIX" is stylized with a blue triangle in the middle. The brain icon is a gradient of blue and green.
Suites 11-14 Suffolk House 263 Banbury Road Oxford OX2 7HN
ISO 14971:2007/(R)2016. Software verification and validation, performance testing and risk management demonstrates that Brainomix 360 e-ASPECTS is safe and effective for use as intended and described in its indications for use.
We propose that Brainomix 360 e-ASPECTS is substantially equivalent to the Rapid ASPECTS predicate.