(113 days)
Bullsai is composed of a set of modules intended for analysis and processing of medical images and other healthcare data. It includes functions for image manipulation, basic measurements, and planning.
Bullsai is indicated for use in image processing, registration, atlas-assisted visualization and segmentation, and target export creation and selection of structural MRI images, where an output can be generated for use by a system capable of reading DICOM image sets.
Bullsai is indicated for use in the processing of diffusion-weighted MRI sequences into 3D maps that represent white matter tracts based on diffusion reconstruction methods and for the use of said maps to select and create exports.
Typical users of Bullsai are medical professionals, including but not limited to surgeons, clinicians. and radiologists.
Bullsai is a software-only, cloud-deployed, image processing package which can be used to perform DICOM image processing and analysis.
Bullsai can receive ("import") DICOM images from picture archiving and communication systems (PACS), including Diffusion Weighted Imaging (DWI) and structural brain imaging.
Bullsai removes protected health information (PHI) and links the dataset to an encryption key, which is then used to relink the data back to the patient when the data is exported to a medical imaging platform such as a hospital PACS or other DICOM device.
The software provides a workflow for a clinician to:
- Select an image for planning and visualization,
- Validate image quality,
- Export black and white and color DICOMs for use in systems that can view DICOM images.
Bullsai uses advanced MRI processing to deliver patient-specific anatomy and tractography results to support physicians in neurosurgical planning. Bullasi preprocessing steps include denoising, debiasing, skull stripping, susceptibility distortion and head motion correction to ensure input data can support generation of tractography and segmentation results. Bullsai uses generalized q-sampling imaging (GQI) to estimate the voxel-level white matter microstructure: GQI is a model-free diffusion reconstruction method that uses the Fourier transform relationship between the diffuse MR signal and the potential diffusion displacement for resolving fiber orientations and the anisotropy of water. Patient-specific anatomical segmentation and GQI estimated fiber orientations are used in Bullsai as part of an iterative heuristic tractography algorithm that emulates the manual work of neuroanatomists who iteratively seed tracts and remove aberrant fibers. Results are shared as DICOM outputs which can readily be viewed and edited in standard neurosurgical planning software packages.
The provided text contains details about the Bullsai device, its indications for use, and a comparison to a predicate device (Quicktome Software Suite). However, it does not explicitly detail the acceptance criteria for a study or the results of a specific study proving the device meets those criteria, nor does it provide information regarding sample sizes for test/training sets, data provenance, number/qualification of experts, adjudication methods, MRMC studies, or standalone performance metrics.
The "Performance Testing Summary" section indicates that "Software verification and validation testing were conducted. Documentation and relevant standards were provided." but does not elaborate on the specifics of these tests or their results against defined acceptance criteria.
The "Validation of differences compared to predicate devices" section mentions three validation activities:
- "Clinical accuracy of the Bullsai device outputs were evaluated and validated by clinical experts for the clinical intended uses of presurgical planning."
- "Bullsai device output's were validated compatibility with major neuronavigation software systems."
- "Bullsai device output's were validated for repeatability and reproducibility across major scanner manufacturer brands."
However, no further details are provided about these validations.
Therefore,Based on the provided text, the specific information requested in the prompt's numbered points cannot be fully extracted as it is not explicitly stated.
Here's a summary of what can be inferred or what is missing:
1. A table of acceptance criteria and the reported device performance:
* Acceptance Criteria: Not explicitly stated in the document.
* Reported Device Performance: Not explicitly stated in the document in measurable terms against acceptance criteria. The document mentions "Clinical accuracy of the Bullsai device outputs were evaluated and validated by clinical experts" and "Bullsai device output's were validated compatibility" and "Bullsai device output's were validated for repeatability and reproducibility," but no specific performance metrics or thresholds are provided.
2. Sample sized used for the test set and the data provenance (e.g. country of origin of the data, retrospective or prospective):
* Sample Size (Test Set): Not stated.
* Data Provenance: Not stated.
3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g. radiologist with 10 years of experience):
* Number of Experts: Not stated, only "clinical experts" are mentioned.
* Qualifications of Experts: Not stated.
4. Adjudication method (e.g. 2+1, 3+1, none) for the test set:
* Adjudication Method: Not stated.
5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:
* MRMC Study: Not mentioned as being performed. The device description does not imply a human-in-the-loop diagnostic aid but rather image processing and output generation for other systems. The predicate device's differences section states, "Bullsai does not have a viewer and therefore a usability study was not conducted," which suggests a traditional MRMC study involving human reading performance might not be directly applicable or was not undertaken.
6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done:
* Standalone Performance: The document implies standalone validation for "clinical accuracy," "compatibility," and "repeatability and reproducibility." However, specific quantitative results from such a standalone study are not provided.
7. The type of ground truth used (expert consensus, pathology, outcomes data, etc.):
* Type of Ground Truth: The document states "Clinical accuracy of the Bullsai device outputs were evaluated and validated by clinical experts." This suggests expert consensus or expert review served as the ground truth. No mention of pathology or outcomes data is made.
8. The sample size for the training set:
* Sample Size (Training Set): Not stated.
9. How the ground truth for the training set was established:
* Ground Truth (Training Set): Not stated. The document focuses on validation activities, not training methodologies or ground truth establishment for training data.
{0}------------------------------------------------
Image /page/0/Picture/0 description: The image shows the logo for the U.S. Food & Drug Administration (FDA). The logo consists of two parts: a symbol on the left and the FDA name on the right. The symbol is a stylized representation of a human figure, while the FDA name is written in blue and includes the words "U.S. Food & Drug Administration".
August 13, 2024
Turing Medical Technologies, Inc. Christa Nova Lead Manager of QARA (Quality Assurance and Regulatory Affairs) 393 N Euclid Ave Suite 310 Saint Louis, Missouri 63108
Re: K241094
Trade/Device Name: Bullsai Regulation Number: 21 CFR 892.2050 Regulation Name: Medical Image Management And Processing System Regulatory Class: Class II Product Code: LLZ Dated: July 18, 2024 Received: July 18, 2024
Dear Christa Nova:
We have reviewed your section 510(k) premarket notification of intent to market the device referenced above and have determined the device is substantially equivalent (for the indications for use stated in the enclosure) to legally marketed predicate devices marketed in interstate commerce prior to May 28, 1976, the enactment date of the Medical Device Amendments, or to devices that have been reclassified in accordance with the provisions of the Federal Food, Drug, and Cosmetic Act (the Act) that do not require approval of a premarket approval application (PMA). You may, therefore, market the device, subject to the general controls provisions of the Act. Although this letter refers to your product as a device, please be aware that some cleared products may instead be combination products. The 510(k) Premarket Notification Database available at https://www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfpmn/pmn.cfm identifies combination product submissions. The general controls provisions of the Act include requirements for annual registration, listing of devices, good manufacturing practice, labeling, and prohibitions against misbranding and adulteration. Please note: CDRH does not evaluate information related to contract liability warranties. We remind you, however, that device labeling must be truthful and not misleading.
If your device is classified (see above) into either class II (Special Controls) or class III (PMA), it may be subject to additional controls. Existing major regulations affecting your device can be found in the Code of Federal Regulations, Title 21, Parts 800 to 898. In addition, FDA may publish further announcements concerning your device in the Federal Register.
Additional information about changes that may require a new premarket notification are provided in the FDA guidance documents entitled "Deciding When to Submit a 510(k) for a Change to an Existing Device" (https://www.fda.gov/media/99812/download) and "Deciding When to Submit a 510(k) for a Software Change to an Existing Device" (https://www.fda.gov/media/99785/download).
{1}------------------------------------------------
Page 2
Your device is also subject to, among other requirements, the Quality System (QS) regulation (21 CFR Part 820), which includes, but is not limited to, 21 CFR 820.30, Design controls; 21 CFR 820.90, Nonconforming product; and 21 CFR 820.100, Corrective and preventive action. Please note that regardless of whether a change requires premarket review, the QS regulation requires device manufacturers to review and approve changes to device design and production (21 CFR 820.70) and 21 CFR 820.70) and document changes and approvals in the device master record (21 CFR 820.181).
Please be advised that FDA's issuance of a substantial equivalence determination does not mean that FDA has made a determination that your device complies with other requirements of the Act or any Federal statutes and regulations administered by other Federal agencies. You must comply with all the Act's requirements, including, but not limited to: registration and listing (21 CFR Part 807); labeling (21 CFR Part 801); medical device reporting of medical device-related adverse events) (21 CFR Part 803) for devices or postmarketing safety reporting (21 CFR Part 4, Subpart B) for combination products (see https://www.fda.gov/combination-products/guidance-regulatory-information/postmarketing-safety-reportingcombination-products); good manufacturing practice requirements as set forth in the quality systems (QS) regulation (21 CFR Part 820) for devices or current good manufacturing practices (21 CFR Part 4, Subpart A) for combination products; and, if applicable, the electronic product radiation control provisions (Sections 531-542 of the Act); 21 CFR Parts 1000-1050.
Also, please note the regulation entitled, "Misbranding by reference to premarket notification" (21 CFR 807.97). For questions regarding the reporting of adverse events under the MDR regulation (21 CFR Part 803), please go to https://www.fda.gov/medical-device-safety/medical-device-reportingmdr-how-report-medical-device-problems.
For comprehensive regulatory information about mediation-emitting products, including information about labeling regulations, please see Device Advice (https://www.fda.gov/medicaldevices/device-advice-comprehensive-regulatory-assistance) and CDRH Learn (https://www.fda.gov/training-and-continuing-education/cdrh-learn). Additionally, you may contact the Division of Industry and Consumer Education (DICE) to ask a question about a specific regulatory topic. See the DICE website (https://www.fda.gov/medical-device-advice-comprehensive-regulatoryassistance/contact-us-division-industry-and-consumer-education-dice) for more information or contact DICE by email (DICE@fda.hhs.gov) or phone (1-800-638-2041 or 301-796-7100).
Sincerely,
D.G.K.
Daniel M. Krainak, Ph.D. Assistant Director DHT8C: Division of Radiological Imaging and Radiation Therapy Devices OHT8: Office of Radiological Health Office of Product Evaluation and Quality Center for Devices and Radiological Health
{2}------------------------------------------------
Indications for Use
Form Approved: OMB No. 0910-0120 Expiration Date: 07/31/2026 See PRA Statement below.
Submission Number (if known)
Device Name
Bullsai
Indications for Use (Describe)
Bullsai is composed of a set of modules intended for analysis and processing of medical images and other healthcare data. It includes functions for image manipulation, basic measurements, and planning.
Bullsai is indicated for use in image processing, registration, atlas-assisted visualization and seqmentation, and target export creation and selection of structural MRI images, where an output can be generated for use by a system capable of reading DICOM image sets.
Bullsai is indicated for use in the processing of diffusion-weighted MRI sequences into 3D maps that represent white matter tracts based on diffusion reconstruction methods and for the use of said maps to select and create exports.
Typical users of Bullsai are medical professionals, including but not limited to surgeons, clinicians. and radiologists.
Type of Use (Select one or both, as applicable)
Prescription Use (Part 21 CFR 801 Subpart D)
Over-The-Counter Use (21 CFR 801 Subpart C)
CONTINUE ON A SEPARATE PAGE IF NEEDED.
This section applies only to requirements of the Paperwork Reduction Act of 1995.
DO NOT SEND YOUR COMPLETED FORM TO THE PRA STAFF EMAIL ADDRESS BELOW.
The burden time for this collection of information is estimated to average 79 hours per response, including the time to review instructions, search existing data sources, gather and maintain the data needed and complete and review the collection of information. Send comments regarding this burden estimate or any other aspect of this information collection, including suggestions for reducing this burden, to:
Department of Health and Human Services Food and Drug Administration Office of Chief Information Officer Paperwork Reduction Act (PRA) Staff PRAStaff(@fda.hhs.gov
"An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB number."
{3}------------------------------------------------
510(k) Summary
| Device Trade Name: | Bullsai |
|---|---|
| Manufacturer: | Turing Medical Technologies, Inc.393 N EUCLID AVE STE 310,SAINT LOUIS, MISSOURI 63108 UNITED STATES |
| Contact: | Christa NovaLead Manager of QARA419-388-3288 |
| Date Prepared: | August 9, 2024 |
| Classification: | Medical image management and processing system, 21 CFR892.2050 |
| Class: | II |
| Product Code: | LLZ |
| Primary Predicate: | Quicktome Software Suite, K222359 |
Indications For Use:
Bullsai is composed of a set of modules intended for analysis and processing of medical images and other healthcare data. It includes functions for image manipulation, basic measurements, and planning.
Bullsai is indicated for use in image processing, registration, atlas-assisted visualization and segmentation, and target export creation and selection of structural MRI images, where an output can be generated for use by a system capable of reading DICOM image sets.
Bullsai is indicated for use in the processing of diffusion-weighted MRI sequences into 3D maps that represent white matter tracts based on diffusion reconstruction methods and for the use of said maps to select and create exports.
Typical users of Bullsai are medical professionals, including but not limited to surgeons, clinicians, and radiologists.
{4}------------------------------------------------
Device Description:
Bullsai is a software-only, cloud-deployed, image processing package which can be used to perform DICOM image processing and analysis.
Bullsai can receive ("import") DICOM images from picture archiving and communication systems (PACS), including Diffusion Weighted Imaging (DWI) and structural brain imaging.
Bullsai removes protected health information (PHI) and links the dataset to an encryption key, which is then used to relink the data back to the patient when the data is exported to a medical imaging platform such as a hospital PACS or other DICOM device.
The software provides a workflow for a clinician to:
- · Select an image for planning and visualization,
- Validate image quality,
- · Export black and white and color DICOMs for use in systems that can view DICOM images.
Bullsai uses advanced MRI processing to deliver patient-specific anatomy and tractography results to support physicians in neurosurgical planning. Bullasi preprocessing steps include denoising, debiasing, skull stripping, susceptibility distortion and head motion correction to ensure input data can support generation of tractography and segmentation results. Bullsai uses generalized q-sampling imaging (GQI) to estimate the voxel-level white matter microstructure: GQI is a model-free diffusion reconstruction method that uses the Fourier transform relationship between the diffuse MR signal and the potential diffusion displacement for resolving fiber orientations and the anisotropy of water. Patient-specific anatomical segmentation and GQI estimated fiber orientations are used in Bullsai as part of an iterative heuristic tractography algorithm that emulates the manual work of neuroanatomists who iteratively seed tracts and remove aberrant fibers. Results are shared as DICOM outputs which can readily be viewed and edited in standard neurosurgical planning software packages.
Predicate Device:
Turing Medical Technologies, Inc. submits the following information in this Premarket Notification to demonstrate that, for the purposes of FDA's regulation of medical devices, Bullsai is substantially equivalent in indications, design principles, and performance to the following predicate device, which have been determined by FDA to be substantially equivalent to pre-amendment devices:
Primary Predicate: Quicktome Software Suite (K222359)
Performance Testing Summary:
Software verification and validation testing were conducted. Documentation and relevant standards were provided.
| Item | Predicate:Quicktome SoftwareSuiteK222359 | Subject Device:Bullsai | Comparison |
|---|---|---|---|
| Classification | Class II | Class II | Identical |
| ProductCode | LLZ | LLZ | Identical |
| DeviceDescription | Similar; | ||
| Quicktome is a software-only, cloud- deployed, image processing package which can be used to perform DICOM image viewing, image processing, and analysis.Quicktome can receive (“import”) DICOM images from picture archiving and communication systems (PACS), acquired with MRI, including Diffusion Weighted Imaging (DWI) sequences, T1, T2, BOLD, and FLAIR images. Quicktome can also receive Resting State functional MRI (rs-fMRI) blood- oxygen-level- dependent (BOLD) datasets.Once received, Quicktome removes protected health information (PHI) and links the dataset to an encryption key, which is then used to relink the data back to the patient when the data is exported to hospital PACS or other DICOM device.The software provides a workflow for a clinician to:Select an image for planning and visualization, Validate image quality, Explore the available anatomical regions, network templates, tractography bundles, and parcellations, Select regions of interest, Display resting state fMRI (BOLD) correlation maps using task-analogous seeds for Motor, Vision and Language networks, and Export black and white and color DICOMs for use in systems that can view DICOM images. | Bullsai is a software-only, cloud-deployed, image processing package which can be used to perform DICOM image processing and analysis.Bullsai can receive (“import”) DICOM images from picture archiving and communication systems (PACS), including Diffusion Weighted Imaging (DWI) and structural brain imaging. Bullsai removes protected health information (PHI) and links the dataset to an encryption key, which is then used to relink the data back to the patient when the data is exported to a medical imaging platform such as a hospital PACS or other DICOM device.The software provides a workflow for a clinician to:Select an image for planning and visualization, Validate image quality, Export black and white and color DICOMs for use in systems that can view DICOM images.Bullsai uses advanced MRI processing to deliver patient-specific anatomy and tractography results to support physicians in neurosurgical planning. Bullasi preprocessing steps include denoising, debiasing, skull stripping, susceptibility distortion and head motion correction to ensure input data can support generation of tractography and segmentation results. Bullsai uses generalized q-sampling imaging (GQI) to estimate the voxel-level white matter microstructure: GQI is a model-free diffusion reconstruction method that uses the Fourier transform relationship between the diffuse MR signal and the potential diffusion displacement for resolving fiber orientations and the anisotropy of water. Patient-specific anatomical segmentation and GQI estimated fiber orientations are used in Bullsai as part of an iterative heuristic tractography algorithm that emulates the manual work of neuroanatomists who iteratively seed tracts and remove aberrant fibers. Results are shared as DICOM outputs which can readily be viewed and edited in standard neurosurgical planning software packages. | 1) Bullsai does not have a viewer and therefore does not provide display, image viewing, or clinician exploration of device outputs within the device.2) Bullsai does not support the processing or visualization of resting-state MRI studies.3) Description of the process and GQI included. | |
| Item | Predicate:Quicktome Software SuiteK222359 | Subject Device:Bullsai | Comparison |
| Indicationfor Use | The Quicktome Software Suite iscomposed of a set of modules intendedfor display of medical images andother healthcare data. It includesfunctions for image review, imagemanipulation, basic measurements,planning, 3D visualization (MPRreconstructions and 3D volumerendering) and display of BOLD(blood oxygen level dependent)resting-state MRI scan studies.Modules are available for imageprocessing, atlas-assisted visualizationand segmentation, resting stateanalysis and visualization, and targetexport creation and selection, wherean outputcan be generated for use by a systemcapable of reading DICOM image sets.Quicktome is indicated for use in theprocessing of diffusion-weighted MRIsequences into 3D maps that representwhite matter tracts based onconstrained spherical deconvolutionmethods and for the use of said mapsto select and create exports.Quicktome can generate motor,language, and vision resting statefMRI correlation maps using task-analogous seeds.Typical users of Quicktome are medicalprofessionals, including but not limitedto surgeons, clinicians, and radiologists. | Bullsai is composed of a set ofmodules intended for analysis andprocessing of medical images andother healthcare data. It includesfunctions for image manipulation,basic measurements, and planning.Bullsai is indicated for use in imageprocessing, registration, atlas-assistedvisualization and segmentation, andtarget export creation and selection ofstructural MRI images, where anoutput can be generated for use by asystem capable of reading DICOMimage sets.Bullsai is indicated for use in theprocessing of diffusion-weighted MRIsequences into 3D maps that representwhite matter tracts based on diffusionreconstruction methods and for the useof said maps to select and createexports.Typical users of Bullsai are medicalprofessionals, including but not limitedto surgeons, clinicians, and radiologists. | Similar; 1)Bullsai does nothave a viewerand thereforedoes not providedisplay, imageviewing, or 3Dvisualization. 2)Bullsai does notsupport theprocessing orvisualization ofresting-stateMRI studies. 3)Bullsai usesdiffusionreconstructionmethods ratherthan constrainedsphericaldeconvolutionmethods. |
Substantial Equivalence:
{5}------------------------------------------------
{6}------------------------------------------------
Bullsai is substantially equivalent to the identified predicate (legally marketed) device. Bullsai has the same intended use and technological characteristics as the predicate device and or different intended use and technological characteristics that do not raise different questions of safety and effectiveness.
At a high level, Bullsai and predicate device are based on the following same elements:
- . Bullsai is composed of a set of modules intended for medical images and other healthcare data.
- Bullsai includes functions for image manipulation, basic measurements, and planning. ●
- . Bullsai modules are available for image processing, atlas-assisted visualization and segmentation, and target export creation and selection, where an output can be generated for use by a system capable of reading DICOM image sets.
- . Bullsai is indicated for use in the processing of diffusion-weighted MRI sequences into 3D maps that represent white matter tracts and for the use of said maps to select and create exports.
- Typical users of Bullsai are medical professionals, including but not limited to surgeons, ● clinicians, and radiologists.
- Bullsai is a software-only, cloud-deployed, image processing package which can be used ●
{7}------------------------------------------------
to perform DICOM image processing and analysis.
- . Bullsai can receive ("import") DICOM images from picture archiving and communication systems (PACS).
- Bullsai provides support to structural imaging techniques including Diffusion Weighted ● Imaging (DWI).
- Bullsai accepts standardized imaging formats for volumetric medical imaging.
- . Bullsai removes protected health information (PHI) and links the dataset to an encryption key, which is then used to relink the data back to the patient when the data is exported to a medical imaging platform such as a hospital PACS or other DICOM device.
- Bullsai provides a workflow for a clinician to select an image for planning and visualization, validate image quality, and export black and white and color DICOMs for use in systems that can view DICOM images.
At a high level, Bullsai and predicate device have the following different elements:
- Bullsai does not have a viewer and therefore does not provide display, image viewing, 3D ● visualization, or clinician exploration of device outputs within the device.
- Bullsai does not support the processing or visualization of resting-state MRI studies.
- Bullsai uses diffusion reconstruction methods rather than constrained spherical deconvolution methodologies, to process diffusion-weighted MRI sequences into 3D maps that represent white matter tracts. Generalized q-sampling imaging (GQI) is a model-free diffusion reconstruction method that uses the Fourier transform relationship between the diffuse MR signal and the potential diffusion displacement for resolving fiber orientations and the anisotropy of water.
Validation of differences compared to predicate devices:
- . Clinical accuracy of the Bullsai device outputs were evaluated and validated by clinical experts for the clinical intended uses of presurgical planning.
- Bullsai device output's were validated compatibility with major neuronavigation software ● systems.
- Bullsai device output's were validated for repeatability and reproducibility across major scanner manufacturer brands.
Differences:
- The predicate device conducted a summative usability evaluation and design validation with ● representative users; Bullsai does have a viewer and therefore a usability study was not conducted.
- The predicate device conducted performance evaluations for their BOLD processing pipeline. Bullsai does not support resting-state BOLD MRI data and therefore a similar study was not conducted.
- The predicate device compared resting state fMRI correlation maps to task-based fMRI activation maps; Bullsai does not support resting state fMRI data and therefore a similar study was not conducted.
Conclusion:
The subject device and the predicate devices have intended use and have similar technological characteristics. The data included in this submission demonstrate substantial equivalence to the predicate device listed above. Bullsai is as safe, as effective, and performs as well as, or better, than the predicate device.
§ 892.2050 Medical image management and processing system.
(a)
Identification. A medical image management and processing system is a device that provides one or more capabilities relating to the review and digital processing of medical images for the purposes of interpretation by a trained practitioner of disease detection, diagnosis, or patient management. The software components may provide advanced or complex image processing functions for image manipulation, enhancement, or quantification that are intended for use in the interpretation and analysis of medical images. Advanced image manipulation functions may include image segmentation, multimodality image registration, or 3D visualization. Complex quantitative functions may include semi-automated measurements or time-series measurements.(b)
Classification. Class II (special controls; voluntary standards—Digital Imaging and Communications in Medicine (DICOM) Std., Joint Photographic Experts Group (JPEG) Std., Society of Motion Picture and Television Engineers (SMPTE) Test Pattern).