Search Results
Found 3 results
510(k) Data Aggregation
(90 days)
The MBT Sepsityper is a qualitative in vitro diagnostic device consisting of an MBT-CA (Sepsityper) software extension and a reagent kit (MBT Sepsityper Kit US IVD) for use in conjunction with other clinical and laboratory findings to aid in the early diagnosis of bacterial and yeast infections from positively flagged blood cultures using the MALDI Biotyper CA System.
The MBT Sepsityper Kit US IVD is a disposable blood culture processing device that includes associated reagents that are intended to concentrate and purify microbial cells from blood culture samples identified as positive by a continuous monitoring blood culture system and confirmed to demonstrate the presence of a single organism as determined by Gram stain. This sample preparation manual method is performed by laboratory health professionals in a clinical diagnostic setting. Subculturing of positive blood cultures is necessary to recover organisms for identification of organisms not identified by the MBT-CA System, for susceptibility testing and for differentiation of mixed growth.
Positive MBT Sepsityper results do not rule out co-infection with organisms that may not be detected by the MBT-CA System. Results of the MBT Sepsityper should not be used as the sole basis for diagnosis, treatment, or other patient management decisions. Results of the MBT Sepsityper should be correlated with Gram stain results and used in conjunction with other clinical and laboratory findings to aid in the diagnosis of bacterial and yeast bloodstream infections.
Organisms recovered from positive blood culture bottles that are suitable for identification using the MBT Sepsityper Kit US IVD and MBT-CA Systems are listed in the MALDI Biotyper CA System Package Insert Reference Library.
The MALDI Biotyper CA System uses MALDI (matrix-assisted laser desorption/ionization) TOF (time of flight) mass spectrometry technology for the identification of organisms isolated from clinical samples. Identification can be performed from an isolated colony or from a cell extract. The sample material is transferred to a target plate, dried and overlaid with a matrix. The MBT FAST Shuttle US IVD is an optional hardware tool that may be used for drying the samples deposited on the MALDI target plate under controlled conditions.
The MALDI process transforms the proteins and peptides from the isolated microorganisms into positively charged ions. This is achieved by irradiating the matrix-sample composite with a UV laser. The matrix absorbs laser energy and transfers protons to the intact proteins or peptides in the gas phase. These ions are electrostatically accelerated and arrive in the flight tube at a mass-dependent speed. Because different proteins/peptides have different masses, ions arrive at the detector at different times (time of flight). The MBT-CA System measures the time (in the nanosecond range) between pulsed acceleration and the corresponding detector signal of the ions, and the time is converted into an exact molecular mass.
The highly abundant microbial ribosomal proteins result in a mass spectrum with a characteristic mass and intensity distribution pattern. This pattern is species-specific for many bacteria and yeasts and can be used as a 'molecular fingerprint' to identify a test organism. The spectrum of the unknown test organism, acquired through the software MBT Compass HT CA of the MBT-CA System, is electronically transformed into a peak list. Using a biostatistical algorithm, this peak list is compared to reference peak lists of organisms in the MBT-CA Reference Library and a log(score) between 0.00 and 3.00 is calculated. The higher the log(score), the higher the degree of similarity to a given organism in the MBT-CA Reference Library. The log(score) ranges reflect the probability of organism identification.
The FDA 510(k) submission document focuses on demonstrating substantial equivalence to an existing predicate device rather than presenting a traditional acceptance criteria study for a new device. Therefore, the "acceptance criteria" discussed are largely driven by proving that the new components (MBT Compass HT CA software and MBT FAST Shuttle US IVD) maintain or improve the performance and safety established by the predicate device.
Here's an analysis of the provided text to fulfill your request:
Acceptance Criteria and Reported Device Performance
The concept of "acceptance criteria" in this context isn't a single set of predefined thresholds for a novel device's performance against a clinical gold standard (e.g., sensitivity/specificity targets). Instead, it's about demonstrating that the new components do not negatively impact the established performance of the predicate device and potentially offer improvements (like accelerated drying time). The "reported device performance" is presented as evidence that these conditions are met.
Table 1: Acceptance Criteria (Implied) and Reported Device Performance
Acceptance Criteria (Implied from Study Design) | Reported Device Performance |
---|---|
MBT FAST Shuttle US IVD: | |
Safety and Compliance: Meets EMC, Electrical, Mechanical, and Thermal standards. | Complies with IEC 61326-1, IEC 61326-2-6, IEC 60601-1-2 regarding EMC. Complies with IEC 61010-1, IEC 61010-2-010, IEC 61010-2-101 and national versions (UL, CAN/CSA) for safety. |
Repeatability of Microorganism Identification: High percentage of correct identifications across different preparation methods and workflows. | MBT Workflow: Overall average 96.67% correct ID. Sepsityper Workflow: Overall average 100% correct ID. (Table 3) |
Reproducibility of Microorganism Identification: Consistent correct identification across sites, FAST Shuttle units, operators, and days. | Site-to-Site: MBT: 96.9% correct; Sepsityper: 89.1% correct. (Table 4) |
FAST Shuttle-to-FAST Shuttle: MBT: 95.6% correct; Sepsityper: 98.3% correct. (Table 5) | |
Operator-to-Operator: MBT: 98.3% correct; Sepsityper: 98.9% correct. (Table 6) | |
Day-to-Day: MBT: 98.2% correct; Sepsityper: 98.9% correct. (Table 7) | |
Equivalence of Drying Methods (FAST Shuttle vs. Air-drying): No significant difference in log(score) results. | Mean log(scores) for air-dried (2.32 ± 0.25) and MBT FAST Shuttle dried (2.34 ± 0.28) samples were very similar across all methods and study sites. (Table 8) Differences in means were minimal (e.g., -0.02). |
Accelerated Drying Time: Significantly shorter drying time with MBT FAST Shuttle. | MBT FAST Shuttle drying times (average 7.63 minutes) were significantly shorter than air drying times (average 17.59 minutes). (Table 9) |
MBT Compass HT CA Software: | |
Software Verification & Validation: Meets software standards and requirements with established traceability. | Conducted and documented in accordance with 2023 FDA guidance. Includes code review, unit level, and system level testing. |
Cybersecurity: Vulnerability and penetration testing conducted, controls implemented and verified. | Conducted and documented in accordance with 2023 FDA guidance. All appropriate controls implemented and verified. |
Analytical Performance (Low Confidence Results as Final): Low confidence results (DT/eDT) show no significant difference in species identification compared to the Ext method. | Of 1,670 yellow log(scores), 1,269 showed high-confidence species ID after Ext. Only 7 samples (0.55%) showed a different result with Ext, which were justified by polyphasic taxonomic rules or library improvement. |
IDealTune Functionality: Improves and maintains mass spectrometer performance, reducing need for manual tune-ups. | High BTS-QC passing rates (99% and 100%) observed over 14-17 months, with only 9-24 IDealTune adjustments. (Table 10) Confirmed no manual tune-ups needed for over a year with IDealTune. |
Study Details
Based on the provided text:
-
Sample sizes used for the test set and the data provenance:
- MBT FAST Shuttle - Repeatability: 120 mass spectra (presumably from 12 bacterial/yeast strains * 10 repeats * 2 runs across DT, eDT, Ext, Sepsityper workflows as indicated in Table 3 headers, although the text says "each out of 2 runs" for "each workflow/method" - suggesting 10 per method/workflow per run).
- MBT FAST Shuttle - Reproducibility (Site-to-Site): 2700 samples for MBT workflow (900 samples per study site * 3 sites) and 1350 samples for Sepsityper workflow (450 samples per study site * 3 sites). The document mentions "10 microorganisms" used per study site.
- MBT FAST Shuttle - Reproducibility (Device-to-device): 1080 samples for MBT workflow (360 samples per MBT FAST Shuttle * 3 shuttles) and 540 samples for Sepsityper workflow (180 samples per MBT FAST Shuttle * 3 shuttles).
- MBT FAST Shuttle - Reproducibility (Operator-to-operator): 900 samples for MBT workflow (450 samples per operator * 2 operators) and 450 samples for Sepsityper workflow (225 samples per operator * 2 operators).
- MBT FAST Shuttle - Reproducibility (Day-to-day): 900 samples for MBT workflow (180 samples per day * 5 days) and 450 samples for Sepsityper workflow (90 samples per day * 5 days).
- MBT FAST Shuttle - Method Comparison (Drying): 279 mass spectra for air-dried and 279 mass spectra for MBT FAST Shuttle dried from three study sites (93 mass spectra per site per drying method). Ten (10) microorganisms and a blood culture, each spotted in triplicates.
- MBT Compass HT CA - Low Confidence Results: 15,270 spectra in total, with 1,670 yellow log(scores) re-analyzed.
- MBT Compass HT CA - IDealTune: Data collected from 133 BTS-QC runs at Site 1 (over 17 months) and 76 BTS-QC runs at Site 2 (over 14 months).
Data Provenance: The studies were performed at multiple sites (at least 3 for reproducibility studies), and one study explicitly mentions that microorganisms were shipped to both US study sites. This implies the data is, at least in part, prospectively collected in a multi-center setting for verification/validation. The "low confidence results" study was a retrospective non-interventional validation using data from previous clearances.
-
Number of experts used to establish the ground truth for the test set and the qualifications of those experts:
- The document does not specify the number or qualifications of experts used to establish ground truth for most of these performance studies. The studies primarily focus on performance consistency and equivalence compared to established methods using what appears to be common laboratory standards (e.g., identity confirmed organisms, BTS quality checks).
- For the "low confidence results" study, it states: "Isolates from clinical routine were used to compare the results of the MBT-CA System against a gold standard (16S sequencing)." This suggests the ground truth was established by 16S sequencing, a molecular method, rather than solely by human experts, and then potentially interpreted by experts.
-
Adjudication method (e.g. 2+1, 3+1, none) for the test set:
- No adjudication method involving multiple human readers for conflict resolution is mentioned or appears to be applicable given the nature of the device (mass spectrometry-based organism identification). The performance is assessed on the agreement with an expected identification or log(score) thresholds.
-
If a multi-reader multi-case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:
- No MRMC or human-in-the-loop comparative effectiveness study with human readers assisting or being assisted by AI is described in this document. The device is a "clinical mass spectrometry microorganism identification and differentiation system," not an AI-assisted diagnostic imaging tool.
-
If a standalone (i.e. algorithm only without human-in-the-loop performance) was done:
- Yes, the performance validation studies of the MBT FAST Shuttle US IVD and MBT Compass HT CA software are essentially standalone performance evaluations of these components within the overall MALDI Biotyper CA System. The "outputs" (identification results, log(scores)) are generated by the system (including the hardware, software, and reference library) without direct human interpretation of the raw mass spectra. Human involvement is in sample preparation and operating the system, but the core identification is algorithmic.
-
The type of ground truth used (expert consensus, pathology, outcomes data, etc):
- For the analytical performance of organism identification, the ground truth appears to be based on:
- Reference strains/known microorganisms: Used in repeatability and reproducibility studies.
- 16S sequencing: Explicitly stated as the "gold standard" for comparing results in the "low confidence results" study.
- Internal quality control standards: Like the Bacterial Test Standard (BTS) for IDealTune validation.
- This is primarily laboratory-based "gold standard" ground truth (molecular methods, established reference cultures), rather than expert consensus on clinical cases.
- For the analytical performance of organism identification, the ground truth appears to be based on:
-
The sample size for the training set:
- This document describes the validation of new components for an existing system. It does not provide details about the training set size for the underlying MALDI Biotyper CA System's reference library or analytical algorithms. The "reference library" (which acts as a form of "training data" for identifying unknown spectra) is mentioned as being continually updated, but its size is not specified.
-
How the ground truth for the training set was established:
- Similar to the above, the document does not detail how the ground truth was established for the training data (the reference library) of the overall MALDI Biotyper CA System. However, standard practice for building such libraries involves:
- Well-characterized bacterial and yeast strains: Often from culture collections, with identity confirmed by a variety of methods including 16S rRNA gene sequencing, traditional biochemical tests, and possibly whole-genome sequencing.
- Internal validation and verification: Ensuring the spectral patterns are consistent and representative for each species.
- Similar to the above, the document does not detail how the ground truth was established for the training data (the reference library) of the overall MALDI Biotyper CA System. However, standard practice for building such libraries involves:
In summary, this 510(k) submission successfully demonstrates substantial equivalence by showing that the new components (MBT Compass HT CA software and MBT FAST Shuttle US IVD) maintain the safety and effectiveness of the predicate device, and in some cases, enhance usability (faster drying time, improved instrument maintenance) without introducing new risks or compromising diagnostic accuracy. The studies presented are analytical validations focusing on performance characteristics relevant to microorganism identification in a laboratory setting.
Ask a specific question about this device
(203 days)
The MALDI Biotyper CA System is a mass spectrometer system using matrix-assisted laser desorption/ionization - time of flight (MALDI-TOF) for the identification and differentiation of microorganisms cultured from human specimens.
The MALDI Biotyper CA System is a qualitative in vitro diagnostic device indicated for use in conjunction with other clinical and laboratory findings to aid in the diagnosis of bacterial and fungal infections.
The MBT-CA System consists of the Microflex LT/SH mass spectrometer, reference library, kit reagents (US IVD HCCA, US IVD Bacterial Test Standard), US IVD 48 Spot Target or MBT Biotarget 96 US IVD plate, and software. The MALDI Biotyper CA System with closed safety covers is a Class 1 Laser product. With the safety cover opened it becomes a Class 4 Laser product.
The MALDI Biotyper CA System reference library was established by analyzing the type strain from each claimed species combined with 4 to ~30 additional strains from the same species provided by clinical laboratories or commercial strain collections. Currently a total of 3029 strains (covering 334 species / groups with 294 bacteria plus 40 yeasts) are contained in the clinically validated MBT-CA library.
Implementation methodology, construction parameters and quality assurance protocols use a standard operating protocol for generation of reference entries and all testing parameters are the same.
MBT-CA microorganism identification is based on isolate MALDI spectra using Bruker reference libraries with a 1:1 comparison of unknown MALDI spectra against each single entry of a given reference library. During a single identification event, an unknown MALDI spectra is compared against each single reference entry producing individual log(score) results. This number of log(scores) is sorted based on their value and the highest one is used to generate the final result. The addition of new reference entries does not influence the already included entries. If no reference entries are removed within a library update the log(score) calculation remains unchanged for the same MALDI spectra.
MALDI Biotyper CA System client software displays a user-interface which guides the user through the MALDI Biotyper CA System workflow. The MALDI Biotyper CA System client also interfaces to the flexControl software for automated acquisition of mass spectra on the microflex LT/SH instrument.
The MALDI Biotyper CA System server communicates with the MALDI Biotyper CA System client and the MBT-DB server. It performs preprocessing on acquired spectra, and matches peak lists against the Main Spectrum (reference pattern, (MSP)) for matching and calculates the score value (log (score)).
The MBT-DB server stores all information for the MALDI Biotyper CA System. The MBT-DB maintains spectra data (creation information and mass/intensity lists), project data (results of defined and executed runs), method data (parameter lists for spectra preprocessing and identification), user management data, reference patterns and other peak lists plus additional maintenance data.
GTPS firmware communicates with the flexControl PC software, controls and monitors the vacuum, moves the sample carrier and performs the docking of the target plate, controls and monitors high voltages in the ion source, generates trigger signals, and monitors instrument status.
The flexControl acquisition software communicates with the MALDI Biotyper CA System client, loads automatic run jobs, communicates with the GTPS firmware, communicates with the laser in the microflex LT/SH instrument, sets the acquisition parameters in the digitizer and reads the acquired data from the digitizer, performs automated data acquisition, evaluates acquired spectra, adjusts the laser power during automatic data acquisition, performs a re-calibration of the time-of-flight to mass transformation, stored acquired spectra on disk and performs source cleaning. The flexControl software does not display a user interface.
The optional Honeywell (Hyperion 1300g) Barcode Reader USB cable is connected to the MALDI Biotyper CA System computer. The barcode reader scans the unique ten-digit target ID which appears in the Target ID box on the target plate. After the target ID has been entered, the a new Run page opens and the ten-digit target ID appears as the Plate ID and is appended to the Run name. Sample identifications are entered into the computer corresponding to the target plate position for that run.
Here's a breakdown of the acceptance criteria and study information for the MALDI Biotyper CA System, extracted from the provided text:
1. Table of Acceptance Criteria and Reported Device Performance
The document describes performance for the addition of Candida auris to the existing MBT-CA reference library, rather than a full de novo clearance study of the entire device. Therefore, the "acceptance criteria" here refer to the performance required for the inclusion of this new organism into the established system.
Criteria (for C. auris identification) | Reported Device Performance (C. auris identification) |
---|---|
High confidence organism ID (log(score) $\ge$ 2.0) | 22 out of 22 (100%) correctly identified |
Low confidence organism ID (log(score) $\ge$ 1.7 - |
Ask a specific question about this device
(222 days)
The MALDI Biotyper CA System is a mass spectrometer systems using matrix-assisted laser desorption/ionization - time of flight (MALDI-TOF) for the identification of microorganisms cultured from human specimens.
The MALDI Biotyper CA System is a qualitative in vitro diagnostic device indicated for use in conjunction with other clinical and laboratory findings to aid in the diagnosis of bacterial and yeast infections.
The MBT-CA System is a mass spectrometer system using matrix-assisted laser desorption/ionization - time of flight (MALDI-TOF) for the identification of microorganisms cultured from human specimens. The system uses a different methodology for organism identification based on unique protein patterns of the microorganisms obtained from mass spectrometry. The test organism's spectrum (a pattern of mass peaks) is compared with a reference spectra library (database). Using biostatistical analysis, a probability ranking of the organism identification is generated. The probability ranking is represented as a log(score) between 0.00 and 3.00. Organism identification is reported with high confidence if the log(score) is ≥2.00. An organism identification is reported with low confidence if the log(score) is between 1.70 and
Here's a breakdown of the acceptance criteria and the study details for the MALDI Biotyper CA (MBT-CA) System, based on the provided document:
1. Table of Acceptance Criteria and Reported Device Performance
The provided document does not explicitly state pre-defined acceptance criteria in terms of numerical thresholds for sensitivity, specificity, or overall accuracy. Instead, it presents performance results from various studies (reproducibility, challenge panel, method comparison) and concludes that the device performs acceptably.
However, based on the reported performance in the Method Comparison study, common metrics for identification systems would be:
Performance Metric (Interpreted) | Acceptance Criteria (Implied / Expected) | Reported Device Performance (Overall Isolate Performance from Table 6) |
---|---|---|
High Confidence ID Rate (≥ 2.0 log(score)) | High, ideally >95% for species identification | 1904 / 1930 = 98.65% (for high resolution species) |
(1904 + 130) / (1930 + 136) = 98.42% (for high & low resolution species/genus) | ||
**Low Confidence ID Rate (≥ 1.7 to 95% | (1904+23) / 1930 = 99.84% (for high resolution species) | |
(1904+130+23+5) / (1930+136) = 99.81% (for high & low resolution species/genus) | ||
False Identification Rate | 0% (critical for diagnostic accuracy) | 0% reported across several validation studies (Repeatability/Precision, LOD, Sample Stability, Validation of 50 Representative Claimed Species, Nocardia Study). For the overall isolate performance, the "Incorrect MBT-CA ID" for positive cases (3+1=4) indicates a very low rate of incorrect IDs, which are distinct from "negative" cases. The document states "no isolates were falsely identified" in the reproducibility study and similar conclusions in other studies. For the method comparison, it is reported as 0% for negative cases and very low for positive cases. |
Note: The "acceptance criteria" presented above are inferred from the strong performance and conclusions drawn in the document, rather than explicitly stated numerical targets prior to testing.
2. Sample Size Used for the Test Set and Data Provenance
-
Method Comparison Study (Overall Isolate Performance):
- Sample Size: 2091 fresh and stored organisms.
- Data Provenance: Organisms were tested at four (4) US clinical test sites and an in-house laboratory. Isolates were sub-cultured and sent to an interim reference laboratory and then to a sequencing reference laboratory for ground truth determination. This indicates prospective and retrospective data collection with a US origin.
-
Reproducibility Study:
- Sample Size: 9 unique organisms (REPRO-02 excluded). Each organism tested in duplicate, 5 days, 2 runs/day, 3 sites (9 organisms x 2 replicates x 5 days x 2 runs x 3 sites = 540 measurements). Total MBT-CA IDs for summary = 179/180 per site.
- Data Provenance: Conducted at three (3) clinical study sites (US, likely, given the FDA submission context). The organisms were "well-characterized," suggesting they might be reference strains or previously identified clinical isolates.
-
Challenge Panel Study:
- Sample Size: 46 organisms.
- Data Provenance: Selected from stored organisms from the clinical study, prepared by the interim reference laboratory. Tested at three (3) study sites (US, likely).
-
Biological/Technical Equivalency Studies:
- Sample Size: 34 species for laser equivalency (4080 spectra). Multiple species for target equivalency (e.g., 1000 measurements for repeatability/precision, 1500 for LOD, 2500 for sample stability prior to matrix, 3000 for post-matrix stability, 50 FDA cleared organisms, 1500 for mass accuracy/edge effects). Nocardia Study: 30 strains covering 6 species, resulting in ~15,000 measurements.
- Data Provenance: Not explicitly stated for specific origin, but these are technical validation studies performed by the manufacturer, likely controlled lab settings.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications
-
Method Comparison Study:
- The ground truth was established by sequencing (16S rRNA or ITS sequencing and protein gene sequencing). This relies on established molecular biology techniques, not human expert interpretation. While experts run and interpret these sequences, the core ground truth is the genetic information itself. The document does not specify a number or qualification of "experts" in the sense of clinical reviewers for ground truth determination but implies reliance on the robust and objective results of gene sequencing performed by a sequencing reference laboratory.
-
Reproducibility Study:
- Organisms were "well-characterized." The ground truth was presumably established by prior definitive identification methods, likely including gene sequencing or reputable reference lab methods. No mention of independent experts for this study's ground truth.
-
Challenge Panel Study:
- Organism identifications were "blinded to test sites," and the panel was prepared by the study interim reference laboratory. The ground truth was established by the reference lab, again likely through gold standard methods like sequencing.
4. Adjudication Method for the Test Set
The document does not describe an explicit adjudication method involving multiple human readers or a specific consensus process for discrepancies in the generated log(scores) or identifications against a human-read ground truth. Instead:
- The ground truth for the organism identity itself (reference algorithm) was established by molecular sequencing.
- The device's log(score) provides a quantitative measure of confidence. If the log(score) is too low (
Ask a specific question about this device
Page 1 of 1