Search Results

VITEK® MS PRIME is a mass spectrometry system using matrix-assisted laser desorption/ionization time of flight mass spectrometry (MALDI-TOF MS) for the identification of microorganisms cultured from human specimens.

The VITEK® MS PRIME system is a qualitative in vitro diagnostic device indicated for use in conjunction with other clinical and laboratory findings to aid in the diagnosis of bacterial and fungal infections.

This 510(k) submission introduces the VITEK®MS PRIME System. The VITEK® MS PRIME is intended for laboratory use by professional users who are trained in microbiology and good laboratory practices.

The VITEK® MS PRIME makes microorganism identifications via matrix-assisted laser desorption/ionization - time of flight mass spectrometry (MALDI-TOF MS) technology, which includes the three basic principles of ionization, separation, and detection,

As a first step, a VITEK® MS-DS Target Slide is prepared in accordance with the instructions for use.

NOTE: Depending on the culture, the analyte sample (i.e. microorganism from cultured media) may be directly spotted to a target slide, or for Mycobacterium. Nocardia and mould it must be processed/inactivated before adding to the target slide.

Once the specimen (cultured from the appropriate media) is spotted to the target slide, a matrix is added for the purpose of easy sublimation and strong absorbance in the laser wavelength employed by theinstrument.

NOTE: The VITEK® MS PRIME is a Class 1 laser product, containing a Class 4 Neodymium-doped yttrium lithium fluoride (Nd:YLF) laser – the laser operates at a wavelength of 349 nm.

The prepared slide is then loaded onto the VITEK®MS PRIME instrument. where a laser targets the sample spot and pulses the isolate spot, resulting in vibrational excitation of matrix and analyte molecules. The matrix transfer protons to the analyte resulting in a positive charge. So as part of the first basic principle, the ionized molecules are then accelerated in an electromagnetic field and a grid electrode in the ionization chamber.

The acceleration in the electromagnetic field is the beginning of the second basic principle (i.e. the separation process that is based of the time-of-flight principle). The velocity of the molecules depends on the mass-to-charge (m/z) ratio of the analyte, with heavier molecules having a higher moment of inertia resulting in a lower velocity.

As a final step in the basic principle of MALDI-ToF technology (i.e. detection) the time of flight is measured precisely by the ions arrival at a particle detector. This speed of the ions in flight depends on their mass - with heavier molecules having a higher moment of inertia resulting in a lower velocity. The time of transit is measured precisely by the ions' arrival at a particle detector. Based on the time of flight, the m/z ratio of each particle can be determined, and a mass spectrum of the analyte sample mixture is generated. The recorded signal is processed and presented as a spectrum of intensity versus mass in Daltons (Da). The mass spectrum displays results as a series of peaks (spectrum) which correspond to the ionized proteins derived from the analyte sample. And for identification of an unknown organism, the resulting mass spectra are sufficiently distinctive to allow taxonomic characterization at the genus and species when compared against the VITEK® MS Knowledge Base.

Here's a breakdown of the acceptance criteria and study information for the VITEK® MS PRIME, based on the provided text:

1. Table of Acceptance Criteria and Reported Device Performance:

2. Sample Sizes Used for the Test Set and Data Provenance:

• Biological Equivalency Study:

  • Sample Size: 1461 samples (representing 487 unique tests in triplicate).
  • Data Provenance: Not explicitly stated, but the strains tested included "critical pathogens" for the 479 claimed species. It is likely a combination of well-characterized laboratory strains and potentially some clinical isolates, given the reference to "clinically validated isolates." retrospective or prospective is not mentioned.

• Clinical Performance Evaluation:

  • Sample Size: 500 clinical isolates (from 100 species with five strains each).
  • Data Provenance: "clinical isolates tested from all sites combined." The specific countries of origin are not specified, but the data is explicitly from "clinical isolates," suggesting data from human specimens. The study design of using "clinical isolates" usually implies retrospective or prospectively collected samples from clinical settings. It refers to "reference identification obtained during previous clinical studies," suggesting a retrospective use of previously characterized clinical data.

• Challenge Isolate Results:

  • Sample Size: 100 challenge strains.
  • Data Provenance: Not specified, but "challenge strains" often refers to a curated set of difficult-to-identify or representative strains used for rigorous testing.

• Quality Control Results:

  • Sample Size: Not explicitly stated, but refers to "all quality control strains tested at all sites."

• Reproducibility Results:

  • Sample Size: Not explicitly stated, but refers to "Reproducibility strains."

3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications:

• The document does not directly state the number of experts or their qualifications.
• For the Clinical Performance Evaluation, the ground truth was established by "a one choice or multiple choice (more than one species) reference identification obtained during previous clinical studies." This implies that the reference identifications were well-established and accepted, likely through conventional microbiological methods and expert interpretation from those previous studies. The nature of these "previous clinical studies" (e.g., whether they involved expert consensus or a gold standard method) is not detailed.

4. Adjudication Method for the Test Set:

• The document does not explicitly describe an adjudication method for the test set results. The ground truth for the clinical performance evaluation was "reference identification obtained during previous clinical studies," implying that disagreements with a single reference standard were likely noted as discordant results rather than undergoing a separate adjudication process within this specific study.

5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study:

• No MRMC comparative effectiveness study is mentioned. This device (VITEK® MS PRIME) is an automated system for microorganism identification using MALDI-TOF MS technology, which does not involve human readers interpreting results in the same way an imaging AI algorithm would. Its performance is compared to a reference method, not to human readers' performance with and without AI assistance.

6. Standalone Performance:

• Yes, a standalone performance study was done. Both the "Biological Equivalency study" and "Clinical Performance Evaluation" describe the performance of the VITEK® MS PRIME system alone (algorithm only) in identifying microorganisms, comparing its results to a ground truth or reference identification. The stated agreement rates (e.g., 98.4% clinical agreement) are measures of this standalone performance. The device is described as "a qualitative in vitro diagnostic device indicated for use in conjunction with other clinical and laboratory findings," but the performance metrics provided are for the device's identification capability itself.

7. Type of Ground Truth Used:

• The ground truth used appears to be reference identification by accepted microbiological methods (which implicitly includes expert consensus in their establishment).
  • For the Biological Equivalency study, performance was measured "in comparison with the reference method."
  • For the Clinical Performance Evaluation, performance was determined by comparing the VITEK® MS PRIME identification to "a one choice or multiple choice (more than one species) reference identification obtained during previous clinical studies." This "reference identification" would be established through a combination of traditional culture-based methods, molecular methods, and expert interpretation/consensus over time, serving as the gold standard for organism identification. "Outcomes data" or "pathology" as the direct ground truth are not mentioned for identifying the microorganisms themselves, though the device aids in diagnosis of infections.

8. Sample Size for the Training Set:

• The document does not explicitly state the sample size for the training set. It refers to a "VITEK® MS Knowledge Base" (KB v3.2) against which the mass spectra are compared. This knowledge base is the "training set" or reference library. The complexity and size of this knowledge base are not detailed in terms of number of samples/isolates used to build it.

9. How the Ground Truth for the Training Set Was Established:

• The document states that identifications are made "when compared against the VITEK® MS Knowledge Base." While it doesn't describe the exact process for building this KB, such knowledge bases for MALDI-TOF MS systems are typically built by:
  • Acquisition of mass spectra from a large collection of well-characterized and phenotypically/genetically confirmed (often by sequencing, biochemical tests, or other gold-standard methods) reference strains across various species.
  • Each reference strain's identity is verified by expert microbiologists using established methods before being added to the database.
  • The collection process ensures reproducibility and representation of intra-species variability.
  • Thus, the ground truth for the training set (Knowledge Base) is established through a rigorous process of expert-validated identification using traditional and molecular microbiological gold standards.

Ask a specific question about this device

VITEK® MS is a mass spectrometry system using matrix-assisted laser desorption/ionization time of flight mass spectrometry (MALDI-TOF MS) for the identification of microorganisms cultured from human specimens.

The VITEK® MS system is a qualitative in vitro diagnostic device indicated for use in conjunction with other clinical and laboratory findings to aid in the diagnosis of bacterial, yeast and mould infections.

The VITEK® MS v3.0 system is a system consisting of kit reagents (VITEK® MS-CHCA, VITEK® MS-FA, VITEK® MS Mycobacterium/Nocardia Kit, VITEK® MS Mould Kit), VITEK® MS-DS target slides, and the VITEK® MS (original equipment VITEK® MS Prep Station, Knowledge Base v3.2.0, software, and the VITEK" MS (original eq

This document focuses on the VITEK® MS system, a mass spectrometry system for microorganism identification, and its performance characteristics. It outlines the acceptance criteria and details of the study conducted to prove the device meets these criteria.

1. Acceptance Criteria and Reported Device Performance

The acceptance criteria are implicitly defined by the reported performance targets which show very high agreement rates for identification. The primary performance metric is the "Total Correct Genus ID (One Choice and Low Discrimination)".

Here's a table summarizing criteria derived from the reported performance, reflecting typical expectations for such devices, and the observed performance for different organism groups.

Note: The reported performance also details "One Choice Correct" and "Low Discrimination Correct" breakouts, as well as discordant and no-ID rates, providing a comprehensive view of the device's accuracy. For example, for "All" clinical bacteria and yeast isolates tested, the agreement with reference identification was 98.8% (4189/4241).

2. Sample Size Used for the Test Set and Data Provenance

Test Set Sample Size:

• Overall Performance (Routine fresh and stock strains): 13,884 samples across various organism groups.
• Clinical Studies (Clinical isolates): 4,241 test results.
• Brucella specific testing (ATCC): 240 strains for clinical trial, 180 for reproducibility, 45 for challenge testing.

Data Provenance:
The data was collected from:

• Routine fresh and stock strains from patient cultures in clinical microbiology laboratories and bioMérieux laboratories in the United States and France. This indicates a mix of prospective and retrospective (stock strains) data and geographic diversity.
• Clinical isolates were tested at "one external clinical trial site and one internal site" for bacteria (other than Brucella) and yeasts.
• For Brucella, clinical trial, reproducibility, and challenge testing were performed at "one external clinical trial site" (specifically, ATCC is mentioned for Brucella testing). This suggests a focus on specific, well-characterized strains for Brucella.

3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications

The document does not explicitly state the number of experts used or their specific qualifications (e.g., "radiologist with 10 years of experience"). However, it mentions that "Samples were sequenced by the appropriate reference laboratory, and if needed, additional analysis was performed internally to obtain a reference identification (GenBank, dendrogram analysis)."

This implies that the ground truth was established by:

• Personnel at "appropriate reference laboratories" (implying qualified microbiologists/scientists).
• Internal personnel at bioMérieux.
• The use of "proficiency panels tested by all participating technologists at the external sites" for the clinical trial suggests that the individuals performing the tests were trained and qualified.

While specific numbers and detailed qualifications of individual experts are not provided, the methodology points to reliance on established laboratory practices and reference techniques for accurate identification.

4. Adjudication Method for the Test Set

The document does not explicitly describe a formal adjudication method (like 2+1 or 3+1 for human readers of images). For microbiological identification, the "adjudication" is inherent in the ground truth establishment process:

• Reference methods (DNA sequencing analysis, supplemental testing) are considered the gold standard.
• If sequencing was insufficient, "additional analysis was performed internally to obtain a reference identification (GenBank, dendrogram analysis)." This suggests a process where discrepancies or difficult identifications are resolved by deeper, more definitive, and comparative analysis rather than a simple consensus among multiple readers.

5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

No, a multi-reader multi-case (MRMC) comparative effectiveness study was not done in the traditional sense of comparing human readers with and without AI assistance for interpretation tasks. This device is an automated system for identifying microorganisms, not an AI for image interpretation that assists human diagnosticians. The study focuses on the accuracy of the automated system against a definitive reference method.

6. Standalone (Algorithm Only Without Human-in-the-Loop Performance)

Yes, the study primarily evaluates the standalone performance of the VITEK® MS system. The reported performance metrics (e.g., "Total Correct Genus ID") reflect the accuracy of the device's algorithm in identifying microorganisms when presented with samples.

While the "Interpretation of results and use of the VITEK® MS system require a competent laboratorian" is mentioned in the device description, the performance tables quantify the output of the machine itself compared to the ground truth, effectively reporting its standalone accuracy.

7. The Type of Ground Truth Used

The ground truth for microorganism identification was established using:

• DNA sequencing analysis: This is the primary reference method.
• Supplemental testing (when necessary): This could include biochemical tests, serology, or other definitive microbiological techniques.
• Previously well-characterized strains (ATCC or equivalent): For certain challenge or quality control tests, established strains were used, for which the identity is already known and highly reliable.
• GenBank and dendrogram analysis: Used for additional internal analysis to obtain reference identification when sequencing was not fully conclusive, reinforcing the ground truth.

This indicates a robust, multi-faceted approach to ground truth establishment, relying on genetic and phenotypic gold standards.

8. The Sample Size for the Training Set

The document does not explicitly state the sample size used for the training set for the VITEK® MS Knowledge Base (KB) v3.2.0. It mentions that the "Knowledge Base includes data representing 1316 species and 1158 taxa displayed" and "1095 species of bacteria" and "232 species of fungi." This describes the content of the database used for identification, which is analogous to the "training data" that built the system's ability to recognize these species. However, the exact number of samples or spectra used to build this database is not provided in this excerpt.

9. How the Ground Truth for the Training Set Was Established

The document describes the "Knowledge Base" as having been "developed from spectra of a number of microbial species." While it doesn't detail the training process or the ground truth establishment for the training set specifically, it's highly implied that the same rigorous methods used for the test set (DNA sequencing, supplemental testing, well-characterized strains) would have been used to curate the reference spectra within the Knowledge Base. This ensures that the foundational data used by the device for identification is accurate and reliable. The continuous updates to the "Knowledge Base v3.2.0" suggest an ongoing process of incorporating new and validated spectral data.

Ask a specific question about this device

VITEK® MS is a mass spectrometry system using matrix-assisted laser desorption/ionization – time of flight mass spectrometry (MALDI-TOF MS) for the identification of microorganisms cultured from human specimens.

The VITEK® MS is a qualitative in vitro diagnostic device in conjunction with other clinical and laboratory findings to aid in the diagnosis of bacterial, yeast and mould infections.

VITEK® MS is mass spectrometry system using matrix-assisted laser desorption/ionization-time of flight mass spectrometry (MALDI-TOF MS) for the identification of microorganisms cultured from human specimens. The VITEK® MS is a qualitative in vitro diagnostic device indicated for use in coniunction with other clinical and laboratory findings to aid in the diagnosis of bacterial, yeast and mould infections.

The VITEK® MS is intended for laboratory use by professional users who are trained in microbiology and good laboratory practices.

This 510(k) is an update to the VITEK® MS (Mass Spectrometry) clinical knowledge base (KB v3.0.0) for the purposes of identifying Mycobacterium, Nocardia, and mould isolates. As the VITEK® MS KB v3.0.0 update includes new indications for use on the VITEK® MS system, new clinical data was required to establish safety and effectiveness. To account for the detection of higher mass peaks, relevant for some moulds and Mycobacterium, the VITEK® MS acquisition station software was optimized (in v1.5.0) .

Microorqanism identifications are are made via matrix-assisted laser desorption/ionization - time of flight mass spectrometry (MALDI-TOF MS) technology, which includes the three basic principles of ionization, separation, and detection. Depending on the isolate culture, the analyte sample may be directly spotted to a target slide, or for Mycobacterium, Nocardia and mould it must be processed/inactivated before adding to the target slide. Once spotted to the target slide, a matrix is added for the purpose of easy sublimation and strong absorbance in the laser wavelength employed by the instrument.

The slide is then loaded onto the instrument, where a laser targets the sample spot and pulses the isolate spot, resulting in vibrational excitation of matrix and analyte molecules. The matrix transfer protons to the analyte resulting in a positive charge. The ionized molecules are then accelerated in an electromagnetic field and a grid electrode in the ionization chamber. The velocity of the molecules depends on the mass-to-charge (m/z) ratio of the analyte, with heavier molecules having a higher moment of inertia resulting in a lower velocity.

The time of flight is measured precisely by the ions arrival at a particle detector. Based on the time of flight, the m/z ratio of each particle can be determined, and a mass spectrum of the analyte sample mixture is generated. The mass spectrum displays results as a series of peaks (spectrum) which correspond to the ionized proteins derived from the analyte sample. The mass spectra are sufficiently distinctive to allow taxonomic characterization at the genus and species.

The VITEK® MS system is a mass spectrometry system using matrix-assisted laser desorption/ionization – time of flight mass spectrometry (MALDI-TOF MS) for the identification of microorganisms cultured from human specimens. It is a qualitative in vitro diagnostic device used in conjunction with other clinical and laboratory findings to aid in the diagnosis of bacterial, yeast, and mold infections. This summary specifically details the performance of the VITEK® MS with an updated clinical knowledge base (KB v3.0.0) for identifying Mycobacterium, Nocardia, and mold isolates.

1. Table of Acceptance Criteria and Reported Device Performance

The acceptance criteria for the VITEK® MS updated with KB v3.0.0 are implied by the reported performance, aiming for high agreement rates and very low error rates when compared against a reference method (molecular sequencing).

Reported Device Performance for Challenge Strains (Mycobacterium, Nocardia, and Mold Combined):

2. Sample Size Used for the Test Set and Data Provenance

• Sample Size (Clinical Strains): A total of 2,695 isolates (Mycobacterium, Nocardia, and mold) were tested.
• Sample Size (Challenge Strains): 100 well-characterized challenge strains were included (50 molds, 35 Mycobacterium, and 15 Nocardia).
• Data Provenance: The study was conducted at five clinical sites. The document does not specify the country of origin of the data, but it is implied to be clinical data from human specimens. The data is prospective in the sense that it was collected specifically for this performance testing, but the isolates themselves would have been collected as part of routine clinical practice.

3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts

The document does not specify the number or qualifications of experts used to establish the ground truth beyond stating that the reference method was "molecular sequencing methods." This suggests that the ground truth was established through laboratory testing rather than human expert consensus on morphological characteristics, for example.

4. Adjudication Method for the Test Set

The document does not explicitly state an adjudication method. The performance evaluation was a direct comparison of the VITEK MS identification results to molecular sequencing methods.

5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was Done

No, a Multi-Reader Multi-Case (MRMC) comparative effectiveness study was not done. This device identifies microorganisms and does not involve human readers interpreting images or data directly in a way that an MRMC study would typically assess. The performance is assessed on the accuracy of the device's identification against a reference standard.

6. If a Standalone (i.e. algorithm only without human-in-the-loop performance) was Done

Yes, the performance study described is a standalone performance assessment of the VITEK® MS system. The device automatically generates an identification based on MALDI-TOF MS data, and its results are compared directly to a molecular sequencing reference method. While professional users trained in microbiology operate the device and interpret its output in a laboratory setting, the core performance reported (agreement, error, no-ID rates) reflects the algorithm's capability without direct human interpretation influencing the primary identification result itself.

7. The Type of Ground Truth Used

The ground truth used was molecular sequencing methods. This is considered a highly accurate and definitive method for identifying microorganisms at the species level. Clinical strains included samples from both solid and liquid culture media.

8. The Sample Size for the Training Set

The document does not explicitly state the sample size for the training set. It refers to the "VITEK® MS clinical knowledge base (KB v3.0.0)," implying a database of known mass spectra used for identification. The development of this knowledge base would have involved a large and diverse collection of characterized organisms, but the specific numbers for the training set are not provided in this summary.

9. How the Ground Truth for the Training Set was Established

The document does not explicitly detail how the ground truth for the training set (clinical knowledge base) was established. However, for such diagnostic platforms, the ground truth for training data is typically established through a combination of:

• Reference methods: Including molecular sequencing (e.g., 16S rRNA gene sequencing for bacteria, ITS sequencing for fungi), conventional biochemical tests, and expert microbiological characterization.
• Pure, well-characterized strains: Often sourced from culture collections (e.g., ATCC).
• Clinical isolates: Confirmed by multiple reliable methods.

The knowledge base would be built by acquiring mass spectral profiles from these ground-truthed organisms.

Ask a specific question about this device

VITEK MS is a mass spectrometer system using matrix-assisted laser desorption/ionization time to flight (MALDI-TOF) for the identification of microorganisms cultured from human specimens.

The VITEK®MS is a qualitative in vitro diagnostic device indicated for use in conjunction with other clinical and laboratory findings to aid in the diagnosis of bacterial and yeast infections.

The VITEK® MS v2.0 system is a system consisting of kit reagents (VITEK MS-CHCA, VITEK MS-FA), VITEK MS-DS target slides, VITEK® MS Prep Station, Knowledge Base, software, and the VITEK®MS (original equipment manufacturer (OEM)-labeled Shimadzu AXIMA® Assurance mass spectrometer).

The VITEK® MS v2.0 system includes an OEM-labeled Shimadzu AXIMA® Assurance mass spectrometer linked to a reference database, referred to as Knowledge Base. Matrix assisted laser desorption ionization (MALDI) is the process used to ionize a sample in to the gas phase. A pulsed laser beam is directed on to the sample. Energy from the laser beam desorbs and ionizes the sample. Extraction plates provide high-voltage electrical fields to accelerate the ionized particles upwards through the time-of-flight (TOF) vacuum tube. An ion lens focuses the ions. Deflector plates steer the ions on a path towards the linear detector at the flight-tube. An ion gate blanks out low mass ions (for example, derived from the matrix). The detector detects the ions directly from the sample (lower-molecular weight ions followed by highermolecular weight ions). Ions hitting the detector cause an electrical signal which is recorded. The recorded signal is processed by the software and presented as a spectrum of intensity versus mass, in Daltons (Da).

During target ionization, mass spectra within a range of 2,000-20,000 Daltons are recorded in linear positive mode at a laser frequency of 50 Hz. For each interrogation, laser shots at different positions within the target well produce up to 100 mass profiles that are summed into a single, raw mass spectrum. The spectrum is then processed by baseline correction, de-noising, and peak detection to identify well-defined peaks. The list of these significant peaks is subjected to a proprietary process called "mass binning". The processed (binned) data are used to query the Knowledge Base to determine the unknown's taxonomic identity. These results are then provided in the form of a single, species-level (and sometimes subspecies-level) identification, a split (low discrimination) identification with up to four species-level alternatives displayed, or no identification.

VITEK®MS Device Acceptance Criteria and Study Summary

Here's an analysis of the VITEK®MS device's acceptance criteria and the study data provided, structured as requested:

1. Table of Acceptance Criteria and Reported Device Performance

The acceptance criteria are not explicitly stated as distinct numerical thresholds in the provided document, but rather implied by the overall performance demonstrated in the clinical study and the defined operational characteristics. The key performance indicators for a diagnostic device like VITEK®MS are typically related to its accuracy in identifying organisms. Based on the clinical study results, here's a table summarizing the performance in terms of "Correct Identification":

Note: Specific, pre-defined numerical acceptance criteria for each organism group (e.g., "Gram-positive bacteria must have >90% combined correct identification") are not explicitly listed as "acceptance criteria" in the text, but the demonstrated performance would be evaluated against what is considered clinically acceptable for such a device. The FDA's decision to classify it as Class II with special controls suggests these performance levels were deemed acceptable.

2. Sample Size Used for the Test Set and Data Provenance

• Sample Size for the Test Set:
  • Challenge Study: 300 isolates (3 panels of 100 strains each).
  • Prospective Clinical Study: 7068 isolates in total, broken down as:
    • Gram-positive bacteria: 2256 isolates
    • Gram-negative bacteria: 3656 isolates
    • Yeasts: 1156 isolates
• Data Provenance: Prospective clinical study data was collected from five clinical microbiology laboratories in the United States. The study involved patient cultures.

3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications

The document states that the reference identification for the prospective clinical study was "determined by molecular sequencing supplemented as needed by additional molecular sequencing and/or biochemical testing."

• Number of Experts: Not explicitly stated. The process "determined by molecular sequencing" implies laboratory personnel trained in molecular biology and biochemical identification methods, but not a specific count of "experts."
• Qualifications of Experts: Not explicitly stated, but inferred to be laboratory professionals skilled in molecular sequencing and biochemical testing for microbial identification. No specific years of experience or board certifications (e.g., radiologist) are mentioned, as this is a microbiology device.

4. Adjudication Method for the Test Set

The document does not explicitly describe a formal "adjudication method" in the sense of multiple experts reviewing and resolving discrepancies in the VITEK®MS results against a ground truth.

Instead, the process described for establishing ground truth is:

• "molecular sequencing supplemented as needed by additional molecular sequencing and/or biochemical testing."
• This suggests that molecular sequencing was the primary reference method, and if there were ambiguities or needs for further confirmation for the ground truth itself, additional molecular or biochemical tests were used. The document does not describe a process for resolving disagreements between the VITEK®MS result and the reference identification by a panel of human experts. Discrepancies are simply reported.

5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done, and Effect Size

No, a Multi-Reader Multi-Case (MRMC) comparative effectiveness study was not explicitly reported or described in the provided document. The study focuses on evaluating the standalone performance of the VITEK®MS device against a reference method (molecular sequencing), not on how human readers' performance improves with or without AI assistance.

6. If a Standalone (Algorithm Only Without Human-in-the-Loop Performance) Was Done

Yes, a standalone performance study was clearly done. The "Prospective Clinical Study" and the "Challenge Study" evaluate the VITEK®MS device's identification performance (algorithm only) against a reference standard. The results are presented as percentages of correct identification by the device itself. The device is described as a "mass spectrometer system for clinical use for the identification of microorganisms...a qualitative in vitro diagnostic device intended for the identification of microorganisms cultured from human specimens." Its output is an identification with a confidence value.

7. The Type of Ground Truth Used

The ground truth used for both the challenge study and the prospective clinical study was molecular sequencing supplemented as needed by additional molecular sequencing and/or biochemical testing.

8. The Sample Size for the Training Set

The training set details are described under "Knowledge Base":

• Reference database: Data representing 755 taxa, including 645 bacteria and 110 fungi.
• Isolates per species group: An average of 10 isolates (range 2-475) per species group.
• Reference spectra per species: An average of 40 reference spectra per species.

Therefore, the training set effectively included data from at least 755 taxa, with extensive spectral data (average 40 spectra per species) generated from these isolates. The total number of individual isolates used for training would be at least 755 taxa * (average 10 isolates/taxa) = ~7550 isolates if each isolate was distinct. The total number of spectra would be at least 755 taxa * (average 40 spectra/taxa) = ~30,200 spectra.

9. How the Ground Truth for the Training Set Was Established

For the training set (Knowledge Base development):

• Each reference isolate was grown on multiple media types under several growth conditions.
• Raw spectra were acquired by more than one technician using multiple instruments.
• The raw spectra were processed (baseline correction, de-noising, peak detection) to identify well-defined peaks.
• The list of significant peaks was subjected to a proprietary process called "mass binning."
• These processed (binned) data were then used to build the Knowledge Base, implying that the taxonomic identity of these reference isolates was established through standard microbiological and molecular methods prior to their inclusion in the database. While the specific methods for establishing the identity of each isolate for the knowledge base are not explicitly detailed in the same way as the clinical study's ground truth, it is understood that such reference strains would have their identities confirmed by established, reliable methods (e.g., 16S rRNA gene sequencing, traditional biochemical tests, etc.) before being used to build a diagnostic database.

Ask a specific question about this device