Search Results
Found 2 results
510(k) Data Aggregation
(30 days)
BIOFIRE SPOTFIRE Respiratory/Sore Throat (R/ST) Panel Mini
The BIOFIRE® SPOTFIRE® Respiratory/Sore Throat (R/ST) Panel Mini is a multiplexed polymerase chain reaction (PCR) test intended for use with the BIOFIRE® System for the simultaneous, qualitative detection and identification of multiple respiratory viral and bacterial nucleic acids in nasopharyngeal swab (NPS) specimens obtained from individuals with signs and symptoms of respiratory tract infection, including COVID-19; (Respiratory menu) or in throat swab (TS) specimens from individuals with signs and symptoms of pharyngitis (Sore Throat menu).
The following analytes are identified and differentiated using the SPOTFIRE R/ST Panel Mini:
Respiratory Menu:
Viruses
Coronavirus SARS-CoV-2
Human rhinovirus
Influenza A virus
Influenza B virus
Respiratory syncytial virus
Sore Throat Menu:
Viruses
Human rhinovirus
Influenza A virus
Influenza B virus
Respiratory syncytial virus
Bacteria
Streptococcus pyogenes (group A Strep)
Nucleic acids from the viral and bacterial organisms identified by this test are generally detectable in NPS/TS specimens during the acute phase of infection. The detection and identification of specific viral and bacterial nucleic acids from individuals exhibiting signs and symptoms of respiratory infection and/or pharyngitis is indicative of the presence of the identified microorganism and aids in diagnosis if used in conjunction with other clinical and epidemiological information, and laboratory findings. The results of this test should not be used as the sole basis for diagnosis, treatment, or other patient management decisions.
Negative results in the setting of a respiratory illness and/or pharyngitis may be due to infection with pathogens that are not detected by this test, or a respiratory tract infection that may not be detected by an NPS or TS specimen. Positive results do not rule out co-infection with other organisms. The agent(s) detected by the SPOTFIRE R/ST Panel Mini may not be the definite cause of disease.
Additional laboratory testing (e.g., bacterial and viral culture, immunofluorescence, and radiography) may be necessary when evaluating a patient with possible respiratory tract infection and/or pharyngitis.
The SPOTFIRE R/ST Panel Mini simultaneously identifies 5 different respiratory viral pathogens in nasopharyngeal swabs (NPS) or 5 different viral and bacterial pharyngitis pathogens in throat swabs (TS) from individuals with signs and symptoms of respiratory tract infections or pharyngitis, respectively, (see Table 1) The SPOTFIRE R/ST Panel Mini is compatible with the BIOFIRE® System, a polymerase chain reaction (PCR)-based in vitro diagnostic system for infectious disease testing. The BIOFIRE System Sottware executes the SPOTFIRE R/ST Panel Mini test and interprets and reports the test results. The SPOTFIRE R/ST Panel Mini was designed to be used in CLIA-waived environments.
A test is initiated by loading Hydration Solution injection solution injection port of the SPOTFIRE R/ST Panel Mini pouch and NPS or TS specimen, mixed with the provided Sample injection port of the SPOTFIRE R/ST Panel Mini pouch and placing it in the SPOTFIRE System. The reagents required for specimen testing and analysis in a freeze-dried format; the addition of Hydration and Sample/Buffer Mix rehydrates the reagents. After the pouch is prepared, the SPOTFIRE System Software guides the user through the steps of placing the pouch into the instrument, scanning the sample identification, and initiating the run.
The SPOTFIRE System contains coordinated systems of inflatable bladders and seal points, which act on the pouch to control the movement of liquid between the pouch blisters. When a bladder is inflated over a reagent blister, it forces liquid from the blister into connecting channels. Alternatively, when a seal is placed over a connecting channel it acts as a valve to open or close a channel. In addition, electronically-controlled pneumatic pistons are positioned over multiple plungers in order to deliver the rehydrated reagents into the blisters at the appropriate times. Two Peltier devices control heating and cooling of the pouch to drive the PCR reactions and the melt curve analysis.
Nucleic acid extraction occurs within the SPOTFIRE R/ST Panel Mini pouch using mechanical Ivsis followed by purfication using standard magnetic bead technology. After extracting and purifying nucleic acids from the unprocessed sample, the SPOTFIRE System performs a nested multiplex PCR that is executed in two stage. During the first stage, the SPOTFIRE System performs a single, large volume, highly multiplexed reverse transcription PCR (rt-PCR) reaction. The products from first stage PCR are then diluted and combined with a fresh, primer-free master mix and a fluorescent doublestranded DNA binding dye (LC Green® Plus, BioFire Diagnostics). The solution is then distributed to each well of the array. Array wells contain sets of primers designed specifically to amplify sequences internal to the PCR products generated during the first stage PCR reaction. The 2nd stage PCR, or nested PCR, is performed in singleplex fashion in each well of the array. At the conclusion of the 2nd stage PCR, the array is interrogated by melt curve analysis for the detection of signature amplicons denoting the presence of specific targets. A digital camera placed in front of the 2nd stage PCR captures fluorescent images of the PCR reactions and software interprets the data.
The SPOTFIRE System Software automatically interprets the results of each DNA melt curve analysis and combines the data with the results of the internal pouch controls to provide a test result for each organism on the SPOTFIRE R/ST Panel Mini.
This document describes the BIOFIRE® SPOTFIRE® Respiratory/Sore Throat (R/ST) Panel Mini, a multiplex PCR test.
1. Table of Acceptance Criteria and Reported Device Performance
The document provides extensive analytical performance data rather than a direct comparison of acceptance criteria to reported clinical performance metrics (like PPA and NPA). However, the "Summary of Performance Data" for clinical studies does present sensitivity/PPA and specificity/NPA, which can be interpreted as the reported device performance against implied clinical acceptance criteria.
Clinical Performance Summary (NPS Specimens - Respiratory Menu)
Analyte | Performance Metric (Prospective) | % | 95% CI |
---|---|---|---|
Coronavirus SARS-CoV-2 (PPA) | 71/73 | 97.3 | 90.5-99.2% |
Coronavirus SARS-CoV-2 (NPA) | 1031/1037 | 99.4 | 98.7-99.7% |
Human rhinovirus (PPA) | 345/348 | 99.1 | 97.5-99.7% |
Human rhinovirus (NPA) | 695/767 | 90.6 | 88.3-92.5% |
Influenza A virus (PPA) | 0/0 (no positive cases identified) | - | - |
Influenza A virus (NPA) | 1115/1115 | 100 | 99.7-100% |
Influenza B virus (PPA) | 0/0 (no positive cases identified) | - | - |
Influenza B virus (NPA) | 1110/1110 | 100 | 99.7-100% |
Respiratory syncytial virus (PPA) | 26/27 | 96.3 | 81.7-99.3% |
Respiratory syncytial virus (NPA) | 1086/1088 | 99.8 | 99.3-100% |
Clinical Performance Summary (TS Specimens - Sore Throat Menu)
Analyte | Performance Metric (Prospective) | % | 95% CI |
---|---|---|---|
Human rhinovirus (Sensitivity/PPA) | 202/213 | 94.8 | 91.0-97.1% |
Human rhinovirus (Specificity/NPA) | 619/662 | 93.5 | 91.4-95.1% |
Influenza A virus (Sensitivity/PPA) | 35/35 | 100 | 90.1-100% |
Influenza A virus (Specificity/NPA) | 840/840 | 100 | 99.5-100% |
Influenza B virus (Sensitivity/PPA) | 4/4 | 100 | 51.0-100% |
Influenza B virus (Specificity/NPA) | 872/872 | 100 | 99.6-100% |
Respiratory syncytial virus (Sensitivity/PPA) | 21/24 | 87.5 | 69.0-95.7% |
Respiratory syncytial virus (Specificity/NPA) | 849/851 | 99.8 | 99.1-99.9% |
Streptococcus pyogenes (PPA - PCR) | 209/217 | 96.3 | 92.9-98.1% |
Streptococcus pyogenes (NPA - PCR) | 654/660 | 99.1 | 98.0-99.6% |
Streptococcus pyogenes (Sensitivity - Culture) | 174/177 | 98.3 | 95.1-99.4% |
Streptococcus pyogenes (Specificity - Culture) | 654/692 | 94.5 | 92.6-96.0% |
Analytical Acceptance Criteria and Results for key studies:
Study | Acceptance Criteria | Reported Device Performance (Results) |
---|---|---|
Sample Storage and Handling | 100% expected positive results in all samples tested for each organism. Crossing point (Cp) values evaluated and trended across conditions to assess analyte stability. | Positive results were observed in 100% of all TSa samples tested at all conditions evaluated for all SPOTFIRE R/ST Panel Mini analytes. |
Limit of Detection (LoD) | LoD confirmed when positive results were reported in at least 95% (≥19/20) of replicates tested at 1x LoD, and fewer than 95% (≤18/20) of replicates tested at 0.1x LoD. Equivalent detection in single and multi-analyte samples based on concordance of positive/negative results. | The LoD concentrations for the SPOTFIRE R/ST Panel Mini analytes were confirmed in viable or infectious units and/or nucleic acid copies/mL. The panel accurately detected viruses and bacteria in samples contrived in either VTM or Amies media containing one or multiple organisms. |
Analytical Reactivity (Inclusivity) | Assay reactivity of each isolate confirmed if positive results were reported for the appropriate analyte in 3/3 or 4/5 replicates tested within 10x LoD. If fewer than 4/5 replicates, additional testing at 100x LoD or higher. Isolates with reactivity limitations noted in product literature. | Analytical reactivity testing demonstrated that the SPOTFIRE R/ST Panel Mini can detect and accurately report results for a diverse collection of isolates from a variety of strains, serotypes, and genotypes with few limitations. (Limitations noted in conclusion include rare S. pyogenes strains not detected). |
Analytical Specificity (Exclusivity) | On-panel organisms expected positive for target analyte and negative for others. Off-panel organisms expected negative for all panel analytes, unless otherwise indicated. | Three cross-reactivities were identified by empirical and/or in silico evaluations: SARS-CoV-2 with closely related sarbecoviruses, some Bordetella species with Human Rhinovirus (at high concentration), and some bovine/canine picornaviruses with Human Rhinovirus. These limitations are noted in the device labeling. |
Interference | Primary results evaluated: pass/fail/invalid for internal controls, and analyte positive/negative results. If unexpected result/control failure for one replicate, retested in two additional pouches. | Accurate results for the SPOTFIRE R/ST Panel Mini were reported in the presence of a variety of potentially interfering substances (endogenous, exogenous, technique-specific, microorganisms). |
Near-LoD/Reproducibility | Minimum of 90% agreement with expected positive results (≥95% desired) for all organisms. Minimum of 95% agreement with expected negative results. | For positive samples, agreement with expected positive results (all systems/sites) was ≥98% for all analytes. Agreement with expected negative results was 100% for all analytes. Total positive agreement nearly identical between BioFire and clinical sites (99.8% vs. 99.0%). |
Matrix Validation | Equivalent performance between artificial and natural matrices based on agreement of positive and negative results at each test concentration. Considered equivalent if negative results observed at same or similar test concentration. | Equivalent results achieved when samples prepared in natural and artificial NPS or natural and artificial TS matrices and tested with the SPOTFIRE R/ST Panel Mini. |
Transport Media Validation | Primary metric: percent agreement between candidate medium and control medium (CDC VTM) for each spiked analyte at each test concentration. 100% agreement when testing above LoD and ≥95% at LoD for compatibility. | Equivalent analyte detection observed for all representative analytes when samples were prepared in each of the candidate media types (BD™ Universal Viral Transport, and Remel MicroTest™ M4RT® Multi-Microbe Media) compared to the control medium (CDC VTM). |
Sample Carry Over | Positive and negative analyte results evaluated. Positive samples expected positive for target and negative for others. Negative samples expected negative for all analytes. | No unexpected positive results were observed in this study. |
2. Sample Sizes and Data Provenance
- Clinical Performance (Test Set):
- NPS Specimens (Respiratory Menu - Prospective): Total of 1115 specimens. The document doesn't explicitly state the country of origin but implies clinical sites (e.g., "as tested by intended users"). This is prospective data.
- NPS Specimens (Respiratory Menu - Archived): Used for some analytes, e.g., Human Rhinovirus (30 positive, 454 negative), Influenza A (59 positive, 423 negative), Influenza B (30 positive, 28 negative), RSV (37 positive, 447 negative). This is retrospective data.
- TS Specimens (Sore Throat Menu - Prospective): Total of 876 specimens for most viral targets. Streptococcus pyogenes had 217 positive (PCR) / 177 positive (Culture) and 660 negative (PCR) / 692 negative (Culture). This is prospective data.
- TS Specimens (Sore Throat Menu - Archived): Used for some analytes, e.g., Human Rhinovirus (2 positive, 57 negative), Influenza A (11 positive, 44 negative), Influenza B (20 positive, 0 negative), RSV (2 positive, 57 negative), Streptococcus pyogenes (39 positive, 10 negative). This is retrospective data.
- TS Specimens (Sore Throat Menu - Contrived): Used for some analytes, e.g., Influenza A (93 positive, 332 negative), Influenza B (49 positive, 333 negative), RSV (50 positive, 381 negative). This would be laboratory-generated data.
3. Number of Experts and Qualifications for Ground Truth
The document does not specify the number or qualifications of experts used to establish the ground truth for the clinical test set. It mentions using "molecular assays or known specimen composition" as comparator methods for most analytes, and "culture" as the reference method for Streptococcus pyogenes.
4. Adjudication Method
The document does not describe any specific adjudication method (e.g., 2+1, 3+1) for establishing the ground truth or resolving discrepancies in the clinical test set.
5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study
No MRMC comparative effectiveness study is mentioned or implied, as this device is an in vitro diagnostic (IVD) PCR test for direct pathogen detection, not an AI-assisted diagnostic imaging or interpretation tool for human readers. Therefore, the concept of "human readers improve with AI vs without AI assistance" does not apply.
6. Standalone Performance
Yes, the studies described are for standalone performance. The BIOFIRE® SPOTFIRE® R/ST Panel Mini provides automated interpretation and reporting of test results based on the PCR assay. It is designed to be used independently to generate a qualitative detection and identification of microbial nucleic acids.
7. Type of Ground Truth Used
- Clinical Performance (Prospective/Archived): The ground truth for most analytes was established using molecular assays or, in some cases, known specimen composition. For Streptococcus pyogenes, culture was also used as a reference method for some comparisons.
- Analytical Performance (LoD, Inclusivity, Exclusivity, Interference, Reproducibility, Matrix Validation, Transport Media Validation, Carry Over): The ground truth was established through known specimen composition (e.g., contrived samples with known concentrations of organisms, presence of interfering substances, specific transport media).
8. Sample Size for the Training Set
The document does not explicitly mention a "training set" in the context of machine learning or AI algorithm development. This device is a PCR-based test, and its performance is validated through analytical and clinical studies, not typically through a machine learning training phase with a distinct dataset. The "training" in this context refers to the development and optimization of the PCR primers, probes, and reaction conditions.
9. How the Ground Truth for the Training Set Was Established
Given that this is a PCR diagnostic device, not an AI algorithm in the typical sense of needing a "training set" for model learning, this question isn't directly applicable. The "ground truth" for developing and optimizing the PCR assays themselves would have been established through:
- Careful selection and validation of synthetic nucleic acid targets.
- Testing with characterized microbial isolates and clinical samples whose status was confirmed by established reference methods (e.g., sequencing, culture, validated molecular tests).
- In silico analysis of genetic sequences to design primers and probes with high specificity and inclusivity.
Ask a specific question about this device
(187 days)
BIOFIRE SPOTFIRE Respiratory/Sore Throat (R/ST) Panel
The BIOFIRE® SPOTFIRE® Respiratory/Sore Throat (R/ST) Panel is a multiplexed polymerase chain reaction (PCR) test intended for use with the BIOFIRE® System for the simultaneous, qualitative detection and identification of multiple respiratory viral and bacterial nucleic acids in nasopharyngeal swab (NPS) specimens obtained from individuals with signs and symptoms of respiratory tract infection, including COVID-19; (Respiratory menu) or in throat swab (TS) specimens from individuals with signs and symptoms of pharyngitis (Sore Throat menu).
The following organism types and subtypes are identified and differentiated using the SPOTFIRE R/ST Panel:
Respiratory Menu Viruses Adenovirus Coronavirus SARS-CoV-2 Coronavirus (seasonal) Human metapneumovirus Human rhinovirus/enterovirus Influenza A virus Influenza A virus/H1-2009 Influenza A virus/ H3 Influenza B virus Parainfluenza virus Respiratory syncytial virus
- Bacteria Bordetella parapertussis Bordetella pertussis Chlamydia pneumoniae Mycoplasma pneumoniae
Sore Throat Menu Viruses Adenovirus Coronavirus (seasonal) Human metapneumovirus Human rhinovirus/enterovirus Influenza A virus Influenza A virus/H1-2009 Influenza A virus/H3 Influenza B virus Parainfluenza virus Respiratory syncytial virus
Bacteria Chlamydia pneumoniae Mycoplasma pneumoniae Streptococcus dysgalactiae (Group C/G Strep) Streptococcus pyogenes (Group A Strep)
Nucleic acids from the viral and bacterial organisms identified by this test are generally detectable in NPS/TS specimens during the acute phase of infection and identification of specific viral and bacterial nucleic acids from individuals exhibiting signs and symptoms of respiratory infection and/or pharyngtis are indicative of the identified microorganism and aids in diagnosis if used in conjunction with other clinical and epidemiological information, and laboratory findings. The results of this test should not be used as the sole basis for diagnosis, treatment, or other patient management decisions.
Negative results in the setting of a respiratory illness and/or pharyngitis may be due to infection with pathogens that are not detected by this test, or a respiratory tract infection that may not be detected by an NPS or TS specimen. Positive results do not rule out coinfection with other organisms. The agent(s) detected by the SPOTFIRE R/ST Panel may not be the definite cause of disease.
Additional laboratory testing (e.g., bacterial and viral culture, immunofluorescence, and radiography) may be necessary when evaluating a patient with possible respiratory tract infection and/or pharyngitis.
The SPOTFIRE R/ST Panel simultaneously identifies 15 different respiratory viral and bacterial pathogens in nasopharyngeal swabs (NPS) or 14 viral and bacterial pharyngitis pathogens in throat swabs (TS) from individuals with signs and symptoms of respiratory tract infections or pharyngitis, respectively, (see Intended Use:). The SPOTFIRE R/ST Panel is compatible with the SPOTFIRE System, a polymerase chain reaction (PCR)-based in vitro diagnostic system for infectious disease testing. The SPOTFIRE System Software executes the SPOTFIRE R/ST Panel test and interprets and reports the test results. The SPOTFIRE RIST Panel was designed to be used in CLIA-waived environments. A test is initiated by loading Hydration Solution into one port of the SPOTFIRE R/ST Panel pouch and NPS or TS specimen, mixed with the provided Sample Buffer, into the port of the SPOTFIRE R/ST Panel pouch and placing it in the SPOTFIRE System. The pouch contains all of the reagents required for specimen testing and analysis in a freeze-dried format; the addition of Hydration Solution and Sample/Buffer Mix rehydrates the reagents. After the pouch is prepared, the SPOTFIRE System Software guides the user through the steps of placing the instrument, scanning the pouch barcode, entering the sample identification, and initiating the run.
The SPOTFIRE System contains coordinated systems of inflatable bladders and seal points, which act on the pouch to control the movement of liguid between the pouch blisters. When a bladder is inflated over a reagent blister, it forces liguid from the blister into connecting channels. Alternatively, when a seal is placed over a connecting channel it acts as a valve to open or close a channel. In addition, electronically controlled pneumatic pistons are positioned over multiple plungers in order to deliver the rehydrated reagents into the blisters at the appropriate times. Two Peltier and cooling of the pouch to drive the PCR reactions and the melt curve analysis.
Nucleic acid extraction occurs within the SPOTFIRE R/ST Panel pouch using mechanical and chemical lysis followed by purification using standard magnetic bead technology. After extracting and purifying nucleic acids from the unprocessed sample, the SPOTFIRE System performs a nested multiplex PCR that is executed in two stage, the SPOTFIRE System performs a single, large volume, highly multiplexed reverse transcription PCR (rt-PCR) reaction. The products from first stage PCR are then diluted and combined with a fresh, primer-free master mix and a fluorescent doublestranded DNA binding dye (LC Green® Plus, BioFire Diagnostics). The solution is then distributed to each well of the array. Array wells contain sets of primers designed specifically to amplify sequences internal to the PCR products generated during the first stage PCR reaction. The 2nd stage PCR, is performed in singleplex fashion in each well of the array. At the conclusion of the 2nd stage PCR, the array is interrogated by melt curve analysis for the detection of signature amplicons denoting the presence of specific targets. A digital camera placed in front of the 2nd stage PCR captures fluorescent images of the PCR reactions and software interprets the data.
The SPOTFIRE System Software automatically interprets the results of each DNA met curve analysis and combines the data with the results of the internal pouch controls to provide a test result for each organism on the SPOTFIRE R/ST Panel.
Here's a breakdown of the acceptance criteria and study proving the device meets those criteria, based on the provided FDA 510(k) summary for the BIOFIRE® SPOTFIRE® Respiratory/Sore Throat (R/ST) Panel:
The document describes the BIOFIRE® SPOTFIRE® Respiratory/Sore Throat (R/ST) Panel, a multiplexed PCR test for simultaneous, qualitative detection and identification of multiple respiratory viral and bacterial nucleic acids. The data presented primarily focuses on analytical performance and clinical performance to demonstrate substantial equivalence to a predicate device.
1. Table of Acceptance Criteria and Reported Device Performance
The acceptance criteria are generally implied by the performance metrics reported, specifically the Positive Percent Agreement (PPA) / Sensitivity and Negative Percent Agreement (NPA) / Specificity. For analytical studies, acceptance criteria related to percentages of positive results and agreement levels are explicitly stated.
Clinical Performance Acceptance Criteria (Implied by Data Reported):
For each analyte, the acceptance criteria are generally to achieve high PPA and NPA. While specific numerical thresholds for PPA/NPA are not explicitly listed as "acceptance criteria" in the clinical tables themselves, the FDA's clearance implies that the presented performance met their internal requirements for substantial equivalence. For diagnostic tests, generally, PPA and NPA values in the high 90s are expected.
Analytical Performance Acceptance Criteria and Reported Performance:
Study | Acceptance Criteria | Reported Device Performance and Conclusion |
---|---|---|
Clinical Performance (NPS Specimens) | High Positive Percent Agreement (PPA) and Negative Percent Agreement (NPA) for each analyte. (Specific numerical thresholds not explicitly stated as acceptance criteria in the table but are implied by the nature of regulatory submissions for diagnostic tests.) | Table 2. R/ST Panel Performance Summary for NPS Specimens (Respiratory Menu): |
Across prospective and archived studies, PPAs for individual viruses ranged from 96.3% (Respiratory syncytial virus) to 100% (Adenovirus, Human metapneumovirus, Influenza A A/H3, Influenza B, Chlamydia pneumoniae, Mycoplasma pneumoniae). NPAs for individual viruses ranged from 90.6% (Human rhinovirus/enterovirus) to 100% (Human metapneumovirus, Influenza A, Influenza A A/H1-2009, Influenza A A/H3, Influenza B, Bordetella parapertussis, Bordetella pertussis, Chlamydia pneumoniae, Mycoplasma pneumoniae). Overall high performance observed. | ||
Clinical Performance (TS Specimens) | High Sensitivity / PPA and Specificity / NPA for each analyte. (Specific numerical thresholds not explicitly stated as acceptance criteria in the table but are implied by the nature of regulatory submissions for diagnostic tests.) | Table 3. R/ST Panel Performance Summary for TS Specimens (Sore Throat Menu): |
Across prospective, archived, and contrived studies, Sensitivities/PPAs for individual viruses ranged from 81.8% (Adenovirus, archived) to 100% (multiple analytes). Specificities/NPAs for individual viruses ranged from 91.7% (Adenovirus, archived) to 100% (multiple analytes). Overall high performance observed, with some variations based on study type (e.g., contrived samples often showing 100% agreement due to controlled conditions). Culture was used as the reference method for Streptococcus dysgalactiae and Streptococcus pyogenes. | ||
Sample Storage and Handling | "For the storage condition to be considered acceptable for each organism, 100% expected positive results were required to be observed in all samples tested. In addition, crossing point (Cp) values were evaluated for each relevant assay and trended across the conditions to assess analyte stability over time." | "Positive results were observed in 100% of all TSa samples tested at all conditions evaluated for all SPOTFIRE R/ST Panel analytes." |
Conclusion: "The SPOTFIRE R/ST Panel provides accurate results when TS specimens are stored in Amies media for up to 4 hours at ambient temperature (15-25 °C), up to 3 days at refrigerated temperature (2-8 °C), and up to 30 days at frozen temperature (≤ -15 °C). Similar results were previously observed with NPS specimens stored in transport media." | ||
Limit of Detection (LoD) | "The LoD for each SPOTFIRE R/ST Panel analyte was confirmed when positive results were reported in at least 95% (≥19/20) of replicates tested at the LoD (1× LoD), and fewer than 95% (≤18/20) of replicates tested at a concentration 10-fold below LoD (0.1× LoD). Equivalent detection of representative analytes in single analyte and multi-analyte samples was determined primarily based on concordance of positive or negative results at each test concentration." | "The LoD concentrations for the SPOTFIRE R/ST Panel analytes were confirmed...The panel accurately detected viruses and bacteria in samples contrived in either VTM or Amies media containing one or multiple organisms." |
Conclusion: "The SPOTFIRE R/ST panel provides accurate detection results for all analytes in single or polymicrobial specimens when present at or above the LoD. No adverse effect on the analytical sensitivity of the SPOTFIRE R/ST Panel was observed when evaluating multi-analyte specimens." | ||
Analytical Reactivity (Inclusivity) | "The assay reactivity of each isolate was confirmed if positive results were reported for the appropriate analyte in 3/3 or 4/5 replicates tested within 10× LoD. If positive results were reported in fewer than 4/5 replicates, additional testing was performed at 100× LoD or higher." | "Analytical reactivity testing demonstrated that the SPOTFIRE R/ST Panel can detect and accurately report results for a diverse collection of isolates from a variety of strains, serotypes, and genotypes of species collected over many years and from geographically distinct locations with few limitations." Specific limitations related to Streptococcus dysgalactiae and Streptococcus pyogenes were identified and noted in device labeling. |
Analytical Specificity (Exclusivity) | "On-panel organisms were expected to have a positive result for the analyte being tested and negative results for all other analytes targeted by the panel. Off-panel organisms were expected to have negative results for all panel analytes, unless otherwise indicated." | "Six cross-reactivities were identified by empirical and/or in silico evaluations that are predicted to cause inaccurate test results...Five of the identified cross-reactivities are either due to reactivity between phylogenetic near-neighbors that are rarely observed in human populations or were further evaluated and found to not impact the panel's specificity relevant to the intended use." Specific limitations related to SARS-CoV-2, B. bronchiseptica, Bordetella species, influenza A viruses of swine origin, bovine/canine picornaviruses, and Chlamydia gallinacea were identified and noted in device labeling. |
Interference (Interfering Substances) | "If an unexpected result or control failure was observed for one replicate of a sample containing a potentially interfering substance, the affected sample was retested in two additional pouches to determine if the failure was reproducible." Implied: accurate results should be maintained in the presence of interfering substances. | "Accurate results for the SPOTFIRE R/ST Panel were reported in the presence of a variety of potentially interfering substances...". |
Conclusion: "The SPOTFIRE R/ST Panel provides accurate results in the presence of various potentially interfering substances." A warning about bleach was noted. | ||
Near-LoD/Reproducibility | "For all organisms, a minimum of 90% agreement with the expected positive results (with 95% agreement desired) to demonstrate the reproducibility of positive results, and a minimum of 95% agreement with the expected negative results was required." | "For positive samples, agreement with the expected positive results (all systems/sites) was $\ge$ 95% for all analytes. The agreement with the expected negative results was 100% for all analytes. The total positive agreement reported for testing completed at BioFire and at clinical sites was nearly identical (99.1% (2052/2070) and 98.9% (1365/1380), respectively)..." |
Conclusion: "The SPOTFIRE R/ST Panel provides accurate and reproducible analyte detection results over time and in actual use conditions when testing was performed over multiple days, by operators with differing skill levels, at different sites, using different SpotFire Systems and different reagent kit lots. ... support use of the SPOTFIRE R/ST Panel and SPOTFIRE System at sites that hold a CLIA Certificate of Waiver." | ||
Matrix Validation | "Equivalent performance between the artificial and natural sample matrices was determined primarily based on agreement of positive and negative results at each test concentration. Artificial and natural matrices were considered equivalent if negative results were observed at the same or similar test concentration." | "Performance of the SPOTFIRE R/ST Panel was determined to be equivalent in natural and artificial NPS (nNS and aNS) and in natural and artificial throat swab (nTS and aTS) matrices for five representative panel analytes. In all cases, negative results were observed in artificial and natural matrices at the same or similar test concentrations." |
Conclusion: "The results of this study demonstrated that the artificial NPS and artificial TS matrices were acceptable for use in analytical evaluation of SPOTFIRE R/ST Panel performance." | ||
Transport Media Validation | "If the overall agreement was 100% when testing above the LoD and ≥95% when testing at the LoD, then the candidate medium was determined to be compatible. It was acceptable for the agreement to be less than 95% when testing below the LoD." | "Equivalent analyte detection was observed for all representative analytes when samples were prepared in each of the candidate media types (BD™ Universal Viral Transport, and Remel MicroTest™ M4RT® Multi-Microbe Media) compared to the control medium (CDC VTM)." |
Conclusion: "The SPOTFIRE R/ST Panel demonstrated equivalent results when samples were prepared in Viral Transport Media, BD™ Universal Viral Transport, and Remel MicroTest™ M4RT® Multi-Microbe Media. These transport media are indicated in the product labeling as suitable for use with the SPOTFIRE R/ST Panel." | ||
Sample Carry Over | "For positive samples, a positive result was expected for the analyte being tested and negative results were expected for all other analytes on the panel. Negative samples were expected to have a negative result for all analytes." Implied: No unexpected positive results due to carry-over. | "No unexpected positive results were observed in this study." |
Conclusion: "This study demonstrated that sample-to-sample carry-over between samples containing high concentrations of organism and negative samples is unlikely to occur and that carry-over poses an acceptable risk to the accuracy of the SPOTFIRE R/ST Panel test results when testing is performed according to the instructions for use." |
2. Sample Sizes Used for the Test Set and Data Provenance
The sample sizes vary by analyte and study type (prospective, archived, contrived).
-
Clinical Performance (Test Set):
- NPS Specimens (Respiratory Menu):
- Prospective Data: The total number of NPS specimens tested across all viruses and bacteria is not explicitly stated as a single number but can be aggregated from the "Positive" and "Negative" counts for each analyte. For example, for Adenovirus, there were 33 positives and 1082 negatives, totaling 1115 prospective NPS specimens where Adenovirus was assessed. This appears to be the total number of clinical samples evaluated in the prospective study.
- Archived Data: Similarly, for Adenovirus, there were 31 positives and 439 negatives, totaling 470 archived NPS specimens.
- Contrived Data: Indicated as 0/0 for all NPS analytes, suggesting contrived samples were not used for clinical performance evaluation of NPS specimens.
- TS Specimens (Sore Throat Menu):
- Prospective Data: For Adenovirus, 65 positives and 810 negatives (total 875). This seems to be the total number of clinical throat swab specimens assessed.
- Archived Data: For Adenovirus, 11 positives and 48 negatives (total 59).
- Contrived Data: For Adenovirus, 50 positives and 381 negatives (total 431). Contrived samples were used for TS clinical performance studies.
- Data Provenance: The document states "as tested by intended users," implying clinical sites. No specific country of origin is mentioned, but typically, these studies for FDA clearance involve sites within the US. The "Prospective" studies indicate prospective collection, while "Archived" refers to retrospective samples. "Contrived" samples are laboratory-prepared.
- NPS Specimens (Respiratory Menu):
-
Analytical Performance (Test Set):
- Limit of Detection (LoD): At least 20 replicates (e.g., 19/20) tested at LoD and 10-fold below LoD for each analyte.
- Analytical Reactivity (Inclusivity): 3/3 or 4/5 replicates tested within 10x LoD for each isolate.
- Near-LoD/Reproducibility: Not explicitly stated but mentions "multiple days," "multiple operators," "three unique SPOTFIRE Systems," "three distinct clinical sites holding a CLIA waiver." The reported positive and negative agreement totals are 2070 (BioFire) and 1380 (clinical sites) tests.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and the Qualifications of Those Experts
The document does not specify the number of experts or their qualifications (e.g., radiologist with 10 years of experience
) used to establish the ground truth. This is a common characteristic of in vitro diagnostic (IVD) submissions focusing on molecular diagnostic tests.
- For molecular tests, the "ground truth" is typically established by comparator methods, often laboratory-developed tests (LDTs) or other cleared/validated molecular diagnostic assays (e.g., PCR followed by sequencing, or highly sensitive and specific reference PCR methods).
- For bacterial culture (used for Streptococcus dysgalactiae and Streptococcus pyogenes), the ground truth is established by standard microbiological culture and identification techniques, performed by trained laboratory personnel.
4. Adjudication Method for the Test Set
The document does not describe a formal adjudication method (e.g., 2+1, 3+1) for the clinical test sets. This is expected given that the ground truth is established by laboratory reference methods (molecular or culture), which typically do not involve human reader adjudication in the same way imaging studies might. Any discrepancies between the investigational device and the reference method would be investigated by the manufacturer, rather than through an expert consensus adjudication.
5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done
No, an MRMC comparative effectiveness study was not done. This type of study is primarily relevant for imaging-based AI devices where human readers interpret medical images, and the AI assists or augments their performance. The BIOFIRE SPOTFIRE R/ST Panel is a molecular diagnostic test where the output is an automated detection of nucleic acids, not an interpretation by a human reader that could be augmented by AI.
6. If a Standalone (i.e. Algorithm Only Without Human-in-the Loop Performance) Was Done
Yes, the performance data presented (Tables 2 and 3 for Clinical Performance, and Table 4 for Analytical Performance) represents the standalone performance of the BIOFIRE SPOTFIRE R/ST Panel, which includes the instrument and its automated software interpretation. The device itself is designed to provide automated results without human interpretive input for the detection of targets. The "as tested by intended users" for clinical performance indicates that the device was used in a realistic setting, but the performance metrics reflect the direct output of the system.
7. The Type of Ground Truth Used
The ground truth for the clinical performance evaluation was established using:
- Comparator molecular assays or known specimen composition for most analytes (referred to as "molecular assays or known specimen composition were used as comparator methods" for PPA/NPA). This suggests a combination of validated PCR assays, and potentially sequencing for confirmation.
- Culture for Streptococcus dysgalactiae (Group C/G Strep) and Streptococcus pyogenes (Group A Strep). This is explicitly stated: "Performance measures of sensitivity and specificity refer to the prospective and archived Streptococcus and archived Streptococcus analytes for which culture was used as the reference method."
For analytical studies, the ground truth was established by:
- Known concentrations of organisms (e.g., viable or infectious units, nucleic acid copies/mL) for LoD and Inclusivity studies.
- Defined panels of organisms or substances for Exclusivity and Interference studies.
8. The Sample Size for the Training Set
This document does not provide information on the training set size directly. The presented studies are for validation/testing of the device's performance. For molecular diagnostic assays like this, the 'training' of the algorithms (e.g., primer design, melt curve analysis interpretation) typically happens during the assay development phase, often using synthetic targets, cultured organisms, and preliminary clinical samples. However, this is not detailed in a 510(k) summary, which focuses on validation data against a defined product. The "software was verified and validated" statement implies that developmental data was used, but details on sample size for that specific phase are not provided in this regulatory summary.
9. How the Ground Truth for the Training Set Was Established
Since the training set details are not provided, the method for establishing its ground truth is also not explicitly stated in this document. However, based on typical IVD development practices:
- Ground truth for assay development (which informs the 'training' of a molecular diagnostic system) would involve well-characterized positive and negative controls, reference strains, and potentially sequenced clinical isolates.
- Molecular target sequences (
in silico
analysis) - Analytical dilution series where the exact concentration of the pathogen is known.
- Samples confirmed by multiple, orthogonal laboratory methods.
The rigorous analytical and clinical studies described in the results section serve as the validation of the final trained/developed system.
Ask a specific question about this device
Page 1 of 1