(24 days)
The Influenza A Subtyping Kit contains reagents and controls of the CDC Human Influenza Virus Real-Time RT-PCR Diagnostic Panel and is intended for use in real-time RT-PCR (rRT-PCR) assays on an Applied Biosystems (ABI) 7500 Fast Dx Real-Time PCR instrument in conjunction with clinical and epidemiological information:
· For determination of the subtype of seasonal human influenza A viruses as seasonal A(H3) and/or A(H1)pdm09 from viral RNA in upper respiratory tract clinical specimens (including nasopharyneed swabs [NS], throat swabs [TS], nasal aspirates [NA], nasal washes [NW] and dual nasopharyngeal/throat swabs [NPS/TS]) and lower respiratory tract specimens (including bronchoalveolar lavage [BAL], bronchial wash [BW], tracheal aspirate [TA], sputum, and lung tissue) from human patients with signs and symptoms of respiratory infection and/or from viral culture;
· To provide epidemiologic information for surveillance of circulating influenza viruses.
Performance characteristics for influenza were established during a seasonal influenza viruses A(HIN1) and A(H3N2) were the predominant influenza A viruses in circulation and during a season when the A(H1N) Jodm09 influenza virus was the predominant influenza A virus in circulation. Performance characteristics may vary with other emerging influenza A viruses.
Negative results do not preclude influenza virus infection and should not be used as the sole basis for treatment or other patient management decisions. Conversely, positive results do not rule out bacterial infection with other viruses. The agent detected may not be the definite cause of disease.
If infection with a novel influenza A virus is suspected based on current clinical and epidemiological screening criteria recommended by public health authorities, specimens should be collected with appropriate infection control precautions for novel virulent influenza viruses and sent to state or local health department for testing. Viral culture should not be attempted unless a BSL 3E facility is available to receive and culture specimens.
All users, and any person reporting results from use of this device should be trained to perform and interpret the results from this procedure by a competent instructor prior to use. CDC Influenza Division will limit the distribution of this device to only those users who have successfully completed a training course provided by CDC instructors or designees.
The CDC Human Influenza Real-Time RT-PCR Diagnostic Panel Influenza A Subtyping Kit is a realtime RT-PCR (rRT-PCR) assay that utilizes the Applied Biosystems® (ABI) 7500 Fast Dx Real-time PCR system. The Influenza A Subtyping Kit consists of oligonucleotide primers, fluorescently labeled hydrolysis probes, and controls which are used in rRT-PCR assays for the in vitro qualitative detection and characterization of influenza virus RNA in respiratory specimens from patients presenting with influenza-like illness (ILI). The oligonucleotide primers and probes for detection of influenza A and 2009 influenza A (swine origin) were selected from highly conserved regions of the matrix (M), and the nucleoprotein (NP), respectively. Oligonucleotide primers and probes for characterization and differentiation of influenza A(H3) and A(H1)pdm09 viruses were selected from highly conserved regions of their HA genes. The Influenza A Subtyping kit also contains primers and probes to detect the human RNase P gene (RP) in control samples and clinical specimens.
This document describes the CDC Human Influenza Virus Real-Time RT-PCR Diagnostic Panel, Influenza A Subtyping Kit (VER 2), which is intended for the qualitative detection and characterization of influenza virus RNA. The document outlines changes from a predicate device (K140851) including modifications to the pdmH1 assay and the removal of the H1 assay.
Here's an analysis of the acceptance criteria and supporting studies as presented in the document:
1. Table of Acceptance Criteria and Reported Device Performance
The document primarily focuses on demonstrating the analytical and clinical performance of the modified pdmH1 assay and the H3 assay. While explicit acceptance criteria (e.g., "PPA must be >X%") are not formalized in a table of the document, the studies demonstrate a high level of performance. Based on the results, implicit acceptance criteria would involve:
- Analytical Sensitivity (LOD): Consistent detection at low viral concentrations for A(H1)pdm09 and A(H3) assays using both enzyme kits.
- Inclusivity: Successful detection of diverse A(H1)pdm09 strains.
- Clinical Performance (Positive Agreement): High percentage of agreement with previously positive clinical samples for A(H1)pdm09 and A(H3).
- Clinical Performance (Negative Agreement): High percentage of agreement with previously negative clinical samples for influenza A for both pdm and H3 assays.
| Performance Metric | Acceptance Criteria (Implied) | Reported Device Performance (CDC Human Influenza Virus Real-Time RT-PCR Diagnostic Panel, Influenza A Subtyping Kit (VER 2)) |
|---|---|---|
| Analytical Sensitivity (LOD) - pdmH1 assay A/West Virginia/01/2016 | Consistent detection (≥ 95% of replicates positive) at specified viral concentrations. | Invitrogen SuperScript™: 100.9 ID50/mL |
| Quanta qScript™: 100.9 ID50/mL | ||
| Confirmed by testing 20 replicates, with ≥95% positive. | ||
| Analytical Sensitivity (LOD) - pdmH1 assay A/California/07/2009 | Consistent detection (≥ 95% of replicates positive) at specified viral concentrations. | Invitrogen SuperScript™: 103.1 ID50/mL |
| Quanta qScript™: 103.8 ID50/mL | ||
| Confirmed by testing 20 replicates, with ≥95% positive. | ||
| Analytical Sensitivity (LOD) - H3 assay A/Hong Kong/4801/2014 Equivalency | Equivalency in LOD between cleared H3 BHQ probe and H3 ZEN probe. | All 3/3 replicates positive for both H3 IVD BHQ and H3 ZEN probes across all dilutions ($10^{4.9}$ to $10^{0.9}$ EID50/mL) for both enzyme systems (Invitrogen Superscript™ and Quanta qScript™). |
| Inclusivity (for 10 A(H1)pdm09 strains) | Reactive with all tested A(H1)pdm09 isolates at or near LOD. | The kit was reactive with all 10 tested H1N1pdm09 isolates (3/3 positives for InfA, pdmInfA, and pdmH1 assays with both enzyme systems). |
| Clinical Performance - A(H1)pdm09 Positive Agreement | High positive agreement with previously positive clinical samples (e.g., >95% PPA with tight CI). | Invitrogen SuperScript™: |
- BW: 1/1 (100.0% PPA, 95% CI: 20.7-100.0)
- NPS, NS: 34/35 (97.1% PPA, 95% CI: 85.5-99.5)
- NW: 4/4 (100.0% PPA, 95% CI: 51.0-100.0)
- TS: 2/2 (100.0% PPA, 95% CI: 34.2-100.0)
Quanta qScript™: - BW: 1/1 (100.0% PPA, 95% CI: 20.7-100.0)
- NPS, NS: 33/33 (100.0% PPA, 95% CI: 89.6-100.0)
- NW: 4/4 (100.0% PPA, 95% CI: 51.0-100.0)
- TS: 2/2 (100.0% PPA, 95% CI: 34.2-100.0) |
| Clinical Performance - A(H3) Positive Agreement | High positive agreement with previously positive clinical samples (e.g., >95% PPA with tight CI). | Invitrogen SuperScript™: - NA: 1/1 (100.0% PPA, 95% CI: 20.7-100.0)
- NPS, NS: 30/30 (100.0% PPA, 95% CI: 88.7-100.0)
- NW: 1/1 (100.0% PPA, 95% CI: 20.7-100.0)
Quanta qScript™: - NA: 1/1 (100.0% PPA, 95% CI: 20.7-100.0)
- NPS, NS: 30/30 (100.0% PPA, 95% CI: 88.7-100.0)
- NW: 1/1 (100.0% PPA, 95% CI: 20.7-100.0) |
| Clinical Performance - A(H1)pdm09 Negative Agreement | High negative agreement with previously negative clinical samples (e.g., >95% NPA with tight CI). | Invitrogen SuperScript™: - NPS: 53/53 (100.00% NPA, 95% CI: 93.2-100.0)
Quanta qScript™: - NPS: 52/52 (100.00% NPA, 95% CI: 93.1-100.0) |
| Clinical Performance - A(H3) Negative Agreement | High negative agreement with previously negative clinical samples (e.g., >95% NPA with tight CI). | Invitrogen SuperScript™: - NPS: 29/29 (100.00% NPA, 95% CI: 88.3-100.0)
Quanta qScript™: - NPS: 28/28 (100.00% NPA, 95% CI: 87.9-100.0) |
2. Sample Sizes Used for the Test Set and Data Provenance
- Analytical Sensitivity (LOD):
- pdmH1 assay: For each of the two A(H1)pdm09 strains tested, 20 replicates of the highest virus dilution were used to confirm LOD.
- H3 assay: A range finding study used 3 replicates per dilution for the LOD equivalency, but the confirmatory LOD for H3 is not explicitly stated in the same manner as pdmH1. However, the study concludes equivalency based on consistent positive results for 3/3 replicates across a range of dilutions.
- Inclusivity Testing: Ten (10) A(H1)pdm09 strains were tested, with each strain tested in triplicate.
- Cross-Reactivity Testing: Five (5) influenza A(H1) virus strains were tested, each in triplicate.
- Clinical Performance Evaluation:
- Positive A(H1)pdm09: A total of 42 retrospective clinical samples previously determined positive for A(H1)pdm09 were evaluated. The breakdown by specimen type for reported results is 1 BW, 35 NPS/NS, 4 NW, and 2 TS for Invitrogen; and 1 BW, 33 NPS/NS, 4 NW, and 2 TS for Quanta.
- Positive A(H3): A total of 32 retrospective clinical samples previously determined positive for A(H3) were evaluated. The breakdown by specimen type is 1 NA, 30 NPS/NS, and 1 NW for both enzyme systems.
- Negative for Influenza A (pdm assays): A total of 53 retrospective clinical samples (NPS) previously determined negative for influenza A were tested for pdm assays.
- Negative for Influenza A (H3 assay): A total of 30 retrospective clinical samples (NPS) previously determined negative for influenza A were tested for H3 assay.
- Data Provenance: Retrospective clinical samples collected during the 2011-2012, 2013-2014, and 2015-2016 influenza seasons. The country of origin is not explicitly stated but implied to be the US given the CDC context.
3. Number of Experts Used to Establish Ground Truth for the Test Set and Their Qualifications
The document does not explicitly state the number or qualifications of experts used to establish the ground truth for the clinical test set. The ground truth for clinical samples was based on prior determination using the "CDC Human Influenza rRT-PCR Diagnostic Panel" and, for the 2015-2016 samples, confirmation by genetic sequence analysis. This implies the use of laboratory professionals and possibly virologists or epidemiologists, but specific details on their expertise are not provided.
4. Adjudication Method for the Test Set
The document does not describe an explicit adjudication method for the test set results. For the analytical studies, replicates are used, and the standard reporting of "X/X (+)" indicates all replicates were positive. For clinical samples, results were compared against prior determinations and genetic sequencing, suggesting these served as the reference standards rather than a separate adjudication process.
5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done
No, a Multi-Reader Multi-Case (MRMC) comparative effectiveness study was not performed. This device is a diagnostic assay (RT-PCR kit), not an imaging or interpretation device that would typically involve multiple human readers. The study focuses on the analytical and clinical performance of the assay itself.
6. If a Standalone (Algorithm Only Without Human-in-the-Loop Performance) Was Done
Yes, the studies conducted are standalone performance evaluations of the diagnostic assay. The device is a "Real-Time RT-PCR Diagnostic Panel," meaning the "algorithm" is the biochemical and molecular process of the assay itself, followed by data interpretation based on established thresholds (e.g., Ct values). The results presented are the output of this assay system.
7. The Type of Ground Truth Used
- Analytical Studies (LOD, Inclusivity, Cross-Reactivity): Ground truth was established using characterized viruses of known titers (ID50/mL or EID50/mL).
- Clinical Performance Studies:
- For positive samples: Ground truth was based on previous positive determination with the "CDC Human Influenza rRT-PCR Diagnostic Panel" and, for some 2015-2016 samples, confirmed by genetic sequence analysis.
- For negative samples: Ground truth was based on previous negative determination for influenza A with the "CDC Human Influenza rRT-PCR Diagnostic Panel."
8. The Sample Size for the Training Set
The document does not explicitly describe a "training set" in the context of machine learning, as this is a molecular diagnostic assay. The development of the oligonucleotide primers and probes would involve extensive bioinformatics and laboratory work, but these are not referred to as a "training set" in the presented material. The "characterization" of the device involves testing its performance with known inputs rather than training an algorithm.
9. How the Ground Truth for the Training Set Was Established
As no explicit "training set" for a machine learning algorithm is described, this question is not directly applicable. The "ground truth" for the development of the assay components (primers and probes) would have been established through molecular biology techniques, genomic sequencing, and epidemiological data on circulating influenza strains to identify conserved regions and ensure specificity. The document mentions that the primers and probes were "selected from highly conserved regions" of the viral genes, implying this foundational work.
§ 866.3980 Respiratory viral panel multiplex nucleic acid assay.
(a)
Identification. A respiratory viral panel multiplex nucleic acid assay is a qualitative in vitro diagnostic device intended to simultaneously detect and identify multiple viral nucleic acids extracted from human respiratory specimens or viral culture. The detection and identification of a specific viral nucleic acid from individuals exhibiting signs and symptoms of respiratory infection aids in the diagnosis of respiratory viral infection when used in conjunction with other clinical and laboratory findings. The device is intended for detection and identification of a combination of the following viruses:(1) Influenza A and Influenza B;
(2) Influenza A subtype H1 and Influenza A subtype H3;
(3) Respiratory Syncytial Virus subtype A and Respiratory Syncytial Virus subtype B;
(4) Parainfluenza 1, Parainfluenza 2, and Parainfluenza 3 virus;
(5) Human Metapneumovirus;
(6) Rhinovirus; and
(7) Adenovirus.
(b)
Classification. Class II (special controls). The special controls are:(1) FDA's guidance document entitled “Class II Special Controls Guidance Document: Respiratory Viral Panel Multiplex Nucleic Acid Assay;”
(2) For a device that detects and identifies Human Metapneumovirus, FDA's guidance document entitled “Class II Special Controls Guidance Document: Testing for Human Metapneumovirus (hMPV) Using Nucleic Acid Assays;” and
(3) For a device that detects and differentiates Influenza A subtype H1 and subtype H3, FDA's guidance document entitled “Class II Special Controls Guidance Document: Testing for Detection and Differentiation of Influenza A Virus Subtypes Using Multiplex Nucleic Acid Assays.” See § 866.1(e) for the availability of these guidance documents.