(135 days)
The QuickVue Influenza A/B Test is intended for the rapid, qualitative detection of influenza Types A and B antigen directly from nasal swab, nasal wash and/or nasal aspirate specimens. The test is intended for use as an aid in the rapid diagnosis of acute influenza virus infection. The test is intended for professional and laboratory use.
The QuickVue Influenza A/B Test is a lateral-flow immunoassay using highly sensitive moroclonal antibodies that are specific for influenza antigens. The test is specific to influenza Types A and B antigen with no know cross-reactivity to normal flora or other known respiratory pathogens.
Here's a summary of the acceptance criteria and study information for the QuickVue Influenza A/B Test based on the provided text:
Acceptance Criteria and Reported Device Performance
The document does not explicitly state pre-defined acceptance criteria values (e.g., "sensitivity must be >90%"). Instead, it describes demonstrating "substantial equivalence" to viral culture. The reported performance is based on exceeding a general benchmark of agreement for laboratory personnel.
Acceptance Criteria Category | Specific Acceptance Criteria (Inferred/Stated) | Reported Device Performance |
---|---|---|
Clinical Performance | Substantial equivalence to viral culture for qualitative detection of Influenza Type A and B antigens. | Demonstrated in a multi-clinical field study. (Specific metrics like sensitivity/specificity are not provided in this summary document, only the conclusion of substantial equivalence). |
User Performance | Doctors' office personnel with diverse educational backgrounds and work experience can perform the test accurately and reproducibly. | >99% agreement with expected results in Physician's Office Laboratory (POL) studies. |
Study Details
-
Sample size used for the test set and the data provenance:
- Test Set Sample Size: Two distinct studies are mentioned:
- A "multi-clinical field study" for substantial equivalence to viral culture. The exact number of clinical specimens or patients is not provided.
- "Physician's Office Laboratory studies" conducted at three geographically distinct sites in the United States. The exact number of tests performed or samples used in these POL studies is not provided.
- Data Provenance:
- Clinical specimens obtained from patients symptomatic for upper respiratory infection.
- POL studies were conducted in the United States at three geographically distinct sites.
- Both studies appear to be prospective, as they compare the QuickVue test to viral culture or assess user performance in real-time settings.
- Test Set Sample Size: Two distinct studies are mentioned:
-
Number of experts used to establish the ground truth for the test set and the qualifications of those experts:
- The primary ground truth for the clinical performance study was viral culture. The document does not specify the number or qualifications of experts interpreting the viral culture results. Viral culture itself is considered a gold standard in this context, and interpretation is typically handled by trained laboratory personnel or virologists, though this is not explicitly stated.
- For the POL studies, "expected results" were used, implying a reference standard, but the origin or expert involvement in establishing these "expected results" is not detailed.
-
Adjudication method for the test set:
- The document does not describe any specific adjudication method (e.g., 2+1, 3+1) for resolving discrepancies between the QuickVue test and the reference standard (viral culture). It simply states a "comparison" was conducted.
-
If a multi-reader multi-case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:
- No, a multi-reader multi-case (MRMC) comparative effectiveness study was not performed. This device is a rapid diagnostic test (lateral-flow immunoassay), not an AI-based diagnostic requiring human reader assistance. The "user performance" study focused on the ability of doctors' office personnel to perform the test accurately, not on their improvement with technological assistance.
-
If a standalone (i.e., algorithm only without human-in-the-loop performance) was done:
- Yes, the QuickVue Influenza A/B Test operates as a standalone device. Its performance is evaluated intrinsically through comparison to a reference standard (viral culture) for antigen detection. There is no "human-in-the-loop" component in the sense of a software algorithm assisting a human interpreter; the human conducts and reads the test directly.
-
The type of ground truth used (expert consensus, pathology, outcomes data, etc.):
- For the clinical performance study, the primary ground truth was viral culture. This is a laboratory-based diagnostic method considered a gold standard for influenza detection.
-
The sample size for the training set:
- The document does not provide details on a separate "training set" or its sample size. For an immunoassay like this, the development typically involves extensive assay optimization and validation during R&D using various characterized samples, rather than a distinct "training set" in the machine learning sense. The clinical studies described are for validation of the final product.
-
How the ground truth for the training set was established:
- As no explicit "training set" is described in the provided text for this immunoassay, how its ground truth was established is not detailed. However, for immunoassay development, ground truth for optimization would typically come from well-characterized clinical samples (e.g., confirmed positive/negative by PCR or viral culture) or spiked samples with known amounts of antigen.
§ 866.3328 Influenza virus antigen detection test system.
(a)
Identification. An influenza virus antigen detection test system is a device intended for the qualitative detection of influenza viral antigens directly from clinical specimens in patients with signs and symptoms of respiratory infection. The test aids in the diagnosis of influenza infection and provides epidemiological information on influenza. Due to the propensity of the virus to mutate, new strains emerge over time which may potentially affect the performance of these devices. Because influenza is highly contagious and may lead to an acute respiratory tract infection causing severe illness and even death, the accuracy of these devices has serious public health implications.(b)
Classification. Class II (special controls). The special controls for this device are:(1) The device's sensitivity and specificity performance characteristics or positive percent agreement and negative percent agreement, for each specimen type claimed in the intended use of the device, must meet one of the following two minimum clinical performance criteria:
(i) For devices evaluated as compared to an FDA-cleared nucleic acid based-test or other currently appropriate and FDA accepted comparator method other than correctly performed viral culture method:
(A) The positive percent agreement estimate for the device when testing for influenza A and influenza B must be at the point estimate of at least 80 percent with a lower bound of the 95 percent confidence interval that is greater than or equal to 70 percent.
(B) The negative percent agreement estimate for the device when testing for influenza A and influenza B must be at the point estimate of at least 95 percent with a lower bound of the 95 percent confidence interval that is greater than or equal to 90 percent.
(ii) For devices evaluated as compared to correctly performed viral culture method as the comparator method:
(A) The sensitivity estimate for the device when testing for influenza A must be at the point estimate of at least 90 percent with a lower bound of the 95 percent confidence interval that is greater than or equal to 80 percent. The sensitivity estimate for the device when testing for influenza B must be at the point estimate of at least 80 percent with a lower bound of the 95 percent confidence interval that is greater than or equal to 70 percent.
(B) The specificity estimate for the device when testing for influenza A and influenza B must be at the point estimate of at least 95 percent with a lower bound of the 95 percent confidence interval that is greater than or equal to 90 percent.
(2) When performing testing to demonstrate the device meets the requirements in paragraph (b)(1) of this section, a currently appropriate and FDA accepted comparator method must be used to establish assay performance in clinical studies.
(3) Annual analytical reactivity testing of the device must be performed with contemporary influenza strains. This annual analytical reactivity testing must meet the following criteria:
(i) The appropriate strains to be tested will be identified by FDA in consultation with the Centers for Disease Control and Prevention (CDC) and sourced from CDC or an FDA-designated source. If the annual strains are not available from CDC, FDA will identify an alternative source for obtaining the requisite strains.
(ii) The testing must be conducted according to a standardized protocol considered and determined by FDA to be acceptable and appropriate.
(iii) By July 31 of each calendar year, the results of the last 3 years of annual analytical reactivity testing must be included as part of the device's labeling. If a device has not been on the market long enough for 3 years of annual analytical reactivity testing to have been conducted since the device received marketing authorization from FDA, then the results of every annual analytical reactivity testing since the device received marketing authorization from FDA must be included. The results must be presented as part of the device's labeling in a tabular format, which includes the detailed information for each virus tested as described in the certificate of authentication, either by:
(A) Placing the results directly in the device's § 809.10(b) of this chapter compliant labeling that physically accompanies the device in a separate section of the labeling where the analytical reactivity testing data can be found; or
(B) In the device's label or in other labeling that physically accompanies the device, prominently providing a hyperlink to the manufacturer's public Web site where the analytical reactivity testing data can be found. The manufacturer's home page, as well as the primary part of the manufacturer's Web site that discusses the device, must provide a prominently placed hyperlink to the Web page containing this information and must allow unrestricted viewing access.
(4) If one of the actions listed at section 564(b)(1)(A)-(D) of the Federal Food, Drug, and Cosmetic Act occurs with respect to an influenza viral strain, or if the Secretary of Health and Human Services (HHS) determines, under section 319(a) of the Public Health Service Act, that a disease or disorder presents a public health emergency, or that a public health emergency otherwise exists, with respect to an influenza viral strain:
(i) Within 30 days from the date that FDA notifies manufacturers that characterized viral samples are available for test evaluation, the manufacturer must have testing performed on the device with those viral samples in accordance with a standardized protocol considered and determined by FDA to be acceptable and appropriate. The procedure and location of testing may depend on the nature of the emerging virus.
(ii) Within 60 days from the date that FDA notifies manufacturers that characterized viral samples are available for test evaluation and continuing until 3 years from that date, the results of the influenza emergency analytical reactivity testing, including the detailed information for the virus tested as described in the certificate of authentication, must be included as part of the device's labeling in a tabular format, either by:
(A) Placing the results directly in the device's § 809.10(b) of this chapter compliant labeling that physically accompanies the device in a separate section of the labeling where analytical reactivity testing data can be found, but separate from the annual analytical reactivity testing results; or
(B) In a section of the device's label or in other labeling that physically accompanies the device, prominently providing a hyperlink to the manufacturer's public Web site where the analytical reactivity testing data can be found. The manufacturer's home page, as well as the primary part of the manufacturer's Web site that discusses the device, must provide a prominently placed hyperlink to the Web page containing this information and must allow unrestricted viewing access.