Search Results
Found 5 results
510(k) Data Aggregation
(87 days)
The Panther Fusion Paraflu assay is a multiplex real-time PCR (RT-PCR) in vitro diagnostic test for the rapid and qualitative detection and differentiation of parainfluenza 1 virus, parainfluenza 2 virus, parainfluenza 3 virus and parainfluenza 4 virus (HPIV-1, HPIV-2, HPIV-3, and HPIV-4). Nucleic acids are isolated and purified from nasopharyngeal (NP) swab specimens obtained from individuals exhibiting signs and symptoms of a respiratory tract infection.
This assay is intended to aid in the differential diagnosis of HPIV-1, HPIV-2, HPIV-3, and HPIV-4 infections in humans. Negative results do not preclude HPIV-1, HPIV-2, HPIV-3, and HPIV-4 infections and should not be used as the sole basis for treatment or other management decisions. This assay is designed for use on the Panther Fusion system.
The Panther Fusion Paraflu assay is a multiplex real-time PCR (RT-PCR) in vitro diagnostic test developed for use on the fully automated Panther Fusion system to detect and differentiate parainfluenza 1 virus, parainfluenza 2 virus, parainfluenza 3 virus, and parainfluenza 4 virus directly from nasopharyngeal swab specimens.
The Panther Fusion Paraflu assay involves the following steps: Sample lysis, nucleic acid capture and elution, and multiplex RT-PCR where analytes (when present) are simultaneously amplified, detected and differentiated. Nucleic acid capture and elution takes place in a single tube on the Panther Fusion system. The eluate is transferred to the Panther Fusion system reaction tube containing the assay reagents. Multiplex RT-PCR is then performed for the eluted nucleic acid on the Panther Fusion system.
Acceptance Criteria and Study for Panther Fusion Paraflu Assay
1. Table of Acceptance Criteria and Reported Device Performance
The acceptance criteria for the Panther Fusion Paraflu assay are largely based on the performance characteristics of its predicate device, the Prodesse ProParaFlu+ Assay, as well as satisfactory analytical and clinical performance established in the studies. While explicit "acceptance criteria" for sensitivity and specificity are not directly stated as numerical thresholds in this document, the clinical performance study aims to demonstrate that the device performs comparably to the reference methods (viral culture/DFA and PCR/sequencing) and that the observed performance (sensitivity, specificity, PPA, NPA) is clinically acceptable. The analytical studies establish the device's technical capabilities.
Here's a summary of the reported device performance from the clinical study (Table 12), which implicitly meets the acceptance threshold for substantial equivalence:
| Analyte | Performance Metric | Reported Device Performance (95% CI) |
|---|---|---|
| HPIV-1 | Sensitivity | 97.1 (85.1-99.5) |
| HPIV-1 | Specificity | 99.6 (99.4-99.8) |
| HPIV-2 | Sensitivity | 91.7 (74.2-97.7) |
| HPIV-2 | Specificity | 99.5 (99.1-99.7) |
| HPIV-3 | Sensitivity | 96.3 (87.5-99.0) |
| HPIV-3 | Specificity | 99.0 (98.6-99.3) |
| HPIV-4 | Positive Percent Agreement (PPA) | 96.7 (83.3-99.4) |
| HPIV-4 | Negative Percent Agreement (NPA) | 99.8 (99.6->99.9) |
2. Sample Size and Data Provenance for the Test Set
- Sample Size Used for the Test Set: 2870 evaluable samples were used for the clinical performance analyses for each analyte. (Initially 2961 specimens were obtained, but 31 were withdrawn, and some had invalid reference results, leading to 2870 evaluable samples).
- Data Provenance: The samples were "leftover, remnant nasopharyngeal (NP) swab specimens" collected from "male and female individuals of all ages exhibiting signs and/or symptoms of a respiratory tract infection." The samples were obtained from "Four participating US pediatric/adolescent, private, and/or university hospitals." The study was prospective in terms of data collection for the clinical performance assessment.
3. Number of Experts and Qualifications for Ground Truth
The document does not explicitly state the number or specific qualifications of experts used to establish the ground truth. However, it indicates the methods used:
- For HPIV-1 and HPIV-3: Reference viral culture followed by direct fluorescent antibody (DFA) identification. This implies laboratory personnel experienced in virology and cell culture techniques.
- For HPIV-4: 2 unique and independently developed reverse transcriptase PCR assays followed by bi-directional sequencing. This would involve molecular biology experts and potentially bioinformaticians for sequence analysis.
4. Adjudication Method for the Test Set
The adjudication method differed by analyte:
- For HPIV-1 and HPIV-3: A validated PCR assay was used for discordant resolution testing.
- For HPIV-4: No discordant resolution testing was performed. The reference assay for HPIV-4 was based on a composite result of two different reverse transcriptase PCR assays followed by bi-directional sequencing. This implies that the consensus of these two independent PCR/sequencing results served as the definitive ground truth for HPIV-4.
5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study
No, a multi-reader multi-case (MRMC) comparative effectiveness study was not done. This device is an in vitro diagnostic test (a laboratory assay) and does not involve human readers in the same way an imaging or AI diagnostic algorithm would. The performance is assessed against established laboratory reference methods.
6. Standalone (Algorithm Only) Performance
Yes, a standalone performance study was done. The "Panther Fusion Paraflu assay" is a fully automated system that performs nucleic acid extraction, amplification, and detection. Its performance as an algorithm/assay without human intervention during the diagnostic process is precisely what the analytical and clinical performance studies describe. The results presented in the tables (e.g., Table 12 for clinical performance, Tables 8, 9, 13, 14, 15 for analytical precision and reproducibility) represent the standalone performance of the device.
7. Type of Ground Truth Used
The ground truth varied by analyte:
- For HPIV-1 and HPIV-3: Viral culture followed by direct fluorescent antibody (DFA) identification. In cases of discordance, a validated PCR assay was used for resolution. This represents a combination of traditional laboratory methods (culture/DFA) and molecular diagnostic (PCR) as expert consensus for confirmed cases.
- For HPIV-4: Two unique and independently developed reverse transcriptase PCR assays followed by bi-directional sequencing. This represents molecular diagnostic confirmation via sequencing.
8. Sample Size for the Training Set
The document does not explicitly state a "training set" size for the Panther Fusion Paraflu assay in the context of an algorithm that learns from data. This is likely because the Panther Fusion Paraflu assay is a molecular diagnostic test based on pre-designed primers and probes for specific viral targets, rather than a machine learning algorithm that is "trained" on a dataset in the conventional sense. The development of such assays involves extensive analytical validation to ensure specificity and sensitivity through iterative design and testing for the targeted genetic sequences.
The analytical studies (e.g., LoD, interference, specificity) involved specific panels and spiked samples to characterize the assay's performance, but these are not referred to as a "training set."
9. How the Ground Truth for the Training Set Was Established
As noted above, there isn't a "training set" in the machine learning sense. The ground truth for the analytical validation (e.g., LoD, interference, specificity) was established by using:
- Well-characterized viral strains (e.g., HPIV-1, HPIV-2, HPIV-3, HPIV-4) at known concentrations (e.g., TCID50/mL).
- Spiking these known viral strains into negative clinical specimens or simulated clinical matrix.
- Testing panels of known interfering organisms (viral, bacterial, yeast) and substances to confirm lack of cross-reactivity or interference.
The positivity or negativity in these analytical studies is determined by the known content of the prepared spiked samples.
Ask a specific question about this device
(33 days)
The Prodesse® ProParaflu®+ Assay is a multiplex Real-Time PCR (RT-PCR) in vitro diagnostic test for the qualitative detection and discrimination of Parainfluenza 1 Virus, Parainfluenza 2 Virus and Parainfluenza 3 Virus (HPIV-1. HPIV-2 and HPIV-3) nucleic acids isolated and purified from nasopharyngeal (NP) swab specimens obtained from individuals exhibiting signs and symptoms of respiratory tract infections. This Assay targets the conserved regions of the Hemagglutinin-Neuraminidase (HN) gene of HPIV-1, HPIV-2 and HPIV-3, respectively. The detection and discrimination of HPIV-1, HPIV-2 and HPIV-3 nucleic acids from symptomatic patients aid in the diagnosis of human respiratory tract parainfluenza infections if used in conjunction with other clinical and laboratory findings. This test is not intended to detect Parainfluenza 4a or Parainfluenza 4b Viruses.
Negative test results are presumptive and should be confirmed by cell culture. Negative results do not preclude Parainfluenza 1, 2 or 3 virus infections and should not be used as the sole basis for treatment or other management decisions.
The ProParaflu+ assay enables detection and differentiation of Parainfluenza 1 Virus, Parainfluenza 2 Virus, Parainfluenza 3 Virus and Universal Internal Control nucleic acids. Nasopharyngeal swab specimens are collected from symptomatic patients using a polyester, rayon or nylon tipped swab and placed into viral transport medium.
A Universal Internal Control (UIC) is added to each sample prior to nucleic acid isolation to monitor for inhibitors present in the specimens. The isolation and purification of the nucleic acids is performed using either a MagNA Pure LC Instrument (Roche) and the MagNA Pure Total Nucleic Acid Isolation Kit (Roche) or a NucliSENS® easyMAG™ System (bioMérieux) and the Automated Magnetic Extraction Reagents (bioMérieux).
The purified nucleic acids are added to ProParaflu+ Supermix along with enzymes included in the ProParaFlu+ Assay Kit. The ProParaflu+ Supermix contains oligonucleotide primers and target-specific oligonucleotide probes. The primers are complementary to highly conserved regions of genetic sequences for these respiratory viruses. The probes are dual-labeled with a reporter dye and a quencher.
Reverse transcription of the RNA in the sample into complementary DNA (cDNA) and subsequent amplification of DNA is performed in a Cepheid SmartCycler® II instrument. In this process, the probe anneals specifically to the template followed by primer extension and amplification. The ProParaFlu+ Assay is based on Tagman chemistry, which utilizes the 5' - 3' exonuclease activity of the Taq polymerase to cleave the probe thus separating the reporter dye from the quencher. This generates an increase in fluorescent signal upon excitation from a light source. With each cycle, additional reporter dye molecules are cleaved from their respective probes, further increasing fluorescent signal. The amount of fluorescence at any given cycle is dependent on the amount of amplification products present at that time. Fluorescent intensity is monitored during each PCR cycle by the SmartCycler II instrument.
This document describes the Prodesse® ProParaflu®+ Assay, a multiplex Real-Time PCR (RT-PCR) in vitro diagnostic test for the qualitative detection and discrimination of Parainfluenza 1, 2, and 3 Viruses.
Here's an analysis addressing your request:
Acceptance Criteria and Device Performance
The provided document is a 510(k) summary, which focuses on demonstrating substantial equivalence to a predicate device. It highlights similarities and differences, and mentions limitations related to specific CAP samples. Crucially, this document does not explicitly state acceptance criteria in terms of performance metrics (e.g., sensitivity, specificity, accuracy) nor does it present detailed study results proving the device meets said acceptance criteria.
The "Substantial Equivalence" section primarily states that the Intended Use, Warnings and Precautions, Organisms Detected, Analyte, Technological Principles, Specimen Types, User Complexity, Sample Preparation Method, Instrumentation, Time to Result, and Controls are the same as the predicate device (K091053). This implies that the device is expected to perform at a similar level to the predicate, but specific performance criteria for the new device are not enumerated here.
The key difference noted is a "Limited reactivity with the 2014 CAP sample ID2-08 and the 2015 CAP sample ID2-02," attributed to a viral mutation in the probe binding region of HPIV3. This limitation implies a potential issue with sensitivity for specific HPIV3 variants, which could be considered a deviation from an implied acceptance criterion of detecting all clinically relevant HPIV3 strains.
Given the information, a table of implied acceptance criteria and reported "performance" (which is more a statement of similarity or a recognized limitation) would be:
| Acceptance Criterion (Implied) | Reported Device Performance / Status |
|---|---|
| Detection and discrimination of HPIV-1, HPIV-2, and HPIV-3 | Same as predicate device (K091053). The device targets conserved regions of the HN gene for each virus. However, there is Limited reactivity with the 2014 CAP sample ID2-08 and 2015 CAP sample ID2-02 (HPIV3 variants due to viral mutation). |
| Use with nasopharyngeal (NP) swab specimens | Same as predicate device. |
| Qualitative detection assay | Same as predicate device. |
| Performance with specific isolation methods (MagNA Pure LC, NucliSENS easyMAG) and instrumentation (Cepheid SmartCycler II) | Same as predicate device. The assay uses a Universal Internal Control (UIC) for inhibition monitoring and external controls with each batch. |
| Aid in the diagnosis of human respiratory tract parainfluenza infections in conjunction with other clinical and laboratory findings | Same as predicate device. |
| Not intended to detect Parainfluenza 4a or 4b Viruses | Same as predicate device. |
| Negative results are presumptive and may require confirmation | Same as predicate device. (Negative test results are presumptive and should be confirmed by cell culture. Negative results do not preclude Parainfluenza 1, 2 or 3 virus infections and should not be used as the sole basis for treatment or other management decisions.) |
The document does not provide the following information:
- Sample sizes used for the test set and the data provenance: There is no specific data presented from a test set. The document refers to "the 2014 CAP sample ID2-08 and the 2015 CAP sample ID2-02" which indicates external proficiency testing samples, but not a full clinical test set used for performance validation in this submission.
- Number of experts used to establish the ground truth for the test set and the qualifications of those experts: Not applicable, as detailed performance data from a test set is not provided.
- Adjudication method for the test set: Not applicable.
- If a multi-reader multi-case (MRMC) comparative effectiveness study was done, and the effect size of how much human readers improve with AI vs without AI assistance: Not applicable. This is an in vitro diagnostic (IVD) assay, not an AI/imaging device requiring human reader analysis.
- If a standalone (i.e. algorithm only without human-in-the-loop performance) was done: The device is a "standalone" in the sense that it's an assay. Performance is measured by its output based on the sample, not by an algorithm's interpretation for a human-in-the-loop. However, specific standalone performance study results (e.g., sensitivity, specificity clinical studies) are not provided in this 510(k) summary. The summary focuses on substantial equivalence based on the technological similarity to a predicate.
- The type of ground truth used: Not explicitly stated for performance verification studies, as such studies are not detailed here. For the CAP samples mentioned, "sequencing analysis" was used to establish the genetic makeup of the viral strain, which served as a form of ground truth for assessing reactivity.
- The sample size for the training set: Not applicable for this type of IVD assay. The assay utilizes PCR primers and probes designed based on conserved genetic regions, not a machine learning model trained on a dataset.
- How the ground truth for the training set was established: Not applicable.
In summary, this 510(k) notification primarily argues for substantial equivalence based on the device's technical and analytical similarity to a previously cleared predicate and its intended use. It discloses a specific limitation identified through external proficiency samples but does not provide comprehensive clinical performance data or details of a validation study with defined acceptance criteria and corresponding results. Such data would typically be part of the full 510(k) submission, but not always summarized in this manner in the publicly available summary.
Ask a specific question about this device
(85 days)
The Lyra™ Parainfluenza Virus Assay is a Real-Time PCR assay for the qualitative detection and identification of human parainfluenza virus types 1, 2 and 3 viral RNA from nasal and nasopharyngeal swab specimens from symptomatic patients. It is intended for use as an aid in the differential diagnosis of parainfluenza virus types 1, 2 and 3. This test is not intended to detect Parainfluenza 4a or Parainfluenza 4b viruses.
Negative results do not preclude parainfluenza virus infection and should not be used as the sole basis for treatment or other patient management decisions.
The Lyra™ Parainfluenza Virus Assay is a Real-Time PCR assay for the qualitative detection and identification of human parainfluenza virus types 1, 2 and 3 viral RNA from nasal and nasopharyngeal swab specimens from symptomatic patients. The assay detects viral nucleic acids that have been extracted from a patient sample. A multiplex Real-time RT-PCR reaction is carried out under optimized conditions in a single tube generating amplicons for PIV-1, PIV-2, PIV-3 and the Process Control (PRC). Identification of PIV-1, PIV-2, PIV-3 and the PRC occurs by the use of target-specific primers and fluorescent-labeled probes that hybridize to conserved regions in the genomes of PIV-1. PIV-2. PIV-3 and the PRC.
Here's a summary of the acceptance criteria and study details for the Lyra™ Parainfluenza Virus Assay, based on the provided document:
1. Table of Acceptance Criteria and Reported Device Performance
The document does not explicitly state pre-defined acceptance criteria in terms of numerical thresholds for sensitivity or specificity. However, based on the conclusions regarding "good sensitivity and specificity" and "good positive and negative percent agreement," we can infer the expected performance. The reported performance is presented below:
| Performance Metric | PIV-1 | PIV-2 | PIV-3 |
|---|---|---|---|
| Prospective Study (vs. DSFA and CCFA) | |||
| Sensitivity | 100% (95% CI: 72.2% to 100%) | 100% (95% CI: 56.6% to 100%) | 100% (95% CI: 81.6% to 100%) |
| Specificity | 99.8% (95% CI: 99.3% to 99.9%) | 100% (95% CI: 99.7% to 100%) | 99.6% (95% CI: 99.0% to 99.8%) |
| Retrospective Study (vs. Prodesse ProParaFlu+ assay) | |||
| Positive Percent Agreement (PPA) | 100% (95% CI: 86.2% to 100%) | 100% (95% CI: 85.1% to 100%) | 100% (95% CI: 86.2% to 100%) |
| Negative Percent Agreement (NPA) | 98.8% (95% CI: 93.3% to 99.8%) | 94.0% (95% CI: 86.7% to 97.4%) | 100% (95% CI: 95.5% to 100%) |
2. Sample Size for Test Set and Data Provenance
- Prospective Study:
- Sample Size: 1241 fresh upper respiratory tract specimens.
- Data Provenance: Not explicitly stated, but the "Prospective multi-center study" suggests samples were collected from various clinical sites. The specimens were sent to a "central location" for comparative testing, implying multi-site collection.
- Retrospective Study:
- Sample Size: 105 frozen upper respiratory tract specimens.
- Data Provenance: Specimens "obtained from a pediatric hospital in the Southwest United States."
3. Number of Experts and Qualifications for Ground Truth
- Prospective Study: The ground truth was established using "direct specimen fluorescent antibody (DSFA) and cell culture with DFA (CCFA)." The document does not specify the number or qualifications of experts involved in performing or interpreting these reference methods.
- Retrospective Study: The ground truth was established using a legally marketed predicate device, the "Prodesse ProParaFlu+ assay (K091053)." The document does not mention experts establishing this ground truth, as it's a comparison against another device.
4. Adjudication Method for the Test Set
The document does not describe a formal adjudication method (e.g., 2+1, 3+1) for the test sets. For discrepant results in the prospective study, an "additional RT-PCR assay" was used for a subset of samples (e.g., 2 of 3 PIV-1 false positives, all 5 PIV-3 false positives). Similarly, for the retrospective study, an "additional RT-PCR assay" was used for 1 PIV-1 false positive and all 5 PIV-2 false positives. This implies a reference method approach, potentially with further molecular confirmation for outliers.
5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study
No multi-reader multi-case (MRMC) comparative effectiveness study was done. The document describes a standalone performance study of the device against reference methods and another legally marketed device; it does not involve human readers or assess improvement with AI assistance.
6. Standalone (Algorithm Only) Performance Study
Yes, a standalone performance study was done. The Lyra™ Parainfluenza Virus Assay, a Real-Time PCR assay (an algorithm-based diagnostic test, not requiring human interpretation of output beyond reading the results), was evaluated on its own against established reference methods (DSFA and CCFA in the prospective study, and the Prodesse ProParaFlu+ assay in the retrospective study).
7. Type of Ground Truth Used
- Prospective Study: Expert consensus, specifically a composite reference method of direct specimen fluorescent antibody (DSFA) and cell culture with DFA (CCFA).
- Retrospective Study: A legally marketed predicate device (Prodesse ProParaFlu+ assay).
8. Sample Size for the Training Set
The document does not provide information on the sample size for a training set. This is a diagnostic assay, and the studies described are performance evaluations, not specifically machine learning model training. The assay's design would have involved internal development and analytical verification, but the term "training set" as commonly used for machine learning is not applicable or detailed here.
9. How Ground Truth for the Training Set Was Established
As no specific "training set" is described in the context of machine learning, this information is not provided. The development of the assay would have been based on established molecular biology principles and analytical validation using known positive and negative controls/samples.
Ask a specific question about this device
(39 days)
The Prodesse® ProParaflu®+ Assay is a multiplex Real-Time PCR (RT-PCR) in vitro diagnostic test for the qualitative detection and discrimination of Parainfluenza 1 Virus, Parainfluenza 2 Virus and Parainfluenza 3 Virus (HPIV-1. HPIV-2 and HPIV-3) nucleic acids isolated and purified from nasopharvngeal (NP) swab specimens obtained from individuals exhibiting signs and symptoms of respiratory tract infections. This Assay targets the conserved regions of the Hemagglutinin-Neuraminidase (HN) gene of HPIV-1, HPIV-3, respectively. The detection and discrimination of HPIV-1, HPIV-2 and HPIV-3 nucleic acids from symptomatic patients aid in the diagnosis of human respiratory tract parainfluenza infections if used in conjunction with other clinical and laboratory findings. This test is not intended to detect Parainfluenza 4a or Parainfluenza 4b Viruses.
Negative test results are presumptive and should be confirmed by cell culture. Negative results do not preclude Parainfluenza 1, 2 or 3 virus infections and should not be used as the sole basis for treatment or other management decisions.
The ProParaflu+ Assay enables detection and differentiation of Parainfluenza 1 Virus. Parainfluenza 2 Virus, Parainfluenza 3 Virus and internal control nucleic acid. Nasopharyngeal swab specimens are collected from patients with signs and symptoms of a respiratory infection using a polyester, rayon or nylon tipped swab and placed into viral transport medium.
A Universal Internal Control (UIC) is added to each sample prior to nucleic acid isolation to monitor for inhibitors present in the specimens. The isolation and purification of the nucleic acids is performed using either a MagNA Pure LC Instrument (Roche) and the MagNA Pure Total Nucleic Acid Isolation Kit (Roche) or a NucliSENS® easyMAG™ System (bioMérieux) and the Automated Magnetic Extraction Reagents (bioMérieux).
The purified nucleic acids are added to ProParaflu+ Supermix along with enzymes included in the ProParaflu+ Assay Kit. The ProParaflu+ Supermix contains oligonucleotide primers and target-specific oligonucleotide probes. The primers are complementary to highly conserved regions of genetic sequences for these respiratory viruses. The probes are dual-labeled with a reporter dye attached to the 5'-end and a quencher dye attached to the 3'-end.
Reverse transcription of the RNA in the sample into complementary DNA (cDNA) and subsequent amplification of DNA is performed in a Cepheid SmartCycler® II instrument. In this process, the probe anneals specifically to the template followed by primer extension and amplification. The ProParaflu+ Assay is based on Taqman chemistry, which utilizes the 5 - 3 ' exonuclease activity of the Taq polymerase to cleave the probe thus separating the reporter dye from the quencher. This generates an increase in fluorescent signal upon excitation from a light source. With each cycle, additional reporter dve molecules are cleaved from their respective probes, further increasing fluorescent signal. The amount of fluorescence at any given cycle is dependent on the amount of amplification products present at that time. Fluorescent intensity is monitored during each PCR cycle by the SmartCycler II instrument.
The provided document describes a special 510(k) submission for the Gen-Probe Prodesse, Inc. Prodesse® ProParaflu®+ Assay (K132238). This submission focuses on modifications to an existing device (predicate device K091053, ProParaflu 101+ Assay) rather than a completely new device. Therefore, the details provided about acceptance criteria and study designs are predominantly related to demonstrating substantially equivalent performance with the modifications, rather than establishing initial performance for a novel diagnostic.
Here's an analysis of the provided information:
1. Table of Acceptance Criteria and Reported Device Performance
The document doesn't explicitly state numerical "acceptance criteria" in the format of a threshold to be met. Instead, it describes the objective of the verification/validation studies for the modified device: to ensure that the modifications did not negatively impact the device's ability to detect target organisms at the limit of detection or change its clinical performance. The reported performance is framed as meeting these objectives and demonstrating substantial equivalence to the previous device.
| Acceptance Criterion Objective (Implicit) | Reported Device Performance |
|---|---|
| The Universal Internal Control (UIC) should not affect the ability of the ProParaflu+ Assay to detect target organisms at the limit of detection. | "The UIC did not affect the ability of the ProParaflu+ Assay to detect target organisms at the limit of detection as evinced by the results of Analytical Sensitivity, IC Interference, Extractor Equivalency, and Sample Stability studies." |
| The incorporation of the UIC should not change the clinical performance of the ProParaflu+ Assay. | "Additionally, the results of a retrospective clinical comparison study demonstrated the modified ProParaflu+ Assay with UIC continues to meet the performance claims for the current ProParaflu+ Assay." (Implicitly, the clinical performance did not change negatively). |
| The positive control, provided "at use" concentration, should continue to monitor for global assay failures and maintain stability. | "A Positive Control Effectiveness Study demonstrated the positive control's continued ability to monitor for global assay failures at the increased testing concentration." (Implicitly, the performance of the positive control was maintained). |
| All clinical and analytical performance/functionality should remain unchanged from the previous device. (Overall objective of verification/validation studies for modifications) | "Verification and validation studies performed demonstrated that all clinical and analytical performance/functionality remains unchanged from the previous device." (This is a summary statement of the overall outcome, not a specific performance metric). |
2. Sample Size Used for the Test Set and Data Provenance
- Sample Size for Test Set: The document mentions a "retrospective clinical comparison study" for the UIC modification but does not specify the sample size for this study or any other test sets.
- Data Provenance: The document states "nasopharyngeal (NP) swab specimens obtained from individuals exhibiting signs and symptoms of respiratory tract infections." The country of origin is not specified but is implied to be within the scope of where Gen-Probe Prodesse, Inc. operates (Waukesha, WI, USA, suggests data from the USA). The clinical comparison study is explicitly stated to be retrospective.
3. Number of Experts Used to Establish Ground Truth for the Test Set and Qualifications
This information is not provided in the document. As this is an in vitro diagnostic device, the ground truth is typically established by other laboratory methods rather than expert interpretation of images or other subjective data.
4. Adjudication Method for the Test Set
This information is not provided in the document. Given that it's an in vitro diagnostic test, the concept of expert adjudication in the same way it applies to image analysis might not be directly relevant. The "ground truth" would likely be determined by a different gold standard assay or cell culture, not a consensus of human reviewers of the device's output.
5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study
An MRMC study is not applicable and was not done. This device is an in vitro diagnostic for detecting viral nucleic acids, not an imaging device requiring human reader interpretation.
6. Standalone Performance (Algorithm Only Without Human-in-the-Loop)
The device is an in vitro diagnostic Real-Time PCR assay. Its operation is inherently "standalone" in the sense that the assay itself generates a result (presence/absence of viral nucleic acid) based on the biochemical reaction and instrument detection. There isn't a "human-in-the-loop" component in the interpretation of the RT-PCR output itself, though a human performs the test and interprets the final qualitative result (positive/negative) from the instrument's readout. The performance studies (Analytical Sensitivity, IC Interference, Extractor Equivalency, Sample Stability, and the retrospective clinical comparison) demonstrate this standalone performance.
7. Type of Ground Truth Used
The document mentions that negative test results are presumptive and should be confirmed by cell culture. This indicates that cell culture is considered a gold standard or a primary method for confirming negative findings, and likely forms part of the "ground truth" for clinical evaluations. For positive results, the ground truth would typically be established by clinical diagnosis and/or comparison to a known highly sensitive and specific comparator assay or other reference methods in the clinical comparison study.
8. Sample Size for the Training Set
The document does not provide any information about a training set. As this is a molecular diagnostic assay using primers and probes targeting specific gene sequences, the "training" aspect is built into the assay design (selecting highly conserved regions) rather than a machine learning training paradigm with a specific dataset.
9. How the Ground Truth for the Training Set Was Established
Since there is no mention of a "training set" in the context of machine learning, this question is not applicable. The "ground truth" for the assay's design (e.g., confirming the suitability of the chosen gene targets and primer/probe sequences) would have been established through bioinformatics analysis and empirical testing with characterized viral isolates.
Ask a specific question about this device
(221 days)
The ProParaflu+ Assay is a multiplex Real Time RT-PCR in vitro diagnostic test for the qualitative detection and discrimination of Parainfluenza 1 Virus, Parainfluenza 2 Virus and Parainfluenza 3 Virus (HPIV-1, HPIV-2 and HPIV-3) nucleic acids isolated and purified from nasopharyngeal (NP) swab specimens obtained from individuals exhibiting signs and symptoms of respiratory tract infections. This assay targets the conserved regions of the Hemagglutinin-Neuraminidase (HN) gene of HPIV-1, HPIV-2 and HPIV-3. respectively. The detection and discrimination of HPIV-1, HPIV-2 and HPIV-3 nucleic acids from symptomatic patients aid in the diagnosis of human respiratory tract parainfluenza infections if used in conjunction with other clinical and laboratory findings. This test is not intended to detect Parainfluenza 4a or Parainfluenza 4b Viruses.
Negative test results are presumptive and should be confirmed by cell culture. Negative results do not preclude Parainfluenza 1, 2 or 3 virus infections and should not be used as the sole basis for treatment or other management decisions.
The ProParaflu+ Assay enables the detection and differentiation of Parainfluenza 1 Virus, Parainfluenza 2 Virus, Parainfluenza 3 Virus and an Internal Control (IC) nucleic acid. Nasopharyngeal swab specimens from symptomatic patients using a polyester, rayon or nylon tipped swab and place into viral transport medium. The IC is added to every sample prior to nucleic acid extraction to monitor for inhibitors present in the specimens.
Isolation and purification of nucleic acids is performed using the bioMérieux NucliSENS easyMAG automated extractor and the Automated Magnetic Extraction Reagents or the Roche MagNA Pure LC Instrument and the MagNA Pure Total Nucleic Acid Isolation Kit.
The purified nucleic acids are added to the ProParaflu+ Supermix along with enzymes included in the ProParaflu+ Detection Kit. The ProParaflu+ Supermix contains oligonucleotide primers that are complementary to highly conserved regions of hemagglutinin neuraminidase gene for each human Parainfluenza type (1, 2 and 3). The probes are dual-labeled with a reporter dye attached to the 5'-end and a quencher dye attached to the 3'-end.
RT-PCR amplification is performed in a Cepheid SmartCycler® II instrument. During this process, the primers and probes anneal specifically to the template (if present) followed by primer extension and amplification. The ProParaflu+ Assay is based on Taqman chemistry, which utilizes the 5' – 3' exonuclease activity of the Taq polymerase to cleave the probe thus separating the reporter dye from the quencher. This generates an increase in fluorescent signal upon excitation from a light source. With each cycle, additional reporter dye molecules are cleaved from their respective probes, further increasing the fluorescent signal. The amount of fluorescence at any given cycle is dependent on the amount of amplification product present at that time. Fluorescent intensity is monitored during each PCR cycle by the real-time instrument. Results are analyzed and interpreted as presented by the software.
Here's an analysis of the ProParaflu+ Assay's acceptance criteria and the studies performed, based on the provided document:
1. Table of Acceptance Criteria and Reported Device Performance
The document does not explicitly state pre-defined acceptance criteria in terms of specific sensitivity and specificity thresholds. Instead, it presents the calculated sensitivity and specificity with 95% confidence intervals from the clinical studies. For the purpose of this summary, the reported performance metrics can be considered the demonstrated performance against which regulatory acceptance was evaluated.
| Metric | Parainfluenza 1 (HPIV-1) | Parainfluenza 2 (HPIV-2) | Parainfluenza 3 (HPIV-3) |
|---|---|---|---|
| Prospective Study | |||
| Sensitivity | 88.9% (67.2% - 96.9% CI) | 96.3% (81.7% - 99.3% CI) | 97.3% (86.2% - 99.5% CI) |
| Specificity | 99.9% (99.3% - 100.0% CI) | 99.8% (99.1% - 99.9% CI) | 99.2% (98.1% - 99.5% CI) |
| Retrospective Study (HPIV-1 only) | |||
| Sensitivity | 82.8% (65.4% - 92.4% CI) | N/A | N/A |
| Specificity | 100% (94.2% - 100% CI) | N/A | N/A |
Reproducibility:
- Overall percent agreement with expected result: 97.8% for the initial reproducibility study.
- Intermediate concentration study:
- HPIV-1: 56.7% agreement with positive result (expected due to concentration below LoD)
- HPIV-2: 86.7% agreement with positive result (expected due to concentration below LoD)
- HPIV-3: 30.0% agreement with positive result (expected due to concentration below LoD)
2. Sample Size and Data Provenance
- Prospective Study:
- Sample Size (Test Set): 857 eligible nasopharyngeal (NP) swab samples.
- Data Provenance: United States (4 U.S. clinical laboratories), prospective collection from symptomatic individuals suspected of respiratory infection.
- Retrospective Study (HPIV-1 only):
- Sample Size (Test Set): 91 frozen NP swab samples.
- Data Provenance: Not explicitly stated, but likely also US-based given the overall context. The data was retrospective, as samples were "previously tested by direct DFA."
3. Number of Experts Used to Establish Ground Truth and Qualifications
The document does not specify the number or qualifications of experts for establishing the ground truth.
4. Adjudication Method for the Test Set
- Reference Method: Cell culture (rapid or traditional) followed by direct fluorescent antibody (DFA) screening and HPIV type identification was used as the primary reference method.
- Discrepant Analysis: For samples where the ProParaflu+ Assay and the reference method disagreed, RT-PCR with virus-specific primers (different from those used in ProParaflu+) followed by bi-directional sequencing was performed. This served as an adjudication method to re-evaluate the true status of discrepant samples.
5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study
No, a multi-reader multi-case (MRMC) comparative effectiveness study comparing human readers with AI assistance versus without AI assistance was not performed. This device is a molecular diagnostic assay, not an imaging AI system designed to aid human interpretation.
6. Standalone Performance Study
Yes, the clinical performance studies (prospective and retrospective) represent a standalone performance evaluation of the ProParaflu+ Assay. The reported sensitivity and specificity figures reflect the algorithm's (assay's) performance without human intervention in the result determination beyond running the assay and interpreting its output according to established rules.
7. Type of Ground Truth Used
The ground truth was established through a combination of:
- Reference Method: Cell culture (rapid or traditional) followed by direct fluorescent antibody (DFA) screening and HPIV type identification.
- Confirmatory Method for Discrepancies: RT-PCR with virus-specific primers followed by bi-directional sequencing. This suggests a form of expert consensus or highly reliable confirmatory testing to resolve ambiguities.
8. Sample Size for the Training Set
The document does not specify a separate "training set" sample size. For in vitro diagnostic assays like this, the development of the assay (primers, probes, conditions) inherently involves a form of "training" or optimization, but this is typically done using synthetic constructs, spiked samples, and smaller panels of clinical samples, not a formally defined "training set" in the machine learning sense. The clinical studies described (prospective and retrospective) are validation studies for the finalized device.
9. How the Ground Truth for the Training Set Was Established
As no formal "training set" is described in the conventional sense for this type of device, the method for establishing ground truth for such a set is not detailed. The design of the assay (selection of conserved regions, primer/probe design) would have relied on existing genomic sequences and expert knowledge of the viruses.
Ask a specific question about this device
Page 1 of 1