K Number
DEN130049
Manufacturer
Date Cleared
2014-03-21

(116 days)

Product Code
Regulation Number
866.3307
Type
Direct
Reference & Predicate Devices
N/A
Predicate For
N/A
AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
Intended Use

The Focus Diagnostics Simplexa™ HSV 1 & 2 Direct is intended for use on the 3M Integrated Cycler instrument for the qualitative detection and differentiation of HSV-1 and HSV-2 DNA in cerebrospinal fluid (CSF) samples from patients suspected of Herpes Simplex Virus (HSV) infections of the central nervous system (CNS). This test is intended as an aid in the diagnosis of HSV-1 and HSV-2 infections of the CNS.

Negative results do not preclude HSV-1 or HSV-2 infection and should not be used as the sole basis for treatment or other patient management decisions.

The assay is not intended for use as a donor screening test. The assay is for professional use only.

The Positive Control is intended to be used as a control with the Simplexa™ HSV 1 & 2 Direct. This control is not intended for use with other assays or systems.

Device Description

The Simplexa™ HSV 1 & 2 Direct system is a real-time PCR that enables the direct amplification, detection and differentiation of HSV-2 DNA from unprocessed CSF samples without nucleic acid extraction. The system consists of the Simplexa™ HSV 1 & 2 Direct, the 3M Integrated Cycler (with 3M Integrated Cycler Studio Software), the Direct Amplification Disc and associated accessories.

In the SimplexaTM HSV 1 & 2 Direct, bi-functional fluorescent probe-primers are used together with corresponding reverse primers to amplify HSV-1, HSV-2 and DNA internal control (IC) targets. Well conserved regions of the HSV-1 and HSV-2 DNA polymerase genes are targeted to identify HSV-1 and HSV-2 DNA respectively in the specimen. The IC is used to detect PCR failure and/or inhibition.

The 3M Integrated Cycler is a real-time PCR thermocycler which uses real-time fluorometric detection to identify targets within the sample wells. The instrument is controlled by an external computer running the Integrated Cycler Studio Software.

The Simplexa™ HSV 1 & 2 Direct assay reaction takes place in the DAD consumable. The DAD consumable is compartmentalized into 8 separate wedges and up to 8 separate samples or controls may be processed on each disc. Each wedge can be used only once, however, the disc may be reused until all wedges have been utilized. Each wedge contains sample and reagent input wells, microfluidic channels and laser activated valves to control the fluid flow. and a reaction chamber. The disc is specifically designed to meter the amount of reagent (Reaction Mix) and sample that are placed into specific wells in the disc. To start processing a patient sample, a foil seal is lifted and the user adds 50 µL of Reaction Mix to the reagent input well using a fixed volume pipette. Next, the user adds 50 uL of unextracted specimen to the sample input well.

The SimplexaTM HSV 1 & 2 Direct kit contains reagents for 24 reactions. Each vial contains sufficient material for a single reaction. The kit contains the Reaction Mix, the Simplexa™ HSV 1 & 2 Direct Barcode Card with assay specific information, and the Package Insert.

AI/ML Overview

This document describes the evaluation of the Simplexa™ HSV 1 & 2 Direct device, a real-time PCR test for detecting and differentiating HSV-1 and HSV-2 DNA in cerebrospinal fluid (CSF). The evaluation supports its classification as a Class II device with special controls.

Here's an analysis of the acceptance criteria and the studies that prove the device meets them:

1. Table of Acceptance Criteria and Reported Device Performance:

The document does not explicitly state "acceptance criteria" in a singular table for all performance measures. Instead, performance is demonstrated through various analytical and clinical studies, with implicit acceptance criteria being met if the results are favorable (e.g., high agreement rates, low variability, no cross-reactivity). For the clinical study, the performance is measured by Positive Percent Agreement (PPA) and Negative Percent Agreement (NPA) compared to a comparator method.

Let's summarize the key performance aspects that serve as de facto acceptance criteria based on the presented data:

Performance CharacteristicAcceptance Criteria (Implicit)Reported Device Performance
ReproducibilityHigh agreement with expected results, low %CV for Ct values.HSV-1 Low Positive, Medium Positive, and Positive Control: 100.0% agreement (90/90) across three sites (95% CI: 95.9% to 100.0%). Total %CV for Ct values ranged from 1.2% to 2.7%. HSV-2 Low Positive: 90.0% agreement (81/90) (95% CI: 82.1% to 94.6%). HSV-2 Medium Positive and Positive Control: 100.0% agreement (90/90) (95% CI: 95.9% to 100.0%). High Negative (for HSV-1 and HSV-2): 100.0% agreement (90/90) for HSV-1, 95.6% agreement (86/90) for HSV-2. DNA IC: 100.0% agreement (90/90) over all samples (95% CI: 95.9% to 100.0%). Inter-Lot Reproducibility (Positive Control): Low %CV (0.5% for HSV-1, 0.6% for HSV-2, 0.8% for IC).
Detection Limit (LoD)≥95% detection rate at the lowest concentration.HSV-1 McIntyre: 5 TCID50/mL (31/32 detected). HSV-1 HF: 40 TCID50/mL (31/32 detected). HSV-2 G: 1.25 TCID50/mL (31/32 detected). HSV-2 MS: 20 TCID50/mL (32/32 detected).
Analytical ReactivityDetection of additional strains.Detected both HSV-1 KOS and HSV-1 F strains at 20 TCID50/mL (3/3 detected in most cases, 2/3 in one instance for KOS). No additional HSV-2 strains available for testing.
Analytical Specificity (Cross-Reactivity)No detection of non-target organisms.No cross-reactivity observed for 51 potential cross-reactants (0/3 detected for HSV-1 and HSV-2 in all cases except for baseline, where 0/20 was reported).
InterferenceNo inhibition or false detection in presence of interferents.No interference observed with 7 common CSF interferents (protein, hemoglobin, WBC, Acyclovir, Betadine, Whole Blood) at specified concentrations (3/3 positive for HSV-1, HSV-2, and DNA IC). Competitive Interference: One instance of competitive interference for HSV-2 (1/8 detected at 5 TCID50/mL HSV-2 when co-infected with 20000 TCID50/mL HSV-1 McIntyre). No inhibition by other microorganisms: Of 51 microorganisms, only minor instances of "Not Detected" for HSV-2 (Dengue, JCV, Rabies) but none caused >4/8 replicates to be "Not Detected."
Sample StabilityQualitative agreement between fresh and frozen samples.100.0% (60/60) qualitative agreement between fresh and frozen samples for both HSV-1 and HSV-2 (95% CI: 94.0% to 100.0%). Regression analysis showed statistically non-significant bias between Ct values.
Carry-over ContaminationNegative rate >90% (lower bound of 95% CI).100% negative rate (60/60) with a lower bound of 95% CI of 94.0%, derived from a previous K120413 study which is applicable. No evidence of carryover.
Clinical Performance (Prospective Samples)High PPA and NPA against comparator.HSV-1: PPA 100.0% (3/3), 95% CI: 43.8 to 100.0%; NPA 98.8% (159/161), 95% CI: 95.6 to 99.7%. HSV-2: PPA 85.7% (6/7), 95% CI: 48.7 to 97.4%; NPA 99.4% (156/157), 95% CI: 96.5 to 99.9%.
Clinical Performance (Retrospective/Preselected Positive Samples)High PPA against comparator.HSV-1: PPA 100.0% (13/13), 95% CI: 77.2 to 100.0%. HSV-2: PPA 100.0% (42/42), 95% CI: 91.6 to 100.0%.

2. Sample Sizes Used for the Test Set and Data Provenance:

  • Reproducibility Test Set:

    • 6 samples (high negative, low positive, moderately positive for HSV-1 and HSV-2, and a positive control)
    • Total of 90 replicates per sample panel member (3 sites x 5 days x 2 runs x 3 replicates) = 540 replicates per analyte group (HSV-1, HSV-2, IC).
    • Data Provenance: Not explicitly stated, but implies multi-site, laboratory-based testing for analytical performance validation.
  • Detection Limit (LoD) Test Set:

    • Two primary strains (HSV-1 McIntyre, HSV-2 G): Each dilution assayed in 32 replicates across 32 DAD runs.
    • Two additional strains (HSV-1 HF, HSV-2 MS): 3-32 replicates per dilution/concentration for screening and confirmation.
    • Data Provenance: Laboratory-generated samples (viral stock spiked into negative human CSF matrix).
  • Analytical Reactivity Test Set:

    • 2 additional HSV-1 strains. Each spiked into negative CSF, assayed in triplicate. (3 replicates per strain, with 2 repeated; total 12 technical replicates for HSV-1 strains).
    • Data Provenance: Laboratory-generated samples.
  • Analytical Specificity (Cross-Reactivity) Test Set:

    • 51 potential cross-reactants.
    • Each assayed in triplicate. (3 replicates per cross-reactant).
    • Data Provenance: Laboratory-generated samples (organisms spiked into negative CSF).
  • Interference Test Set:

    • Interfering Substances: 7 substances tested. Each in low positive HSV-1 and HSV-2 sample, assayed in triplicate (3 replicates per interferent).
    • Competitive Interference: Samples contrived with low and high concentrations of HSV-1 and HSV-2. Replicates ranged from 3 to 8 depending on the condition.
    • Inhibition by Other Microorganisms: 51 microorganisms. Initially tested in triplicate, then 5 additional replicates if any "Not Detected" (total 8 replicates if retested).
    • Data Provenance: Laboratory-generated samples (substances/organisms spiked into CSF).
  • Sample Stability Test Set:

    • A panel of 120 pairs of contrived samples (60 for HSV-1, 60 for HSV-2). Each pair consisted of a fresh and a frozen aliquot.
    • Data Provenance: Laboratory-contrived samples (spiked in negative human CSF matrix).
  • Carry-over Contamination Test Set (from K120413 study):

    • 60 negative samples and 60 high positive samples tested across 17 runs.
    • Data Provenance: Not specified, but likely laboratory-contrived positive and negative samples for the previous device clearance.
  • Clinical Studies Test Set:

    • Prospective Samples: 164 CSF samples.
    • Retrospective/Preselected Positive Samples: 55 CSF samples.
    • Total Clinical Samples: 219 CSF samples.
    • Data Provenance: Collected from eight external sites. Patients with signs and symptoms of Herpes Simplex Virus (HSV) central nervous system (CNS) infection. Submitted to Focus Diagnostics (frozen). Tested at five external sites (Simplexa™) and Focus Diagnostics (comparator). Retrospective samples were collected between 2004 and 2013, indicating retrospective data collection for these specific samples.

3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications:

  • Analytical Studies (Reproducibility, LoD, Reactivity, Specificity, Interference, Stability, Carry-over): The ground truth for these studies was established by the precise formulation and characterization of the contrived samples (e.g., known viral strains at specific concentrations, known presence/absence of interferents). No "experts" in the clinical sense were used to establish ground truth for these analytical tests.

  • Clinical Studies:

    • The ground truth for the clinical samples was established using a "comparator" method: two PCR/bi-directional sequencing assays targeting two distinct regions of the HSV genome.
    • The interpretation of clinical diagnosis (e.g., "Final Diagnosis positive for HSV infection") used "the patient's attending physician and other clinical information such as chemistries, bacterial culture, MRI/CT scans and in-house PCR results." This implies expertise by the treating physicians, but the ground truth for comparison with the device was the defined PCR/sequencing method.
    • Number of experts and specific qualifications (e.g., radiologist with 10 years of experience) for establishing the comparator ground truth are not specified. It's implicitly handled by the laboratory performing the two PCR/bi-directional sequencing assays following established protocols.

4. Adjudication Method for the Test Set:

  • Analytical Studies: Adjudication method is not applicable as the ground truth is pre-defined by the experimental setup. Results are evaluated based on agreement with expected outcomes.

  • Clinical Studies:

    • The "comparator" method itself involved two PCR/bi-directional sequencing assays. A positive result was defined as positive by at least one of these two assays. A negative result required both assays to be negative.
    • This is a form of "rule-based adjudication" to derive a single ground truth from a multi-component comparator. It's not a consensus of human readers, but rather a defined algorithm for combining results from two independent laboratory assays.

5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done, and the Effect Size of How Much Human Readers Improve with AI vs. Without AI Assistance:

  • No, a Multi-Reader Multi-Case (MRMC) comparative effectiveness study was not done.
  • This device is an in vitro diagnostic (IVD) assay (a laboratory test) for direct detection of viral DNA, not an artificial intelligence (AI) solution intended to assist human readers in interpreting images or other data. Therefore, the concept of human readers improving with AI assistance is not applicable to this submission.

6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) Was Done:

  • Yes, the primary performance evaluation of the Simplexa™ HSV 1 & 2 Direct assay is a standalone, algorithm-only performance.
  • The device performs the amplification, detection, and differentiation of HSV-1 and HSV-2 DNA automatically based on the real-time PCR method. The results are calculated and displayed by the Integrated Cycler Studio Software. The performance characteristics (e.g., sensitivity, specificity, reproducibility, LoD) are determined for the device operating independently without subjective human interpretation of the primary signal generation. Human involvement is limited to sample preparation, loading, and interpreting the final "Detected," "Not Detected," or "Invalid" report from the software.

7. The Type of Ground Truth Used:

  • Analytical Studies: The ground truth used for analytical studies (LoD, reactivity, specificity, interference) was laboratory-contrived samples with known concentrations of viral targets or known presence/absence of interferents/cross-reactants. For reproducibility, the expected result for each sample was known.
  • Clinical Studies: The ground truth for clinical studies was established by a comparator method consisting of two PCR/bi-directional sequencing assays. This is a molecular/laboratory-based ground truth, not pathology or direct outcomes data, although clinical information was collected to characterize the patient population.

8. The Sample Size for the Training Set:

  • This submission describes the evaluation and approval of an in vitro diagnostic (IVD) assay, not a machine learning or AI algorithm. Therefore, there is no explicit "training set" in the context of machine learning.
  • The development of the assay (e.g., primer design, probe selection, cut-off determination) would have involved internal optimization and verification studies, but these are not typically referred to as a "training set" in the same way as for AI. The document mentions "feasibility and verification studies" for determining the assay cut-off.

9. How the Ground Truth for the Training Set Was Established:

  • As noted above, there is no explicit "training set" for a machine learning algorithm.
  • For the development and optimization of the PCR assay itself, the "ground truth" (e.g., optimal primer/probe sequences, reaction conditions, Ct cut-offs) would have been established through iterative laboratory experimentation, validation against characterized viral stocks, and empirical performance testing to achieve desired sensitivity and specificity. The document mentions that the cut-off was determined during "feasibility and verification studies" using LoD verification study replicates.

{0}------------------------------------------------

EVALUATION OF AUTOMATIC CLASS III DESIGNATION FOR Simplexa™ HSV 1 & 2 Direct

DECISION SUMMARY

A. 510(k) Number:

K133621

B. Purpose for Submission:

De novo request for evaluation of automatic class III designation for the Simplexa™ HSV 1 & 2 Direct

C. Measurand:

Target DNA sequences from conserved regions of the HSV-1 and HSV-2 DNA polymerase genes.

D. Type of Test:

A real-time Polymerase Chain Reaction (PCR) for the direct amplification, detection and differentiation of HSV-1 and HSV-2 DNA from unprocessed CSF samples without nucleic acid extraction.

E. Applicant:

Focus Diagnostics, Inc.

F. Proprietary and Established Names:

Simplexa™ HSV 1 & 2 Direct

G. Regulatory Information:

    1. Regulation: 21 CFR 866.3307
    1. Classification: Class II (special controls)
    1. Product code: PGH
    1. Panel: Microbiology (83)

{1}------------------------------------------------

H. Intended Use:

    1. Intended use(s):

Simplexa™ HSV 1 & 2 Direct

The Focus Diagnostics Simplexa™ HSV 1 & 2 Direct is intended for use on the 3M Integrated Cycler instrument for the qualitative detection and differentiation of HSV-1 and HSV-2 DNA in cerebrospinal fluid (CSF) samples from patients suspected of Herpes Simplex Virus (HSV) infections of the central nervous system (CNS). This test is intended as an aid in the diagnosis of HSV-1 and HSV-2 infections of the CNS.

Negative results do not preclude HSV-1 or HSV-2 infection and should not be used as the sole basis for treatment or other patient management decisions.

The assay is not intended for use as a donor screening test. The assay is for professional use only.

The Positive Control is intended to be used as a control with the Simplexa™ HSV 1 & 2 Direct. This control is not intended for use with other assays or systems.

    1. Indication(s) for use:
      Same as intended use
    1. Special conditions for use statement(s):
      The Simplexa" HSV 1 & 2 Direct is for prescription use only in accordance with 21 CFR 801.109.
    1. Special instrument requirements:
      To be used with the 3MTM Integrated Cycler with Integrated Cycler Studio Software version 5.0 or higher

I. Device Description:

Simplexa™ HSV 1 & 2 Direct

The Simplexa™ HSV 1 & 2 Direct system is a real-time PCR that enables the direct amplification, detection and differentiation of HSV-2 DNA from unprocessed CSF samples without nucleic acid extraction. The system consists of the Simplexa™ HSV 1 & 2 Direct, the 3M Integrated Cycler (with 3M Integrated Cycler Studio Software), the Direct Amplification Disc and associated accessories.

In the SimplexaTM HSV 1 & 2 Direct, bi-functional fluorescent probe-primers are used together with corresponding reverse primers to amplify HSV-1, HSV-2 and DNA internal control (IC) targets. Well conserved regions of the HSV-1 and HSV-2 DNA polymerase genes are targeted to identify HSV-1 and HSV-2 DNA respectively in the specimen. The IC

{2}------------------------------------------------

is used to detect PCR failure and/or inhibition.

The 3M Integrated Cycler is a real-time PCR thermocycler which uses real-time fluorometric detection to identify targets within the sample wells. The instrument is controlled by an external computer running the Integrated Cycler Studio Software.

The Simplexa™ HSV 1 & 2 Direct assay reaction takes place in the DAD consumable. The DAD consumable is compartmentalized into 8 separate wedges and up to 8 separate samples or controls may be processed on each disc. Each wedge can be used only once, however, the disc may be reused until all wedges have been utilized. Each wedge contains sample and reagent input wells, microfluidic channels and laser activated valves to control the fluid flow. and a reaction chamber. The disc is specifically designed to meter the amount of reagent (Reaction Mix) and sample that are placed into specific wells in the disc. To start processing a patient sample, a foil seal is lifted and the user adds 50 µL of Reaction Mix to the reagent input well using a fixed volume pipette. Next, the user adds 50 uL of unextracted specimen to the sample input well.

The SimplexaTM HSV 1 & 2 Direct kit contains reagents for 24 reactions. Each vial contains sufficient material for a single reaction. The kit contains the Reaction Mix, the Simplexa™ HSV 1 & 2 Direct Barcode Card with assay specific information, and the Package Insert.

KitComponentContents
Simplexa™HSV 1 & 2Direct ReactionMixDNA polymerase, buffer, dNTPs, template DNA (IC), dye-labeledfluorescent probe-primers specific for detection of HSV-1, HSV-2, and theDNA IC.
TargetProbeFluorophore(Dye)Excitation(nm)Emission(nm)Targeted Gene
HSV-1CFR610590610HSV-1 DNApolymerase
HSV-2FAM495520HSV-2 DNApolymerase
DNAICQ670644670NA
Simplexa™HSV 1 & 2 KitBarcode CardAssay specific parameters.

Component Description

The Positive Control contains ten vials of Inactivated HSV-1 and HSV-2.

{3}------------------------------------------------

J. Standard/Guidance Documents Referenced:

Guidance for Industry and FDA Staff: Administrative Procedures for CLIA Categorization, May 7, 2008

Guidance for Industry and FDA Staff: Format for Traditional and Abbreviated 510(k), August 12, 2005

Guidance for Industry, FDA Reviewers and Compliance on Off-The-Shelf Software Use in Medical Devices, September 9, 1999

Guidance for Industry: Cybersecurity for Networked Medical Devices Containing Off-The-Shelf (OTS) Software, July 18, 2007

Guidance for the Content of Premarket Submissions for Software Contained in Medical Devices, May 11, 2005

General Principles of Software Validation: Final Guidance for Industry and FDA Staff, January 11, 2002

K. Test Principle:

The Simplexa™ HSV 1 & 2 Direct system is a real-time PCR for the direct amplification, detection and differentiation of HSV-1 and HSV-2 DNA from unprocessed CSF specimens without nucleic acid extraction. The system consists of the Simplexa™ HSV 1 & 2 Direct, the 3M Integrated Cycler (with 3M Integrated Cycler Studio Software), the Direct Amplification Disc and associated accessories.

In the Simplexa™ HSV 1 & 2 Direct assay reaction, bi-functional fluorescent probe-primers are used together with corresponding reverse primers to amplify HSV-1. HSV-2 and IC targets. Well conserved regions of the HSV-1 and HSV-2 DNA polymerase genes are targeted to identify HSV-1 and HSV-2 DNA, respectively, in the specimen. An internal control is used to detect PCR failure and/or inhibition. The principle of the test and the procedural steps are summarized below.

Specimen Collection:

The specimen type is CSF. Specimens should be transported on ice and stored at 2 to 8°C for up to 7 days post collection. If there is delay for more than 7 days before processing, the specimens should be stored at -70°C.

Real-Time PCR Instrument Setup:

The 3M Integrated Cycler Operator Manual provides details on how to configure the 3M Integrated Cycler Studio Software, to add an assay definition, and to set up and analyze runs on the 3M Integrated Cycler.

Direct Amplification Disc Loading and Real-Time PCR Amplification:

    1. Select samples that need to be tested.
    1. Thaw Reaction Mix vials at room temperature (approximate range 18 to 25°C). Thaw one Reaction Mix vial for each sample or control to be tested.

{4}------------------------------------------------

    1. Scan the barcode on the Simplexa™ HSV 1 & 2 Direct Reaction Mix vial or barcode card.
    1. Scan the disc barcode on the Direct Amplification Disc (DAD).
    1. Scan or type in each sample identifier.
    1. For one wedge at a time, peel the adhesive foil back to expose the Sample (SAMPLE) and Reaction (R) wells without completely removing the adhesive foil cover (Figures 1 & 2). A void touching the under side of the foil that will be in contact with the wells and disc surface.
    1. Ensure that the Reaction Mix is completely thawed. Briefly spin down the tubes as needed. (Do not vortex the Reaction Mix).
  • Use the fixed volume pipette to transfer 50 uL of the Reaction Mix into the Reaction (R) 8. well.
    1. Use the fixed volume pipette to transfer 50 µL of sample or control; pipette sample or control into the Sample well (SAMPLE).
    1. Cover the wedge sealing the wells with the peeled adhesive foil, pressing down firmly near the edge of the wedge. If the original foil is torn, do not load the wells in the wedge. Instead load another wedge.
    1. Tear off the tab portion of the foil cover along the perforation.
    1. Repeat steps 6 to 11 for the next sample(s).
    1. Load the sealed Direct Amplification Disc into the 3M Integrated Cycler and start the run.

Image /page/4/Figure/11 description: The image contains two figures showing a disc with pre-use foil lifted from sample and reaction wells. Figure 1 shows the disc with the foil lifted from wedge #3, revealing the numbers 2, 3, and 4 on the disc. Figure 2 shows a close-up of the sample and reaction wells, labeled as "SAMPLE" and "R" respectively, with the number 4 visible on the foil.

Interpretation of Results:

Upon completion of the run, the Integrated Cycler Studio Software automatically calculates and displays results. The display presents the user with a separate report box for each of the analytes as well as the IC. The IC can be reported as "valid" or "invalid".

The software reports one of four possible outcomes for each of HSV-1 and HSV-2 after a run

{5}------------------------------------------------

is completed for each sample ID entered: "Detected". "Not Detected". "Invalid" or "EC500".

  • "Detected" result indicates that HSV-1 and/or HSV-2 DNA were detected in the patient a. sample tested (whether the DNA IC was detected or not detected)
  • b. "Not Detected" result indicates that HSV-1 and/or HSV-2 DNA were not detected in the patient sample tested whereas the DNA IC was detected.
  • c. "Invalid" result points to the inability to detect presence or absence of HSV-1 and/or HSV-2 DNA in the patient sample. This result may be due to:
      1. DNA Internal Control (DNA IC) failure, or
      1. Failure to detect sufficient specimen.

If an invalid result occurs, the sample needs to be re-tested per the instructions provided in the device Package Insert.

  • d. "EC500" result points to a data quality error for the particular viral analyte(s). The software was unable to determine a valid amplification for that analyte(s). The sample should be re-tested.

L. Performance Characteristics (if/when applicable):

    1. Analytical performance:
    • a. Reproducibility

The reproducibility study evaluated the device's inter-laboratory, inter-assay, and intra-assay reproducibility for high negative, low positive (approximately equal to the Limit of Detection (LoD)) and moderately positive (approximately 4 times LoD) samples for HSV-1 (McIntyre strain) and HSV-2 (G strain) and a positive control. The testing panel consisted of a total of 6 samples: a high negative pool containing both HSV-1 and HSV-2 targets, a low positive and a moderately positive sample separately for each of HSV-1 and HSV-2, and a positive control containing both HSV-1 and HSV-2 targets. The samples (except for the positive control) were generated by spiking viral stock into CSF that was screened to be negative for both analytes. For each sample panel member, two different operators performed two runs per day with 3 replicates per run, for five days at each of the three sites. This provided a total of 90 (3 sites x 5 days x 2 runs (each by different operator) x 3 replicates) replicates per sample panel member over five non-consecutive days. Three sites assessed the device's inter-laboratory reproducibility and inter/intra-assay reproducibility. Combined results for all sites and results stratified by site are presented in the tables below.

{6}------------------------------------------------

Site - 1Site - 2Site - 3
Sample%AgreementwithExpectedResultsAvg.CtTotal%CV%AgreementwithExpectedResultsAvg.CtTotal%CV%AgreementwithExpectedResultsAvg.CtTotal%CVTotal %AgreementwithExpectedResults95% CI
HSV-1 LowPositive100.0%(30/30)36.92.0100.0%(30/30)35.42.2100.0%(30/30)36.62.7100.0%(90/90)95.9%to100.0%
HSV-1MediumPositive100.0%(30/30)34.61.6100.0%(30/30)33.21.2100.0%(30/30)34.31.8100.0%(90/90)95.9%to100.0%
HSV-2 LowPositive100.0%(30/30)aNANA100.0%(30/30)aNANA100.0%(30/30)aNANA100.0%(90/90)a95.9%to100.0%
HSV-2MediumPositive100.0%(30/30)aNANA100.0%(30/30)aNANA100.0%(30/30)aNANA100.0%(90/90)a95.9%to100.0%
HighNegative100.0%(30/30)aNANA100.0%(30/30)aNANA100.0%(30/30)aNANA100.0%(90/90)a95.9%to100.0%
PositiveControl100.0%(30/30)30.71.5100.0%(30/30)30.61.2100.0%(30/30)30.21.4100.0%(90/90)95.9%to100.0%
TotalAgreement100.0% (180/180)100.0% (180/180)100.0% (180/180)100.0%(540/540)99.3%to100.0%

ª Expected Results for HSV-2 Low Positive, HSV-2 Medium Positive and High Negative samples are "Negative" for
HSV-1.

{7}------------------------------------------------

Site - 1Site - 2Site - 3
Sample%AgreementwithExpectedResultsAvg.CtTotal%CV%AgreementwithExpectedResultsAvg.CtTotal%CV%AgreementwithExpectedResultsAvg.CtTotal%CVTotal %AgreementwithExpectedResults95% CI
HSV-1 LowPositive100.0%(30/30)bNANA100.0%(30/30)bNANA100.0%(30/30)bNANA100.0%(90/90)b95.9%to100.0%
HSV-1MediumPositive100.0%(30/30)bNANA100.0%(30/30)bNANA100.0%(30/30)bNANA100.0%(90/90)b95.9%to100.0%
HSV-2 LowPositive96.7%(29/30)38.12.990.0%(27/30)38.43.283.3%(25/30)38.32.490.0%(81/90)b82.1%to94.6%
HSV-2MediumPositive100.0%(30/30)35.01.3100.0%(30/30)34.61.8100.0%(30/30)35.01.4100.0%(90/90)95.9%to100.0%
HighNegative93.3%(28/30)b39.70.296.7%(29/30)b38.4NA96.7%(29/30)b39.1NA95.6%(86/90)b89.1%to98.3%
PositiveControl100.0%(30/30)30.10.9100.0%(30/30)30.61.1100.0%(30/30)30.01.2100.0%(90/90)95.9%to100.0%
TotalAgreement98.3% (177/180)97.8% (176/180)96.7% (174/180)97.6%(527/540)95.9%to98.6%

b Expected Results for HSV-1 Low Positive, HSV-1 Medium Positive and High Negative samples are "Negative" for HSV-2.

Reproducibility – DNA IC

Sample%AgreementwithExpectedResultsAvg.CtTotal%CVSite - 1Site - 2Site - 3Total %AgreementwithExpectedResults95% CI
%AgreementwithExpectedResultsAvg.CtTotal%CV%AgreementwithExpectedResultsAvg.CtTotal%CV%AgreementwithExpectedResultsAvg.CtTotal%CV
HSV-1 LowPositive100.0%(30/30)29.60.7100.0%(30/30)30.01.7100.0%(30/30)29.10.6100.0%(90/90)95.9%to100.0%
HSV-1MediumPositive100.0%(30/30)29.60.8100.0%(30/30)30.11.2100.0%(30/30)29.10.6100.0%(90/90)95.9%to100.0%
HSV-2 LowPositive100.0%(30/30)29.40.7100.0%(30/30)30.11.0100.0%(30/30)29.10.7100.0%(90/90)95.9%to100.0%
HSV-2MediumPositive100.0%(30/30)29.40.9100.0%(30/30)30.01.3100.0%(30/30)29.21.6100.0%(90/90)95.9%to100.0%
HighNegative100.0%(30/30)29.40.8100.0%(30/30)30.11.3100.0%(30/30)29.21.3100.0%(90/90)95.9%to100.0%
PositiveControl100.0%(30/30)29.61.0100.0%(30/30)30.01.1100.0%(30/30)29.20.8100.0%(90/90)95.9%to100.0%
TotalAgreement100.0% (180/180)100.0% (180/180)100.0% (180/180)100.0%(540/540)99.3%to100.0%

The positive control Inter-Lot precision was evaluated to assess if there was lot to lot

{8}------------------------------------------------

variability of the positive control. The study assessed the reproducibility of 3 different lots of positive control Pack by testing each lot of control with one lot of Reaction Mix, using one instrument and one operator over 3 consecutive days. Each lot of positive control was run with 2 replicates per run, 2 runs per day for 3 days, thereby providing a total 12 replicates per lot. The testing was performed at Focus Diagnostics. Results of the study were analyzed for overall mean, overall (total) variability, variability between day (inter-day), variability between run (inter-run), variability between lot (inter-lot) and the residual. The variability is presented in terms of standard deviation (SD) and/or percent coefficient of variation (%CV) of Ct. The inter-lot variability component is summarized in the table below.

Quantitative Summary of PC Inter-Lot Reproducibility
Inter-DayInter-RunInter-LotIntra-Run/LotTotal
AnalyteNMean CtSD%CVSD%CVSD%CVSD%CVSD%CV
HSV-13629.40.000.00.000.00.110.40.110.40.160.5
HSV-23629.80.000.00.000.00.120.40.130.50.180.6
IC3629.60.000.00.080.30.080.30.190.70.220.8

b. Linearity/assay reportable range:

Not applicable.

c. Traceability, Stability, Expected values (controls, calibrators, or methods):

Positive Control Stability:

The positive control for this product is a blend of inactivated HSV-1 and HSV-2 provided in single use aliquots frozen at -20°C. The positive control has been assigned an expiration date of 12 months at -20℃.

To assess the room temperature stability of positive control, aliquots of the positive control were thawed and kept at room temperature for up to 24 hours, and were then evaluated.

Room-temperature stability of Positive Control

{9}------------------------------------------------

HSV-2 (FAM)HSV-1 (CFR610)IC (Q670)
Time (hrs) at room temperatureMean CtChange from time '0'Mean CtChange from time '0'Mean CtChange from time '0'
030.630.730.1
8 hours30.5-0.33%30.90.65%30.30.66%
030.831.330.2
24 hours30.80.00%31.0-0.96%30.20.00%

A negative percent difference indicates earlier Ct detection after room temperature storage. As shown in the table above, no significant change in detection of each target analyte was observed when positive control was stored on the bench top at room temperature for 24 hours. Based on these results, the positive control is stable for at least 24 hours at room temperature.

d. Assay cut-off:

The Simplexa™ HSV 1 & 2 Direct cut-off was determined during feasibility and verification studies. During verification, all studies were performed to a maximum of 45 cycles of amplification for informational use, but the data were calculated with a cut-off of Ct=40 for HSV-1 and HSV-2 targets. When the verification data were analyzed, there were some results that prompted the Ct cut-off for HSV-2 to be re-set from Ct=40 to Ct=42. The LoD verification study detected HSV-2 between a Ct of 40 and 41 for four replicates at HSV-2 concentrations below the established HSV-2 LoD concentration. No HSV-2 LoD replicates (at or below LoD concentration) were detected beyond Ct=41. The HSV-1 cut-off was not adjusted from Ct=40 because no HSV-1 LoD replicates from the LoD verification study were detected at a Ct>40. Based on the results of the verification studies, the final cut-offs were set at Ct=40 for HSV-1 and at Ct=42 for HSV-2. The PCR cycling protocol was reduced to 42 cycles because all target cut-offs are at Ct<42. The Ct cut-offs and cycling protocol is stored in the assay definition for the Simplexa™ HSV 1 & 2 Direct.

e. Detection limit (LoD)

The Limit of Detection (LoD) was determined for the Simplexa™ HSV 1 & 2 Direct using viral stocks of HSV-1 and HSV-2. The samples used for the study were prepared using a total of four strains of HSV-1 (McIntyre and HF strains) and HSV-2 (G and MS strains) that were individually diluted into bulk negative human CSF matrix. Each strain of HSV used in the study consisted of verified stock material that had been regrown and retitered from the original source. The study consisted of multiple runs for each strain to evaluate the LoD of Simplexa™ HSV 1 & 2 Direct and all samples were stored overnight at -20°C or below prior to LoD testing.

{10}------------------------------------------------

For each of the HSV-1 McIntyre and HSV-2 G strains, screening and confirmation testing was consolidated into 32 DAD runs using two lots of Simplexa™ HSV 1 & 2 Direct across four instruments. For each of the two targets, the designated strains were spiked into negative human CSF matrix and serially diluted into 2-fold serial dilutions to encompass concentrations around the theoretical LoD. In total, each dilution was assayed in 32 replicates across the 32 DAD runs, where each run consisted of one replicate of each dilution. Per target strain, each instrument underwent eight runs in total, where four of the runs used material from one designated Simplexa™ HSV 1 & 2 Direct lot and the other four runs used material from a second designated Simplexa™ HSV 1 & 2 lot, resulting in 32 runs per strain.

The LoDs for the remaining two strains (HSV-1 HF strain and HSV-2 MS strain) were determined from screening runs that provided tentative LoDs for both the HSV-1 and HSV-2 strains and confirmation runs to confirm the respective LoDs. To determine the tentative LoDs, the designated strains were spiked into negative human CSF matrix and serially diluted to their approximate theoretical LoDs. For each of these two strains, at least three replicates of each dilution were tested and the lowest concentration at which all replicates were detected was taken as the tentative LoD. For the confirmation of tentative LoD, each designated strain was spiked into negative human CSF matrix at the concentration of the tentative LoD. The samples for each strain were prepared in singlicate and assayed in 32 replicates across multiple disc runs using a single lot of Simplexa™ HSV 1 & 2 Direct. The LoD was determined as the lowest concentration for which ≥ 95% of the replicates were detected.

VirusStrainLoD(TCID50/mL)QualitativeResults at LoD(#Detected/#Total)Mean Ct ± SD(from DetectedReplicates only)
HSV-1McIntyre531/3237.1 ± 1.17
HSV-1 HF4031/3236.9 ± 0.90
HSV-2 G1.2531/3238.3 ± 0.74
HSV-2 MS2032/3237.2 ± 1.03

Limit of Detection Summary

Analytical Reactivity f.

The analytical reactivity of the Simplexa™ HSV 1 & 2 Direct was evaluated using different strains of HSV-1 that were not used to determine the LoD for the assay. No additional strains were available for HSV-2. Ouantified viral material was spiked into negative CSF using a single dilution and assayed in triplicate. The Simplexa™ HSV 1 & 2 Direct was able to detect both strains of HSV-1 virus at 20 TCID« /mL.

{11}------------------------------------------------

Viral StrainConcentration[TCID50/mL]Qualitative Results(#Detected/#Total)
HSV-1 KOS203/30/33/3
HSV-1 KOS202/30/33/3
HSV-1 F403/30/33/3
HSV-1 F803/30/33/3

Analytical Reactivity with Additional Viral Strains

g. Analytical specificity:

Cross-Reactivity:

The analytical specificity of the Simplexa™ HSV 1 & 2 Direct was evaluated by testing 51 potential cross-reactants that are closely related, cause similar clinical symptoms, or may be present in CSF. The potential cross-reactants were spiked into negative CSF and assayed in triplicate. No cross-reactivity was observed as summarized in the following table.

Cross-ReactantTestedConcentrationQualitative Result(#Detected/#Total)
HSV-1HSV-2
BaselineNot Applicable0/200/20
Adenovirus (type 1)1.00 X 105TCID50/mL0/30/3
Adenovirus (type 7A)1.00 X 105TCID50/mL0/30/3
BKV1.00 X 105 copies/mL0/30/3
Citrobacter freundii1.00 X 106 cfu/mL0/30/3
Citrobacter koseri1.00 X 106 cfu/mL0/30/3
Cryptococcus neoformans1.00 X 106 cfu/mL0/30/3
Cytomegalovirus (AD169)1.00 X 105TCID50/mL0/30/3
Dengue (Type1)1.00 X 105TCID50/mL0/30/3
Encephalomyocarditis virus1.00 X 105TCID50/mL0/30/3
Enterobacter aerogenes1.00 X 106 cfu/mL0/30/3
Enterovirus 711.00 X 105TCID50/mL0/30/3
Epstein Barr virus (B95-8)1.00 X 105 copies/mL0/30/3
Cross-ReactantTestedConcentrationQualitative Result(#Detected/#Total)
HSV-1HSV-2
Escherichia coli1.00 X 106 cfu/mL0/30/3
Haemophilus influenzae1.00 X 106 cfu/mL0/30/3
Haemophilus influenzae type b(MinnA)1.00 X 106 cfu/mL0/30/3
Hepatitis B1.00 X 105 IU/mL0/30/3
Hepatitis C1.00 X 105 IU/mL0/30/3
HIV1 (type IIIB)1.00 X 105TCID50/mL0/30/3
HIV2 (type NIHZ)Not Available*0/30/3
Human herpesvirus 61.00 X 105TCID50/mL0/30/3
Human herpesvirus 7 (Type SB)1.00 X 105TCID50/mL0/30/3
Human herpesvirus 81.00 X 105 copies/mL0/30/3
Influenza A/California/7/2009NYMC x-179-A1.00 X 105TCID50/mL0/30/3
Influenza B/Florida/02/20061.00 X 105TCID50/mL0/30/3
JCV (MAD-4)1.00 X 105TCID50/mL0/30/3
Klebsiella pneumoniae1.00 X 106 cfu/mL0/30/3
La Crosse encephalitis1.00 X 105TCID50/mL0/30/3
Listeria monocytogenes1.00 X 106 cfu/mL0/30/3
Measles1.00 X 105TCID50/mL0/30/3
Mumps1.00 X 105TCID50/mL0/30/3
Mycobacterium tuberculosis(Genomic DNA)1.00 X 106 cfu/mL0/30/3
Naegleria fowleri1.00 X 104 cells/mL0/30/3
Neisseria meningitides (serogroup A)1.00 X 106 cfu/mL0/30/3
Parainfluenza Virus 11.00 X 105TCID50/mL0/30/3
Parainfluenza Virus 21.00 X 105TCID50/mL0/30/3
Parainfluenza Virus 31.00 X 105TCID50/mL0/30/3
Parvovirus B191.00 X 105 IU/mL0/30/3
Poliovirus (Type 3)1.00 X 105TCID50/mL0/30/3
Proteus mirabilis (Z050)1.00 X 106 cfu/mL0/30/3
Cross-ReactantTestedConcentrationQualitative Result(#Detected/#Total)
HSV-1HSV-2
Pseudomonas aeruginosa1.00 X 106 copies/mL0/30/3
Rabies1.00 X 105TCID50/mL0/30/3
Rhinovirus (Type 1A)1.00 X 105TCID50/mL0/30/3
Rotavirus (Type Wa)1.00 X 105TCID50/mL0/30/3
Rubella1.00 X 105TCID50/mL0/30/3
St. Louis Encephalitis1.00 X 105TCID50/mL0/30/3
Staphylococcus aureus COL1.00 X 106 cfu/mL0/30/3
Streptococcus agalactiae1.00 X 106 cfu/mL0/30/3
Streptococcus pneumoniae Z022; 19F1.00 X 106 cfu/mL0/30/3
Toxoplasma gondii1.00 X 106tachyzoites/mL0/30/3
Varicella zoster virus1.00 X 105 copies/mL0/30/3
West Nile Virus1.00 X 105TCID50/mL0/30/3

Simplexa™ HSV 1 & 2 Direct Cross-Reactivity Results

{12}------------------------------------------------

{13}------------------------------------------------

h. Interference studies:

Interfering Substances:

The effect of potentially interfering substances that may be present in CSF specimens was evaluated at the concentrations indicated in the table below. A total of 7 potentially interfering substances was tested in a low positive HSV-1 and HSV-2 sample (4 times LoD) in CSF matrix and assayed in triplicate. No interference was observed.

Potential InterferentInterferentConcentrationQualitative Result (#Detected/#Total)
HSV-1HSV-2DNA IC
Albumin (protein)10 mg/mL3/33/33/3
Casein (protein)10 mg/mL3/33/33/3
Hemoglobin0.625 mg/mL3/33/33/3
White Blood Cells5.5 x 108 WBC/mL3/33/33/3
Antiviral Drug (Acyclovir)2.5 mg/mL3/33/33/3
Topical Antiseptic (Betadine)5% (v/v)3/33/33/3
Whole Blood10% (v/v)3/33/33/3

Competitive Interference:

{14}------------------------------------------------

Competitive interference was studied to evaluate the effects of clinically relevant coinfections with each of the analytes detected by the Simplexa™ HSV 1 & 2 Direct. The study assessed whether a high concentration of one virus in the specimen could potentially affect the SimplexaTM HSV 1 & 2 Direct performance for the other viral target present at low level sample was contrived at approximately 4 times LoD for each target, (HSV-1 McIntryre strain and HSV-2 G strain), and a baseline Ct was determined for each sample. Each potential concomitant infecting virus was spiked into the low level specimen and assayed in triplicate. Competitive interference was observed in samples with a very high concentration of HSV-1 virus and a low concentration of HSV-2 virus. Baseline sample results are also shown below.

Baseline(Low Concentration)Competitive Interferent(High Concentration)Qualitative Results(#Detected/#Total)
StrainConcentration[TCID50/mL]StrainConcentration[TCID50/mL]HSV-1HSV-2DNAIC
HSV-1 McIntyre20--5/50/55/5
HSV-1 McIntyre20HSV-2 G100003/33/33/3
HSV-2 G5--0/55/55/5
HSV-2 G5HSV-1McIntyre200008/81/88/8
HSV-2 G5HSV-1McIntyre100008/86/88/8
HSV-2 G5HSV-1McIntyre50003/33/33/3

SimplexaTM HSV 1 & 2 Direct Competitive Interference Results

Inhibition by Other Microorganisms:

The Simplexa™ HSV 1 & 2 Direct was evaluated by testing the ability to identify HSV-1 and HSV-2 viruses when other potentially inhibitory organisms are present. The panel of 51 potentially inhibitory organisms was individually spiked into a pool with a low concentration (approximately 4 times LoD) of HSV-1 and HSV-2 in CSF.

{15}------------------------------------------------

Each microorganism sample was initially tested in triplicate and, if any one of the replicates was "Not Detected" for either the HSV-1 or the HSV-2 targets, then five additional replicates were tested to confirm if any inhibition was caused by the microorganism. If the majority (>4/8) replicates were "Not Detected", then an inhibitory effect would be determined. None of the microorganisms caused >4/8 of the replicates to be "Not Detected". One of 8 replicates of JCV (MAD-4) and Rabies were "Not Detected" for HSV-2 and 2/8 replicates of Dengue (Type1) were "Not Detected" for HSV-2. No inhibition by other organisms was observed for either HSV-1 or HSV-2.

No.MicroorganismTested ConcentrationQualitative Result(#Detected/#Total)
HSV-1HSV-2
1BaselineNot Applicable20/2020/20
2Adenovirus (type 1)1.00 X 105 TCID50/mL3/33/3
3Adenovirus (type 7A)1.00 X 105 TCID50/mL3/33/3
4BKV1.00 X 105 copies/mL3/33/3
5Citrobacter freundii1.00 X 106 cfu/mL3/33/3
6Citrobacter koseri1.00 X 106 cfu/mL3/33/3
7Cryptococcus neoformans1.00 X 106 cfu/mL3/33/3
8Cytomegalovirus (AD169)1.00 X 105 TCID50/mL3/33/3
9Dengue (Type1)1.00 X 105 TCID50/mL8/8**6/8
10Encephalomyocarditis virus1.00 X 105 TCID50/mL3/33/3
11Enterobacter aerogenes1.00 X 106 cfu/mL3/33/3
12Enterovirus 711.00 X 105 TCID50/mL3/33/3
13Epstein Barr virus (B95-8)1.00 X 105 copies/mL3/33/3
14Escherichia coli1.00 X 106 cfu/mL3/33/3
15Haemophilus influenzae1.00 X 106 cfu/mL3/33/3
16Haemophilus influenzae type b(MinnA)1.00 X 106 cfu/mL3/33/3
17Hepatitis B1.00 X 105 IU/mL3/33/3
18Hepatitis C1.00 X 105 IU/mL3/33/3
19HIV1 (type IIIB)1.00 X 105 TCID50/mL3/33/3
20HIV2 (type NIHZ)Not Available*3/33/3
21Human herpesvirus 61.00 X 105 TCID50/mL3/33/3
22Human herpesvirus 7 (Type SB)1.00 X 105 TCID50/mL3/33/3
23Human herpesvirus 81.00 X 105 copies/mL3/33/3
24Influenza A/California/7/2009NYMC x-179-A1.00 X 105 TCID50/mL3/33/3
25Influenza B/Florida/02/20061.00 X 105 TCID50/mL3/33/3
26JCV (MAD-4)1.00 X 105 TCID50/mL8/8***7/8
27Klebsiella pneumoniae1.00 X 106 cfu/mL3/33/3
No.MicroorganismTested ConcentrationQualitative Result(#Detected/#Total)
HSV-1HSV-2
28LA Crosse encephalitis1.00 X 105 TCID50/mL3/33/3
29Listeria monocytogenes1.00 X 106 cfu/mL3/33/3
30Measles1.00 X 105 TCID50/mL3/33/3
31Mumps1.00 X 105 TCID50/mL3/33/3
32Mycobacterium tuberculosis(Genomic DNA)1.00 X 106 cfu/mL3/33/3
33Naegleria fowleri1.00 X 104 cells/mL3/33/3
34Neisseria meningitides(serogroup A)1.00 X 106 cfu/mL3/33/3
35Parainfluenza Virus 11.00 X 105 TCID50/mL3/33/3
36Parainfluenza Virus 21.00 X 105 TCID50/mL3/33/3
37Parainfluenza Virus 31.00 X 105 TCID50/mL3/33/3
38Parvovirus B191.00 X 105 IU/mL3/33/3
39Poliovirus (Type 3)1.00 X 105 TCID50/mL3/33/3
40Proteus mirabilis (Z050)1.00 X 106 cfu/mL3/33/3
41Pseudomonas aeruginosa1.00 X 106 copies/mL3/33/3
42Rabies1.00 X 105 TCID50/mL8/8***7/8
43Rhinovirus (Type 1A)1.00 X 105 TCID50/mL3/33/3
44Rotavirus (Type Wa)1.00 X 105 TCID50/mL3/33/3
45Rubella1.00 X 105 TCID50/mL3/33/3
46St. Louis Encephalitis1.00 X 105 TCID50/mL3/33/3
47Staphylococcus aureus COL1.00 X 106 cfu/mL3/33/3
48Streptococcus agalactiae1.00 X 106 cfu/mL3/33/3
49Streptococcus pneumoniaeZ022; 19F1.00 X 106 cfu/mL3/33/3
50Toxoplasma gondii1.00 X 106 tachyzoites/mL3/33/3
51Varicella zoster virus1.00 X 105 copies/mL3/33/3
52West Nile Virus1.00 X 105 TCID50/mL3/33/3

Simplexa™ HSV 1 & 2: Inhibition by Other Microorganisms

{16}------------------------------------------------

*Quantified material was not available to test; instead the vendor provided a culture fluid with a known Ct value. The site was directed to dilute the stock to a relevant Ct value; 1:200 dilution factor. ** 1/3 and 1/5 replicates were "Not Detected" for HSV-2 during initial and confirmatory testing respectively.

***1/3 replicate was "Not Detected" for HSV-2 during initial testing.

Sample stability studies i.

The objective of this study was to evaluate the difference between results from the Simplexa™ HSV 1 & 2 Direct testing of fresh (never frozen, unextracted and tested within 72 hours of preparation) specimens versus frozen (unextracted and tested after

{17}------------------------------------------------

2 freeze-thaw steps) specimens. A panel of contrived samples consisting of 120 pairs (fresh and frozen) of spiked specimens prepared in negative human CSF matrix was used for this study; 60 of the pairs spanned the analytical range for HSV-1 and the other 60 pairs spanned the range for HSV-2. Sixty percent of the samples (36/60) were spiked to be close to LoD so that 18 of the samples were 1-1.5 times LoD and 18 samples were spiked at 4 times LoD. The remaining 40% of the samples (24/60) were spiked across the assay range. One lot of Simplexa ™ HSV 1 & 2 Direct was used for the study. The frozen samples were stored at -20°C for a minimum of 5 days, after which they were thawed for at least 1 hour and refrozen for >24 hours and then thawed again for testing. The HSV-1 (McIntyre) and HSV-2 G strains were used in the study.

No significant storage effect on the samples stored fresh was detected when compared to the results from the same samples frozen. Below is the summary of results from the Fresh vs. Frozen Study of the Simplexa™ HSV 1 & 2 Direct along with the concentration [TCID50/mL] of the virus strains. In the SimplexaTM HSV 1 & 2 Direct Fresh vs. Frozen study, 100% (60/60) qualitative agreement was observed with 95% CI (94.0% to 100.0%) between the fresh and frozen states for both HSV-1 and HSV-2 targets. Regression analysis was performed to estimate quantitative bias (in terms of Ct) between Ct values from the paired fresh and frozen samples. The regression plots are shown below. The 95% confidence intervals for intercept and slope of both targets indicate statistically non-significant bias between Ct values for fresh and frozen samples. These results support the testing of frozen samples to establish performance characteristics of the assay.

HSV-1 Sample Distribution
HSV-1 (McIntyre)Spiked Concentration[TCID50/mL]Number ofReplicates(% of Total)
5 (LoD)18 (30%)
20 (4XLoD)18 (30%)
78.1254 (6.7%)
156.254 (6.7%)
312.54 (6.7%)
6254 (6.7%)
12504 (6.7%)
25004 (6.7%)
Total60 (100%)

{18}------------------------------------------------

Image /page/18/Figure/0 description: The image contains a Passing-Bablok regression fit with a confidence bound, showing the relationship between fresh and frozen HSV1 Ct values. The regression line equation is P-B Reg Line = -1.54 + 1.05 * X, with a 95% confidence interval for the intercept of (-3.1146, 0.1000) and for the slope of (1.0000, 1.0976), based on a sample size of n=60. Additionally, there is a table showing the HSV-2 sample distribution, detailing the number of replicates and their percentage of the total for various spiked concentrations of HSV-2 (G strain), ranging from 1.875 (1.5XLoD) to 2500 [TCID50/mL].

Spiked Virus-HSV1 Passing-Bablok Regression Fit with Confidence Bound

{19}------------------------------------------------

Spiked Virus-HSV2 Passing-Bablok Regression Fit with Confidence Bound

Image /page/19/Figure/1 description: The image is a scatter plot that shows the correlation between fresh and frozen HSV2 Ct values. The x-axis represents fresh HSV2 Ct, and the y-axis represents frozen HSV2 Ct. The plot includes a Passing-Bablok regression line with the equation P-B Reg Line = -0.91 + 1.04 * X, along with 95% confidence intervals for the intercept (-2.6000, 0.2000) and slope (1.0000, 1.0889), with a sample size of n=60. Different symbols represent varying concentrations of TCID50/mL.

j. Stability studies

A real-time stability was completed over a 14 month time period supporting a shelflife claim of 12 months for the Simplexa™ HSV 1 & 2 Direct and the positive control.

k. Carry-over Contamination

The amplification carry-over for the Simplexa™ assays including the DirectSimplexa™ HSV 1 & 2 Direct Simplexa™ HSV 1 & 2 Direct was assessed from the Simplexa™ Flu A/B & RSV Direct (K120413). The carry-over study in K120413 can be applied to the Simplexa™ HSV 1 & 2 Direct as carry-over contamination is not expected to be analyte specific and there have been no hardware changes to the instrument since the K120413 clearance. The carry-over study in K120413 searched for the presence of contamination in negative samples that were adjacent to high positive samples. The study was designed by alternately placing high positive and negative samples on each disc. A total of 60 negative samples and 60 high positive samples were tested across 17 runs using 4 different instruments. The

{20}------------------------------------------------

sample size of 60 was chosen to provide an acceptance criterion of > 90% for the lower bound of the two-sided 95% Confidence Interval for the observed negative rate of the negative samples. This acceptance criterion would be met if no more than one of the 60 negative samples gave a "Detected" result indicative of carry-over contamination. All 60 negative samples gave a result of "Not Detected" for all three target viruses in the K120413 study with a negative rate of 100% and a lower bound of the two-sided 95% CI of 94.0%. Therefore, no evidence of carryover was observed.

2. Comparison studies:

  • a. Method comparison with predicate device:
    Not applicable. Refer to the Clinical Studies section of this document.

  • b. Matrix comparison:
    Not applicable.

    1. Clinical studies:
      A total of 219 CSF samples were prospectively or retrospectively collected from patients with signs and symptoms of Herpes Simplex Virus (HSV) central nervous system (CNS) infection at eight external sites. All sites sent the frozen samples to Focus Diagnostics. Two aliquots were prepared from each sample and the samples were then blinded for testing. One aliquot was sent to an external testing with the SimplexaTM HSV 1 & 2 Direct. Five external sites, which included four of the collection sites, performed testing with the Simplexa™ HSV 1 & 2 Direct. The other aliquot was retained at Focus Diagnostics for the comparator PCR/sequencing method.

Results from the Simplexa™ HSV 1 & 2 Direct were compared to results from two PCR/bi-directional sequencing assays (comparator). A positive result by the comparator is defined as a positive by at least one of the two PCR/bidirectional sequencing assays. For a result to be defined as negative by the comparator, both of the two PCR/bidirectional sequencing assays should yield negative results. The samples were tested using two PCR reactions targeting two distinct regions of the HSV genome followed by analysis with two bi-directional sequencing assays. Three hundred (300) base-pair dideoxy DNA sequencing assays were validated for two different HSV gene targets. SYBR Green PCR using extracted patient sample DNA was used to test all samples. Amplicons from positive samples were used for bidirectional sequencing. Sequence requirements had a phred quality score ≥20 (for each base) and a continuous read length >200 and a 2x coverage >180. Sequence alignments were analyzed against the GenBank database using the BLAST search program to determine if the patient sample was positive for HSV-1 or HSV-2.

Neural imaging/clinical impression results documented in a case report form (CRF) as

{21}------------------------------------------------

determined by the patient's attending physician and other clinical information such as chemistries, bacterial culture, MRI/CT scans and in-house PCR results were collected for all patients. The Final Diagnosis takes into consideration all of the laboratory findings and the results of a PCR test performed locally along with clinical presentation of the patient. No dual positive (both HSV-1 Positive and HSV-2 Positive) samples were found by the Simplexa HSV1&2 Direct and the comparator algorithm. The table below shows the distribution of the different clinical parameters collected from patients who were confirmed positive and negative by the results from the two PCR/bi-directional sequencing assays.

ParameterPatients whichare positive bythe comparatorfor HSV(Number and %)Patients whichare negative bythe comparatorfor HSV(Number and %)
MRI results suggestive of HSV infection18/65 (27.7%)9/154 (5.8%)
MRI results not suggestive of HSV infection43/65 (66.2%)121/154 (78.6%)
MRI results not available4/65 (6.2%)24/154 (15.6%)
Final Diagnosis positive for HSV infection.61/65 (93.8%)33/154 (21.4%)
Final Diagnosis negative for HSV infection4/65 (6.2%)121/154 (78.6%)
Bacteria culture positive2/65 (3.1%)4/154 (2.6%)
Bacteria culture negative63/65 (96.9%)145/154 (94.2%)
Bacteria culture not performed0/65 (0.0%)5/154 (3.2%)

{22}------------------------------------------------

The following tables summarize the results of the Simplexa™ HSV 1 & 2 Direct assay's
agreement with the comparator (results of the 2 PCR/bidirectional sequencing assays).
HSV-1: Prospective SamplesHSV-2: Prospective Samples
Simplexa™ResultsComparator: Two PCR/SEQSimplexa™ResultsComparator: Two PCR/SEQ
DetectedNotDetectedTotalDetectedNotDetectedTotal
Detected32*5Detected61##7
Not Detected0159159Not Detected1#156157
Total3161164Total7157164
PPA100.0% (3/3)95% CI: 43.8 to 100.0%PPA85.7% (6/7)95% CI: 48.7 to 97.4%
NPA98.8% (159/161)95% CI: 95.6 to 99.7%NPA99.4% (156/157)95% CI: 96.5 to 99.9%
*1/2 sample had a final diagnosis of meningitisfrom the chart information.#Sample was collected from patient with a finaldiagnosis of meningitis from the chartinformation.##Sample was collected from patient with a finaldiagnosis of meningitis from the chartinformation.

Note: PPA: Positive Percent Agreement; NPA: Negative Percent Agreement

Fifty five (55) retrospective/preselected HSV positive (as determined by the collection sites) samples from four sites were collected between 2004 and 2013 and confirmed positive by the two PCR/bi-directional sequencing assays. These retrospective samples were used to supplement the prospective study to evaluate the sensitivity of the Simplexa™ HSV 1 & 2 Direct. The results are shown in the table below.

{23}------------------------------------------------

Retrospective/Preselected Positive Samples –Positive Percent Agreement (PPA)
Simplexa™ResultsComparator: Two PCR/SEQ
HSV-1HSV-2
HSV-1130
HSV-2042
Not Detected00
Total1342
HSV-1HSV-2
PPA100.0% (13/13)95% CI: 77.2 to100.0%100.0% (42/42)95% CI: 91.6 to100.0%

4. Expected Values

The observed expected values of HSV-1 and HSV-2 in the prospective population of the Simplexa™ HSV 1 & 2 Direct clinical study varied between institutions, and are shown in the tables below.

SamplePopulationSampleCollectionSiteNo. ofSamplesExpected Values Based onSimplexa™ HSV1/2 Direct
HSV-1HSV-2NotDetected
Prospective131-6.5%(2/31)93.5%(29/31)
7244.2%(1/24)-95.8%(23/24)
8944.3%(4/94)5.3%(5/94)90.4%(85/94)
915--100.0%(15/15)
All1643.0%(5/164)4.3%(7/164)92.7%(152/164)

{24}------------------------------------------------

AgeCategoryProspective - Number of Samples Positive by Simplexa™ HSV1/2 Direct
CombinedFemaleMale
HSV-1HSV-2NotDetectedAllHSV-1HSV-2NotDetectedAllHSV-1HSV-2NotDetectedAll
From birthto 1 month1191066134
>1 month to2 years1125268811718
>2 years to12 years996633
>12 years to21 years11111214577
>21 years to60 years446573313539133034
>60 years13334120211313
All57152164427985157379

{25}------------------------------------------------

M. Instrument Names:

Integrated Cycler with Integrated Cycler Studio Software version 5.0 or higher (3M)

N. System Description:

    1. Modes of Operation: Batch
    1. Specimen Identification: Entered manually by user
    1. Specimen Sampling and Handling: Samples are processed according to assay instructions.
    1. Calibration:

In-field calibration for the Integrated Cycler is not necessary. Calibration of the optical modules (excitation and emission gain settings) is performed during the manufacturing process and the values are stored in the instrument firmware.

    1. Quality Control:
      Quality control is addressed for each separately cleared specific assay to be run on the instrument.

The positive control may be used as an external control for Quality Control (QC) testing, training or proficiency testing. Synthetic CSF is recommended as a No Template Control (NTC). Ouality control ranges have been established as indicated in the table below. If the controls are not within these parameters, patient results should be considered invalid and the assay repeated. Focus Diagnostics recommends testing controls once per day. Each laboratory should establish its own QC ranges and frequency of QC testing based on applicable local laws, regulations and standard good laboratory practice. Refer to the Simplexa" HSV 1 & 2 Direct package insert for instructions on testing the positive control.

Control TypeHSV-1HSV-2DNA InternalControl (DNA IC)
Simplexa™ HSV 1& 2 PositiveControl1DetectedDetectedNot applicable2
No TemplateControl (NTC)Not DetectedNot DetectedValid

Expected Control Results

1 Typical Ct values for the Positive Control range between 25 to ≤40.

2 Detection of the Simplexa™ DNA Internal Control (DNA IC) is not required for a valid result when HSV is detected.

{26}------------------------------------------------

    1. Software:
      FDA has reviewed applicant's Hazard Analysis and Software Development processes for this line of product types:

Yes___________ or No__________________________________________________________________________________________________________________________________________________________

O. Other Supportive Instrument Performance Characteristics Data Not Covered In the "Performance Characteristics" Section above:

Not Applicable

P. Proposed Labeling:

The labeling is sufficient and satisfies the requirements of 21 CFR Parts 801 and 809, 21 CFR 801.109, and the special controls.

Q. Identified Potential Risks and Required Mitigation Measures

Identified Potential RisksRequired Mitigation Measures
Risk of false resultsSpecial controls (1), (2), and (3)
Failure to correctly interpret test resultsSpecial controls (4) and (5)
Failure to correctly operate theinstrumentSpecial controls (6) and (7)

R. Benefit/Risk Analysis

Summary
Summary ofthe Benefit(s)When used for the proposed intended use, the benefits to the clinician and the patientinclude: (1) establishment of the device performance in a manner that demonstratesconsistent accurate test results; and 2) ability to use a well validated device to diagnoseHSV in the CNS, which will allow prompt initiation of disease specific treatment.

{27}------------------------------------------------

Summary ofthe Risk(s)The risks associated with the device, when used as intended, are those related to therisk of false results, failure to correctly interpret the test results and failure to correctlyoperate the instrument.They may lead to error or delay in the diagnosis of HSV-1 and HSV-2 infections,error or delay in treatment of these infections, unnecessary use of anti-viral therapy,and delay in establishing the patient's true diagnosis.
ConclusionsDo theprobablebenefitsoutweigh theprobable risks?The probable benefits of this device outweigh the probable risks associated with itsuse. There are no substantial clinical concerns with the classification of this device inClass II given the combination of general and special controls.

S. Conclusion:

The information provided in this de novo submission is sufficient to classify this device into class II under regulation 21 CFR 866.3307 with special controls. FDA believes that special controls, along with the applicable general controls, provide reasonable assurance of the safety and effectiveness of the device type. The device is classified under the following:

Device Type: Herpes simplex virus nucleic acid-based assay for central nervous system infections.

Class: II (special controls)

Regulation: 21 CFR 866.3307

(a) Identification. A herpes simplex virus nucleic acid-based assay for central nervous system infections is a qualitative in vitro diagnostic device intended for detection and differentiation of HSV-1 and HSV-2 in cerebrospinal fluid (CSF) samples from patients suspected of Herpes Simplex Virus (HSV) infections of the central nervous system (CNS). This test is intended as an aid in the diagnosis of HSV-1 and HSV-2 infections of the CNS. Negative results do not preclude HSV-1 or HSV-2 infection and should not be used as the sole basis for treatment or other patient management decisions.

(b) Classification. Class II (special controls). The special controls for this device are:

    1. Premarket notification submissions must include detailed documentation for the device description, including the device components, ancillary reagents required but not provided, and a detailed explanation of the methodology including primer design

{28}------------------------------------------------

and selection.

    1. Premarket notification submissions must include detailed documentation from the following analytical and clinical performance studies: Analytical sensitivity (Limit of Detection), reactivity, inclusivity, precision, reproducibility, interference, cross reactivity, carry-over, and cross contamination. Premarket notification submissions must also document reagent and sample stability recommendations.
    1. Premarket notification submissions must include detailed documentation from a clinical study. The study, performed on a study population consistent with the intended use population, must compare the device performance to the results of two PCR methods followed by bidirectional sequencing.
    1. A detailed explanation of the interpretation of results and acceptance criteria must be included in the device's 21 CFR 809.10(b)(9) compliant labeling.
    1. The device labeling must include a limitation statement that reads: "Negative results do not preclude HSV-1 or HSV-2 infection and should not be used as the sole basis for treatment or other patient management decisions."
    1. Premarket notification submissions must include quality assurance protocols and a detailed documentation for device software, including, but not limited to, standalone software applications and hardware-based devices that incorporate software.
    1. The risk management activities performed as part of the manufacturer's 21 CFR 820.30 design controls must document an appropriate end user device training program that will be offered as part of efforts to mitigate the risk of failure to correctly operate the instrument.

§ 866.3307 Herpes simplex virus nucleic acid-based assay for central nervous system infections.

(a)
Identification. A herpes simplex virus nucleic acid-based assay for central nervous system infections is a qualitative in vitro diagnostic device intended for the detection and differentiation of HSV-1 and HSV-2 in cerebrospinal fluid (CSF) samples from patients suspected of Herpes Simplex Virus (HSV) infections of the central nervous system (CNS). This test is intended as an aid in the diagnosis of HSV-1 and HSV-2 infections of the CNS. Negative results do not preclude HSV-1 or HSV-2 infection and should not be used as the sole basis for treatment or other patient management decisions.(b)
Classification. Class II (special controls). The special controls for this device are:(1) Design verification and validation must include:
(i) Detailed documentation for the device description, including the device components, ancillary reagents required but not provided, and a detailed explanation of the methodology, including primer design and selection.
(ii) Detailed documentation from the following analytical and clinical performance studies: Analytical sensitivity (limit of detection), reactivity, inclusivity, precision, reproducibility, interference, cross reactivity, carryover, and cross contamination. Documentation must include reagent and sample stability recommendations.
(iii) Detailed documentation from a clinical study. The study, performed on a study population consistent with the intended use population, must compare the device performance to the results of two polymerase chain reaction methods followed by bidirectional sequencing.
(iv) Documentation of an appropriate end user device training program that will be offered as part of efforts to mitigate the risk of failure to correctly operate the instrument.
(v) Quality assurance protocols and detailed documentation for device software, including standalone software applications and hardware-based devices that incorporate software.
(2) The labeling required under § 809.10(b) of this chapter must include:
(i) A detailed explanation of the interpretation of results and acceptance criteria.
(ii) A limiting statement indicating that negative results do not preclude HSV-1 or HSV-2 infection and should not be used as the sole basis for treatment or other patient management decisions.