(299 days)
The EnLite™ Neonatal TREC Kit is an in vitro diagnostic device intended for the semiquantitative determination of TREC (T-cell receptor excision circle) DNA in blood specimens dried on filter paper. The test is for use on the VICTOR™ EnLite instrument. The test is indicated for use as an aid in screening newborns for severe combined immunodeficiency disorder (SCID).
This test is not intended for use as a diagnostic test or for screening of SCID-like Syndromes, such as DiGeorge Syndrome, or Omenn Syndrome. It is also not intended to screen for less acute SCID syndromes such as leaky-SCID or variant SCID.
The EnLite™ Neonatal TREC Kit is comprised of the EnLite™ Neonatal TREC Kit, the VICTOR™ EnLite instrument and the EnLite™ workstation software. The EnLite™ Neonatal TREC Kit contains reagents sufficient for 384 reactions or 1152 reactions, and multi-level, dried blood spot (DBS) calibrators and controls. The DBS calibrators and DBS controls have been prepared from porcine whole blood with a hematocrit value of 48-55%, and contain purified salmon-sperm, TREC, and beta-actin DNA.
The EnLite™ Neonatal TREC Kit is an in vitro diagnostic device for semi-quantitative determination of T-cell receptor excision circles (TRECs) in dried blood specimens, used as an aid in screening newborns for severe combined immunodeficiency disorder (SCID).
1. Acceptance Criteria and Reported Device Performance
The acceptance criteria for the EnLite™ Neonatal TREC Kit are outlined in the regulatory information, specifically within the "Special Controls" section (Section T, point 1(iii)). These criteria detail the required analytical and clinical performance characteristics for the device. The reported device performance is presented throughout the "Performance Characteristics" section (Section M).
Here's a table summarizing key acceptance criteria and reported performance, focusing on the clinical validation study as that directly addresses the intended use of screening:
Table of Acceptance Criteria and Reported Device Performance
| Performance Characteristic | Acceptance Criteria (from Special Controls) | Reported Performance (from Clinical Study) |
|---|---|---|
| Clinical Validity | Data demonstrating clinical validity using well-characterized prospectively or retrospectively obtained clinical specimens representative of the intended use population. A minimum of 10-15 confirmed positive specimens from more than one site, with relevant annotation, and SCID diagnosis by flow cytometry or clinically meaningful information regarding subject status at one year or beyond. Additional specimens characterized by other disorders with low/absent TREC (e.g., other T-cell lymphopenic disorders) to supplement the range of results. Pre-specified clinical decision point (cut-off) before studies. Results summarized in tabular format comparing interpretation to reference method. Point estimates and 95% CIs for PPA, NPA, and OPA. Data must include retest rate, false positive rate before retest, final false positive rate, and false negative rate. | The primary clinical study objective was to demonstrate the EnLite™ Neonatal TREC Kit's screening performance in the intended use population and its ability to discriminate between normal and SCID cases. The study was conducted retrospectively. SCID Positive Specimens: 17 archived confirmed SCID positive DBS specimens were obtained from newborn screening laboratories in the US. All 17 were confirmed for SCID by flow cytometry. These enriched the study due to the low incidence of SCID. Other Low TREC Specimens: An additional 9 DBS specimens from babies with low TREC values (0 to 20 TREC Copies/uL) were included. Comparator: For routine clinical study specimens, the comparator was the clinical assessment from medical records at one year of age or older (365 days), confirming the newborn was not identified with SCID, was not deceased from SCID-related complications, and was apparently healthy. For confirmed SCID cases, the comparator was the reference tests results for SCID confirmation. Pre-specified Cut-off: The cut-off for TREC was pre-determined to be 36 copies/uL and for beta-actin as 56 copies/uL, based on the 2.5th percentile of normal distribution data from a separate cut-off confirmation study using 2846 archived, retrospective newborn specimens from the Danish Newborn Screening Biobank. Retest Rate: The retest rate was 1.9%. False Positive Rate: The false positive rate using the cut-off of 36 in the first round of testing was 1.5%. After repeat testing on follow-up cases, the final false positive rate was 0.5%. False Negative Rate: The clinical data indicates 0 false negative results among the 16 confirmed SCID positives classified after the final testing round (Table 14). Performance (from Table 14, excluding invalid results): - Overall Percent Agreement (OPA): 99.7% (95% CI: 99.4% to 99.8%) - Positive Percent Agreement (PPA): 100% (95% CI: 79.4% to 100%) - Negative Percent Agreement (NPA): 99.7% (95% CI: 99.4% to 99.8%) Note: One SCID positive specimen in the clinical study was classified as an invalid result, leading to 16 confirmed SCID positives being used for final agreement calculations. |
2. Sample Sizes and Data Provenance
-
Test Set Sample Size:
- Clinical Study: A total of 6,471 neonatal specimens were run, with 6,373 included in the final analysis. This included 6,389 routine Danish newborn screening biobanked newborn routine DBS samples and 82 enrichment samples (17 confirmed SCID positive samples, 9 confirmed low-level TREC specimens, and 56 samples used for blinding purposes). For the final agreement calculations, 5,454 specimens (after some exclusions and loss-to-follow-up) were used, specifically 5,442 after removing invalid results (16 confirmed SCID positives and 5,426 normal/presumptive normal).
- Cut-off Establishment Study: 3,243 archived, retrospective newborn specimens initially, with 2,846 included in the analysis after exclusions.
- Analytical Performance Studies (Examples):
- Reproducibility (Site-to-Site): 90 measurements per sample (6 unique TREC levels, 10 runs x 3 laboratories x 3 replicates/sample).
- Precision: 27 runs performed over 20 days. For TREC precision, 10 samples were assessed with 4 replicates/sample. For beta-actin, 7 samples were used.
- LoB/LoD/LoQ: 5 samples for LoB (60 results per sample); 5 samples for LoD/LoQ (108 results per sample).
-
Data Provenance:
- Clinical Study & Cut-off Establishment:
- Country of Origin: Denmark (samples from the Danish Newborn Screening Biobank, comprising the Danish population).
- Retrospective/Prospective: All samples were archived, retrospective.
- SCID Enrichment Samples: 17 confirmed SCID positive DBS specimens were obtained from newborn screening laboratories in the US (retrospective).
- Clinical Study & Cut-off Establishment:
3. Number of Experts and Qualifications for Ground Truth
The document does not explicitly state the number of experts used to establish the ground truth for the test set, nor their specific qualifications (e.g., "radiologist with 10 years of experience").
- However, the ground truth for the 17 confirmed SCID positive specimens was established by flow cytometry, which is a specialized laboratory test requiring expert interpretation, presumably by qualified clinical immunologists or pathologists.
- For the routine newborn specimens, the comparator for ground truth was the clinical assessment of the study subjects obtained from their medical records at one year of age or older (365 days), confirming they were not identified with SCID, were not deceased from SCID-related complications, and were apparently healthy. This clinical assessment would implicitly involve input from various medical professionals (pediatricians, specialists).
- The "expert" component primarily comes from the reference method (flow cytometry) for SCID diagnosis and the subsequent clinical follow-up for the larger cohort.
4. Adjudication Method for the Test Set
The adjudication method for the test set was not explicitly described as a multi-expert consensus process like "2+1" or "3+1" that is common in medical imaging studies. Instead, the ground truth for SCID confirmation was primarily based on:
- Laboratory Confirmation: Flow cytometry for the 17 confirmed SCID cases.
- Clinical Outcomes: Medical record review at one year of age or older for the large cohort of routine newborns to determine the absence of SCID.
The device itself has an internal retesting algorithm (Section P.4 and P.4, Figure 8). Initial results below the cut-off are "presumptive positive" and are retested in duplicate. This internal retesting acts as a form of "internal adjudication" for the device's own classification, but it's not external expert adjudication of the ground truth.
5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study
No MRMC comparative effectiveness study was mentioned. This device is a laboratory diagnostic kit and not an AI-assisted diagnostic tool for human readers (like a CAD system for radiologists). Therefore, a study to measure how much human readers improve with AI vs. without AI assistance is not applicable to this type of device.
6. Standalone Performance
The study primarily assessed the standalone performance of the device/kit (EnLite™ Neonatal TREC Kit, VICTOR™ EnLite instrument, and EnLite™ workstation software) in classifying samples as "presumptive positive" or "normal" based on its quantitative TREC and beta-actin measurements and the predefined cut-offs. The results (PPA, NPA, OPA) reflect the performance of the integrated system in a laboratory setting, without direct human cognitive interpretation of raw data for diagnosis. The output from the device is a quantitative TREC value, which is then used with a hard cut-off.
7. Type of Ground Truth Used
The ground truth used was a combination of:
- Laboratory Test Confirmation: For the known SCID positive cases, flow cytometry was used to confirm SCID.
- Clinical Outcomes Data: For the large cohort of routine newborn screening samples, the absence of SCID was determined through medical record review (vaccination records, national patient registry, civil registration system) at one year of age or older, looking for signs of SCID or SCID-related complications/death.
8. Sample Size for the Training Set
The document describes the evaluation of an already developed device/kit, not a machine learning model. Therefore, there is no explicit "training set" in the context of machine learning model development. The data used for establishing the clinical cut-off (2,846 samples from the Danish Newborn Screening Biobank) could be considered analogous to a "development" or "calibration" dataset, which informed the final cut-off value used in the pivotal study (test set).
9. How the Ground Truth for the Training Set Was Established
As noted above, there isn't a "training set" for a machine learning model. For the dataset used to establish the clinical cut-off (2,846 samples):
- These were archived, retrospective newborn specimens from the Danish Newborn Screening Biobank.
- The ground truth in this context was based on the distribution of TREC and beta-actin values in this "normal newborn population". The 2.5 percentile of this distribution was then chosen as the clinical cut-off for TREC (36 copies/uL) and beta-actin (56 copies/uL). This is a statistical approach to defining "normal" for screening purposes, rather than a direct disease diagnosis for each individual sample.
{0}------------------------------------------------
EVALUATION OF AUTOMATIC CLASS III DESIGNATION FOR ENLITE™ NEONATAL TREC KIT DECISION SUMMARY
A. DEN Number:
B. Purpose for Submission:
De novo request for evaluation of automatic class III designation of the EnLite™ Neonatal TREC Kit
C. Measurand:
T-Cell Receptor Excision Circles (TRECs)
D. Type of Test:
Semi-quantitative, polymerase chain reaction (PCR) based nucleic acid amplification and timeresolved fluorescence resonance energy transfer (TR-FRET) based detection
E. Applicant:
Wallac Oy, a PerkinElmer subsidiary
F. Proprietary and Established Names:
EnLite™ Neonatal TREC Kit
G. Regulatory Information:
-
- Regulation section:
21CFR 866.5930
- Regulation section:
-
- Classification:
Class II
- Classification:
-
- Product code:
- PJI Severe Combined Immunodeficiency Disorder (SCID) Newborn Screening Test System
- KHO Fluorometer, For Clinical Use
{1}------------------------------------------------
4. Panel:
Immunology
H. Intended Use:
-
- Intended use:
The EnLite™ Neonatal TREC Kit is an in vitro diagnostic device intended for the semiquantitative determination of TREC (T-cell receptor excision circle) DNA in blood specimens dried on filter paper. The test is for use on the VICTOR™ EnLite instrument. The test is indicated for use as an aid in screening newborns for severe combined immunodeficiency disorder (SCID).
- Intended use:
This test is not intended for use as a diagnostic test or for screening of SCID-like Syndromes, such as DiGeorge Syndrome, or Omenn Syndrome. It is also not intended to screen for less acute SCID syndromes such as leaky-SCID or variant SCID.
-
- Indication(s) for use:
Same as intended use above.
- Indication(s) for use:
-
- Special conditions for use statement(s):
For prescription use only.
- Special conditions for use statement(s):
-
- Special instrument requirements:
VICTOR™ EnLite instrument and the EnLite™ workstation software.
- Special instrument requirements:
Thermal cycler compatible with full-skirted 96-well PCR plates and with heated lid, heating rate of 3°C - 6°C /sec, cooling rate of 3°C - 4.5°C /sec, heated lid setting using 100°C - 105°C or tracking mode of 5℃ above the block temperature.
I. Device Description:
The EnLite™ Neonatal TREC Kit is comprised of the EnLite™ Neonatal TREC Kit, the VICTOR™ EnLite instrument and the EnLite™ workstation software. The EnLite™ Neonatal TREC Kit contains reagents sufficient for 384 reactions or 1152 reactions, and multi-level, dried blood spot (DBS) calibrators and controls. The DBS calibrators and DBS controls have been prepared from porcine whole blood with a hematocrit value of 48-55%, and contain purified salmon-sperm, TREC, and beta-actin DNA. Specific contents of the kit are as follows:
{2}------------------------------------------------
| DBS calibrators | Filter paper cassettes containing dried blood spots withthree levels (A, B, C) of TREC and beta-actin. Theexact TREC and beta-actin concentrations are given onthe lot-specific quality control certificate included inthe kit but approximate values are targeted as follows:A: TREC 25 copies/µL and beta-actin 18 copies/ µLB: TREC 240 copies/µL and beta-actin 120 copies/ µLC: TREC 770 copies/µL and beta-actin 370 copies/ µL |
|---|---|
| DBS controls | Filter paper cassettes containing dried blood spots withone negative control and two positive controls (C1, C2,C3) for TREC and two levels of beta-actin. The valuesfor the DBS controls measured by the manufacturer aregiven on the lot specific quality control certificateincluded in the kit. Each laboratory should establish itsown mean and acceptable range but approximatevalues are targeted as follows:C1 Low Control: TREC 120 copies/µL and beta-actin20 copies/ µLC2 No TREC control: TREC 0 copies/µL and beta-actin 600 copies/ µLC3 High Control: TREC 670 copies/µL and beta-actin600 copies/ µL |
| Elution Diluent | PCR-grade water |
| Reagent Concentrate | Ready-for-use Tris-HCl buffered (pH 8) salt solutionwith EDTA, Tween® 20, deoxyribonucleotidetriphosphates, unlabeled oligonucleotides, labeledoligonucleotides, and bovine serum albumin. |
| 5x Reaction Buffer | Ready-for-use buffer with 7.5 mM MgCl2 |
| DNA Polymerase | Ready-for-use solution with 20 mM Tris-HCl (pH 7.4at +25 °C), 0.1 mM EDTA, 1 mM DTT, 100 mM KCl,stabilizers, 200 µg/mL bovine serum albumin, and 50% glycerol |
| PCR Diluent | Ready-for-use water solution with MgCl2 |
| Barcode labels for the plate | |
| Lot-specific quality control certificate |
{3}------------------------------------------------
J. Substantial Equivalence Information:
-
- Predicate device name(s) and DEN number(s):
Not applicable.
- Predicate device name(s) and DEN number(s):
-
- Comparison with predicate:
Not applicable.
- Comparison with predicate:
K. Standard/Guidance Document Referenced:
CLSI NBS01-A6: Blood Collection on Filter Paper for Newborn Screening Programs; Approved Standard-Sixth Edition
L. Test Principle:
The EnLite™ Neonatal TREC Kit is a combination of PCR-based nucleic acid amplification and time-resolved fluorescence resonance energy transfer (TR-FRET) based detection. The test detects two targets: TREC (the marker for SCID) and beta-actin (an internal control for the test). Amplification and detection of Beta-actin is used to monitor the PCR amplification of a specimen to aid in detecting samples that do not have a sufficient amount of DNA for analysis. Beta-actin is used as a control for monitoring specimen amplification. The determination of TREC and beta-actin is performed simultaneously for each specimen.
The EnLite™ Neonatal TREC Kit is designed to measure TREC and beta-actin DNA in newborn dried blood spots from filter paper and involves the following steps: (1) A small punch is made from a dried blood spot (DBS) specimen from a filter paper intended for newborn screening; (2) The DBS punch, and reagents are added to a 96 well microtiter plate; calibrators and controls are also added to separate wells in the plate (3) TREC DNA is eluted during incubation in a thermocycler; (3) Target sequence-specific TR-FRET probes, which include donor and acceptor fluorophores coupled to opposite ends of a single probe molecule, are added to the microtiter plate; (4) The microtiter plate is returned to the thermocycler for DNA amplification and hybridization. Upon hybridization with the target sequence, energy transfer towards the acceptor emits a specific fluorescence at a given wavelength based on prolonged decay time of the energy-transfer induced acceptor signal; (5) Signal detection is performed on the Victor™ EnLite Instrument bench top microtiter plate fluorometer. The instrument automatically measures the microtiter plates and outputs quantitative results based on the measured fluorescence signals.
The EnLite™ workstation software interprets test results utilizing fluorescence counts measured at 615 nm, 665 nm, and 780 nm. Corrected fluorescence counts, "TREC Response" and "Betaactin Response" for all reactions are calculated from the raw fluorescence counts. The result interpretation is based on two separate calibration curves which use blanks and DBS calibrators A-C. The response, corrected counts, are fitted against the ArcSinh transformed concentrations (copies/uL) using the unweighted linear regression. The test quality control is based on three kit control result interpretations. Each test generates results for TREC and beta-actin.
{4}------------------------------------------------
M. Performance Characteristics:
1. Analytical performance:
a. Reproducibility/Precision:
Three reproducibility studies were conducted using the EnLite™ Neonatal TREC Kit. These included a site-to-site reproducibility study, an independent precision study to evaluate the within-lot, between-lot and total variation of the EnLite™ Neonatal TREC Kit and a thermocycler reproducibility study.
Study I. Site-to-Site reproducibility:
The reproducibility of the EnLite™ Neonatal TREC Kit was assessed at three clinical sites: two external sites in the US and one non-US internal site. The reproducibility study at each clinical site was conducted over 5 non-consecutive days, using one lot with two operators per site performing 5 runs each (10 runs per laboratory). A run consisted of one plate with 3 replicates per sample. The total number of measurements was 90 per sample (10 runs x 3 laboratories x 3 replicates/sample). Each run included calibrators in triplicate and controls.
The reportable range of the test is 29-473 TREC copies/uL. Results below 29 are reported as <29 and results above 473 are reported as >473. However for the purpose of demonstrating reproducibility of the test, six levels of TREC specimens ranging from 3 copies/uL to 550 copies/uL were tested by all three sites. Four specimens (TR2-TR5) were within the measuring range of the test (29-473 TREC copies/uL) (4)
The lowest
TREC level (TR1), below the measuring range, was prepared from adult blood only containing low to zero TREC. The highest TREC level specimen (TR6) above the measuring range was prepared by spiking adult blood with TREC plasmid DNA. b(4)
Samples were then processed in accordance with the instructions for use (package insert).
Table 1 summarizes the within-laboratory, between-laboratory, within-run, between-run and total variation of TREC results across three clinical sites. These results demonstrate that within the measuring range of the test (29-473 TREC copies/ uL), the within-laboratory percent coefficient of variation (%CV) of the EnLite™ Neonatal TREC Kit was 41.7 to 52.1%, the between-laboratory variation range was 15.1-24.3%, the within-run variation was 31.8 to 47.4%, the between-run variation was 12.0 to 36.1% and the total variation of the test range was 48.5 to 59.4%. Imprecision was larger when specimens had TREC values outside the measuring range. Table 2 summarizes the variation for the within-laboratory, betweenlaboratory, within-run, between-run and total variation for the controls.
Table 1. Within-laboratory, between-laboratory, within-run, between-run and total
{5}------------------------------------------------
| Sample | n | Mean TRECcopies /µl | Withinlaboratoryvariation% CV | Betweenlaboratoryvariation% CV | WithinRunVariation%CV | BetweenRunVariation%CV | Totalvariation% CV |
|---|---|---|---|---|---|---|---|
| 1 TR1 | 90 | 3.16 | 119.1 | 20.2 | 110 | 29.6 | 123.0 |
| e TR2 | 90 | 56.26 | 46.2 | 15.1 | 39.4 | 21.2 | 48.5 |
| TR3 | 90 | 68.03 | 48.5 | 21.2 | 47.4 | 12.0 | 54.5 |
| 2 TR4 | 90 | 200.34 | 41.7 | 22.3 | 31.8 | 26.4 | 48.5 |
| TR5 | 90 | 287.15 | 52.1 | 24.3 | 35.0 | 36.1 | 59.4 |
| TR6 | 90 | 544.57 | 69.8 | 41.7 | 46.2 | 47.4 | 86.9 |
variation of TREC results across three clinical sites
Table 2. Within-laboratory, between-laboratory, within-run, between-run and total variation for the three test controls.
| Sample | n | MeanTRECcopies/µl | Withinlaboratoryvariation% CV | Betweenlaboratoryvariation% CV | Withinrun variation%CV | Betweenrun variation%CV | Totalvariation% CV |
|---|---|---|---|---|---|---|---|
| No TREC control | 60 | 1.86 | 88.4 | 13.1 | 62.0 | 54.5 | 91.5 |
| Low control | 60 | 63.43 | 88.4 | 39.4 | 86.9 | 15.1 | 102.9 |
| High control | 60 | 262.43 | 104.6 | 30.7 | 94.7 | 35.0 | 113.5 |
Study 2. Precision: Within run, Within-Lot, Between-lot and Between Instrument Reproducibility
A study was conducted to determine the precision of the EnLite™ Neonatal TREC Kit among multiple operators, days, lots, instruments, and thermocyclers. The study consisted of 3 kit lots, 3 Victor™ EnLite instruments and 3 thermocyclers in various combinations (4 replicates per sample x 3 lots x 3 instruments = 36 results). One of five different operators was randomized to perform each run. Twenty-seven (27) runs were performed over 20 days. Ten TREC samples spanning the range of TREC values 3-473 copies/uL were assessed. For evaluation of TREC precision, 8 samples were prepared from adult EDTA whole blood spiked with TREC plasmid DNA; one low level TREC sample was prepared from un-spiked adult blood, and one sample consisted of cord blood (containing endogenous TREC). For evaluation of beta-actin precision, 7 beta-actin samples from porcine whole blood were chosen to span the range of 16-608 copies/uL beta-actin. For the beta-actin samples, the blood was spiked with TREC plasmid DNA to obtain constant TREC values in all samples.
Results for the TREC precision within-run, within-lot, between-run, between-run, betweeninstrument and total variation for TREC samples 2 through 10 are as follows: Within the measuring range of the test, %CV for within-run ranged from 45% to 88%, the % CV for between-run ranged from 18 to 42%, % CV for within-lot ranged from 67% to 101%, and % CV for between-lot ranged from 11% to 33%, between-instrument variation ranged from 0 to 50% and total %CV ranged from 73% to 106%. Outside of the measuring range, imprecision was greater. Sample 1 had mean TREC copies/uL of 2 b(4)
{6}------------------------------------------------
Testing of sample 4 yielded one outlier.
A summary of the variation (%CV) for the within-run, between-run, within-lot, between-lot, between instrument and total variation components for beta-actin are as follows: Within the measuring range, the %CV for the precision results for beta-actin within-run were 46-71%, the %CV range for between-run was 7-37%. the %CV range for within-lot was 55-95%, the %CV range for between-lot was 10-24%, the %CV range for between-instrument was 0 to 21% and the range of variation for total beta-actin the %CV range was 56-100%.
The distribution of results of the reproducibility study categorized by the cut-off (36 copies/uL) is shown in Table 3. Results below the cut-off would be deemed SCID positive, while results above the cut-off would be deemed SCID negative.
| Sample | N | Mean TRECcopies /µl | Below Cut-off(%) | Above Cut-off(%) |
|---|---|---|---|---|
| 1 | 108 | 3 | 108 (100%) | |
| 2 | 108 | 19 | 83 (77%) | 25 (23%) |
| 3 | 108 | 29 | 70 (65%) | 38 (35%) |
| 4 | 108 | 43 | 41 (38%) | 67 (62%) |
| 5 | 108 | 59 | 25 (23%) | 83 (77%) |
| 6 | 108 | 74 | 18 (17%) | 107 (100%) |
| 7 | 108 | 144 | 108 (100%) | |
| 8 | 108 | 276 | 108 (100%) | |
| 9 | 108 | 473 | 108 (100%) | |
| 10 | 108 | 1790 | 108 (100%) |
Table 3: Dichotomized Results for Precision Samples
Study 3. Thermocycler Reproducibility
A thermocycler reproducibility study was performed using 3 instruments from different manufacturers testing a panel of samples with varying levels of TREC copies. b(4)
Blood was dispensed onto filter paper from two different paper manufacturers and 12 samples were analyzed in the study b(4)
The study acceptance criteria
was based on between-thermal cycler comparison for 5 levels of TREC copies within the measuring range, which is evaluated by testing for statistically significant differences between thermocyclers. Test calibrators and controls were included in each run. Table 4 shows the within-run, between-run, between paper manufacturer, between-thermal cycler and total variation. Total variation is variation that has been pooled across two distinct paper manufacturers and across all three thermal cyclers. One well of the run performed on the 2nd day of the study showed no signals for TREC or beta-actin in one thermocycler. Investigation revealed that part of the contents of the well was missing due to incomplete seal of the plate
{7}------------------------------------------------
and this result was excluded from data analysis. Recommendations for specific thermocycler specifications are made in the instructions for use. The total variation within the measuring range of the test is similar (63-74% CV) between samples. Imprecision is higher outside of the measuring range. Analysis using one-way ANOVA showed that there were no differences between the thermocyclers from the different manufacturers at any of the TREC sample levels.
| Sample | N | MeanTREC(copies/µl) | Within-runvariation% CV(copies/µl) | Between-runvariationSD(copies/µl) | Between-papermanufacturer %CV(copies/µl) | Betweenthermal-cyclervariation%CV(copies/µl) | Totalvariation%CV(copies/µl) |
|---|---|---|---|---|---|---|---|
| TR1 | 60 | 4 | 123 | 0.3 | 5.58 | 0.04 | 123 |
| TR2 | 60 | 52 | 73 | 0.01 | 12.4 | 0.01 | 74 |
| TR3 | 60 | 83 | 51 | 33.6 | 0.01 | 0.01 | 63 |
| TR4 | 60 | 124 | 64 | 13.3 | 0.1 | 0.03 | 66 |
| TR5 | 60 | 194 | 61 | 24.9 | 0.03 | 0.02 | 67 |
| TR6 | 59 | 393 | 59 | 39.9 | 0.07 | 0.01 | 75 |
Table 4. TREC within-run, between-run, between-paper manufacturer, between-thermal cycler and total variation
b. Linearity/test reportable range:
The objective of the study was to evaluate the TREC linearity of the EnLite™ Neonatal TREC Kit. Human adult EDTA whole blood sample was used to represent the low concentration TREC sample. A high concentration samples was prepared by spiking TREC plasmid DNA into the same adult blood specimen. b(4)
Samples with intermediate TREC levels were prepared by pooling the low concentration sample with high concentration sample. A total of 15 samples were prepared, 8 of the samples (sample number 4 through sample number 12) spanned the measuring range of the test (29-473 TREC copies/uL). The dried blood spot (DBS) samples were prepared by spotting the samples using filter paper intended for neonatal screening, b(4)
The TREC levels of the sample blood spots were measured with one kit lot using one thermal cycler and one VICTOR EnLite™ instrument. The different dilutions were scattered in random order and each sample was analyzed in in 5 replicates in a single run. Two separate runs were conducted in the experiment using the same set of samples. To investigate potential outliers of the first run, a second run was conducted. Test calibrators [blank reaction and three DBS calibrators in 3 replicates and Test controls (duplicates)] were included in the run. b(4)
Linearity analysis within the entire range tested was performed using the combined data (runl + run 2). A polynomial evaluation of linearity was used for the data analysis. [4 ]
{8}------------------------------------------------
All sample dilutions met the pre-defined criteria for acceptance. The EnLite™ Neonatal TREC Kit is linear within the range of 22-1164 copies/uL. The reportable range of the test is 29-473 Copies/uL for TREC and 16 Copies/uL to 608 Copies/uL for beta actin.
Calibrator Linearity
b(4)
An unweighted linear regression algorithm is used for the calibration curve. b(4)
An example calibration graph for TREC from a reproducibility study run is shown in Figure 1 below.
Image /page/8/Figure/4 description: The image shows a scatter plot of TREC copies per microliter. The x-axis represents TREC copies per microliter, ranging from 0 to 5000. The y-axis represents TREC, ranging from 5,000 to 25,000. There is a linear trendline going through the data points.
Figure 1. Calibration graph for TREC from a reproducibility study run
- c. Traceability, Stability, Expected values (controls, calibrators, or methods)
- i. Traceability
{9}------------------------------------------------
There is no recognized standard or reference material for TREC DNA. The EnLite Neonatal TREC Kit contains calibrators and controls employed in test calibration and quality control. Several in-house reference materials b(4)
b(4) ) are used in the calibration process and in the value assignment of the test calibrators.
The EnLite™ Neonatal TREC Kit contains calibrators and controls that are provided on a filter paper cassette and are prepared from porcine whole blood dispensed onto filter paper intended for neonatal screening. The blood used to prepare the calibrators and controls is spiked with plasmid DNA containing the TREC target sequence to cover the range of 0-576 copies/uL blood.
Controls
The test consists of the following set of controls that are used to monitor test performance: Blank reactions serve as no template control reactions and there are 3 control DBS specimens, including low control (C1: low TREC, low beta-actin), no TREC control (C2: no TREC, normal beta-actin) and high control (C3: normal TREC, normal beta-actin).
| Control | TREC | Beta-actin |
|---|---|---|
| C1 Low control | 120 | 20 |
| C2 No TREC control | 0 | 600 |
| C3 High control | 670 | 600 |
Calibrators
The EnLite™ Neonatal TREC calibrators consist of blank reactions and three DBS calibrators, A-C, with known quantities of TREC and beta-actin DNA.
| Calibrator | TREC | Beta-Actin |
|---|---|---|
| A | 25 | 18 |
| B | 240 | 120 |
| C | 770 | 370 |
ii. Stability:
Specimen Stability
The objective of the sample stability testing was to define the short term stability (1-28 days) of TREC in dried blood spot samples collected using filter paper based sample collection devices. The study was conducted using various storage conditions. Adult whole blood and cord blood were mixed in various ratios to obtain samples within the desired TREC levels, such that the samples (n=4) would cover the expected measuring range of the EnLite™ Neonatal TREC Kit.
{10}------------------------------------------------
The test blood samples were spotted using two filter paper brands intended for newborn screening 55 µL/spot and dried overnight at room temperature. Analysis of sample stability was performed using 5 different timepoints: 0, 7, 14, 21 and 28 days. Analysis of the zero timepoint was performed immediately after the drying step using 4 plates containing 5 replicates of the sample stability study samples on each plate. Analysis of the remaining 4 timepoints used 4 plates/timepoint (2 replicates of the sample stability study samples on each plate). Each of these sample plates also included calibrators in triplicate and controls in duplicate.
TREC concentration was measured at the following conditions: storage at -20℃ with no packing, storage at -20°C in a sealed bag with desiccant, storage at 4°C with no packing, storage at 4°C in a sealed bag with desiccant, storage at 22°C, room humidity (RH) at 22-33% with no packing and storage at 35℃, RH 80% with no packing. b(4)
. Figures below shows TREC concentrations measured at different storage conditions and timepoints using 3 kit samples, including 5 TREC copies/uL (Figure 2), 56 TREC copies/uL (Figure 3 and 5) and 273 TREC copies/uL (Figure 4).
As shown in these figures, the decline in the measured TREC concentration was the steepest for samples stored at 35℃, RH 80% with no packing; this was the least optimal storage condition. The decline in the measured TREC concentration was the smallest for samples stored at -20°C. b(4)
Storage of specimens in an environment with elevated temperatures and humidity increases the risk of false positive TREC screening results. TREC concentration may drop over 30% after 7 days at room temperature with low humidity (RH 22-33%). When stored at high temperature (+35 °C) and humidity (RH 80%), the concentration may drop over 50% during the first 7 days, and after 7 days approximately 80%. The results are shown in Figures 2, 3, 4, and 5 for three values of TREC and two filter papers. For longterm storage (up to 19 months), specimens should be placed into plastic bags together with a desiccant and stored at -30 to -16 ℃. The recommended storage condition in the package insert for storage is -30°C to -16°C.
Figure 2. Sample 1 (5 TREC copies/uL) measured at different storage conditions and timepoints on Filter paper brand 1.
{11}------------------------------------------------
Image /page/11/Figure/0 description: This figure shows a line graph titled "Sample 1, Filter paper brand 1 (TREC 5 copies / μl)". The x-axis is labeled "Storage time (days)" and ranges from 0 to 30. The y-axis is labeled "TREC copies / μl" and ranges from 0 to 12. There are five lines on the graph, each representing a different storage condition: -20 C in a sealed bag with a desiccant, +4 C no packing, +4 C in a sealed bag with a desiccant, from +19 to +25 C RH 22-33% no packing, and +35 C RH 80% no packing.
Figure 3. Sample 2 (56 TREC copies/uL) measured at different storage conditions and timepoints on Filter paper brand 1.
Image /page/11/Figure/2 description: The image is a line graph titled "Sample 2, Filter paper brand 1 (TREC 56 copies / μl)". The x-axis is labeled "Storage time (days)" and ranges from 0 to 30. The y-axis is labeled "TREC copies / μl" and ranges from 0 to 60. There are five lines on the graph, each representing a different storage condition: -20 C in a sealed bag with a desiccant, +4 C no packing, +4 C in a sealed bag with a desiccant, from +19 to +25 C RH 22-33% no packing, and +35 C RH 80% no packing.
Figure 4. Sample 3 (273 TREC copies/uL) measured at different storage conditions and timepoints on Filter paper brand 1
{12}------------------------------------------------
Image /page/12/Figure/0 description: The image is a line graph that shows the stability of TREC copies over time under different storage conditions. The x-axis represents storage time in days, ranging from 0 to 30, while the y-axis represents TREC copies per microliter, ranging from 0 to 300. There are five different storage conditions plotted on the graph, including -20 degrees Celsius in a sealed bag with a desiccant, +4 degrees Celsius with no packing, +4 degrees Celsius in a sealed bag with a desiccant, +19 to +25 degrees Celsius with 22-33% relative humidity and no packing, and +35 degrees Celsius with 80% relative humidity and no packing. The graph shows that the number of TREC copies decreases over time for all storage conditions, but the rate of decrease varies depending on the condition.
Image /page/12/Figure/1 description: The image is a figure with a text description. The text says, "Figure 5. Sample 1 (55 TREC copies/uL) measured at different storage conditions and timepoints on Filter paper brand 2." The figure is about measuring TREC copies under different conditions. The sample has 55 TREC copies per microliter.
Image /page/12/Figure/2 description: The image is a line graph that shows the number of TREC copies per microliter over a period of 30 days. There are five lines on the graph, each representing a different storage condition. The storage conditions are -20 degrees Celsius in a sealed bag with a desiccant, +4 degrees Celsius with no packing, +4 degrees Celsius in a sealed bag with a desiccant, from +19 to +25 degrees Celsius with RH 22-33% with no packing, and +35 degrees Celsius with RH 80% with no packing. The graph shows that the number of TREC copies decreases over time for all storage conditions, but the rate of decrease varies depending on the storage condition.
Reagent Stability
The objective of this study was to demonstrate the in-use and on-board stability of the EnLite Neonatal TREC Kit components. These studies were performed with or without an additional transport simulation treatment that simulates the worst case conditions that can occur during packaging and shipping.
In Use Reagent Stability Study
For the in use reagent study, elution diluent and reaction buffer were thawed, diluted as appropriate and stored at 2 to 8° for 15 days before use. All other kit components were thawed and frozen for 4 cycles over 4 days (stored at room temperature for one
{13}------------------------------------------------
hour per day and then re-frozen). Calibrators and control cassettes were also opened during thawing and then packed in a re-sealable bag with desiccant. The kit components were otherwise stored at their normal storage conditions (-30 to -16℃). Fourteen days from the first freeze-thaw cycle, reagents were thawed for a fifth time and tested as follows. Calibrators, controls and DBS samples were punched into microtiter plates, which were stored at room temperature (19 to 25°C) and tested after 23 hours. Before starting the test, the reagent mixture was prepared and the mixture was stored at 2 to 8° for 24 hours.
On Board Study
For the on board study, the test plates from study 1 were removed from the VICTOR EnLite™ instrument after the first measurement. These test plates were then stored in the thermal cycler (23°C) for 70 minutes and the plates were then measured again with the VICTOR EnLite™ instrument.
Transport Simulation
A transport simulation treatment was performed for all the kit components, and exposed to the transport simulation treatment before the study. The stress condition sequence for the kit components (packed and shipped with blue ice) was: 1 hour at 25°C, 6 hours at -20°C, 6 days at 4°C, 1 day at -20°C, 2 days at 4°C and ≥ 1 day at -20°C. After the transport simulation, all reagents were stored at their normal storage conditions (-30 to -16℃) until starting the in-use study.
The acceptance criteria for the stability tests are based on product performance specifications for precision. Test-specific acceptance limits corresponding to a=0.5% significance level (2SD) and a=0.3% significance level (3SD) are statistically calculated from the precision requirements (population SD). In addition there are acceptance limits for within and between plates variations to assure that all the individual test results contributing to the mean are acceptable.
The in-use and on-board stability testing was performed in a manner such that the EnLite™ Neonatal TREC Kits were first performed with the in-use treated kit components and the plates were measured without delay. The same plates were re-measured when 70 minutes had elapsed from the end of the PCR program. Table 5 below summarizes the mean TREC results of the in-use study (before on-board testing) followed by results measured 70 minutes after completion of the PCR program (after on-board testing). Table 6 below summarizes the mean beta-actin results on the on-board testing study.
These studies demonstrate that the elution buffer can be stored at 2 to 8° for 14 days, once it is diluted, and used in the EnLite™ Neonatal TREC Kit. The reagent mixture can be stored at 2 to 8°C for 23 hours, once it is prepared. For the calibrators and controls, once they are opened, they can be thawed and re-frozen four times, stored at -30 to -16°C for 14 days in a resealable plastic bag with desiccant (protected from light) and used in the EnLite™ Neonatal TREC Kit. The reagent concentrate, reaction buffer, DNA Polymerase and PCR diluent can
{14}------------------------------------------------
also be thawed and re-frozen four times, stored at -30 to -16℃ for 14 days and then used in the EnLite™ Neonatal TREC Kit. Microplates with punched calibrators and controls in wells can be stored at room temperature (19 to 25°C) after PCR and hybridization for 60 minutes before measurement.
| Control | Target(Copies/µL) | Mean TREC concentration(Copies/µL) | |
|---|---|---|---|
| Before on-board testing | After on-board time | ||
| Kit control 1 | 117 | 85 | 86 |
| Kit control 2 | 0 | 0 | 0 |
| Kit control 3 | 470 | 343 | 344 |
| TREC ReferenceControl K1 | 67 | 46 | 51 |
| TREC ReferenceControl K2 | 118 | 72 | 77 |
| TREC ReferenceControl K3 | 287 | 104 | 120 |
Table 5. Mean TREC on-board stability test results
Table 6. Mean beta-actin on-board testing results
| Control | Target(Copies/µL) | Mean beta-actin concentration(Copies/µL) | |
|---|---|---|---|
| Before on-board testing | After on-board time | ||
| Kit control 1 | 52 | 46 | 38 |
| Beta-actin ReferenceControl K1 | 56 | 52 | 49 |
| Beta-actin ReferenceControl K2 | 80 | 71 | 66 |
d. Detection limit:
The objective of the study was to determine the TREC limit of blank (LoB), limit of detection (LoD) and limit of quantitation (LoQ) for the EnLite™ Neonatal TREC Kit.
Limit of Blank (LoB)
Five dried blood spot samples prepared from porcine whole blood with no endogenous TREC and low basal level of beta actin were used to assess the LoB. b(4)
The blood was dispensed on filter paper intended for neonatal screening b(4) and dried. Repeated measurements of the blank samples were tested against a full calibration curve (blank reaction and three DBS calibrators in 3 replicates). Three kit controls in duplicate were included in each plate. Ten separate runs of six replicates/sample were performed over five operating days (10 runs x 6 replicates = 60 results/sample). Two kit lots and two thermal cyclers/fluorometer instruments were used for the analysis. b(4)
{15}------------------------------------------------
b(4) The observed LoB of TREC was determined to be 3 copies/uL, which met the pre-defined acceptance criteria for the EnLite™ Neonatal TREC Kit.
Limit of Detection (LoD) and Limit of Quantification (LoQ)
Five low-level samples (19, 29, 42, 59 and 74 TREC copies/uL) were used for defining the LoD and the LoQ for TREC. The samples were dried blood spot samples prepared from adult EDTA whole blood that contains a low endogenous level of TREC. b(4)
The blood was spiked with TREC plasmid DNA to obtain low TREC samples. As whole blood contains a considerable level of endogenous beta actin, the betaactin level is constant in all samples. The DBS samples were prepared by spotting the blood with different TREC concentration levels on filter paper intended for newborn screening, b(4)
Repeated measurements were carried out using five low level TREC dried blood spot samples. For the study, 27 runs were performed using 5 samples with 4 replicates/sample (27 runs x 4 replicates = 108 results per sample) over 20 operating days. Three kit lots and three thermal cyclers/fluorometer instruments were used for the analysis. Three kit controls in four replicates were included in each plate. LoD, was defined as the 95th percentile of measurements that exceeds the LoB. The LoO is defined as the lowest concentration of the analyte that can be measured with acceptable total variation.
An estimate of the standard deviation for LoD was derived from five low level sample result distributions. b(4)
The most conservative highest kit lot SD was used and the LoD was reported as 20 copies/ uL, b(4) b(4)
Since there is no reference method for the value assignment of TREC concentration for the LoQ study and no international reference standard, a functional sensitivity study was used to define LoQ. The total SD less than or equal to the specification for total variation was fulfilled for samples with TREC concentrations equal or higher than 29 copies/uL. The observed LoQ of 29 copies/uL met the acceptance criteria.
The reported values for TREC are LoB 3 copies/uL; LoD 20 copies/uL and LoQ 29 copies/uL.
- e. Analytical specificity:
Interfering Substances:
The objective of this study was to evaluate the potential for interfering substances
{16}------------------------------------------------
(endogenous) in dried blood spot samples on the measurement of TREC concentrations with the EnLite™ Neonatal TREC Kit. The effect of bilirubin (unconjugated 100mg/L blood) and conjugated (166mg/L blood), lipids (15mg/mL blood), hemoglobin (200g/L blood (this hemoglobin concentration exceeded the recommended interferent test concentration of CLSI EP7-A2), and heparin (0.375 mg/mL blood) on test performance was evaluated. Additionally, because preliminary studies suggested that there was interference by hemoglobin, blood pools with three different TREC concentration levels (unspiked blood and two spiked TREC levels) and intermediate hemoglobin levels (155, 170 and 185 g/L blood = 25% pool, 50% pool and 75% pool, respectively) were also prepared for testing. Interference on TREC was tested using three different TREC levels (low, mid, high) using one kit lot. Dried blood spot samples were prepared by dispensing the prepared samples onto filter paper intended for newborn screening, D(4)
Potential interference was measured using the paired-difference method in which the tested substance is added to the sample. For the study acceptance criteria, a bias of greater than 1SD (calculated from the total variation of the test) at the 5% level of statistical significance (α=0.05) is considered analytically significant.
Unconjugated bilirubin at a concentration of 100 mg/mL blood, conjugated bilirubin at a concentration of 166 mg/L blood, heparin at a concentration of 0.375 mg/mL blood, lipemic samples at lipid concentration of 15 mg/l blood did not interfere with the measurement of TREC using the EnLite™ Neonatal TREC Kit. However, hemoglobin did have an interfering effect and dose-response studies were performed. Only the lowest tested hemoglobin level (25% pool) displayed no interference at any of the tested TREC levels. Since the control pool had 138g/L of hemoglobin, and the 25% pool had 155g/L of hemoglobin, the amount of hemoglobin added to the 25% pool was 17 g/L. Hemoglobin at concentrations lower than 17 g/L did not interfere with TREC measurements.
Primer and Probe Specificity
TREC DNA is formed from sequences from chromosome 14. Beta-actin gene is located in chromosome 7. In silico analysis was conducted to assess for the possibility of crossreactivity to other sequences. No homology was observed leading to false results.
Specimen Carryover Contamination:
The objective of this study was to evaluate whether analyte can be carried over from one sample reaction to subsequent sample reactions by the puncher instrument used to punch out blood disks from the DBS sample for analysis. The test was performed using one kit lot of the EnLite™ Neonatal TREC Kit and three Wallac DBS puncher instruments used to punch 1.5 mm blood spot disks for the analysis. There kit controls in duplicate were included in each plate. The high TREC sample to be used in the study was kit calibrator C prepared from b(4) The mid TREC sample to be used was cord blood prepared by spotting onto filter paper b(4) . The zero TREC level was prepared from porcine whole blood, which is not spiked with TREC. b(4)
{17}------------------------------------------------
b(4) The carry-over result for each of the three puncher instruments is summarized in the Table 7 below. The carry-over study meets the predefined acceptance criteria for TREC. b(4)
The highest observed
mean carry-over percentage was 1.5%.
Table 7. Mean carry-over percentages separately for each of three Puncher instruments. N=number of repetitions of the high- low-low cycle.
| Puncher | High sample material | Mean carry-over-percentage (%) (N=8) |
|---|---|---|
| 1 | Calibrator C | 0.6 |
| 1 | Cord blood sample | 0.4 |
| 1 | Neonatal DBS sample | 3.7 |
| 2 | Calibrator C | 0.1 |
| 2 | Cord blood sample | 0.0 |
| 2 | Neonatal DBS sample | 0.6 |
| 3 | Calibrator C | -0.1 |
| 3 | Cord blood sample | 0.1 |
| 3 | Neonatal DBS sample | 0.1 |
f Assay cut-off:
The test reportable range for TREC is 29 copies/uL to 473 copies/uL blood. Samples that result in values below 29 copies/uL blood are reported as <29 copies/ uL blood. Samples that result in values above 473 copies/uL blood are reported as >473 copies/uL blood. The reportable range for beta-actin is demonstrated to be from 16 copies/ uL blood to 608 copies/ uL blood. The clinical cut-offs are as follows:
TREC positive: ≥36 copies/uL TREC negative: < 36 copies/uL
Beta-actin: The test is valid when beta-actin copy number is ≥56 copies/uL
2. Comparison studies:
- a. Accuracy: Not applicable.
- b. Matrix comparison:
Between Filter Paper Lot-to-Lot Reproducibility
A filter paper lot-to-lot reproducibility study using filter paper from two manufacturers, was conducted in order to evaluate manufacturer differences, and lot differences, as well as to assess homogeneity of the analyte across the dried blood spot. The samples used in the study were prepared from adult whole blood spiked with TREC plasmid DNA to achieve six TREC levels, five of which were within the 29-473 TREC copies/uL measuring range of the test (43, 69, 93, 155, 316 TREC copies/uL). b(4)
{18}------------------------------------------------
b(4) The six levels were dispensed, b(4) onto six different lots of filter paper (3 lots each from two distinct filter paper manufacturers. The total number of samples analyzed in the study, therefore, was 36 (b(4) The study was performed using one lot of the EnLite™ Neonatal TREC Kit and PCR was performed using three different thermocyclers from the same manufacturer.
Image /page/18/Figure/1 description: The image shows text from a document. The text discusses the overall precision for the EnLite™ Neonatal TREC Kit, stating that it was calculated as the sum of within-run, between-run, between paper lot, and between paper-manufacturer variations. The text "b(4)" appears at the top and bottom of the text.
Table 8 below summarizes the within-run, between-run, between paper-lot, between paper-manufacturer and total variation across paper manufacturers and lots. Within the measuring range, within-run variation was between 29 to 47%, between-run variation was between 28 to 32%, between paper-lot variation was between 0.02 to 0.05%, between paper-manufacturer was 0.01 to 0.04% and total variation was 44 to 56%. Imprecision was higher outside of the measuring range. Additionally there are no significant differences between paper manufacturers or between paper lots at the six sample levels tested in the study and that homogeneity is equal between the different paper manufacturers and between paper lots.
Table 8. Within-run, between-run, between paper lot, between paper-manufacturer and total variation across paper manufacturers and lots
{19}------------------------------------------------
| Sample | n | MeanTREC(copies/μl) | Within-runvariation% CV | Between-runvariation%CV | Between-paper lotvariation% CV | Between paper-manufacturervariation%CV | Total variationCV (copies/μl) |
|---|---|---|---|---|---|---|---|
| TR1 | 180 | 3 | 122 | 32 | 0.11 | 0.06 | 132 |
| TR2 | 180 | 43 | 47 | 28 | 0.05 | 0.02 | 56 |
| TR3 | 180 | 69 | 37 | 29 | 0.03 | 0.01 | 48 |
| TR4 | 180 | 93 | 37 | 29 | 0.02 | 0.01 | 48 |
| TR5 | 180 | 155 | 40 | 28 | 0.03 | 0.01 | 50 |
| TR6 | 180 | 316 | 29 | 32 | 0.04 | 0.04 | 44 |
3. Clinical studies:
a. Establishment of the cut-off
A study was conducted to establish a clinical screen cut-off based on the normal newborn population distribution data with the EnLite™ Neonatal TREC Kits and to confirm the TREC and beta-actin cut-off values derived in a separate feasibility study. The cut-off confirmation study utilized a total of 3243 archived, retrospective newborn specimens from the Danish Newborn Screening Biobank (NBS-Biobank). The samples, which originated from the Danish population, were leftover dried blood spot (DBS) samples collected on devices intended for newborn screening. The samples used for the cut-off confirmation study were independent of samples tested in the feasibility study and the pivotal study (samples in the cut-off confirmation study were different than samples in the feasibility study and the pivotal study).
After sample elimination due to failure to meet specimen inclusion/exclusion criteria, 2846 samples were included in the analysis. Table 9 below summarizes the distribution of the TREC and beta-actin copies for the newborn specimens analyzed with the EnLite™ Neonatal TREC Kit. The 2.50 percentile was identified as the cut-off for use in the pivotal clinical validation study. The cut-off is 36 copies/uL for TREC and 56 copies/uL for beta-actin. Figure 6 shows the TREC copies/uL distribution of the samples. The vertical line indicates the 2.5 percentile cut-off. Figure 7 shows the beta-actin copies/uL distribution of samples. The vertical line indicates the 2.5th percentile cut-off.
| N | Median | 0.5% | 1.0% | 2.0% | 2.5% | 5.0% | |
|---|---|---|---|---|---|---|---|
| TREC | 2846 | 150 | 21 | 25 | 34 | 36 | 46 |
| Beta-Actin | 2846 | 595 | 25 | 34 | 53 | 56 | 79 |
Table 9. Distribution of TREC and beta-actin in newborn specimens
Figure 6. The TREC copies/uL distribution of samples. The vertical line indicates the 2.5th percentile cut-off for TREC at 36 copies/uL.
{20}------------------------------------------------
Image /page/20/Figure/0 description: This image is a histogram showing the number of samples versus TREC Copies/uL. The x-axis shows the TREC Copies/uL ranging from 0 to 980, and the y-axis shows the number of samples ranging from 0 to 250. The histogram shows a distribution that is skewed to the right, with the highest number of samples occurring between 80 and 140 TREC Copies/uL. There is a vertical red line at approximately 40 TREC Copies/uL.
Figure 7. The distribution of beta-actin copies/μL values among samples. The vertical line indicates the 2.5th percentile cut-off for beta actin at 56 copies/pL.
Image /page/20/Figure/2 description: The image is a histogram showing the distribution of Beta-actin Copies/µL. The x-axis represents the Beta-actin Copies/µL, ranging from 0 to 4700, with intervals of varying sizes. The y-axis represents the number of samples, ranging from 0 to 300. The histogram shows a right-skewed distribution, with the majority of samples having lower Beta-actin Copies/µL values.
b. Pivotal Study:
The objective of the clinical study was the following: to demonstrate the screening
{21}------------------------------------------------
performance of the EnLite™ Neonatal TREC Kit in the intended use population: to demonstrate that the EnLite™ Neonatal TREC Kit discriminates between normal and SCID cases in the intended use population; to ensure that the EnLite™ Neonatal TREC Kit conforms with defined user needs and intended use; to assess the usability of the VICTOR EnLite and EnLite workstation as part of the EnLite™ Neonatal TREC Kit. The study was conducted at one external newborn screening laboratory located at Statens Serum Institut (SSI) Denmark. The study involved testing of archived, retrospective dried blood spot samples submitted to the laboratory for routine newborn screening and stored in the Danish biobank. A total of 6389 archived, retrospective newborn specimens were tested from the Danish Newborn Screening Biobank (NBS-biobank). To avoid sample selection bias, 6389 routine samples, consecutively received at SSI and archived into the NBS-biobank from newborn patients from June 26, 2012 through August 6, 2012 were sequentially entered into the study according to the inclusion/exclusion criteria for the study. Inclusion criteria for the pivotal study included age of the newborn at time of sample collection <31 days. Exclusion criteria included: the DBS not of appropriate quality, insufficient number of punches available from the DBS to complete testing, the parents of the newborn opted out of use of the newborn's sample, the DBS is older than 19 months, or the DBS could not be found in the Biobank. The gestational age of the majority of the subjects was greater than 39-weeks (approximately 72%). Approximately 18% of the subjects were 37-38 gestational weeks, 3.3% were 35-36 weeks, and less than 3% were ≤34 weeks.
Due to the low incidence of SCID, the specimen testing population was enriched with 17 archived confirmed SCID positive DBS specimens obtained from newborn screening laboratories in the US. All of the 17 samples were confirmed for SCID by flow cytometry. In addition to the 17 confirmed positive SCID samples, an additional nine DBS specimens were used from babies with low TREC values ranging from 0 to 20 TREC Copies/uL. Prior to testing all the specimens were stored at -20°C. An additional 56 normal TREC samples were provided by the laboratories that supplied the confirmed SCID positive samples, in order to mask identification of the true SCID positive samples before they were tested.
As summarized in Table 10 below, a total of 6471 neonatal specimens were tested in the study. This included 6389 Danish newborn screening biobanked newborn routine DBS samples, and 82 enrichment samples (17 confirmed SCID positive samples, 9 confirmed low-level TREC specimens and 56 samples used for blinding purposes). Of the 6471 neonatal specimens, 30 were removed due to violation of the inclusion/exclusion criteria and 68 specimens were removed for other reasons, leaving 6373 included in the analysis population. Table 10 shows the distribution of specimens tested and reasons for exclusion.
{22}------------------------------------------------
| Sample Description | Number of Samples | ||
|---|---|---|---|
| Routine | Enrichmentsamples | Total | |
| Number of all samples run | 6389 | 82 | 6471 |
| Samples Removed Due Inclusion/Exclusion Criteria | |||
| Age of newborn ≥ 31 days | 29 | 29 | |
| Unacceptable quality sample | 1 | 1 | |
| Samples Removed Due to Other Issues | |||
| Sample possessed identifier not traceable in Danish registries; error in identifier | 1 | 1 | |
| Specimens used for blinding purposes | 56 | 56 | |
| Repeat samples of subjects already in study | 2 | 2 | |
| Specimens resulting from protocol deviation #4 | 9 | 9 | |
| Number of Samples included in the study | 6347 | 26 | 6373 |
| Confirmed SCID positives | 17 | ||
| Confirmed low TREC positives | 9 |
The specimens were analyzed according the EnLite™ Neonatal kit insert. Each run included calibrators in triplicate. The cut-off values for TREC and beta-actin were previously determined to be 36 and 56 copies/uL, respectively, based on the 2.5th percentile of the normal distribution of specimens tested, conducted prior to the pivotal study. Study samples were analyzed in singlicate and repeated in duplicate according to the testing algorithm in the package insert and shown in Figure 8. Final testing round samples that result in values below 16 copies/ µL blood are reported as <16 copies/ µL blood and are considered to have DNA amplification failure. Samples that result in values above 608 copies/ µL blood are considered to be normal in terms of amplification efficiency.
{23}------------------------------------------------
Figure 8. Testing Algorithm for the Pivotal Study using the EnLite™ Neonatal TREC Kit
As the comparator for the over 6347 routine clinical study specimens, the clinical assessment of the study subjects was obtained from their medical records to confirm that the newborn at one year of age (365 days) or older, was not been identified with SCID, or was not deceased from SCID-related complications, and was apparently healthy.
Table 11 summarizes the distribution of TREC results for the EnLite™ Neonatal TREC Kit based on the cut-off determination of 36 TREC copies/uL for specimens in the data analysis. Calculations were performed using the initial testing results. The 2.5th percentile TREC result was observed to be 41-42 copies/μL, which was higher than the pre-defined cut-off of 36 TREC copies/uL determined in the cut-off confirmation study. Table 12 summarizes the distribution of beta-actin results for the EnLite™ Neonatal TREC Kit.
{24}------------------------------------------------
Table 11. Distribution of TREC results
| Mean TREC Copies/uL by bottom percentile | |||||||||
|---|---|---|---|---|---|---|---|---|---|
| Population | N | Median | Min | Max | 0.5% | 1.0% | 2.0% | 2.5% | 5.0% |
| SCID+lowTREC | 26 | 2 | 0 | 24 | |||||
| All RoutineSamples | 6347 | 172 | 6 | >473 | 26 | 32 | 39 | 41 | 52 |
Table 12. Distribution of Beta-actin Results
| Population | Nobs | Median | Min | Max | 0.5% | 1.0% | 2.0% | 2.5% | 5.0% |
|---|---|---|---|---|---|---|---|---|---|
| SCID+lowTREC | 26 | 1028 | 77 | 19900 | NA | NA | NA | NA | NA |
| All RoutineSamples | 6347 | 691 | 2 | >608 | 17 | 26 | 42 | 48 | 69 |
Of the available 6347 routine newborn specimens, 910 (14%) cases were loss-to-follow due to the absence of proof-of-life documentation at 12 months of age or older in available vaccination and hospitalization records. Table 13 shows the 5454 specimen results from 5437 routine newborn specimens along with the 17 confirmed positive SCID cases. For the confirmed positive SCID cases, the comparator was the reference tests results. In the initial round of testing the EnLite™ Neonatal TREC Kit identified all of the 17 confirmed SCID specimens as below the cut-off of <36 Copies/uL, which acording to the testing algorithem, requires that the samples be retested. An additional 94 routine newborn screening samples were retested in the first round for a total of 111 samples retested after the first round (17 + 94 =111). Table 14 shows the positive percent agreement (PPA), negative percent agreement (NPA) and overall percent agreement (OPA), along with 95% confidence intervals for the first round of testing.
Table 13. Cross tabulation of newborn specimens (n= 5454) that were categorized as normal or presumptive positive by the EnLite Neonatal TREC Kit.
| Comparator | ||||
|---|---|---|---|---|
| SCID (%) | Normal (%) | Total (%) | ||
| Invalid result (%) | 1 (5.9) | 11 (0.2) | 12 (0.2) | |
| EnLite Neonatal TRECFinal test classification | Presumptive positive (%) | 16 (94.1) | 16 (0.4) | 32 (0.6) |
| Normal (%) | 0 (0) | 5410* (99.4) | 5410 (99.2) | |
| Total (%) | 17 (100) | 5437 (100) | 5454 (100) |
- Includes a specimen with known IKK2 mutation but normal T cell level.
After the second round of testing, the final classification, all but one of the 17 confirmed
{25}------------------------------------------------
SCID positive specimens were classified as presumptive SCID screen positive. One SCID positive specimen was classified as invalid result due to beta-actin amplification failure. Table 14 displays the tabulation of results for the 5454 specimen results with the 12 invalid results specimens removed. In routine newborn screening use, if a subject result is categorized as invalid result, a new blood specimen and retesting should be requested. Overall percent agreement = (16 + 5410) / 5442 * 100% = 99.7 % (95% CI from 99.4% to 99.8%), Positive percent agreement = (16 / 16) * 100% = 100 % (95% CI from 79.4% to 100%), and Negative percent agreement = (5410 / 5426) * 100% = 99.7 % (95% CI from 99.4% to 99.8%).
Table 14. Cross tabulation of newborn specimens (n= 5442) that were categorized as normal or presumptive positive by the EnLite Neonatal TREC Kit (excluding invalid results).
| Comparator | ||||
|---|---|---|---|---|
| SCID (%) | Normal (%) | Total (%) | ||
| EnLite Neonatal TREC KitFinal test classification | Presumptive positive (%) | 16 (100) | 16 (0.3) | 32 (0.6) |
| Normal (%) | 0 (0) | 5410* (99.7) | 5410 (99.4) | |
| Total (%) | 16 (100) | 5426 (100) | 5442 (100) |
- Includes a specimen with known IKK2 mutation but normal T cell level.
Follow-up for the remaining 910 patients was performed. Patient outcome for the specimens in the study subject was assessed by evaluating patient records including data available from three different sources: The Danish Vaccination Registry, The Danish National Patient Registry and The Danish Civil Registration System. Clinical information included vaccination records post one year of birth, hospitalization records, and survival status at 17 months. The reason for death and hospitalization history was reviewed to assess the relation to SCID. TREC testing was conducted according to the pre-specified testing algorithm. The retest rate was 1.9%. The false positive rate using the cut-off 36 in the first round of testing was 1.5% and after repeat testing on follow-up cases, was 0.5%.
-
b. Clinical specificity:
See above -
Other clinical supportive data (when a. and b. are not applicable): C.
N/A -
- Clinical cut-off:
The cut-off is identified as 36 TREC copies/uL Beta-actin: The test is valid when Beta-actin copy number is ≥56 copies/uL
- Clinical cut-off:
{26}------------------------------------------------
The following screening algorithm is used in the interpretation of results: The screening algorithm contains two rounds of testing designed to minimize the number of false positive specimens, and also to identify specimens that are deficient in PCR and for which a new blood specimen needs to be requested. Specimens are first tested in singlicate for TREC (i.e, first round). The specimens having low TREC values in the initial round are retested in duplicate to confirm the low TREC result. At the same time, the test results for beta-actin are compared to the cut-off to identify the specimens that are deficient in PCR (DNA amplification failure). Based on the findings in the first and second round of testing, the final interpretation of results can be performed.
| Initial TREC Result(Copies/μL) | Interpretation of Result | Retest Procedure |
|---|---|---|
| ≥ 36 cut-off | Normal | No retest required |
| < 36 cut-off | Presumptive positive | Retest in duplicate with DBSfrom same blood sample |
Initial EnLite™ Neonatal TREC Kit results:
Final EnLite™ Neonatal TREC Kit results:
| InitialTRECResult | Beta-actincontrolResultduplicateretest | TRECResultduplicateretest | Final result | Interpretation of Result |
|---|---|---|---|---|
| $\ge$ cut-off | -- | No retestrequired | Normal | Normal |
| < cut-off | Both$\ge$ cut-off | Both$\ge$ cut-off | Normal | Normal |
| < cut-off | Both$\ge$ cut-off | Eitherduplicate< cut-off | PresumptivePositive | If full term newbornproceed to confirmationtesting.If premature / NICU*newborn request newsample and retest. |
| < cut-off | Both< cut-offor noagreementbetweenduplicates | -- | Invalid result | Request new sample andretest.If second sample isinconclusive, obtain newsample two weeks later andretest. |
5. Expected values/Reference range:
- a. The estimated annual incidence of SCID is one case per 40,000--100,000 live births, or a total
{27}------------------------------------------------
of approximately 40--100 new cases among infants in the United States each year. In a screening program implemented 6 states for 126 months of continuous screening, 961,925 newborns have been screened, 364 newborns had a positive screen requiring additional testing and resulting in 60 cases of diagnosed immune deficiency. Table 15 shows the breakdown of the number of SCID positives and SCID negatives observed. (Report by the Secretary's Advisory Committee on Heritable Disorders in Newborn and Children.)
| Screening | State | Total | ||||||
|---|---|---|---|---|---|---|---|---|
| Result | WI | MA | NavajoNation | NewYork | California | PuertoRico | Louisiana | Screened |
| Negativea | 243,657 | 161,679 | 1,296 | 136,412 | 357,954 | 29,107 | 31,456 | 961,561 |
| Positiveb | 50 | 28 | 1 | 223 | 46 | 8 | 8 | 364 |
| TotalScreened | 243,707 | 161,707 | 1,297 | 136,635 | 358,000 | 29,115 | 31,464 | 961,925 |
Table 15. Number of Negative and Positive Screens by State:
Negative: TREC copy number above cut-off point. No further analysis needed. Positive: TREC copy number below cut-off point. Case referred for confirmatory diagnostic studies.
- b. A study of 5766 de-identified dried blood spot samples submitted to the Wisconsin newborn screening program determined that 1.6% of newborns have <75 TREC copies copies/3uL, or the equivalent of 25 TREC copies/uL. The cut-off of <25 cleared 98.94% of all initial specimens in the initial test. (Baker et al., Implementing routine testing for severe combined immunodeficiency within Wisconsin's newborn screening program, 2010, Public Health Reports, Volume 125 (supplement 2), 88-95).
N. Instrument Name:
The VICTOR EnLite Fluorometer
O. System Descriptions:
-
- Modes of Operation:
The VICTOR EnLite Fluorometer is designed to accept 96-well microtiter plates, which can be loaded manually or with a stacker for automatic operation. The instrument automatically measures the microtiter plates and outputs quantitative results based on the measured fluorescence signals.
- Modes of Operation:
-
- Software:
FDA has reviewed applicant's Hazard Analysis and software development processes for this line of product types:
- Software:
{28}------------------------------------------------
Yes V
3. Specimen Identification:
Specimens are transferred to a barcode-labeled 96-well microtiter plate. Users create a plate map that identifies the specimen in each well using the VICTOR EnLite Workstation Software. The barcode and the plate map are used to track the specimens.
4. Specimen Sampling and Handling:
Specimens are processed according to EnLite™ Neonatal TREC Kit instructions.
-
- Calibration: The VICTOR EnLite Fluorometer does not require to be calibrated by end-users.
6. Quality Control
Run Acceptance
Before analyzing the EnLite™ Neonatal TREC Kit results, the following steps are performed:
The blank reaction replicates (= no template control) are monitored to detect contamination. In a successful experiment, blank reaction replicates should have the median corrected 665 nm and 780 nm fluorescence signals below 7500 counts and below 1500 counts for beta-actin and TREC, respectively. If blank reaction replicates have the median corrected fluorescence signals above the acceptable limits, the run for the samples in that test plate should be repeated. The calibrator C replicates (high beta-actin / high TREC) are monitored to confirm successful PCR amplification. After successful amplification, calibrator C replicates should have the median corrected 665 nm and 780 nm fluorescence signals above 22000 counts and above 9500 counts for beta-actin and TREC, respectively. If calibrator C replicates have the median corrected fluorescence signals below the acceptable limits, the run for the samples in that test plate should be repeated.
The following acceptance criteria were used for the kit control results:
- · C1 (Low control): The mean value of TREC result duplicates (Ln copies) must be within ±2SD from the target. The mean value of beta-actin duplicates (Ln copies) must be below target+2SD.
- · C2 (No TREC control): Both of the C2 control replicates must be equal or below the used TREC cut-off (40 copies/ul). The mean value of beta-actin result duplicates (Ln copies) must be above target-2SD.
- · C3 (High control): The mean value of TREC and beta-actin results (Ln copies) must be above target-2SD.
Calibrator C results are monitored for the presence of TREC and beta-actin amplification. After successful amplification, calibrator C wells should have 'TREC Response' and
{29}------------------------------------------------
'Beta-actin response' above predefined levels. If calibrator C wells have median corrected fluorescence counts below the acceptable limits, an error message 'Low amplification' would be reported and the run would be rejected.
P. Other Supportive Instrument Performance Characteristics Data Not Covered in the "Performance Characteristics" Section above:
A study was conducted to support the concordance between adult blood spiked with synthetic TREC plasmid and cord blood using specimens that spanned the measuring range.
Q. Proposed Labeling:
The labeling is sufficient and it satisfies the requirements of 21 CFR Parts 801 and 809, including adequately identifying the device as a prescription device, and the special controls for this type of device.
R. Identified potential Risks and Required Mitigation Measures:
| Identified Potential Risk | Required Mitigations |
|---|---|
| False negative results due to device or user error | Special Controls (1) and (2) |
| False positive results due to device or user error | Special Controls (1) and (2) |
S. Benefit/Risk Analysis
| Summary | |
|---|---|
| Summary of Benefit(s) | Newborns may potentially benefit from the use of the device as anaid in screening because it might assist practitioners in makingearlier decisions that diagnostic testing is needed for patients withsevere combined immunodeficiency disorder and lead to earlierappropriate treatment. |
| Summary of Risk(s) | Associated device risks include erroneous false negative resultsdue to device or user error or false positive results due to device oruser error. A patient with a false positive result could haveunnecessary additional testing. A patient with a false negativeresult could fail to be detected as a possible SCID case and bedelayed from timely therapy. Proposed special controls andlabeling are appropriate for risk mitigation as a class II device. |
| Summary of Other Factors | Analytical performance studies were considered as part of overalldevice review. |
| ConclusionsDo the probable benefitsoutweigh the risks? | Yes. Based on the pivotal clinical study, proposed special controls,labeling, and analytical validation, the probable benefits outweighthe probable risks. |
{30}------------------------------------------------
T. Conclusion:
The information provided in this de novo submission to classify this device into class II under regulation 21 CFR 866.5930. FDA believes that special controls, along with the applicable general controls, provide reasonable assurance of the safety and effectiveness of the device type. This device is classified under the following:
| Product Code: | PJI—Severe Combined Immunodeficiency Disorder (SCID) NewbornScreening Test System |
|---|---|
| Device Type: | Newborn screening test for SCID |
| Class: | II (special controls) |
| Regulation: | 21 CFR 866.5930 |
- (a) Identification. A newborn screening test for severe combined immunodeficiency syndrome (SCID) is a prescription device intended to measure T-cell receptor excision circle (TREC) DNA obtained from dried blood spot specimens on filter paper using a polymerase chain reaction (PCR) based test as an aid in screening newborns for SCID. Presumptive positive results must be followed-up by diagnostic confirmatory testing. This test is not intended for use as a diagnostic test or for screening of SCID-like syndromes, such as DiGeorge syndrome or Omenn syndrome. It is also not intended to screen for less acute SCID syndromes, such as leaky SCID or variant SCID.
- Classification. Class II (special controls). A newborn screening test for severe combined (b) immunodeficiency must comply with the following special controls:
-
- Premarket notification submissions must include the following information:
- i. The intended use must indicate:
- A) The test is not intended for diagnostic use, or for screening of SCID-like syndromes, such as DiGeorge syndrome or Omenn syndrome, and
- B) The test is not intended to screen for less acute SCID syndromes, such as leaky SCID or variant SCID.
- ii. A detailed description of all components in the test that includes:
- A)A detailed description of the test components, all required reagents, instrumentation and equipment. including illustrations or photographs of non-standard equipment or methods.
- B) Detailed documentation of the device software including, but not limited to, standalone software applications and hardware-based devices that incorporate software.
- C) Specifications for the filter paper, which must be appropriately labeled for in vitro diagnostic use, to be used in specimen collection and how it will be used in specimen collection validation. These specifications must include: descriptive characteristics of the filter paper, instructions on how a lab should choose the appropriate filter paper, chemical properties of the filter paper, interference concerns associated with the
{31}------------------------------------------------
chemicals in the filter paper, and absorption properties of the filter paper, punch size, absorption capacity, testing for homogeneity of punches, diameter of the circle for the dried blood spot aliquot, absorption time, physical composition, and number and size of punches to be tested.
- D) Methodology and protocols for detection of T-cell receptor excision circles and methods for determination of results. The cut-off must be selected before conducting clinical and analytical studies.
- E) A description of the result outputs along with sample reports. Sample reports must include the scale used in reporting of results (e.g., TREC copies/uL) and the range of values that will be reported out.
- F) A description of appropriate internal and external controls that are recommended or provided. The description must identify those control elements that are incorporated into the testing procedure.
- iii. Information that demonstrates the performance characteristics of the test, including:
- A) Data that demonstrates the clinical validity of the device, using well characterized prospectively or retrospectively obtained clinical specimens representative of the intended use population. A minimum of 10-15 confirmed positive specimens must be obtained from more than one site, including relevant annotation, and, at one year or beyond, a SCID diagnosis by flow cytometry or clinically meaningful information regarding the status of the subject must be obtained. Additional specimens should have been obtained that are characterized by other disorders that can be found by screening specimens that have low or absent TREC (e.g., other T-cell lymphopenic disorders) to supplement the range of results. The clinical validation study must have a pre-specified clinical decision point (i.e., cut-off to distinguish positive and negative results). Results must be summarized in tabular format comparing interpretation of results to the reference method. Point estimates together with two-sided 95 percent confidence intervals must be provided for the positive percent agreement (PPA), negative percent agreement (NPA) and overall percent agreement (OPA). Data must include the retest rate, the false positive rate before retest, the final false positive rate, and the false negative rate.
- B) Device reproducibility data generated, using a minimum of three sites of which at least two must be external sites, with two operators at each site. Each site must conduct a minimum of 5 runs per operator over 5 non-consecutive days evaluating a minimum of six different relevant TREC concentrations that span and are well distributed over the measuring range and include the clinical cut-off. Specimens must include cord blood and cord blood diluted with ABO matched adult blood specimens. Identical specimens from the same sample panel must be tested at each site. Each specimen must be run in triplicate and include controls run in triplicate. Results must be reported as the standard deviation and percentage coefficient of variation for each level tested. Results must also be displayed as a dichotomous variable around the cut-
{32}------------------------------------------------
off. Total variation must be partitioned into the sum of within-lab and between-lab variations with pre-specified acceptance criteria and 95 percent confidence intervals for all data. Pre-specified acceptance criteria must be provided and followed.
- C) Device precision data using clinical samples to evaluate the within-lot, between-lot, within-run, between run and total variation. A range of TREC levels of the specimen must include samples within the measuring range, samples above and below the measuring range, as well as with samples very near above and below the cut-off value. At least three replicates of each specimen must be tested with controls and calibrator(s) according to the device instructions for use. The precision study must use well characterized samples using different lots, instruments and operators. Results must be summarized in tabular format. Pre-specified acceptance criteria must be provided and followed.
- D) Linearity of the test must be demonstrated using a dilution panel from clinical samples. The range of dilution samples must include samples within the measuring range, samples above and below the measuring range, as well as with samples very near above and below the cut-off value. Results of the regression analysis must be summarized in tabular format and fitted into a linear regression model with the individual measurement results against the dilution factors. Pre-specified acceptance criteria must be provided and followed.
- E) Device analytic sensitivity data, including limit of blank, limit of detection, and limit of quantification.
- F) Device specificity data, including interference, carryover, cross-contamination, and in silico analysis of potential off-target genomic sequences.
- G) Device stability data, including real-time stability of samples under various storage times, temperatures, and freeze-thaw conditions. A separate shipping stability study must be performed.
- H) Lot-to-lot reproducibility study of each filter paper that will be validated with the test. The lot-to-lot study must include a minimum of three lots of each blood spot card that will be validated with the test and be conducted over 5 non-consecutive days. The sample panel must consist of specimens with a range of TREC levels and include samples within the measuring range, samples above and below the measuring range, and samples very near above and below the cut-off value. Multiple punches must be obtained from each card for demonstration of homogeneity of the analyte across the dried blood spot. Comparability of the test performance for each filter paper must be demonstrated. Stability and storage of TREC DNA on each blood spot card must be demonstrated. Results of the lot-to-lot study must be summarized providing the mean, standard deviation, and percentage coefficient of variation in a tabular format. Data must be calculated for the within-run, between-run, within-lot, and between-lot. Data demonstrating the concordance between results across different filter papers must be provided. Study acceptance criteria must be provided and followed.
{33}------------------------------------------------
- I) If applicable, a thermocycler reproducibility study must be performed using thermocyclers from three independent thermocyler manufacturers. The sample panel must consist of specimens with a range of TREC levels and must include samples within the measuring range, samples above and below the measuring range, and samples very near above and below the cut-off value. The study must be done using 3 filter paper lots and conducted over 5 non-consecutive days. Results of the thermocycler reproducibility study must be summarized providing the mean, standard deviation, and percentage coefficient of variance in a tabular format. Data must be calculated for the within-run, between-run, within-lot, between-lot and between thermocycler manufacturer study results. Study acceptance criteria must be provided and followed.
- iv. Identification of risk mitigation elements used by your device, including a description of all additional procedures, methods and practices incorporated into the directions for use that mitigate risks associated with testing.
-
- Your 809.10 compliant labeling must include:
- i. A warning statement that reads, "This test is not intended for diagnostic use, preimplantation or prenatal testing, or for screening of SCID-like syndromes, such as DiGeorge syndrome or Omenn syndrome. It is also not intended to screen for less acute SCID syndromes, such as leaky SCID or variant SCID."
- ii. A warning statement that reads, "Test results are intended to be used in conjunction with other clinical and diagnostic findings, consistent with professional standards of practice, including confirmation by alternative methods, and clinical evaluation as appropriate."
- iii. A description of the performance studies listed in section 1(iii) and a summary of the results.
- iv. A description of the filter paper specifications required for the test.
§ 866.5930 Newborn screening test for severe combined immunodeficiency disorder (SCID).
(a)
Identification. A newborn screening test for SCID is a prescription device intended to measure T-cell receptor excision circle (TREC) DNA obtained from dried blood spot specimens on filter paper using a polymerase chain reaction based test as an aid in screening newborns for SCID. Presumptive positive results must be followed up by diagnostic confirmatory testing. This test is not intended for use as a diagnostic test, or for screening of SCID-like syndromes, such as DiGeorge syndrome or Omenn syndrome. It is also not intended to screen for less acute SCID syndromes, such as leaky SCID or variant SCID.(b)
Classification. Class II (special controls). The special controls for this device are:(1) Premarket notification submissions must include the following information:
(i) The intended use must indicate:
(A) The test is not intended for diagnostic use, or for screening of SCID-like syndromes, such as DiGeorge syndrome or Omenn syndrome; and
(B) The test is not intended to screen for less acute SCID syndromes, such as leaky SCID or variant SCID.
(ii) A detailed description of all components in the test that includes:
(A) A detailed description of the test components, all required reagents, instrumentation and equipment, including illustrations or photographs of nonstandard equipment or methods;
(B) Detailed documentation of the device software including, but not limited to, standalone software applications and hardware-based devices that incorporate software;
(C) Specifications for the filter paper, which must be appropriately labeled for in vitro diagnostic use, to be used in specimen collection and how it will be used in specimen collection validation. These specifications must include: descriptive characteristics of the filter paper, instructions on how a lab should choose the appropriate filter paper, chemical properties of the filter paper, interference concerns associated with the chemicals in the filter paper, absorption properties of the filter paper, punch size, absorption capacity, testing for homogeneity of punches, diameter of the circle for the dried blood spot aliquot, absorption time, physical composition, and number and size of punches to be tested;
(D) Methodology and protocols for detection of T-cell receptor excision circles and methods for determination of results. The cutoff must be selected before conducting clinical and analytical studies;
(E) A description of the result outputs along with sample reports. Sample reports must include the scale used in reporting of results (
e.g., TREC copies/µL) and the range of values that will be reported out; and(F) A description of appropriate internal and external controls that are recommended or provided. The description must identify those control elements that are incorporated into the testing procedure.
(iii) Information that demonstrates the performance characteristics of the test, including:
(A) Data that demonstrates the clinical validity of the device, using well characterized prospectively or retrospectively obtained clinical specimens representative of the intended use population. A minimum of 10 to 15 confirmed positive specimens must be obtained from more than 1 site, including relevant annotation, and, at 1 year or beyond, a SCID diagnosis by flow cytometry or clinically meaningful information regarding the status of the subject must be obtained. Additional specimens should have been obtained that are characterized by other disorders that can be found by screening specimens that have low or absent TREC (
e.g., other T-cell lymphopenic disorders) to supplement the range of results. The clinical validation study must have a pre-specified clinical decision point (i.e., cutoff to distinguish positive and negative results). Results must be summarized in tabular format comparing interpretation of results to the reference method. Point estimates together with two-sided 95 percent confidence intervals must be provided for the positive percent agreement, negative percent agreement, and overall percent agreement. Data must include the retest rate, the false positive rate before retest, the final false positive rate, and the false negative rate;(B) Device reproducibility data generated, using a minimum of three sites of which at least two must be external sites, with two operators at each site. Each site must conduct a minimum of five runs per operator over five nonconsecutive days evaluating a minimum of six different relevant TREC concentrations that span and are well distributed over the measuring range and include the clinical cutoff. Specimens must include cord blood and cord blood diluted with ABO matched adult blood specimens. Identical specimens from the same sample panel must be tested at each site. Each specimen must be run in triplicate and include controls run in triplicate. Results must be reported as the standard deviation and percentage coefficient of variation for each level tested. Results must also be displayed as a dichotomous variable around the cutoff. Total variation must be partitioned into the sum of within-lab and between-lab variations with pre-specified acceptance criteria and 95 percent confidence intervals for all data. Pre-specified acceptance criteria must be provided and followed;
(C) Device precision data using clinical samples to evaluate the within-lot, between-lot, within-run, between run, and total variation. A range of TREC levels of the specimen must include samples within the measuring range, samples above and below the measuring range, as well as with samples very near above and below the cutoff value. At least three replicates of each specimen must be tested with controls and calibrator(s) according to the device instructions for use. The precision study must use well characterized samples using different lots, instruments, and operators. Results must be summarized in tabular format. Pre-specified acceptance criteria must be provided and followed;
(D) Linearity of the test must be demonstrated using a dilution panel from clinical samples. The range of dilution samples must include samples within the measuring range, samples above and below the measuring range, as well as with samples very near above and below the cutoff value. Results of the regression analysis must be summarized in tabular format and fitted into a linear regression model with the individual measurement results against the dilution factors. Pre-specified acceptance criteria must be provided and followed;
(E) Device analytic sensitivity data, including limit of blank, limit of detection, and limit of quantification;
(F) Device specificity data, including interference, carryover, cross-contamination, and in silico analysis of potential off-target genomic sequences;
(G) Device stability data, including real-time stability of samples under various storage times, temperatures, and freeze-thaw conditions. A separate shipping stability study must be performed;
(H) Lot-to-lot reproducibility study of each filter paper that will be validated with the test. The lot-to-lot study must include a minimum of three lots of each blood spot card that will be validated with the test and be conducted over five nonconsecutive days. The sample panel must consist of specimens with a range of TREC levels and include samples within the measuring range, samples above and below the measuring range, and samples very near above and below the cutoff value. Multiple punches must be obtained from each card for demonstration of homogeneity of the analyte across the dried blood spot. Comparability of the test performance for each filter paper must be demonstrated. Stability and storage of TREC DNA on each blood spot card must be demonstrated. Results of the lot-to-lot study must be summarized providing the mean, standard deviation, and percentage coefficient of variation in a tabular format. Data must be calculated for within-run, between-run, within-lot, and between-lot. Data demonstrating the concordance between results across different filter papers must be provided. Study acceptance criteria must be provided and followed; and
(I) If applicable, a thermocycler reproducibility study must be performed using thermocyclers from three independent thermocyler manufacturers. The sample panel must consist of specimens with a range of TREC levels and must include samples within the measuring range, samples above and below the measuring range, and samples very near above and below the cutoff value. The study must be done using three filter paper lots and conducted over five nonconsecutive days. Results of the thermocycler reproducibility study must be summarized providing the mean, standard deviation, and percentage coefficient of variance in a tabular format. Data must be calculated for the within-run, between-run, within-lot, between-lot, and between thermocycler manufacturer study results. Study acceptance criteria must be provided and followed.
(iv) Identification of risk mitigation elements used by your device, including a description of all additional procedures, methods, and practices incorporated into the directions for use that mitigate risks associated with testing.
(2) Your § 809.10 compliant labeling must include:
(i) A warning statement that reads “This test is not intended for diagnostic use, preimplantation or prenatal testing, or for screening of SCID-like syndromes, such as DiGeorge syndrome or Omenn syndrome. It is also not intended to screen for less acute SCID syndromes, such as leaky SCID or variant SCID.”;
(ii) A warning statement that reads “Test results are intended to be used in conjunction with other clinical and diagnostic findings, consistent with professional standards of practice, including confirmation by alternative methods and clinical evaluation, as appropriate.”;
(iii) A description of the performance studies listed in paragraph (b)(1)(iii) and a summary of the results; and
(iv) A description of the filter paper specifications required for the test.