(170 days)
Not applicable
Not Found
No
The description focuses on a traditional ELISA assay and the statistical analysis of the results (K-fold cross-validation for cutoff selection), not on AI/ML algorithms for data interpretation or prediction.
No
The device is an in vitro diagnostic test that measures biomarkers to aid in the evaluation of patients with suspected traumatic brain injury. It does not provide therapy or treatment.
Yes
The "Intended Use / Indications for Use" section explicitly states that the Banyan BTI is an "in vitro diagnostic chemiluminescent enzyme-linked immunosorbent assay (ELISA)" and its results are used "to aid in the evaluation of patients 18 years of age and older with suspected traumatic brain injury."
No
The device is an in vitro diagnostic kit consisting of physical components (reagents, plates, etc.) used with a hardware reader (Synergy 2 Multi-mode Reader) to perform a chemical assay on serum samples. It is not solely software.
Yes, the Banyan BTI is an IVD (In Vitro Diagnostic).
Here's why:
- Intended Use: The "Intended Use / Indications for Use" section explicitly states: "The Banyan BTI is an in vitro diagnostic chemiluminescent enzyme-linked immunosorbent assay (ELISA)."
- Mechanism: The device measures the concentrations of specific proteins (UCH-L1 and GFAP) in human serum, which is a biological sample taken from the body. This is a hallmark of in vitro diagnostics.
- Purpose: The assay results are used "to aid in the evaluation of patients... with suspected traumatic brain injury," indicating its use in diagnosing or aiding in the diagnosis of a medical condition.
N/A
Intended Use / Indications for Use
The Banyan BTI is an in vitro diagnostic chemiluminescent enzyme-linked immunosorbent assay (ELISA). The assay provides a semi-quantitative measurement of the concentrations of ubiquitin C-terminal hydrolase-L1 (UCH-L1) and glial fibrillary acidic protein (GFAP) in human serum, and is used with the Synergy 2 Multi-mode Reader.
The assay results obtained from serum collected within 12 hours of suspected head injury are used, along with other available clinical information, to aid in the evaluation of patients 18 years of age and older with suspected traumatic brain injury (Glasgow Coma Scale score 13-15). A negative assay result is associated with the absence of acute intracranial lesions visualized on a head CT (computed tomography) scan.
The Banyan BTI is for prescription use only.
Product codes (comma separated list FDA assigned to the subject device)
QAT
Device Description
The Banyan BTI consists of two kits, one for the UCH-L1 assay components and one for GFAP assay components. Each kit is packaged individually in a box and consists of the following: 96-well microtiter strip plate, each well coated with mouse monoclonal UCH-L1 antibody or mouse monoclonal GFAP capture antibody (1 plate); UCH-L1 or GFAP calibrators (1 vial); UCH-L1 or GFAP calibrator diluent (1 vial, 4 mL); UCH-L1 or GFAP control 1 (1 vial); UCH-L1 or GFAP control 2 (1 vial); mouse monoclonal UCH-L1 or mouse monoclonal GFAP detection antibody (1 vial, 0.23 mL); UCH-L1 or GFAP detection antibody diluent (2 vials, 6.5 mL per vial for UCH-L1 or 1 vial, 14 mL for GFAP); ready-to-use assay diluent (2 vials, 5 mL per vial for UCH-L1 or 1 vial, 10 mL for GFAP), chemiluminescent substrate solution A (2 vials, 4.5 mL per vial) and solution B (2 vials, 4.5 mL per vial); a wash tablet and four adhesive plate seals. Components within the same kit are intended to be used together. In each kit, sufficient quantities of each component are provided to test samples from up to 30 patients. Each kit is stored at 2°C to 8°C until ready for use.
Mentions image processing
Not Found
Mentions AI, DNN, or ML
Not Found
Input Imaging Modality
Not Found
Anatomical Site
Not Found
Indicated Patient Age Range
18 years of age and older
Intended User / Care Setting
prescription use only
Description of the training set, sample size, data source, and annotation protocol
The assay cutoffs were determined by analyzing a training dataset consisting of a completely independent population distinct from the subjects evaluated in the ALERT-TBI pivotal trial. A total of 334 subjects (39.2% were female and 60.8% were male; mean age 48.3 years) with Glasgow Coma Scale (GCS) scores between 13-15 who had blood specimens collected within eight hours from the time of head injury were included in the training dataset. Of the 334 subjects, 102 had a positive adjudicated CT result, i.e., the subject had confirmed presence of an acute intracranial lesion per an independent Neuroimaging Review Committee. The K-fold crossvalidation technique was used to aid in the selection of the optimal cutoff values for the two biomarkers. After performing 50 rounds of 10-fold cross-validations, the optimal cutoff values were selected as 327 pg/mL for the UCH-L1 kit and 22 pg/mL for the GFAP kit.
Description of the test set, sample size, data source, and annotation protocol
A total of 2,011 subjects who fulfilled the study inclusion and exclusion criteria and gave informed consent were enrolled at 22 clinical sites in three countries. Two-thirds of the subjects (1,354/2,011 or 67.3%) were enrolled at U.S. sites. A total of 47 subjects (47/2011 or 2.3%) were excluded due to the following: unreadable head CT scan results (7/2011), inconclusive head CT scan result (3/2011), lost blood samples (2/2011), no head CT scan result (8/2011), no serum collected (16/2011), and withdrawal by the subject (11/2011). There were no withdrawals due to screen failure, adverse events, or deaths. Of the 1964 subjects remaining in the study, there were 17 subjects with a GCS of 9-12 (moderate TBI) which are excluded from the analyses of Banyan BTI clinical performance. Of the 1947 evaluable subjects, 1312 (67.4%) of the subjects were enrolled in the United States and 635 (32.6%) were enrolled in Germany and Hungary.
All subjects in the study received standard-of-care treatment which included a head CT scan performed within three hours of presenting to HCF or ED and within 12 hours of injury. All images were de-identified and transmitted from each site to the Core Imaging Laboratory. A Neuroimaging Review Committee, consisting of three neuroradiologists independent from the ALERT-TBI study, conducted an independent, blinded review of each CT scan without access to any other clinical or laboratory data except for age and gender. The blinded review consisted of an assessment of image quality, scalp injuries, facial, cranial and skull based fractures, acute intracranial lesions, and incidental findings of potential clinical relevance. Two primary reviewers independently evaluated each subject CT scan to determine whether it was CT-positive, CT-negative, inconclusive, or unreadable as defined by the presence or absence of acute intracranial lesions, the presence of non-evaluable acute intracranial lesions, or the inability to fully assess the head CT scan, respectively. An acute intracranial lesion was defined as any trauma induced or related finding visualized upon head CT scan, and may have included acute epidural hematomas, acute subdural hematomas, indeterminate extra-axial lesions. cortical contusions, parenchymal hematomas, non-hemorrhagic contusions, ventricle compression, ventricular trapping, brain herniation, intraventricular hemorrhage, hydrocephalus, subarachnoid hemorrhage, petechial hemorrhage, global or focal brain edema and post traumatic ischemia. If the interpretations of the two primary reviewers did not agree, the scan was adjudicated by a third reviewer who was not a primary reviewer and who was blinded to the interpretations from the two primary reviewers. Disagreement was defined as any difference in result of 'CT-positive', 'CT-negative', 'Inconclusive', or 'Unreadable'.
Summary of Performance Studies (study type, sample size, AUC, MRMC, standalone performance, key results)
Clinical sensitivity and specificity: The ability of Banyan BTI to assist physicians in determining the need for a computed tomography (CT) scan of the head in conjunction with other clinical information was evaluated in a prospective, multi-site pivotal trial (ALERT-TBI). This study enrolled 1947 evaluable subjects over the age of 18 who presented to a health care facility (HCF) or emergency department (ED) with suspected head injuries and GCS scores of 13-15 (mild TBI). Subjects had blood withdrawn within 12 hours of head injury and tested.
All subjects in the study received standard-of-care treatment which included a head CT scan performed within three hours of presenting to HCF or ED and within 12 hours of injury. A Neuroimaging Review Committee, consisting of three neuroradiologists independent from the ALERT-TBI study, conducted an independent, blinded review of each CT scan.
Of the 1947 evaluable subjects, 120 had positive CT scan results. Of the 120 subjects with positive CT scan results, 117 had a positive Banyan BTI result. The remaining three CT scan positive subjects had negative results from the Banyan BTI test. None of the five subjects identified with a lesion requiring surgical intervention had a FN result suggesting that Banyan BTI correctly classified all these five CT-positive subjects as assay positive. Of the 1827 subjects with negative CT scan results, 666 had a negative Banyan BTI result. Overall, there were 669 subjects with negative Banyan BTI results. Of these, 666 had negative CT scan results. There was little variation in NPV and PPV between males and females and with increasing time from injury. These data indicate that gender differences and differences between head injury characteristics did not translate into statistically significant differences in assay performance.
Key Metrics (Sensitivity, Specificity, PPV, NPV, etc.)
Sensitivity = 97.5% (117/120)
Specificity = 36.4% (666/1827)
False Negative (FN) rate = 2.5% (3/120)
False Positive (FP) rate = 63.2% (1161/1827)
Negative Predictive Value (NPV) = 99.6% (666/669)
Positive Predictive Value (PPV) = 9.2%
Likelihood Ratio Negative (LRN) = 0.07 (one-sided, lower, exact 95% confidence limit: 0.170)
Likelihood Ratio positive (LRP) = 1.53 (one-sided, lower, 95% confidence limit: 1.468)
Predicate Device(s): If the device was cleared using the 510(k) pathway, identify the Predicate Device(s) K/DEN number used to claim substantial equivalence and list them here in a comma separated list exactly as they appear in the text. List the primary predicate first in the list.
Not applicable
Reference Device(s): Identify the Reference Device(s) K/DEN number and list them here in a comma separated list exactly as they appear in the text.
Not Found
Predetermined Change Control Plan (PCCP) - All Relevant Information for the subject device only (e.g. presence / absence, what scope was granted / cleared under the PCCP, any restrictions, etc).
Not Found
§ 866.5830 Brain trauma assessment test.
(a)
Identification. A brain trauma assessment test is a device that consists of reagents used to detect and measure brain injury biomarkers in human specimens. The measurements aid in the evaluation of patients with suspected mild traumatic brain injury in conjunction with other clinical information to assist in determining the need for head imaging per current standard of care.(b)
Classification. Class II (special controls). The special controls for this device are:(1) The 21 CFR 809.10(b) compliant labeling must include detailed descriptions of and results from performance testing conducted to evaluate precision, accuracy, linearity, analytical sensitivity, interference, and cross-reactivity. This information must include the following:
(i) Performance testing of device precision must, at minimum, use one unmodified clinical specimen from the intended use population with concentration of the brain injury biomarker(s) near the medical decision point. Contrived specimens that have been generated from pooling of multiple samples or spiking of purified analyte to cover the measuring range may be used, but the contrived samples must be prepared to mimic clinical specimens as closely as possible. This testing must evaluate repeatability and reproducibility using a protocol from an FDA-recognized standard.
(ii) Device performance data must be demonstrated through a clinical study and must include the following:
(A) Data demonstrating clinical validity including the clinical sensitivity and specificity, and positive and negative predictive value of the test in the intended use population of patients with suspected mild traumatic brain injury (
i.e., Glasgow Coma Score (GCS) of 13-15), or equivalent standard of care for determination of severity of traumatic brain injury (TBI).(B) Study must be performed using the operators and in settings that are representative of the types of operators and settings for which the device is intended to be used.
(C) All eligible subjects must meet the well-defined study inclusion and exclusion criteria that define the intended use population. The prevalence of diseased or injured subjects in the study population must reflect the prevalence of the device's intended use population, or alternatively, statistical measures must be used to account for any bias due to enrichment of subpopulations of the intended use population.
(D) All eligible subjects must have undergone a head computerized tomography (CT) scan or other appropriate clinical diagnostic standard used to determine the presence of an intracranial lesion as part of standard of care and must also be evaluated by the subject device. All clinical diagnostic standards used in the clinical study must follow standard clinical practice in the United States.
(E) Relevant demographic variables and baseline characteristics including medical history and neurological history. In addition, head injury characteristics, neurological assessments, and physical evidence of trauma must be provided for each subject. This information includes but is not limited to the following: Time since head injury, time from head injury to CT scan, time from head injury to blood draw, GCS score or equivalent, experience of loss of consciousness, presence of confusion, episodes of vomiting, post-traumatic amnesia characteristics, presence of post-traumatic seizures, drug or alcohol intoxication, mechanism of injury, acute intracranial lesion type, neurosurgical lesion, and cranial fracture.
(F) Each CT scan or other imaging result must be independently evaluated in a blinded manner by at least two board-certified radiologists to determine whether it is positive or negative as defined by the presence or absence of acute intracranial lesions. This independent review must be conducted without access to test results of the device. Prior to conducting the review, the criteria and procedures to be followed for scoring the images must be established, including the mechanism for determining consensus.
(G) All the clinical samples must be tested with the subject device blinded to the TBI status and the neurological-lesion-status of the subject.
(H) Details on how missing values in data are handled must be provided.
(I) For banked clinical samples, details on storage conditions and storage period must be provided. In addition, a specimen stability study must be conducted for the duration of storage to demonstrate integrity of archived clinical samples. The samples evaluated in the assay test development must not be used to establish the clinical validity of the assays.
(iii) Performance testing of device analytical specificity must include the most commonly reported concomitant medications present in specimens from the intended use population. Additionally, potential cross-reacting endogenous analytes must be evaluated at the highest concentration reported in specimens from the intended use population.
(iv) Expected/reference values generated by testing a statistically appropriate number of samples from apparently healthy normal individuals.
(2) The 21 CFR 809.10(a) and (b) compliant labeling must include the following limitations:
(i) A limiting statement that this device is not intended to be used a stand-alone device but as an adjunct to other clinical information to aid in the evaluation of patients who are being considered for standard of care neuroimaging.
(ii) A limiting statement that reads “A negative result is generally associated with the absence of acute intracranial lesions. An appropriate neuroimaging method is required for diagnosis of acute intracranial lesions.”
(iii) As applicable, a limiting statement that reads “This device is for use by laboratory professionals in a clinical laboratory setting.”
0
EVALUATION OF AUTOMATIC CLASS III DESIGNATION FOR Banyan Brain Trauma Indicator
DECISION MEMORANDUM
A. DEN Number:
B. Purpose for Submission:
De Novo request for evaluation of automatic class III designation of the Banyan Brain Trauma Indicatory (BTI)
C. Measurands:
Ubiquitin C-terminal hydrolase-L1 (UCH-L1) and glial fibrillary acidic protein (GFAP)
D. Type of Test:
Manual enzyme-linked immunosorbent assay, semi-quantitative
E. Applicant:
Banyan Biomarkers, Inc.
F. Proprietary and Established Names:
Banyan BTI
G. Regulatory Information:
-
- Regulation section: 21 CFR §866.5830
-
- Classification: Class II (special controls)
-
- Product code:
QAT
-
- Panel: Immunology (82)
H. Indications for use:
1
1. Indications for Use:
The Banyan BTI is an in vitro diagnostic chemiluminescent enzyme-linked immunosorbent assay (ELISA). The assay provides a semi-quantitative measurement of the concentrations of ubiquitin C-terminal hydrolase-L1 (UCH-L1) and glial fibrillary acidic protein (GFAP) in human serum, and is used with the Synergy 2 Multi-mode Reader.
The assay results obtained from serum collected within 12 hours of suspected head injury are used, along with other available clinical information, to aid in the evaluation of patients 18 years of age and older with suspected traumatic brain injury (Glasgow Coma Scale score 13-15). A negative assay result is associated with the absence of acute intracranial lesions visualized on a head CT (computed tomography) scan.
The Banyan BTI is for prescription use only.
-
- Special conditions for use statement(s):
For prescription use only
- Special conditions for use statement(s):
For in vitro diagnostic use
-
- Special instrument requirements:
BioTek Instruments, Inc., Synergy 2 Multi-mode Reader, model SL.
- Special instrument requirements:
I. Device Description:
The Banyan BTI consists of two kits, one for the UCH-L1 assay components and one for GFAP assay components. Each kit is packaged individually in a box and consists of the following: 96-well microtiter strip plate, each well coated with mouse monoclonal UCH-L1 antibody or mouse monoclonal GFAP capture antibody (1 plate); UCH-L1 or GFAP calibrators (1 vial); UCH-L1 or GFAP calibrator diluent (1 vial, 4 mL); UCH-L1 or GFAP control 1 (1 vial); UCH-L1 or GFAP control 2 (1 vial); mouse monoclonal UCH-L1 or mouse monoclonal GFAP detection antibody (1 vial, 0.23 mL); UCH-L1 or GFAP detection antibody diluent (2 vials, 6.5 mL per vial for UCH-L1 or 1 vial, 14 mL for GFAP); ready-to-use assay diluent (2 vials, 5 mL per vial for UCH-L1 or 1 vial, 10 mL for GFAP), chemiluminescent substrate solution A (2 vials, 4.5 mL per vial) and solution B (2 vials, 4.5 mL per vial); a wash tablet and four adhesive plate seals. Components within the same kit are intended to be used together. In each kit, sufficient quantities of each component are provided to test samples from up to 30 patients. Each kit is stored at 2°C to 8°C until ready for use.
J. Standard/Guidance Document Referenced:
2
CLSI EP05-A3, Evaluation of Precision of Quantitative Measurement Procedures; Approved Guideline-Third Edition
CLSI EP6-A: Evaluation of Linearity of Quantitative Measurement Procedures; A Statistical Approach; Approved Guideline
CLSI EP07-A2: Interference Testing in Clinical Chemistry: Approved Guideline-Second Edition
CLSI EP09-A2: Method Comparison and Bias Estimation Using Patient Samples; Approved Guideline
CSLI EP17-A2: Evaluation of Detection Capability for Clinical Laboratory Measurement Procedures: Approved Guideline- Second Edition
CLSI EP25-A, Evaluation of Stability of In Vitro Diagnostic Reagents
CLSI C28-A3c: Defining, Establishing, and Verifying Reference Intervals in the Clinical Laboratory; Approved Guideline- Third Edition
K. Test Principle:
The Banyan BTI is a semi-quantitative test that determines UCH-L1 and GFAP concentrations in human serum using two separate chemiluminescent sandwich immunoassays. Samples (clinical specimens, controls, or standards) are pipetted into wells of a microplate that are coated with a monoclonal antibody that can capture the target (UCH-L1 or GFAP) protein, thereby immobilizing the target to the well. After washing away unbound protein, a second UCH-L1 or GFAP mouse monoclonal antibody that has been conjugated to the enzyme horseradish peroxidase (HRP) is added to the well. After washing away unbound HRPconjugated antibody, the chemiluminescent substrate is added to the well. The HRP enzyme catalyzes a specific reaction with the chemiluminescent substrate, which produces light that is detected at 300 nm to 700 nm with the Synergy 2 Multi-mode Reader, a 96-well plate-based luminometer. The amount of light generated is proportional to the amount of conjugated antibody in the well. The results from the wells containing standards are used to create a doseresponse curve to quantify the amount of UCH-L1 or GFAP in the sample.
The reader GEN5 IVD software installed on a personal computer processes the data generated and determines the validity of results for each specimen tested. If the results for a specimen do not meet predetermined validity criteria, the result is invalid. For specimens with valid results, the concentration (average of duplicate results) of the analyte is reported along with the categorization of the semi-quantitative result relative to the cutoff value, if the concentration is between the pre-established lower and upper limits of quantitation. If the concentration is above the upper limit of quantitation, a concentration will not be reported, but the result will be reported as 'Above' the cutoff value. If the concentration is below the lower limit of quantitation, a concentration will not be reported, but the result will be reported as 'Below' the cutoff value.
3
Results of the UCH-L1 and GFAP assays are reported separately by the reader but must be combined to determine the Banyan BTI result (Positive, or Not Reportable) because the reader does not report the final result. The Banyan BTI result must be interpreted by the laboratory professional according to the table below:
| Banyan UCH-L1 Kit
Result
(relative to cutoff)A | Banyan GFAP Kit
Result
(relative to cutoff)B | Banyan BTI
Result |
|------------------------------------------------------|----------------------------------------------------|----------------------|
| Below | Below | Negative |
| Below | Above | Positive |
| Above | Below | Positive |
| Above | Above | Positive |
| Invalid or No Result | Below | Not ReportableC |
| Invalid or No Result | Above | Positive |
| Below | Invalid or No Result | Not ReportableC |
| Above | Invalid or No Result | Positive |
| Invalid or No Result | Invalid or No Result | Not ReportableC |
B Above = GFAP concentration is equal to or above 22 pg/mL; Below = GFAP concentration is below 22 pg/mL
Clinical samples with Invalid Results or No results that yield a Not Reportable Banyan BTI result may be retested once to obtain an interpretable Negative or Positive result
The test outcome for a specimen is considered 'Positive' when the measured serum concentration of either UCH-L1 and/or GFAP (in pg/mL) is above its clinical cutoff value. Conversely, the test outcome is considered 'Negative' when the measured serum concentrations of both UCH-L1 and GFAP are below their respective cutoff values.
Specimens that fail to meet the predetermined validity criteria yield 'Invalid Result' outcomes. Specimens with 'Invalid Result' outcomes for either protein that lead to a 'Not Reportable' qualitative result may be retested for that protein once to obtain a 'Negative' or 'Positive' result. The qualitative results for the retested samples are re-interpreted according to the above table.
A 'No Result' outcome occurs when a run is aborted. The reader aborts the run to prevent sensor damage from light generated from a sample that contains a very high concentration of target analyte. In this situation, the resulting report lists 'No Result' for all samples located in the microtiter plate row containing the sample that caused the abort, and for all samples in subsequent rows on the microtiter plate. When this occurs, the reader software generates an
4
error message that includes an error code and the number of the well that triggered the run abort. The assay result (relative to cutoff) for the specimen that triggered the run abort is considered Above, and the qualitative result for the applicable sample is then interpreted using the above table. All other specimens with 'No Result' outcomes that lead to a 'Not Reportable' qualitative result may be retested once to obtain a 'Negative' or 'Positive' result using a new assay kit. The qualitative results for the retested samples are re-interpreted according to the table above.
L. Performance Characteristics:
1. Analytical performance:
All results met the manufacturer's pre-determined acceptance criteria.
a. Precision/Reproducibility:
Semi-quantitative precision: A study was conducted per CLSI guideline EP05-A3 to evaluate the within-laboratory precision of the UCHL-1 kit and the GFAP kit. Two separate panels, each consisting of five human sera samples with levels of UCH-L1 or GFAP that cover the measuring range of the respective kits, were tested at one site. using one instrument and one reagent lot, over the course of 20 days. The panel members were made of pooled human sera from healthy volunteers. Higher panel members were spiked with one or more positive clinical specimens (i.e., sera containing high level of endogenous UCH-L1 or GFAP) from subjects with a severe traumatic brain injury (TBI) or with the recombinant UCH-L1 or purified native GFAP protein as detailed in the tables below. Each panel member was tested each day with two runs per day and two replicate measurements per sample per run for a total of 80 replicates per sample. The results are summarized in the tables below for each kit.
| UCH-L1 Kit | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Panel | |||||||||||
| member | Mean | ||||||||||
| (pg/mL) | N | Within- | |||||||||
| run | Between- | ||||||||||
| run | Between- | ||||||||||
| day | Within- | ||||||||||
| laboratory | |||||||||||
| SD | %CV | SD | %CV | SD | %CV | SD | %CV | ||||
| 1 | 196.9 | 80 | 8.4 | 4.3 | 0.0 | 0.0 | 2.8 | 1.4 | 8.9 | 4.5 | |
| 2A | 268.9 | 80 | 8.5 | 3.2 | 1.8 | 0.7 | 5.7 | 2.1 | 10.4 | 3.9 | |
| 3B | 390.6 | 80 | 9.1 | 2.3 | 5.1 | 1.3 | 6.8 | 1.7 | 12.5 | 3.2 | |
| 4C | 1163.7 | 80 | 32.5 | 2.8 | 0.0 | 0.0 | 0.0 | 0.0 | 32.5 | 2.8 | |
| 5C | 2118.5 | 80 | 46.2 | 2.2 | 27.0 | 1.3 | 3.6 | 0.2 | 53.7 | 2.5 |
Pooled sera from normal donors and a patient with severe TBI
B Pooled sera from normal donors and patients with severe TBI
C Pooled sera from normal donors were spiked with recombinant UCH-L1 antigen
5
| GFAP Kit | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Panel | ||||||||||
| member | Mean | |||||||||
| (pg/mL) | N | Within- | ||||||||
| run | Between- | |||||||||
| run | Between- | |||||||||
| day | Within- | |||||||||
| laboratory | ||||||||||
| SD | %CV | SD | %CV | SD | %CV | SD | %CV | |||
| 1 | 6.8 | 79C | 0.5 | 7.4 | 0.6 | 8.8 | 0.0 | 0.0 | 0.7 | 10.3 |
| 2 | 21.6 | 79C | 0.6 | 2.8 | 1.1 | 5.1 | 0.0 | 0.0 | 1.3 | 6.0 |
| 3A | 36.4 | 80 | 0.7 | 1.9 | 1.3 | 3.6 | 0.2 | 0.5 | 1.5 | 4.1 |
| 4B | 138.5 | 80 | 5.0 | 3.6 | 13 | 0.9 | 2.4 | 1.7 | 5.6 | 4.0 |
| 5 | 252.7 | 80 | 5.2 | 2.1 | 5.7 | 2.3 | 4.4 | 1.7 | 8.9 | 3.5 |
| A Pooled sera from normal donors and patients with severe TBI | ||||||||||
| B Pooled sera from normal donors and a patient with severe TBI were spiked with purified |
native GFAP antigen
illative GFAP antigen.
C A total of two measurements were invalid and excluded from analysis
Qualitative precision: A total of 80 replicates of each panel member were performed to evaluate qualitative precision. The panel members were identical to those in the semiquantitative precision study above; however, % correct call was calculated for each panel member based on the number of positive BTI results. Results are summarized in the tables below for each kit.
| UCH-L1 Kit | ||||
|---|---|---|---|---|
| Panel | ||||
| member | Mean | |||
| (pg/mL) | Total | |||
| replicates | Qualitative agreement | |||
| Number of positive | ||||
| BTI results | % Correct | |||
| call | ||||
| 1A | 191.2 | 80 | 0/80 | 100 |
| 2B | 282.2 | 80 | 0/80 | 100 |
| 3C | 396.9 | 80 | 80/80 | 100 |
| 4C | 1188.3 | 80 | 80/80 | 100 |
| 5C | 2107.6 | 80 | 80/80 | 100 |
6
| GFAP Kit | |||||
|---|---|---|---|---|---|
| Panel | |||||
| member | Mean | ||||
| (pg/mL) | Total | ||||
| replicates | Qualitative agreement | ||||
| Number of positive | |||||
| BTI results | % Correct | ||||
| call | |||||
| 1A | 9.3 | 80 | 0/80 | 100 | |
| 2B | 23.2 | 79D | 28/79 | 65 | |
| 3C | 40.4 | 80 | 80/80 | 100 | |
| 4C | 146.5 | 80 | 80/80 | 100 | |
| 5C | 261.0 | 80 | 80/80 | 100 | |
| ABelow cutoff; BCut-off +20%; CAbove cutoff; DOnly three measurements instead of four on day 3 |
Semi-quantitative internal reproducibility: A study was conducted per the CLSI guideline EP05-A3 to evaluate the effects of two major sources of variability: operator and reagent lot. The same two sample panels evaluated in the within-laboratory precision study were tested by three operators in four replicates per run and one run per day for five days with three reagent lots of each kit for a total of 180 replicates per panel member. Three Synergy 2 Multi-mode Readers were used randomly across operators throughout the study. The results are summarized in the tables below for each kit.
| UCH-L1 Kit | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Panel | ||||||||||||
| member | Mean | |||||||||||
| (pg/mL) | N | Within- | ||||||||||
| run | Between- | |||||||||||
| day | Between- | |||||||||||
| operator | Between- | |||||||||||
| lot | Within- | |||||||||||
| laboratory | ||||||||||||
| SD | %CV | SD | %CV | SD | %CV | SD | %CV | SD | %CV | |||
| 1 | 189.2 | 180 | 7.7 | 4.1 | 11.2 | 5.9 | 0.0 | 0.0 | 7.7 | 4.1 | 15.6 | 8.2 |
| 2A | 289.3 | 180 | 10.0 | 3.5 | 13.2 | 4.6 | 0.0 | 0.0 | 15.1 | 5.2 | 22.4 | 7.7 |
| 3B | 385.5 | 180 | 12.8 | 3.3 | 14.8 | 3.8 | 3.2 | 0.8 | 9.1 | 2.4 | 21.8 | 5.7 |
| 4C | 1122.3 | 180 | 36.1 | 3.2 | 20.4 | 1.8 | 22.3 | 2.0 | 25.8 | 2.3 | 53.8 | 4.8 |
| 5C | 2086.8 | 180 | 70.5 | 3.4 | 36.4 | 1.7 | 76.7 | 3.7 | 55.3 | 2.6 | 123.5 | 5.9 |
A Pooled sera from normal donors and a patient with severe TBI
B Pooled sera from normal donors and patients with severe TBI
C Pooled sera from normal donors were spiked with recombinant UCH-L1 antigen
7
| GFAP Kit | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Panel | ||||||||||||
| member | Mean | |||||||||||
| (pg/mL) | N | Within- | ||||||||||
| run | Between- | |||||||||||
| day | Between- | |||||||||||
| operator | Between- | |||||||||||
| lot | Within- | |||||||||||
| laboratory | ||||||||||||
| SD | %CV | SD | %CV | SD | %CV | SD | %CV | SD | %CV | |||
| 1 | 8.2 | 180 | 0.6 | 7.3 | 0.8 | 9.8 | 0.0 | 0.0 | 0.8 | 9.8 | 1.3 | 15.9 |
| 2 | 25.3 | 180 | 1.0 | 4.0 | 1.3 | 5.1 | 0.3 | 1.2 | 1.9 | 7.5 | 2.5 | 9.9 |
| 3A | 38.6 | 180 | 1.4 | 3.6 | 1.7 | 4.4 | 0.6 | 1.6 | 1.1 | 2.8 | 2.5 | 6.5 |
| 4B | 141.6 | 180 | 5.5 | 3.9 | 3.7 | 2.8 | 0.0 | 0.0 | 2.1 | 1.5 | 6.9 | 4.9 |
| 5 | 247.4 | 180 | 6.2 | 2.5 | 6.8 | 2.7 | 3.5 | 1.4 | 5.4 | 2.2 | 11.3 | 4.6 |
| A Pooled sera from normal donors and patients with severe TBI | ||||||||||||
| B Pooled sera from normal donors and a patient with severe TBI were spiked with purified native GFAP antigen |
Qualitative internal reproducibility: A total of 180 replicates of each panel member were tested to determine internal qualitative reproducibility. The panel members were identical to those in the semi-quantitative internal reproducibility study above; however, % correct call was calculated for each panel member based on the number of positive BTI results. Results are summarized in the tables below for each kit.
| Panel | Mean | Total | Qualitative agreement | |
|---|---|---|---|---|
| member | (pg/mL) | replicates | Number of positive | |
| BTI results | % Correct | |||
| call | ||||
| 1A | 191.2 | 180 | 0/180 | 100 |
| 2B | 282.2 | 180 | 9/180 | 95 |
| 3C | 396.9 | 180 | 180/180 | 100 |
| 4C | 1188.3 | 180 | 180/180 | 100 |
| 5C | 2107.6 | 180 | 180/180 | 100 |
8
| GFAP Kit | ||||
|---|---|---|---|---|
| Panel | ||||
| member | Mean | |||
| (pg/mL) | Total | |||
| replicates | Qualitative agreement | |||
| Number of positive | ||||
| BTI results | % Correct | |||
| call | ||||
| 1A | 9.3 | 180 | 0/180 | 100 |
| 2B | 23.2 | 180 | 172/180 | 96 |
| 3C | 40.4 | 180 | 180/180 | 100 |
| 4C | 146.5 | 180 | 180/180 | 100 |
| 5C | 261.0 | 180 | 180/180 | 100 |
Semi-quantitative external reproducibility: To evaluate site-to-site reproducibility, two separate panels, each consisting of five samples with analyte levels spanning the measuring range of each kit, were tested in replicates of five at three U.S. sites. The panel members were pooled serum samples from healthy volunteers mixed with pooled serum samples containing high levels of endogenous UCH-L1 and GFAP from mTBI patients, except for UCH-L1 panel members 4 and 5, that consisted of a combination of endogenous and recombinant proteins to achieve the desired target UCH-Llconcentrations. At each site, one operator performed one run on each of five nonconsecutive days using one reagent lot of each kit and one Synergy 2 Multi-mode Reader. Combining all sites, a total of 75 replicates were obtained per panel member. The results are summarized in the tables below for each kit:
| UCH-L1 Kit | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Panel | ||||||||||
| member | Mean | |||||||||
| (pg/mL) | N | Within- | ||||||||
| run | Between- | |||||||||
| day | Between- | |||||||||
| site | Total | |||||||||
| SD | %CV | SD | %CV | SD | %CV | SD | %CV | |||
| 1A | 203.8 | 75 | 5.9 | 4.2 | 7.2 | 3.5 | 8.6 | 2.9 | 12.7 | 6.2 |
| 2A | 305.1 | 75 | 7.9 | 4.5 | 10.6 | 3.5 | 13.7 | 2.6 | 19.1 | 6.2 |
| 3A | 413.8 | 75 | 11.7 | 3.9 | 12.3 | 3 | 16.3 | 2.8 | 23.5 | 5.7 |
| 4B | 1216.6 | 75 | 30.4 | 3.1 | 27.8 | 2.3 | 37.6 | 2.5 | 55.8 | 4.6 |
| 5B | 2245.9 | 75 | 58.6 | 3.8 | 54.9 | 2.4 | 85.6 | 2.6 | 117.3 | 5.2 |
A Pooled sera from normal donors and patients with severe TBI
B Pooled sera from normal donors and patients with severe TBI were spiked with recombinant UCH-L1 antigen
9
| GFAP Kit | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Panel | ||||||||||
| member | Mean | |||||||||
| (pg/mL) | N | Within- | ||||||||
| run | Between- | |||||||||
| day | Between- | |||||||||
| site | Total | |||||||||
| SD | %CV | SD | %CV | SD | %CV | SD | %CV | |||
| 1A | 8.1 | 73B | 0.4 | 5.2 | 0.5 | 5.9 | 0.5 | 6.1 | 0.8 | 9.9 |
| 2A | 25.4 | 75 | 1 | 3.8 | 0.8 | 3 | 0.1 | 0.6 | 1.3 | 4.9 |
| 3A | 37.9 | 75 | 1.1 | 2.9 | 0.8 | 2.2 | 0.5 | 1.4 | 1.5 | 3.9 |
| 4A | 146.8 | 74B | 3.0 | 2.1 | 3.7 | 2.5 | 2.0 | 1.4 | 5.2 | 3.5 |
| 5A | 258.7 | 75 | 8.0 | 3.1 | 1.1 | 0.4 | 4.6 | 1.8 | 9.3 | 3.6 |
| A Pooled sera from normal donors and patients with severe TBI |
B A total of three measurements were invalid and excluded from analysis
Qualitative external reproducibility: A total of 75 replicates of each panel member were performed to determine external qualitative reproducibility. The panel members were identical to those in the semi-quantitative external reproducibility study above; however, % correct call was calculated for each panel member based on the number of positive BTI results. Results are summarized in the tables below for each kit.
| UCH-L1 Kit | ||||||||
|---|---|---|---|---|---|---|---|---|
| Panel | Mean | Total | Qualitative agreement | |||||
| member | (pg/mL) | replicates | Number of positive | |||||
| BTI results | % Correct | |||||||
| call | ||||||||
| 1A | 191.2 | 75 | 0/75 | 100 | ||||
| 2B | 282.2 | 75 | 6/75 | 92 | ||||
| 3C | 396.9 | 75 | 75/75 | 100 | ||||
| 4C | 1188.3 | 75 | 75/75 | 100 | ||||
| 5C | 2107.6 | 75 | 75/75 | 100 |
| GFAP Kit | ||||
|---|---|---|---|---|
| Panel member | Mean (pg/mL) | Total replicates | Qualitative agreement | |
| Number of positive BTI results | % Correct call | |||
| 1A | 9.3 | 75 | 0/75 | 100 |
| 2B | 23.2 | 75 | 75/75 | 100 |
| 3C | 40.4 | 75 | 75/75 | 100 |
10
| GFAP Kit | ||||
|---|---|---|---|---|
| Panel | ||||
| member | Mean | |||
| (pg/mL) | Total | |||
| replicates | Qualitative agreement | |||
| Number of positive | ||||
| BTI results | % Correct | |||
| call | ||||
| 4C | 146.5 | 75 | 75/75 | 100 |
| 5C | 261.0 | 75 | 75/75 | 100 |
b. Linearity/assay reportable range:
Linearity: Linearity and recovery characteristics of the UCH-L1 kit and GFAP kit were evaluated per the CLSI guideline EP6-A. A pool of human sera containing a high concentration of analyte was combined with a pool of human sera containing a low concentration of analyte to create a mid-pool that was then combined with the high and low pools to obtain additional dilutions for a total of 11 sample pools spanning across the measuring range of each assay. Each sample pool was tested in four replicates using one UCH-L1 kit lot and one GFAP kit lot. The observed values were evaluated against the calculated values and standard linear regression was performed. The results are summarized in the tables below for each kit:
| Pool | Expected
(pg/mL) | Measured mean
(pg/mL) | %CV | %Recovery |
|------|---------------------|--------------------------|-----|-----------|
| 1 | 73.3 | 73.3 | 2.9 | 100 |
| 2 | 139.3 | 138 | 5.3 | 99.1 |
| 3 | 244.9 | 244.9 | 3.3 | 100 |
| 4 | 304.3 | 300.7 | 2.1 | 98.8 |
| 5 | 363.6 | 361.6 | 4.1 | 99.4 |
| 6 | 601.2 | 592.0 | 2.6 | 98.5 |
| 7 | 865.2 | 861.4 | 1.5 | 99.6 |
| 8 | 1393.1 | 1286.0 | 3.6 | 92.3 |
| 9 | 2184.9 | 2115.2 | 2.5 | 96.8 |
| 10 | 2448.9 | 2336.0 | 3.7 | 95.4 |
| 11 | 2712.8 | 2712.8 | 3.5 | 100 |
Linearity was demonstrated throughout the measurable range of the UCH-L1 kit. The claimed linear range for the UCH-L1 kit is from 80 pg/mL (lowest calibrator) to 2560 pg/mL (highest calibrator). The regression equation for the linear range is y=0.97x-4.7, R =0.99. The 95% confidence interval (CI) of the slope was 0.95-1.00; the 95% CI of the intercept was -43.2-33.8.
11
| GFAP Kit | ||||
|---|---|---|---|---|
| Pool | Expected | |||
| (pg/mL) | Measured mean | |||
| (pg/mL) | %CV | %Recovery | ||
| 1 | 8.6 | 8.6 | 8.7 | 100 |
| 2 | 14.1 | 13.8 | 7.0 | 97.8 |
| 3 | 17.7 | 17.6 | 2.1 | 99.4 |
| 4 | 26.8 | 26.8 | 3.1 | 100.0 |
| 5 | 44.8 | 42.9 | 1.7 | 95.8 |
| 6 | 80.9 | 72.9 | 1.7 | 90.1 |
| 7 | 117.0 | 102.5 | 1.0 | 87.6 |
| 8 | 189.2 | 167.5 | 0.8 | 88.5 |
| 9 | 297.5 | 277.7 | 1.6 | 93.3 |
| 10 | 333.6 | 319.3 | 0.9 | 95.7 |
| 11 | 369.7 | 369.7 | 2.6 | 100.0 |
Linearity was demonstrated throughout the measuring range of the GFAP kit. The claimed linear range for the GFAP kit is from 10 pg/mL (lowest calibrator) to 320 pg/mL (highest calibrator). The regression equation for the linear range is y=0.92x +0.14, R-0.99. The 95% CI of the slope was 0.88-0.95; the 95% CI of the intercept was -3.88-4.17.
Hook effect. To show that a clinical specimen with very high concentrations of analyte would not cause false negative results ('Below' the cutoff) hook effect studies were performed. A sample with GFAP concentration of 100 ng/mL (100,000 pg/mL) was tested with the GFAP kit. A 'No Result' was observed due to the run abort which is interpreted as 'Above' the cutoff and is, therefore, not a negative result. For the UCH-L1 kit, a test sample with UCH-L1 concentration of 200.0 ng/mL (200,000 pg/mL) was tested. This sample also triggered the run to abort and generated a 'No Result' and not a false negative.
- Traceability, Stability, Expected values (controls, calibrators, or methods): C.
- i) Traceability and value assignment: As there are no international reference standards for GFAP and UCH-L1, commercially available antigens for GFAP (HyTest GFAP antigen) and UCH-L1 (Origene-UCH-L1 antigen) were used to create Reference Standards for each kit. The UCH-L1 and GFAP Reference Standards were aliquoted and stored at 160XA |
| Potential interfering substance | Test concentration |
| Exogenous | |
| Aspirin (Acetylsalicylic acid) | 3.62 mmol/L |
| Acetaminophen | 1324 $ \mu $ mol/L |
| Coumadin (Warfarin) | 32.5 $ \mu $ mol/L |
| Ibuprofen | 2425 $ \mu $ mol/L |
| Lopressor (Metoprolol) | 18.7 $ \mu $ mol/L |
| Oxazepam | 25 ng/mL |
| Plavix (Clopidogrel) | 9 $ \mu $ g/mL |
| Cardene (Nicardipine) | 400 ng/mL |
| (b) (4) Ethanol | 5% (weight by volume) |
| Benzoylecgonine | 37.5 ng/mL |
| d-Methamphetamine | 125 ng/mL |
| EDDPB | 125 ng/mL |
| Methadone | 37.5 ng/mL |
| Methaqualone | 37.5 ng/mL |
| Morphine | 250 ng/mL |
| Phencyclidine | 3.1 ng/mL |
| Propoxyphene | 37.5 ng/mL |
| Secobarbital | 25 ng/mL |
| A>160 times more activity than a known negative for ability to crosslink in a
mouse system assay as characterized by (b) (4)
B2-ethylidene-1,5-dimethyl-3,3-diphenylpyrrolidine | |
- i) Traceability and value assignment: As there are no international reference standards for GFAP and UCH-L1, commercially available antigens for GFAP (HyTest GFAP antigen) and UCH-L1 (Origene-UCH-L1 antigen) were used to create Reference Standards for each kit. The UCH-L1 and GFAP Reference Standards were aliquoted and stored at 160XA |
16
For the UCH-L1 kit, hemoglobin, rheumatoid factor and HAMA showed a statistically significant difference from the control and % recovery exceeded the pre-specified acceptance limits. These substances were re-tested at lower doses. Results show no interference up to 62.5 mg/dL hemoglobin, 250 IU rheumatoid factor, and 40x HAMA. No interference was seen with the other interferents tested, as described in the table above.
For the GFAP kit, hemoglobin and HAMA showed a statistically significant difference from the control and % recovery exceeded the pre-specified acceptance
17
limits. Both substances were re-tested at lower doses. Results show no interference up to 62.5 mg/dL hemoglobin and 40x HAMA (i.e. forty times the activity of a known negative). No interference was seen with the other interferents tested, as described in the table above.
The Banyan BTI Package Insert 'Limitations of the Procedure' states that "Levels of hemoglobin, rheumatoid factor, or HAMA exceeding the normal physiological concentration or activity in serum may have erroneously high Banyan UCH-L1 or Banyan GFAP results, potentially leading to a false positive Banyan BTI result.'
- ii) Cross-reactivity:
A panel comprised of proteins that have significant homology to either GFAP or UCH-L1 was evaluated for cross-reactivity. The GFAP panel of potential crossreactants was spiked into the GFAP calibrator diluent and UCH-L3, the only protein identified with significant amino acid homology to UCH-L1 (~55%), was spiked into the UCH-L1 calibrator diluent at the concentrations listed in the table below:
| Potential
cross-reactant | Test
concentrationA | N | Mean
(pg/mL) | SD | %CV |
|-----------------------------|------------------------|---|-----------------|-----|-------|
| GFAP Kit | | | | | |
| Vimentin | 354 ng/mL1 | 4 | 0 | n/a | n/a |
| Desmin | 127 ng/mL2 | 4 | 0 | n/a | n/a |
| Peripherin | 5 ng/mL3 | 4 | 0 | n/a | n/a |
| Neurofilament light | 68 pg/mL4 | 4 | 10.8 | 3.9 | 35.9% |
| Neurofilament
medium | 8.6 ng/mL5 | 4 | 0 | n/a | n/a |
| Neurofilament heavy | 77 ng/mL6 | 4 | 0 | n/a | n/a |
| Keratin type II | 10 ng/mL7 | 4 | 0 | n/a | n/a |
| Internexin | 77 ng/mLB | 4 | 0 | n/a | n/a |
| UCH-L1 Kit | | | | | |
| UCH-L3 | 354 ng/mLC | 4 | 0 | n/a | n/a |
18
- A Test concentrations of the identified cross-reactants (except for internexin and UCH-L3) are based on the highest concentration of each protein in the circulation as reported in: 1 Sun et al. (2010) J Proteome Research 9:1923; 2 Ma et al. (2009) Mol Cell Proteomics 8.8:1878; Determined at MyBioSource, email communication; 4Giottino et al. (2013) PLOS One 8: e75091; Martinez-Morillo et al. (2015) Clin Chem Lab Med 53:1575; 6 Lu et al. (2015) J Neurol Neurosurg Psychiatry 86:565; 'Sundstrom et al. (1990) Int J Cancer 46:604
- B For internexin, the level of 77 ng/mL was chosen because this is the highest concentration of a neurofilament (i.e. neurofilament heavy) tested in the study C For UCH-L3, the level of 354 ng/mL was chosen because this is the highest concentration of cross-reactant (Vimentin) tested with the GFAP kit
The spiked calibrator diluent samples were tested in replicates of four using one GFAP kit lot and one UCH-L1 kit lot. Results show that, in the absence of the assay-specific marker, there is significant (15.9%) cross-reactivity detected with the GFAP kit for neurofilament light at concentration of 68 pg/mL. No cross-reactivity in the UCH-L1 kit was observed when UCH-L3 was tested. As the serum concentration of neurofilament light in patients with neurodegenerative diseases such as Guillain-Barré syndrome, amyotrophic lateral sclerosis, Parkinson's disease, Alzheimer's disease, or Creutzfeldt-Jakob disease could exceed 68 pg/mL, the Banyan BTI Package Insert 'Limitations of the Procedure' states that "Due to cross-reactivity of neurofilament light with the antibodies in the Banyan GFAP Kit, patients with neurodegenerative diseases such as Guillain-Barré syndrome, amyotrophic lateral sclerosis (ALS), Parkinson's disease, Alzheimer's disease, or Creutzfeldt-Jakob disease may have erroneously high Banyan GFAP results, potentially leading to a false-positive Banyan BTI result".
iii) Carryover/cross-contamination:
A study was performed to evaluate if cross-contamination and/or carryover occurs between samples in the plate wells during the assay procedure. Two test plates were run with an alternating pattern over all 30 available patient sample locations. The pattern consisted of two wells containing only the calibrator diluent (blank) followed by two wells containing the calibrator diluent spiked with GFAP purified from human brain lysate at a final concentration of 1 ng/mL (which is approximately 33 times the concentration of the highest assay calibrator). A control plate (consisting of all blank samples) was also tested. Testing was conducted using one GFAP kit lot and one Synergy 2 Multi-mode Reader. Results showed that carryover did not occur as none of the wells with blanks reported values higher than "