(104 days)
The Wielisa anti-GBM Test Kit is an Enzyme Linked Immunosorbent Assay (ELISA) for the detection and semi-quantitation of IgG antibodies in human serum to GBM (glomerular basement membrane). The assay is used to detect antibodies in a single serum specimen. The results of the assay are to be used as an aid to the diagnosis of Goodpasture syndrome. FOR IN VITRO DIAGNOSTIC USE.
The Wielisa anti-GBM Test Kit is an enzyme-linked immunosorbent assay (ELISA) for the detection and semi-quantitation of IgG antibodies to glomerular basement membrane(GBM) in human sera. The assay is used to detect antibodies in a single serum specimen. The results of the assay are to be used as an aid to the diagnosis of Goodpasture syndrome. FOR IN VITRO DIAGNOSTIC USE. The wells of the microtiter strips are coated with purified GBM antigen. During the first incubation, specific antibodies in diluted serum, will bind to the antigen coating. The wells are then washed to remove unbound antibodies and other components. A conjugate of alkaline phosphatase-labeled antibodies to human IgG binds to the antibodies in the wells in this second incubation. After a further washing step, detection of specific antibodies is obtained by incubation with substrate solution. The amount of bound antibodies correlates to the color intensity and is measured in terms of absorbance (optical density (OD)). The absorbance is then calculated against a calibrator curve and the results are given in arbitrary units.
The Wieslab AB Ideon Research Park's Wielisa anti-GBM Test Kit is an enzyme-linked immunosorbent assay (ELISA) designed for the detection and semi-quantitation of IgG antibodies to glomerular basement membrane (GBM) in human sera. The assay aims to aid in the diagnosis of Goodpasture syndrome. The device applied for 510(k) clearance (K974169) to the FDA. The submission outlines studies demonstrating the performance characteristics of the device.
Here's a breakdown of the acceptance criteria and study details:
1. Table of Acceptance Criteria and Reported Device Performance
The acceptance criteria are not explicitly stated as numerical targets in the provided document. Instead, the performance is demonstrated through comparison with clinical characterization and existing methods. The implied acceptance is that the device demonstrates high sensitivity and specificity in diagnosing anti-GBM nephritis and distinguishing it from other conditions, as well as showing comparable results to a predicate device and an alternative ELISA.
| Performance Metric | Acceptance Criteria (Implied) | Reported Device Performance |
|---|---|---|
| Clinical Sensitivity (anti-GBM nephritis) | High sensitivity for detecting anti-GBM nephritis. | 100% (95% CI: 95.0-100%) |
| Clinical Specificity (Blood donors) | High specificity for healthy individuals. | 100% (95% CI: 97.5-100%) |
| Clinical Specificity (Systemic vasculitis: WG and MP) | High specificity for other autoimmune conditions (Systemic vasculitis). | 96.9% (95% CI: 90.7-100%) |
| Clinical Specificity (SLE) | High specificity for other autoimmune conditions (SLE). | 100% (95% CI: 92.6-100%) |
| Clinical Specificity (RA) | High specificity for other autoimmune conditions (RA). | 100% (95% CI: 82.7-100%) |
| Relative Sensitivity (vs. GBM IFA) | High sensitivity when compared to Immunofluorescence Assay (IFA) as an existing method. | 100.0% (95% CI: 94.6-100.0%) |
| Relative Specificity (vs. GBM IFA) | High specificity when compared to Immunofluorescence Assay (IFA) as an existing method. | 88.9% (95% CI: 67.9-100.0%) |
| Relative Accuracy (vs. GBM IFA) | High overall accuracy when compared to Immunofluorescence Assay (IFA). | 98.4% (95% CI: 95.3-100.0%) |
| Relative Sensitivity (vs. Alternate ELISA) | High sensitivity when compared to another commercial ELISA. | 92.7% (95% CI: 84.6-100%) |
| Relative Specificity (vs. Alternate ELISA) | High specificity when compared to another commercial ELISA. | 100% (95% CI: 95.9-100%) |
| Relative Accuracy (vs. Alternate ELISA) | High overall accuracy when compared to another commercial ELISA. | 97.4% (95% CI: 94.3-100%) |
| Batch to Batch Variation (CV%) | Low coefficient of variation (CV%) to demonstrate consistency across different manufacturing batches. | 3.1% - 17.7% (for samples with mean values 16-134 units) |
| Inter-assay Precision (CV%) | Low coefficient of variation (CV%) to demonstrate consistency between different assay runs. | 3.0% (for 46 units) and 7.6% (for 154 units) |
| Intra-assay Precision (CV%) | Low coefficient of variation (CV%) to demonstrate consistency within a single assay run. | 10% (for 77 units) |
| Linearity (r value) | High correlation (r value close to 1) for serial dilutions. | 0.823 - 0.994 |
2. Sample Size Used for the Test Set and Data Provenance
- Clinical Sensitivity and Specificity Study (Table 1):
- Sample Size: 272 frozen sera.
- Data Provenance: Retrospective, with clinical characterization. The country of origin is not specified, but the applicant's address is in Sweden.
- Relative Sensitivity and Specificity vs. GBM IFA (Table 2):
- Sample Size: 68 frozen retrospective sera.
- Data Provenance: Retrospective. Country of origin not specified.
- Relative Sensitivity and Specificity vs. Alternate ELISA (Table 3):
- Sample Size: 122 frozen retrospective sera.
- Data Provenance: Retrospective. Country of origin not specified.
3. Number of Experts Used to Establish Ground Truth and Qualifications
The document does not explicitly state the number of experts used or their detailed qualifications (e.g., radiologist with 10 years of experience).
- For Table 1 (Clinical Sensitivity and Specificity), the "clinical characterization" of the sera implies that a clinical diagnosis was used as ground truth. This would typically involve review by clinicians, potentially specialists in nephrology or rheumatology, based on a combination of clinical symptoms, other laboratory tests, and potentially biopsy results. However, the exact number and qualifications are not provided.
- For Table 2 (Relative Sensitivity and Specificity vs. GBM IFA), the Immunofluorescence Assay (IFA) results are used as the comparator, which serves as a form of ground truth or an established benchmark. The interpretation of IFA typically requires experienced laboratory personnel or pathologists.
- For Table 3 (Relative Sensitivity and Specificity vs. Alternate ELISA), another commercial ELISA is used as the comparator, also serving as an established benchmark.
4. Adjudication Method for the Test Set
The document does not describe any specific adjudication method (like 2+1 or 3+1) for resolving discrepancies in diagnostic classifications for the ground truth. It relies on "clinical characterization" or comparison with established methods (IFA, alternate ELISA).
5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done
No, a Multi-Reader Multi-Case (MRMC) comparative effectiveness study was not done. The study focuses on the performance of the in-vitro diagnostic device itself, not on the improvement of human readers with or without AI assistance. The device is a laboratory assay, not a tool for interpretation by human readers in the same way an imaging AI might be.
6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) Was Done
Yes, the studies presented are essentially standalone performance evaluations of the Wielisa anti-GBM Test Kit. This is an immunoassay that produces quantitative results (optical density, then arbitrary units) and then applies defined cut-offs (e.g., <10 units negative, >20 units positive) to classify samples. There is no "human-in-the-loop" interaction in the interpretation of the assay's output as part of the primary device function itself, beyond a clinician interpreting the final numerical result provided by the kit in the context of a patient's overall clinical picture.
7. The Type of Ground Truth Used
- Clinical Sensitivity and Specificity (Table 1): Clinical diagnosis based on "clinical characterization" of the sera. This would likely stem from a combination of patient symptoms, medical history, other diagnostic tests, and potentially pathology (e.g., kidney biopsy for anti-GBM nephritis).
- Relative Sensitivity and Specificity vs. GBM IFA (Table 2): Results from Immunofluorescence Assay (IFA) for GBM antibodies. IFA is considered a standard method for detecting these antibodies.
- Relative Sensitivity and Specificity vs. Alternate ELISA (Table 3): Results from an alternate commercial ELISA for anti-GBM antibodies. This serves as a comparison against another established in-vitro diagnostic approach.
8. The Sample Size for the Training Set
The document does not explicitly mention a separate "training set" or "validation set" in the context of machine learning. For an ELISA kit, development typically involves optimizing reagents and conditions using various samples, but this is not typically referred to as a "training set" in the same way as in AI/ML. The provided sample sizes (272, 68, 122) appear to be for the performance evaluation/testing of the device with established parameters.
9. How the Ground Truth for the Training Set Was Established
Since a "training set" in the AI/ML sense is not explicitly described, neither is the method for establishing its ground truth. However, for the development of such an assay, the "ground truth" used during optimization would typically involve well-characterized patient samples with confirmed diagnoses (e.g., biopsy-proven Goodpasture syndrome, healthy controls, or patients with other well-defined autoimmune diseases).
{0}------------------------------------------------
Summary of Safety and Effectiveness Information anti-GBM Test Kit
FEB 1 7 1998
Wieslab AB Ideon Research Park S-223 70 Lund Sweden Contact person: Dr. Jorgen Wieslander Telephone: 46-46-182840 Date of preparation: Jan, 19 1998
【.
Description of Device: The Wielisa anti-GBM Test Kit is an enzyme-linked 11. immunosorbent assay (ELISA) for the detection and semi-quantitation of IgG antibodies to glomerular basement membrane(GBM) in human sera. The assay is used to detect antibodies in a single serum specimen. The results of the assay are to be used as an aid to the diagnosis of Goodpasture syndrome. FOR IN VITRO DIAGNOSTIC USE.
The wells of the microtiter strips are coated with purified GBM antigen. During the first incubation, specific antibodies in diluted serum, will bind to the antigen coating.
The wells are then washed to remove unbound antibodies and other components. A conjugate of alkaline phosphatase-labeled antibodies to human IgG binds to the antibodies in the wells in this second incubation.
After a further washing step, detection of specific antibodies is obtained by incubation with substrate solution. The amount of bound antibodies correlates to the color intensity and is measured in terms of absorbance (optical density (OD)). The absorbance is then calculated against a calibrator curve and the results are given in arbitrary units.
- Predicate Device
The anti-GBM test is substantially equivalent to the Immunoscan Anti-GBM ELISA Kit. Equivalence is demonstrated by the following comparative results:
{1}------------------------------------------------
Table 1. Clinical Sensitivity and Specificity. A total of 272 frozen retrospective sera with clinical characterization were assayed. The following table summerizes the data.
| Control andDisease groups | Totalnumber | Negative<10 units | Equivocal10-20 units | Positive>20 units |
|---|---|---|---|---|
| Blood donors: | 120 | 120 | 0 | 0 |
| Anti-GBM nephritis: | 62 | 0 | 2 | 60 |
| Systemic vasculitis:WG and MP | 33 | 31 | 1 | 1 |
| SLE: | 40 | 40 | 0 | 0 |
| RA: | 17 | 17 | 0 | 0 |
WG = Wegener's granulomatosis,
GBM = glomerular basement membrane
Clinical Sensitivity (Equivocal samples excluded from calculations)
GBM = 60/60 = 100% *95% confidence interval = 95.0-100%
Clinical Specificity (Equivocal samples excluded from calculations)
| WG + MP | = 31/32 | = 96.9% | 95% confidence interval = 90.7-100% |
|---|---|---|---|
| SLE | = 40/40 | = 100% | *95% confidence interval = 92.6-100% |
| RA | = 17/17 | = 100% | *95% confidence interval = 82.7-100% |
| Normals | = 120/120 | = 100% | *95% confidence interval = 97.5-100% |
The 95% confidence intervals were calculated using the normal method. *The 95% confidence intervals were calculated assuming one false positive.
MP = microscopic polyangjitis SLE = systemic lupus erythematosus RA = rheumatoid arthritis
{2}------------------------------------------------
Table 2 A total of 68 frozen retrospective sera were assayed by the Wielisa anti-GBM ELISA and by IFA. The following table summarizes the relative sensitivity and specificity of the assay.
Relative Sensitivity and Specificity of the Wielisa anti-GBM Kit Compared to GBM IFA
| Wielisa anti-GBM | |||||
|---|---|---|---|---|---|
| Positive | Equivocal | Negative | Total | ||
| GBMIFA | Positive | 55 | 3 | 0 | 58 |
| Negative | 1 | 1 | 8 | 10 | |
| Total | 56 | 4 | 8 | 68 |
Sera falling in the equivocal range were excluded from the following calculations
| 95% Confidence Interval | ||
|---|---|---|
| Relative Sensitivity | = 55/55 = 100.0 % | 94.6 - 100.0 %* |
| Relative Specificity | = 8/9 = 88.9 % | 67.9 - 100.0 % |
| Relative Accuracy | = 63/64 = 98.4 % | 95.3 - 100.0 % |
- The 95% confidence interval was calculated assuming one false negative.
{3}------------------------------------------------
Table 3 A total of 122 frozen retrospective sera were assayed by the Wielisa anti-GBM ELISA and by an alternate commercial ELISA. The following table summarizes the relative sensitivity and specificity of the assay.
Relative Sensitivity and Specificity of the Wielisa GBM Kit Compared to an Alternate ELISA
GBM Wielisa
| Positive | Equivocal | Negative | Total | ||
|---|---|---|---|---|---|
| Positive | 38 | 0 | 3* | 41 | |
| AlternateELISA | Equivocal | 2 | 0 | 7 | 9 |
| Negative | 0 | 0 | 72 | 72 | |
| Total | 40 | 0 | 82 | 122 |
Sera falling in the equivocal range were excluded from the following calculations
| 95% Confidence Interval | ||
|---|---|---|
| Relative Sensitivity | = 38/41 = 92.7 % | 84.6 - 100 % |
| Relative Specificity | = 72/72 = 100 % | 95.9 - 100 %** |
| Relative Accuracy | = 110/113 = 97.4 % | 94.3 - 100 % |
- All three samples were from normal healthy patients.
** One false positive was included in this calculation.
{4}------------------------------------------------
Table 4. Batch to batch variation.
Batch to batch variation was determined by testing four different samples in duplicate. Results were obtained for four different batches.
| Sample | Mean value | SD | CV % |
|---|---|---|---|
| 1 | 16 units | 2.9 | 17.7 |
| 2 | 42 units | 2.4 | 5.7 |
| 3 | 67 units | 2.1 | 3.1 |
| 4 | 134 units | 9.6 | 7.2 |
Table 5. Inter-assay precision.
Inter-assay precision was determined by testing two different samples in duplicate. Results were obtained for six different runs.
.
| The Court of Children College of Children Collection of Children Company of Children Company of Children Company of Children Company of Children Company of Children Company oSample | .Mean value | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------SD | CV % | |
|---|---|---|---|---|
| 46 units | 1. 6 7 | 3.0 | ||
| 154 unitsComprehensive and the control of the control of the comments of the comments of the comments of the first and | 14.2 | 0 77.6LAND SHEET LILL FURLER & SHEET |
Table 6. Intra-assay precision.
| Intra-assay precision was determined by testing one sample in 80 wells. | |||||||
|---|---|---|---|---|---|---|---|
| Sample | Mean value | SD | CV % | ||||
| 77 units | 19 (8) | 10 |
Table 7. Linearity
. -
·
.
The values were determined for serial two-fold dilutions of six positive sera. The values were compared to log2 of dilution by standard linear regression. The data in Table 7 indicates that the assay has a linear relationship with serum dilution.
| Serum | Neat | 1:2 | 1:4 | 1:8 | 1:16 | 1:32 | 1:64 | r |
|---|---|---|---|---|---|---|---|---|
| 】 | 51 | 28 | 14 | રે | 0.979 | |||
| 2 | 90 | રતે | રે રે | 20 | 00 | 0.981 | ||
| 3 | 293 | 143 | રે ર | 52 | 48 | 25 | ರಿ | 0.862 |
| 4 | 49 | 32 | 16 | ર | 0.994 | |||
| ર | રેતે જેવી સવલતો પ્રાપ્ય થયેલી છે. આ ગામનાં પ્રાથમિક શાળા, પંચાયતઘર, આંગણવાડી તેમ જ દૂધની ડેરી જેવી સવલતો પ્રાપ્ય થયેલી છે. આ ગામનાં લોકોનો મુખ્ય વ્યવસાય ખેતી, ખેતમજૂરી તેમ જ | 39 | 28 | 23 | 】】 | 0.976 | ||
| 6 | 291 | 92 | 67 | 49 | 23 | 11 | 7 | 0.823 |
{5}------------------------------------------------
Image /page/5/Picture/1 description: The image shows the logo for the U.S. Department of Health & Human Services. The logo is circular and contains the text "DEPARTMENT OF HEALTH & HUMAN SERVICES USA" around the perimeter. In the center of the circle is an abstract symbol that resembles an eagle or other bird in flight.
Food and Drug Administration 2098 Gaither Road Rockville MD 20850
WEISLAB AB William L. Boteler c/o IMMUNO PROBE, INC. 1306 Bailes Lane, Suite F 21701 Frederick, MD
FEB 1 7 1998
Re: K974169 Trade Name: Wielisa anti-GBM Test Kit Requlatory Class: II Product Code: DBL 82 Dated: January 19, 1998 January 20, 1998 Received:
Dear Mr. Boteler:
We have reviewed your Section 510(k) notification of intent to market the device referenced above and we have determined the device is substantially equivalent (for the indications for use stated in the enclosure) to devices marketed in interstate commerce prior to May 28, 1976, the enactment date of the Medical Device Amendments, or to devices that have been reclassified in accordance with the provisions of the Federal Food, Drug, and Cosmetic Act (Act). You may, therefore, market the device, subject to the general controls provisions of the Act. The general controls provisions of the Act include requirements for annual registration, listing of devices, good manufacturing practice, labeling, and prohibitions against misbranding and adulteration.
If your device is classified (see above) into either class II (Special Controls) or class III (Premarket Approval), it may be subject to such additional controls. Existing major regulations affecting your device can be found in the Code of Federal Regulations, Title 21, Parts 800 to 895. A substantially equivalent determination assumes compliance with the Current Good Manufacturing Practice requirements, as set forth in the Quality System Regulation (QS) for Medical Devices: General regulation (21 CFR Part 820) and that, through periodic QS inspections, the Food and Drug Administration (FDA) will verify such assumptions. Failure to comply with the GMP regulation may result in regulatory action. In addition, FDA may publish further announcements concerning your device in the Federal Register. Please note: this response to your premarket notification submission does not affect any obligation you might have under sections 531 through 542 of the Act for devices under the Electronic Product Radiation Control provisions, or other Federal laws or regulations.
{6}------------------------------------------------
Page 2
Under the Clinical Laboratory Improvement Amendments of 1988 (CLIA-88), this device may require a CLIA complexity categorization. To determine if it does, you should contact the Centers for Disease Control and Prevention (CDC) at (770)488-7655.
This letter will allow you to begin marketing your device as described in your 510 (k) premarket notification. The FDA finding of substantial equivalence of your device to a legally marketed predicate device results in a classification for your device and thus, permits your device to proceed to the market.
If you desire specific advice for your device on our labeling regulation (21 CFR Part 801 and additionally 809.10 for in vitro diagnostic devices), please contact the Office of Compliance at (301) 594-4588. Additionally, for questions on the promotion and advertising of your device, please contact the Office of Compliance at (301) 594-4639. Also, please note the regulation entitled, "Misbranding by reference to premarket notification" (21 CFR 807.97). Other general information on your responsibilities under the Act may be obtained from the Division of Small Manufacturers Assistance at its toll free number (800) 638-2041 or at (301) 443-6597 or at its internet address "http://www.fda.gov/cdrh/dsmamain.html"
Sincerely yours,
Steven Putman
Steven I. Gutman, M.D., M.B.A. Director Division of Clinical Laboratory Devices Office of Device Evaluation Center for Devices and Radiological Health
Enclosure
{7}------------------------------------------------
Page 1 of 1
K974169 510(k) Number: Not known
Device Name: Wielisa anti-GBM Test Kit
Indications For Use: The Wielisa anti-GBM Test Kit is an Enzyme Linked Immunosorbent Assay (ELISA) for the detection and semi-quantitation of IgG antibodies in human serum to GBM (glomerular basement membrane). The assay is used to detect antibodies in a single serum specimen. The results of the assay are to be used as an aid to the diagnosis of Goodpasture syndrome.
Peter E. Madson
(Division Sign-Off) (Division Sign-Oft)
Division of Clinical Laboratory Devices y 2741 69 510(k) Number
PLEASE DO NOT WRITE BELOW THIS LINE-CONTINUE ON ANOTHER PAGE IF NEEDED) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Concurrence of CDRH, Office of Device Evaluation (ODE)
Prescription Use (Per 21 CFR 801.109)
. .
OR
Over-The Counter Use (Optional Format 1-2-96)
§ 866.5660 Multiple autoantibodies immunological test system.
(a)
Identification. A multiple autoantibodies immunological test system is a device that consists of the reagents used to measure by immunochemical techniques the autoantibodies (antibodies produced against the body's own tissues) in serum and other body fluids. Measurement of multiple autoantibodies aids in the diagnosis of autoimmune disorders (disease produced when the body's own tissues are injured by autoantibodies).(b)
Classification. Class II (performance standards).