Search Results

The iDart™ Lyme IgM ImmunoBlot Kit is an immunoblot assay intended for the in vitro qualitative detection of IgM antibodies to Borrelia burgdorferi in human serum. The iDart™ Lyme IgM ImmunoBlot Kit is intended to detect antibodies to Lyme Screen Antigen (LSA) and multiple other B. burgdorferi antigens following a modified two-tier test methodology. Positive results from the iDart™ Lyme IgM ImmunoBlot Kit are supportive evidence for the presence of antibodies and exposure to B. burgdorferi. Negative results do not preclude infection with B. burgdorferi. iDart™ Lyme IgM ImmunoBlot Kit is intended to aid in the diagnosis of Lyme disease and the test kit should only be used on samples from patients with clinical history, signs and symptoms consistent with Lyme disease. The iDart™ Lyme IgM Immunoblot Kit is not intended as a screen for asymptomatic patients.

Test results are to be used in conjunction with information obtained from the patient's clinical evaluation and other diagnostic procedures.

The iDart™ Lyme IgM ImmunoBlot tests are line immunoblot assays. Antigenic proteins specific for Borrelia species that cause Lyme Disease are produced by recombinant DNA technology in Escherichia coli. The purified proteins are then applied as discrete lines on a nitrocellulose membrane along with two control proteins. The iDart™ Lyme IgM ImmunoBlot Kit contains IgM ImmunoBlot strips and the proteins are applied in the following order: C1 (IgG/IgM – conjugate control), C2 (Protein L – calibrator/serum control), P93, P41 (2 antigen bands), P39 (2 antigen bands), P23 (9 antigen bands), P31 (9 antigen bands), P34, C10 and LSA (a chimeric VlsE peptide termed the Lyme Screen Antigen).

Here's an analysis of the acceptance criteria and study detailed in the provided FDA 510(k) clearance letter for the iDart™ Lyme IgM ImmunoBlot Kit.

Note: The provided text details the performance characteristics but does not explicitly state "acceptance criteria" in a separate section with numerical thresholds. Therefore, the "Acceptance Criteria" column in the table below is inferred from the achieved "Reported Device Performance" and common expectations for such devices (e.g., high agreement, specificity, and sensitivity). The "study that proves the device meets the acceptance criteria" refers to the clinical and analytical performance studies conducted.

1. Table of Acceptance Criteria and Reported Device Performance

Study Proving Device Meets Acceptance Criteria

The studies detailed in the "PERFORMANCE CHARACTERISTICS" section of the 510(k) summary are designed to prove that the iDart™ Lyme IgM ImmunoBlot Kit meets the necessary performance standards for its intended use. These include:

• Reproducibility Study: Tested consistency across multiple sites, operators, and runs.
• Analytical Specificity Studies: Evaluated performance in healthy endemic and non-endemic populations, and cross-reactivity with various non-Borrelia pathogens and autoantibodies.
• Interference Study: Assessed impact of common endogenous substances.
• Method Comparison with STTT: Compared the device's accuracy (PPA and NPA) against the Standard Two-Tier Test methodology, which is a recognized approach for Lyme disease diagnosis.
• CDC Serum Panel Study: Evaluated sensitivity and specificity across different disease stages and in various control groups using a well-characterized reference panel.
• Fresh and Frozen Samples Comparison Study: Demonstrated stability of samples under different storage conditions.
• Antibody Class Specificity Study: Confirmed the specific detection of IgM antibodies.

Additional Information:

2. Sample size used for the test set and the data provenance:

• Reproducibility: A panel of coded samples with different levels of anti-B. burgdorferi IgM (negative, high negative, low positive, moderate positives, and high positive samples). 90 replicates per sample were generated. The specific number of distinct samples in this panel is not explicitly stated beyond "a panel of coded samples".
• Analytical Specificity (Endemic): 177 samples from apparently healthy individuals in the US from endemic areas (CDC and Bay Area Foundation NY, MA, WI).
• Analytical Specificity (Non-Endemic): 127 samples from apparently healthy individuals in the US from non-endemic areas (CDC and IGeneX, Inc.).
• Cross-Reactivity Study: 243 serum samples from patients with bacterial or viral infections, as well as sera from patients with diagnoses that could be confused with Lyme disease (CDC, IGeneX, Inc., New York Biologics (NY), Kamineni Life Sciences Pvt. Ltd, Hydrabad (India), Warde Medical Laboratory (MI)).
• Interference Study: One positive, one low positive, and one negative Borrelia IgM samples (tested in singlicate with various spiked interfering agents).
• Method Comparison with STTT: 997 prospectively collected serum samples procured from IGeneX, Inc.
• CDC Serum Panel: 258 serum samples from the CDC panel. These included patients with Lyme disease at different stages and Lyme disease look-alike infections, and healthy controls.
• Fresh and Frozen Samples Comparison Study: 63 fresh samples and 63 frozen samples.
• Antibody Class Specificity: 8 previously tested patient samples (4 negatives, 4 positives).

Data Provenance: The data appears to be a mix of retrospective and prospective. Samples from "apparently healthy individuals" and "patients with bacterial or viral infections" can be either. The "Method Comparison with STTT" explicitly states "Prospectively collected serum samples" from IGeneX, Inc. The CDC Serum Panel is a reference panel, usually well-characterized retrospectively. Locations include the US (CDC, Bay Area Foundation NY, MA, WI, IGeneX, Inc., New York Biologics (NY), Warde Medical Laboratory (MI)) and India (Kamineni Life Sciences Pvt. Ltd, Hydrabad).

3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts:
The document does not explicitly state the number of experts or their qualifications for establishing ground truth for the clinical study samples. For the "Method Comparison with comparators (STTT)", the comparison is against "FDA-cleared EIA and immunoblot as part of the standard two-tier test methodology (STTT)". This implies the ground truth for these samples was established by the results of the STTT, which is a standardized and accepted diagnostic algorithm, rather than by individual expert interpretation. For the CDC Panel, the samples are "from patients diagnosed with Lyme Disease at different stages" or "Lyme disease look-like infections", suggesting that the CDC provided established diagnoses based on their protocols, which would implicitly involve expert clinical and laboratory evaluation.

4. Adjudication method (e.g. 2+1, 3+1, none) for the test set:
The document does not describe an explicit adjudication method (like 2+1 or 3+1) for establishing ground truth for the clinical test sets. The ground truth for the method comparison study was the result of the "FDA-cleared EIA and immunoblot as part of the standard two-tier test methodology (STTT)". For the CDC panel, it was based on the provided "diagnosis".

5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:
No MRMC comparative effectiveness study was done. This device is an in vitro diagnostic (IVD) kit for laboratory use (an ImmunoBlot assay, specifically evaluating IgM antibodies) rather than an AI-powered image analysis system or a device requiring human-in-the-loop interpretation that would typically necessitate such a study. The "reading" of the immunoblot strips is performed visually but the interpretation criteria are clearly defined, not requiring subjective interpretive discretion usually addressed by MRMC studies.

6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done:
This question is not directly applicable in the terms typically used for AI/software devices. The iDart™ Lyme IgM ImmunoBlot Kit is a lab-based immunoassay. Its performance characteristics (sensitivity, specificity, reproducibility) were evaluated as a standalone device (without external assistance like AI or human readers for interpretation, other than the standard visual reading of the bands per the kit's instructions), as demonstrated by the analytical and clinical studies. The results are generated by the chemical reaction on the strip and interpreted based on predefined criteria. It's an "algorithm only" in the sense of the assay's biochemical process and visual interpretation rules, operating without additional "human-in-the-loop" modifications to its fundamental mechanism or output.

7. The type of ground truth used (expert consensus, pathology, outcomes data, etc):
The ground truth used primarily appears to be:

• Standard Two-Tier Test (STTT) results: For the majority of the clinical method comparison study (N=997), the device was compared against the results from "FDA-cleared EIA and immunoblot as part of the standard two-tier test methodology".
• Clinical Diagnosis from CDC: For the CDC reference panel, samples were from patients "diagnosed with Lyme Disease at different stages" or "Lyme disease look-like infections". This implies a ground truth established through a combination of clinical evaluation, laboratory tests, and expert judgment according to CDC protocols.

8. The sample size for the training set:
Not applicable/Not specified. This is an in vitro diagnostic kit (ImmunoBlot assay), not a machine learning or AI-based device that typically requires a distinct "training set" for model development. The antigens used are recombinant proteins, and the assay's interpretation criteria are rule-based, not learned from a dataset.

9. How the ground truth for the training set was established:
Not applicable. As stated above, this device does not utilize a training set in the context of machine learning. The design and validation of immunoblots are based on known antigen-antibody interactions and assay development methodologies.

Ask a specific question about this device

The iDart™ Lyme IgG ImmunoBlot Kit is an immunoblot assay intended for the in vitro qualitative detection of IgG antibodies to Borrelia burgdorferi in human serum. The iDart Lyme IgG ImmunoBlot Kit is intended to detect antibodies to LSA and multiple other B. burgdorferi antigens following a modified two-tier test methodology. Positive results from the iDart Lyme IgG ImmunoBlot Kit are supportive evidence for the presence of antibodies and exposure to B. burgdorferi. Negative results do not preclude infection with B. burgdorferi. iDart™ Lyme IgG ImmunoBlot Kit is intended to aid in the diagnosis of Lyme disease and the test kit should only be used on samples from patients with clinical history, signs and symptoms consistent with Lyme disease. The iDart Lyme IgG Immunoblot Kit is not intended as a screen for asymptomatic patients.

Test results are to be used in conjunction with information obtained from the patient's clinical evaluation and other diagnostic procedures.

For in vitro diagnostic use only
For professional use only
For prescription use only

The iDart™ Lyme IgG ImmunoBlot tests are line immunoblot assays. Antigenic proteins specific for Borrelia species that cause Lyme Disease are produced by recombinant DNA technology in Escherichia coli. The purified proteins are then applied as discrete lines on a nitrocellulose membrane along with two control proteins.

The iDart™ Lyme IgG ImmunoBlot Kit contains IgG ImmunoBlot strips and the proteins are applied in the following order: C1 (lgG/lgM - conjugate control), C2 (Protein L - calibrator/serum control), P93, P41, P39, P23, P31, P66, P58, P45, P34, P30, P28, P18 and LSA (a chimeric VISE peptide termed the Lyme Screen Antigen).

Here's a breakdown of the acceptance criteria and the study that proves the device meets them, based on the provided text:

1. Table of Acceptance Criteria and Reported Device Performance

The acceptance criteria for the iDart™ Lyme IgG ImmunoBlot Kit are primarily demonstrated through its analytical performance (reproducibility, analytical specificity, cross-reactivity, interference) and clinical performance (method comparison with STTT, clinical sensitivity/specificity using a CDC panel).

2. Sample Size Used for the Test Set and Data Provenance

• Reproducibility: 90 samples for each of the 6 sample types (High Positive, Moderate Positive, Negative-1, Negative-2, Negative-3, Low Positive). Total of 540 tests performed across 3 sites, 2 operators, 5 days, 2 runs/day. Data provenance is not explicitly stated beyond "blinded and coded samples."
• Analytical Specificity (Healthy Individuals):
  • 313 samples from endemic areas (CDC, Bay Area Lyme Foundation - NY, MA, WI).
  • 112 samples from non-endemic areas (CDC, CA).
• Cross-Reactivity Study: 376 samples from various disease states/infections (CDC, IGeneX (CA), New York Biological (NY), BEI, Kamineni Life Sciences Pvt. Ltd, Hydrabad (India), Warde Medical Laboratory (MI)).
• Interference Study: One positive, one low positive, and one negative Borrelia IgG sample were used for each interference agent and concentration, tested in singlicate.
• Clinical Studies (Method Comparison with STTT): A total of 768 serum samples.
  • Site 1: 290 clinical serum samples from Bay Area Lyme Foundation.
  • Site 2: 37 clinical serum samples (Cohort 2) + 230 clinical serum samples (Cohort 3) from IGeneX Inc.
  • Site 3: 211 clinical serum samples (Cohort 2) from IGeneX Inc.
  • Data provenance: "procured from two vendors" (Bay Area Lyme Foundation and IGeneX Inc.). Samples were "prospective banked samples" or "clinical serum samples."
• Clinical Sensitivity/Specificity (CDC Serum Panel): 280 serum samples from CDC (patients with Lyme disease at different stages, look-alike conditions, healthy controls from endemic and non-endemic regions).
• Fresh and Frozen Samples Comparison Study: 72 decoded left-over patient serum samples.
• Antibody Class Specificity: 10 previously tested patient samples (6 negatives, 4 positives).

All clinical samples were "blinded, re-coded."

3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications

The document does not explicitly state that experts were used to establish ground truth for the test set derived from clinical samples. Instead, the ground truth for these clinical performance studies appears to be based on:

• STTT (Standard Two-Tier Test Methodology): This is a laboratory-based diagnostic algorithm involving an EIA/IFA screen followed by an immunoblot. Its results serve as the comparator (ground truth) for the method comparison study.
• CDC Reference Panel: For the clinical sensitivity/specificity, the CDC reference panel implicitly has established diagnoses for Lyme disease stages and other conditions. The process by which CDC established these diagnoses (e.g., expert consensus, other gold standards) is not detailed here.

For the reproducibility study, the samples were "blinded and coded" with "expected result" (e.g., High Positive, Negative). It's not specified how these initial categorizations were established.

4. Adjudication Method for the Test Set

The document does not describe an adjudication method involving multiple experts resolving discrepancies for the test set results. The evaluations are primarily against established comparators like STTT or reference panels (CDC). For the reproducibility study, the agreement was 100%, so no adjudication would have been required for discrepancies.

5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done, and Effect Size

No, a Multi-Reader Multi-Case (MRMC) comparative effectiveness study was not done. The performance studies focus on the device's standalone accuracy against existing diagnostic methods/reference panels, rather than how human readers' performance might improve with or without AI assistance. The device is an ImmunoBlot Kit, not an AI-assisted diagnostic imaging or interpretation system.

6. If a Standalone (i.e. algorithm only without human-in-the-loop performance) Was Done

Yes, the studies reflect the standalone performance of the iDart™ Lyme IgG ImmunoBlot Kit. The "Principle of procedures" describes manual interpretation ("A strip reading guide included in each test kit shows the location of specific antigens in the test strip. ... Any band found having a visual intensity equal to or greater than the C2 control band intensity is considered as a significant (positive) band. Depending on the observed bands pattern, one can interpret the presence or absence of Lyme specific IgG antibodies in the patient serum."). The "Result Generation" for the device is listed as "Manual reading" in the comparison table. This indicates the studies assess the kit's performance as a laboratory test, interpreted by a human, but without a "human-in-the-loop" AI system.

7. The Type of Ground Truth Used

• Clinical Performance (Method Comparison): The "ground truth" was established by Standard Two-Tier Test Methodology (STTT), which involves FDA-cleared EIA and immunoblot tests, performed by laboratory personnel.
• Clinical Sensitivity/Specificity: The "ground truth" was established by the CDC Reference Panel, which represents diagnosed cases of Lyme disease at various stages, look-alike conditions, and healthy controls. The methods for establishing these CDC diagnoses are not detailed but likely involve a combination of clinical assessment and established laboratory criteria.
• Analytical Specificity / Cross-reactivity: Ground truth for these samples was "known to contain potentially cross-reactive antibodies to Lyme infection" or "healthy individuals" or specific disease states, implying prior clinical diagnoses or sample characterization.
• Reproducibility: Samples were initially characterized as "High Positive," "Negative," etc., which served as the expected result for comparison. The method for this initial characterization is not specified.
• Fresh/Frozen & Antibody Class Specificity: Ground truth was based on "previously tested patient samples" with known IgG status.

8. The Sample Size for the Training Set

The document does not describe a "training set" in the context of machine learning or AI. The iDart™ Lyme IgG ImmunoBlot Kit is an immunoassay kit, not an AI-based device that requires model training. Therefore, this question is not applicable to the information provided.

9. How the Ground Truth for the Training Set Was Established

As the device is not an AI/ML product, there is no "training set" or corresponding ground truth establishment process described in the document.

Ask a specific question about this device

The ZEUS Solinas Borrelia VIsE1/pepC10 IgG/IgM Test System uses chemiluminescent immunoassay (CLIA) technology for the qualitative detection of IgGlgM antibodies to Borrelia burgdorferi in human serum. This assay is intended for use on samples from patients with signs and symptoms consistent with or patients suspected of having Lyme disease to assess the presence of IgG/IgM antibodies.

Positive results with the ZEUS Solinas Borrelia VIsE1/pepC10 IgG/IgM Test System should be supplemented with additional testing with a Standard two-tier test (STTT) methodology using an IgG and/or IgM Borrelia burgdorferi immunoblot assay following current guidelines.

Positive supplemental results are supportive evidence of antibodies and exposure to Borrelia burgdorferi and may be used along with patient history, symptoms and other laboratory data to support a clinical diagnosis of Lyme disease.

Negative results by the ZEUS Solinas Borrelia VlsE1/pepC10 IgG/IgM Test System should not be used to exclude Lyme disease. The test must be performed on the ZEUS Solinas instrument.

The ZEUS Solinas Borrelia VIsE1/pepC10 IgG/IgM Control Kit is intended for use as assayed quality control samples to monitor the performance of the ZEUS Solinas Borrelia VlsE1/pepC10 IgG/IgM Test System. The performance characteristics of the ZEUS Solinas Borrelia VIsE1/pepC10 IgG/IgM Control Kit have not been established for any other assays or instrument platforms.

Not Found

This document is an FDA 510(k) clearance letter for the ZEUS Solinas Borrelia VlsE1/pepC10 IgG/IgM Test System. It describes a diagnostic test for Lyme disease. The information provided does not contain details about acceptance criteria, study data, sample sizes, expert qualifications, or ground truth establishment typically found in a clinical study report for an AI/ML medical device.

The questions you've asked are most relevant to AI/ML device approval processes, where the device "learns" from data. This document describes a Chemiluminescent Immunoassay (CLIA) technology, which is a laboratory-based diagnostic test, not an AI/ML algorithm. Therefore, the concepts of training sets, test sets, human readers assisting AI, adjudication methods, and expert consensus for AI ground truth do not directly apply to this type of device.

This clearance is based on substantial equivalence to legally marketed predicate devices, meaning it has similar indications for use and technological characteristics to devices already on the market. The performance of such a device is typically assessed through analytical and clinical performance studies, comparing its results to a reference method or clinical diagnosis, rather than through AI-specific metrics like those you've inquired about.

To directly answer your request based on the provided document, I cannot fill in the table or provide the requested details because the document describes a traditional diagnostic assay, not an AI/ML device.

Here's why each of your points cannot be addressed with the provided text:

• 1. A table of acceptance criteria and the reported device performance: This document is the clearance letter, not the study report. It states the device is substantially equivalent but does not present the raw performance data or acceptance criteria that were met.
• 2. Sample sizes used for the test set and the data provenance: Not present in this document.
• 3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts: Not applicable to a CLIA assay in the context typically asked for AI/ML. Ground truth for a diagnostic test usually refers to clinical diagnosis, a gold standard lab test, or patient outcomes, not expert image annotation.
• 4. Adjudication method (e.g. 2+1, 3+1, none) for the test set: Not applicable to a CLIA assay.
• 5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance: Not applicable, as this is not an AI-assisted device for human interpretation.
• 6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done: Not applicable, as this is a laboratory test, not an algorithm.
• 7. The type of ground truth used (expert consensus, pathology, outcomes data, etc): While not detailed, for a diagnostic test like this, ground truth would typically be established based on a combination of clinical diagnosis, other established laboratory tests, and possibly follow-up outcomes, not expert consensus in the way it's used for AI image interpretation.
• 8. The sample size for the training set: Not applicable, as this is not an AI/ML device that requires a "training set."
• 9. How the ground truth for the training set was established: Not applicable for the same reason as above.

In summary, the provided document is an FDA 510(k) clearance letter for a traditional in-vitro diagnostic test, not an AI/ML medical device submission. Therefore, the specific questions related to AI/ML study design and performance metrics cannot be answered from this document.

Ask a specific question about this device

The Viramed Biotech AG Borrelia All-In-One ViraChip is an in vitro qualitative microarray assay for the detection of IgM and IgG antibodies to Borrelia burgdorferi in human serum. The assay is intended for testing serum samples from symptomatic patients or those suspected of Lyme Disease. It is intended to detect antibodies to VIsE and multiple other B. burgdorferi antigens following a modified two-tier test methodology. Positive results from the Viramed Biotech AG Borrelia All-In-One ViraChip are supportive evidence for the presence of antibodies and exposure to B. burgdorferi, the causative agent for Lyme disease. Negative results do not preclude infection with B. burgdorferi. Test results are to be used in conjunction with information obtained from the patient's clinical evaluation and other diagnostic procedures as an aid in diagnosis of Lyme disease.

The Viramed Biotech AG Borrelia All-In-One ViraChip Test must be used with a ViraChip Reader and the ViraChip Software.

Not Found

This document is an FDA 510(k) clearance letter for a medical device. It does not contain the detailed performance study results, acceptance criteria, or ground truth establishment methods as requested. The letter only states that the device is substantially equivalent to a predicate device and provides its indications for use.

Therefore, I cannot extract the information to complete the table and answer your questions directly from the provided text. The document clearly states "We have reviewed your Section 510(k) premarket notification of intent to market the device referenced above and have determined the device is substantially equivalent...". This implies that the detailed study information would be in the 510(k) submission itself, not in the clearance letter.

Ask a specific question about this device

The Gold Standard Diagnostics Borrelia burgdorferi IgG ELISA Test Kit is intended as a qualitative test for the detection of IgG antibodies to B. burgdorferi sensu stricto in human serum from symptomatic patients or people suspected of infection. When used as the first-tier screening test, positive and equivocal results must be supplemented through additional testing by one of the following methods:
· Standard two-tier test methodology (STTT) using an IgG blot test following current interpretation guidelines, OR
• Modified two-tier test methodology (MTT) using the Gold Standard Diagnostics Borrelia burgdorferi VlsE-OspC IgG/ IgM ELISA Test.
The assay can also be used as a second-tier confirmation test using the MTTT methodology when used with the Gold Standard Diagnostics Borrelia burgdorferi VlsE-OspC IgG/IgM ELISA Test as the first-tier screening test.
Positive test results by either the STTT or MTTT methodology are supportive evidence for the presence of antibodies and exposure to Borrelia burgdorferi, the cause of Lyme disease. A diagnosis of Lyme disease should be made based on the presence of Borrelia burgdorferi antibodies, history, symptoms, and other laboratory findings.

The kit includes 12 x 8 well Antigen Coated strips. Conjugate. Substrate, Stop Solution, Wash Buffer, Diluent, Negative Control, Positive Control, and Cutoff Control. The controls are provided to determine if the assay is functioning properly and to determine the antibody level. The reagents are sufficient for 96 determinations.
During the test procedure, antibodies to B. burgdorferi (sensu stricto) if present in the human serum sample will bind to the antigens coated onto the wells forming antigen-antibody complexes. Excess antibodies are removed by washing. A conjugate of goat anti-human IgG antibodies conjugated with horseradish peroxidase is then added, which binds to the antigenantibody complexes. Excess conjugate is removed by washing. This is followed by the addition of a chromogenic substrate, tetramethylbenzidine (TMB). If specific antibodies to the antigen are present in the patients' serum, a blue color will develop. The enzymatic reaction is then stopped with a stopping solution causing the contents of the well to turn yellow. The wells are read photometrically with a microplate reader at 450nm.
The antigens used in the Gold Standard Diagnostics Borrelia burgdorferi IgG ELISA Test kit is a combination of B. burgdorferi sensu stricto strain B31 lysate, B. burgdorferi sensu stricto strain 2591 lysate, and a recombinant VlsE from B. burgdorferi sensu stricto strain B31. The lysates use spirochetes growing in BSK-H complete medium until mid-exponential phase. The recombinant VlsE protein is produced in E. coli SURE2 cells and purified by affinity chromatography. The purity of each antigen is assayed by SDS-PAGE followed by Coomassie staining and/or Western blotting.

This document describes the validation of the Gold Standard Diagnostics Borrelia burgdorferi IgG ELISA Test Kit, including a new proposed Modified Two-tier Testing (MTTT) methodology. The provided text primarily focuses on comparative studies against predicate devices and existing standard methods, rather than defining explicit acceptance criteria in a quantitative table format. However, implied acceptance criteria can be derived from the performance percentages presented.

Based on the provided information, here's a structured response addressing the requested points:

1. Table of Acceptance Criteria (Implied) and Reported Device Performance

The acceptance criteria are not explicitly stated as numerical cutoffs in the document. However, they can be inferred from the reported "Percent Agreement" values in the comparison studies. The studies aim to demonstrate substantial equivalence to established predicate devices and methodologies.

2. Sample Size Used for the Test Set and Data Provenance

• Determination of Assay Cutoff (Nonclinical):

  • Sample Size: 210 normal sera (105 endemic, 105 non-endemic) + 194 samples (114 Lyme disease stages, 8 healthy negative, 72 negative Lyme disease with other conditions). Total = 404 samples.
  • Data Provenance: Not explicitly stated, but "endemic region of Lyme disease" and "non-endemic region of Lyme disease" suggest geographical diversity. Retrospective, as these are "tested" samples for cutoff determination.

• Precision (Nonclinical):

  • Sample Size: 48 runs for each of 4 panel members (negative, high negative, low positive, moderate positive) + kit controls. This is a repetitive testing design, not individual patient samples.

• Reproducibility (Nonclinical):

  • Sample Size: 90 runs (3 sites x 2 runs/day x 5 days x 3 replicates) for each of 4 panel members (negative, high negative, low positive, moderate positive) + kit controls (30 runs for Pos/Neg control, 60 runs for Cutoff control).

• Analytical Specificity:

  • Sample Size: 208 asymptomatic individuals (103 from endemic regions, 105 from non-endemic regions).
  • Data Provenance: Endemic and non-endemic regions. Retrospective (asymptomatic individuals' samples).

• Cross Reactivity:

  • Sample Size: 377 samples.
  • Data Provenance: Samples obtained from "serum vendors who confirmed their positivity for each respective marker," implying retrospective, controlled samples.

• Comparison/Prospective Study (Clinical):

  • STTT Comparison: 523 serum samples.
  • MTTT Comparison: 481 serum samples for the initial screening. 38 positive/equivocal samples were carried forward for second-tier testing comparison.
  • Data Provenance: "Prospective samples submitted for Lyme serology testing" from "three sites (one internal and two external reference laboratories)." This indicates a prospective study design with samples from potentially diverse geographical locations (clinical labs).

• Sensitivity Study (Clinical):

  • STTT: 114 clinically characterized samples.
  • MTTT: 125 clinically characterized samples.
  • Data Provenance: "Clinically characterized samples" from unspecified sources; likely retrospective collection of known patient cohorts.

• CDC Panel (Clinical):

  • Sample Size: 280 positive and negative specimens.
  • Data Provenance: From the "Center of Disease Control (CDC)." These are reference panels, typically collected and characterized over time, so retrospective.

3. Number of Experts Used to Establish the Ground Truth for the Test Set and the Qualifications of Those Experts

The document does not explicitly state the number or qualifications of experts used to establish the ground truth for the test sets.

• For "clinically characterized samples" and "CDC panel" samples, the implication is that these samples have a pre-defined and reliable "clinical diagnosis" or "reference characterization" based on established medical criteria. This often involves consensus from clinical experts (e.g., infectious disease specialists) and/or a combination of clinical presentation, symptoms, and other laboratory findings, but the specifics are not detailed here.
• For the "Second-Tier Testing" comparison, the "FDA cleared IgG blot assay" and "predicate B. burgdorferi IgG blot test" serve as the ground truth. These are approved diagnostic methods, and their interpretation would follow established guidelines.

4. Adjudication Method for the Test Set

The document does not describe any specific adjudication method (e.g., 2+1, 3+1) for resolving discrepancies in the test results or for establishing the initial ground truth diagnoses. The comparisons are based on the results of the different assays and against established clinical characterizations or CDC panels.

5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

No MRMC study was performed or described. This device is an ELISA test kit, a laboratory diagnostic assay for detecting antibodies, not an AI or imaging diagnostic tool that involves human readers interpreting images. Therefore, the concept of "human readers improving with AI assistance" is not applicable.

6. If a Standalone (i.e. algorithm only without human-in-the-loop performance) was done

Yes, the primary performance evaluation is standalone. The Gold Standard Diagnostics Borrelia burgdorferi IgG ELISA Test Kit operates as a standalone diagnostic assay. Its performance (sensitivity, specificity, agreement) is measured as the output of the kit itself (optical density readings converted to units and qualitative results) without direct human interpretation of complex visual patterns or AI assistance. The results are quantitative and then interpreted qualitatively (positive, equivocal, negative) based on predefined cutoffs.

7. The Type of Ground Truth Used (expert consensus, pathology, outcomes data, etc.)

The ground truth used varies by study:

• Predicate Devices/Methodologies: For the STTT and MTTT comparison studies, the ground truth for the device's performance is a comparison against the results from legally marketed predicate devices (e.g., Trinity Biotech MarDx Borrelia burgdorferi EIA IgG Test Kit) and/or a FDA cleared IgG blot assay. This is a form of comparative ground truth against established methods.
• Clinical Diagnosis/Characterization: For the Sensitivity Study and CDC Panel, the ground truth is "clinically characterized samples" and "positive and negative specimens from the Centers of Disease Control (CDC)." This implies a clinical diagnosis or consensus diagnosis based on comprehensive patient data (history, symptoms, other laboratory findings) or a reference panel with established disease status.
• Analytical Ground Truth: For non-clinical studies like analytical specificity and cross-reactivity, the ground truth is often the confirmed absence or presence of specific conditions in the tested samples, usually based on prior laboratory testing or sample vendor claims.

8. The Sample Size for the Training Set

The document does not explicitly mention a "training set" in the context of machine learning. The term "training set" is usually associated with the development of AI algorithms. For an ELISA kit, development involves:

• Antigen Selection and Optimization: Which antigens to use (e.g., B31 lysate, 2591 lysate, recombinant VlsE).
• Reagent Formulation: Optimizing conjugate, substrate, buffers, etc.
• Cutoff Determination: "The cutoff was determined by testing a total of 210 normal sera..." and "An additional 194 samples..." This process of determining the cutoff could be considered analogous to a 'calibration' or 'training' phase for a traditional diagnostic test, where a dataset is used to define the diagnostic thresholds. In this sense, a total of 404 samples (210 normal + 194 other known samples) were used for cutoff determination.

9. How the Ground Truth for the Training Set Was Established

As discussed above, for establishing the cutoff (analogous to training/calibration):

• Normal Sera: The 210 normal sera were likely verified as "normal" through standard clinical practice or donor screening, indicating the absence of target antibodies/disease in a healthy population.
• Known Positive/Negative/Other Disease Samples: The additional 194 samples included "different phases of Lyme disease," "negative healthy samples," and "negative Lyme disease samples but do have other diseases that may cause serologic cross-reactivity." The "ground truth" for these samples would be their known clinical status or disease classification, typically established through comprehensive clinical evaluation, follow-up, and/or panels from disease banks. The ROC analysis was used to confirm the chosen cutoff provides the best compromise between sensitivity and specificity, indicating an analytical optimization process based on these known samples.

Ask a specific question about this device

The Gold Standard Diagnostics Borrelia burgdorferi IgG/IgM ELISA Test Kit is intended as a qualitative test for the detection of IgG and IgM antibodies to Borrelia burgdorferi sensu stricto in human serum from symptomatic patients or people suspected of infection. When used as the first-tier screening test, positive and equivocal results must be confirmed through additional testing by one of the following methods:

• Standard two-tier test methodology (STTT) using an IgG and/or IgM blot testing following current interpretation guidelines, OR

• Modified two-tier test methodology (MTTT) using the Gold Standard Diagnostics Borrelia burgdorferi VlsE-OspC IgG/ IgM ELISA Test.

The assay can also be used as a second-tier confirmation test using the MTTT methodology when used with the Gold Standard Diagnostics Borrelia burgdorferi VlsE-OspC IgG/IgM ELISA Test as the first-tier screening test.

Positive test results by either the STTT or MTTT methodology are supportive evidence for the presence of antibodies and exposure to Borrelia burgdorferi, the cause of Lyme disease. A diagnosis of Lyme disease should be made based on the presence of Borrelia burgdorferi antibodies, history, symptoms, and other laboratory findings.

The kit includes 12 x 8 well Antigen Coated strips, Conjugate, Substrate, Stop Solution, Wash Buffer, Diluent, Negative Control, Positive Control, and Cutoff Control. The controls are provided to determine if the assay is functioning properly and to determine the antibody level. The reagents are sufficient for 96 determinations.

During the test procedure, antibodies to B. burgdorferi (sensu stricto) if present in the human serum sample will bind to the antigens coated onto the wells forming antigen-antibody complexes. Excess antibodies are removed by washing. A conjugate of goat anti-human IgG/IgM antibodies conjugated with horseradish peroxidase are then added, which binds to the antigen-antibody complexes. Excess conjugate is removed by washing. This is followed by the addition of a chromogenic substrate, tetramethylbenzidine (TMB). If specific antibodies to the antigen are present in the patients' serum, a blue color will develop. The enzymatic reaction is then stopped with a stopping solution causing the contents of the well to turn yellow. The wells are read photometrically with a microplate reader at 450nm.

The antigens used in the Gold Standard Diagnostics Borrelia burgdorferi IgG/IgM ELISA Test kit is a combination of B. burgdorferi sensu stricto strain B31 lysate, B. burgdorferi sensu stricto strain 2591 lysate, and a recombinant VlsE from B. burgdorferi sensu stricto strain B31. The lysates use spirochetes growing in BSK-H complete medium until mid-exponential phase. The recombinant VlsE protein is produced in E. coli SURE2 cells and purified by affinity chromatography. The purity of each antigen is assayed by SDS-PAGE followed by Coomassie staining and/or Western blotting.

The provided document describes the Gold Standard Diagnostics Borrelia burgdorferi IgG/IgM ELISA Test Kit and its performance in various studies. Here's a breakdown of the acceptance criteria and study details:

1. Table of Acceptance Criteria and Reported Device Performance (STTT comparison):

The document does not explicitly state pre-defined acceptance criteria for the comparative studies. Instead, it presents observed performance metrics (Positive Percent Agreement (PPA) and Negative Percent Agreement (NPA)) against a predicate device. For the purpose of this response, I will highlight the reported performance metrics from the comparative study.

1. Table of Acceptance Criteria and Reported Device Performance (MTTT Comparison):

Similar to the STTT comparison, the document reports observed performance metrics for the MTTT protocol against the STTT predicate.

2. Sample Size Used for the Test Set and Data Provenance:

For Comparison with Predicate Device (STTT):

• Sample Size: 520 serum samples.
• Data Provenance: Prospective samples submitted for Lyme serology testing. Collected from three sites (one internal and two external reference laboratories).

For MTTT Comparison (Prospective Study):

• Sample Size: 481 serum samples for the initial screening. Of these, 54 positive or equivocal samples were further tested.
• Data Provenance: Prospective samples submitted for Lyme serology testing. Collected from three sites (one internal and two external reference laboratories).

For Sensitivity Study (STTT and MTTT):

• Sample Size: 89 clinically characterized samples for STTT and 125 clinically characterized samples for MTTT.
• Data Provenance: Clinically characterized samples encompassing early, disseminated, and late stages of Lyme disease. The document doesn't specify geographical origin but implies a clinical context.

For CDC Panel (STTT and MTTT):

• Sample Size: 40 samples for STTT and 280 samples for MTTT.
• Data Provenance: Acquired from the Centers for Disease Control (CDC).

3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications:

The document does not provide specific details on the number or qualifications of experts used to establish the ground truth for the test sets. The ground truth appears to be based on:

• "Clinically characterized samples" (for sensitivity studies).
• "Patients diagnosed with Lyme disease" and "healthy individuals" from the CDC panel.
• Comparison with predicate devices (for comparative studies).

4. Adjudication Method for the Test Set:

The document does not describe any specific adjudication method (e.g., 2+1, 3+1) for resolving discrepancies or establishing ground truth within the test sets. For comparative studies, the predicate device results largely serve as the reference, and for sensitivity studies, samples are clinically characterized, implying pre-existing diagnoses.

5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:

This device is an in-vitro diagnostic (IVD) ELISA test kit, not an AI-powered image analysis or diagnostic tool that involves human readers. Therefore, an MRMC comparative effectiveness study involving human readers and AI assistance is not applicable and was not performed.

6. If a Standalone (i.e. algorithm only without human-in-the-loop performance) was done:

The device is an ELISA test kit designed to provide a qualitative result (positive, equivocal, negative) based on optical density readings. It functions as a standalone diagnostic assay without a human-in-the-loop component in its primary function. The interpretation of the results by laboratory personnel is part of standard lab practice, but the "standalone performance" in this context refers to the assay's accuracy in detecting antibodies. The reported PPA, NPA, and sensitivity studies reflect this standalone performance.

7. The Type of Ground Truth Used (expert consensus, pathology, outcomes data, etc):

The ground truth used for different studies varies:

• Comparison Studies with Predicate Device: The results of the legally marketed predicate devices (Trinity Biotech Captia™ Borrelia burgdorferi IgG/IgM ELISA Test Kit and Gold Standard Diagnostics Borrelia burgdorferi IgG/IgM Blot Tests) served as the reference standard.
• Sensitivity Studies: "Clinically characterized samples" and "patients diagnosed with Lyme disease" from the CDC panel. This implies a combination of clinical assessment, symptomology, and potentially other laboratory findings, which can be seen as a form of expert consensus or aggregated clinical data.
• Analytical Specificity and Cross-Reactivity: For analytical specificity, asymptomatic individuals from endemic and non-endemic regions were used. For cross-reactivity, samples confirmed positive for specific disease markers (from serum vendors) were used.

8. The Sample Size for the Training Set:

The document describes the determination of the assay cutoff but does not explicitly mention a "training set" in the context of machine learning or AI. For the cutoff determination:

• Assay Cutoff: 200 normal sera (100 from endemic, 100 from non-endemic regions).
• Verification: 125 characterized Lyme disease samples were used with the 200 normal samples for ROC analysis to verify the chosen cutoff.

9. How the Ground Truth for the Training Set Was Established:

As noted above, there isn't a "training set" in the typical AI sense. However, for the determination of the assay cutoff:

• Normal Sera: These were identified as "normal" based on their origin from non-diseased individuals in endemic and non-endemic regions.
• Characterized Lyme Disease Samples: These 125 samples were "characterized" for Lyme disease, implying a pre-established clinical diagnosis or a well-defined status as positive Lyme disease samples.

Ask a specific question about this device

The Gold Standard Diagnostics Borrelia burgdorferi IgM ELISA Test Kit is intended as a qualitative test for the detection of IgM antibodies to B. burgdorferi sensu stricto in human serum from symptomatic patients or people suspected of infection. When used as the first-tier screening test, positive and equivocal results must be supplemented through additional testing by one of the following methods:

· Standard two-tier test methodology (STTT) using an IgM blot test following current interpretation guidelines, OR

• Modified two-tier test methodology (MTTT) using the Gold Standard Diagnostics Borrelia burgdorferi VlsE-OspC IgG/ IgM ELISA Test.

The assay can also be used as a second-tier confirmation test using the MTTT methodology when used with the Gold Standard Diagnostics Borrelia burgdorferi VlsE-OspC IgG/IgM ELISA Test as the first-tier screening test.

Positive test results by either the STTT or MTTT methodology are supportive evidence for the presence of antibodies and exposure to Borrelia burgdorferi, the cause of Lyme disease. A diagnosis of Lyme disease should be made based on the presence of Borrelia burgdorferi antibodies, history, symptoms, and other laboratory findings.

The kit includes 12 x 8 well Antigen Coated strips. Conjugate. Substrate, Stop Solution, Wash Buffer, Diluent, Negative Control, Positive Control, and Cutoff Control. The controls are provided to determine if the assay is functioning properly and to determine the antibody level. The reagents are sufficient for 96 determinations.

During the test procedure, antibodies to B. burgdorferi (sensu stricto) if present in the human serum sample will bind to the antigens coated onto the wells forming antigen-antibody complexes. Excess antibodies are removed by washing. A conjugate of goat anti-human IgM antibodies conjugated with horseradish peroxidase is then added, which binds to the antigenantibody complexes. Excess conjugate is removed by washing. This is followed by the addition of a chromogenic substrate, tetramethylbenzidine (TMB). If specific antibodies to the antigen are present in the patients' serum, a blue color will develop. The enzymatic reaction is then stopped with a stopping solution causing the contents of the well to turn yellow. The wells are read photometrically with a microplate reader at 450nm.

The antigens used in the Gold Standard Diagnostics Borrelia burgdorferi IgM ELISA Test kit is a combination of B. burgdorferi sensu stricto strain B31 lysate, B. burgdorferi sensu stricto strain 2591 lysate, and a recombinant VlsE from B. burgdorferi sensu stricto strain B31. The lysates use spirochetes growing in BSK-H complete medium until mid-exponential phase. The recombinant VlsE protein is produced in E. coli SURE2 cells and purified by affinity chromatography. The purity of each antigen is assayed by SDS-PAGE followed by Coomassie staining and/or Western blotting.

Here's an analysis of the provided text to extract the acceptance criteria and study details for the Gold Standard Diagnostics Borrelia burgdorferi IgM ELISA Test Kit.

It's important to note that this document describes an In Vitro Diagnostic (IVD) device, not an AI/ML-based medical device. Therefore, many of the typical acceptance criteria and study designs associated with AI/ML, such as MRMC studies, expert adjudication, separate training/test sets with established ground truth protocols, and specific ground truth types (pathology, outcomes data, expert consensus), are not applicable or described in the same manner.

Instead, the acceptance criteria for IVDs typically revolve around analytical performance (sensitivity, specificity, precision, reproducibility, cross-reactivity, interference) and clinical concordance with a predicate device or clinical diagnosis.

Acceptance Criteria and Device Performance (IVD Device)

1. Table of Acceptance Criteria and Reported Device Performance

Since this is an IVD device, not an AI/ML device, the acceptance criteria are generally based on meeting certain performance metrics (e.g., specificity, sensitivity, precision, agreement with a predicate device) that demonstrate its substantial equivalence to a legally marketed device. The document does not explicitly state numerical acceptance thresholds for each metric, but rather presents the performance observed and implies that these results were deemed acceptable for market clearance.

Here's a table summarizing the reported device performance, which implicitly represents the met acceptance criteria for this IVD:

2. Sample Sampled Used for the Test Set and Data Provenance

• Determination of Assay Cutoff: 208 normal sera (103 from endemic region, 105 from non-endemic region). Provenance not explicitly stated but implies a mix of endemic/non-endemic populations, likely within the US.
• Precision (Test Set): A panel of 4 samples (negative, high negative, low positive, moderate positive) + kit controls. Tested in-house.
• Reproducibility (Test Set): A panel of 4 samples (negative, high negative, low positive, moderate positive) + kit controls. Tested at three different sites.
• Analytical Specificity (Test Set): 208 asymptomatic individuals' samples from endemic and non-endemic regions.
• Cross Reactivity (Test Set): 277 samples from serum vendors, confirmed positive for specific markers (e.g., Tick-borne Relapsing Fever IgM, Treponemal Infections, etc.).
• Interfering Substances (Test Set): 3 samples (high negative, equivocal, low positive) spiked with interferents.
• Clinical Studies (Comparison with Predicate Device - STTT):
  • Prospective Samples: 531 serum samples.
  • Provenance: Collected from three sites (one internal, two external reference laboratories) "using prospective samples submitted for Lyme serology testing". This implies real-world, prospectively collected, likely US-based clinical samples.
• Clinical Studies (Sensitivity Study - STTT): 114 clinically characterized samples (early, disseminated, late stages of Lyme disease). Provenance not explicitly stated.
• Clinical Studies (CDC Panel - STTT): 280 positive and negative specimens from the Center of Disease Control (CDC). These are a characterized reference panel. Provenance is CDC, likely multi-site or pooled.
• Clinical Studies (Method Comparison – MTTT IgM, Prospective Study):
  • Prospective Samples: 481 serum samples for the initial screening. 68 positive and equivocal samples carried forward for second-tier testing.
  • Provenance: Collected from three sites (one internal, two external reference laboratories) "using prospective samples submitted for Lyme serology testing". Implies real-world, prospectively collected, likely US-based clinical samples.
• Clinical Studies (Sensitivity Study - MTTT): 125 clinically characterized samples (early, disseminated, late stages of Lyme disease). Provenance not explicitly stated.
• Clinical Studies (CDC Reference Panel - MTTT): 280 positive and negative specimens from the Centers of Disease Control (CDC).

3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications

For IVD devices like this one, ground truth is typically established by:

• Consensus of clinical diagnosis for disease stages (clinically characterized samples).
• Confirmed status from reference laboratories or biological repositories (e.g., CDC panel, serum vendors for cross-reactivity).
• Comparison to a legally marketed predicate device (as done for the main comparative studies).

The document does not specify a number of experts or their qualifications for establishing ground truth for the test set. Ground truth is derived from the established clinical status of the samples (e.g., clinically characterized samples, CDC panel, confirmed positive from serum vendors). This is standard for IVD submissions, where the "ground truth" often relies on a combination of patient history, symptoms, other laboratory findings, and established reference panels or predicate device results, rather than a panel of independent human readers interpreting medical images.

4. Adjudication Method for the Test Set

Not applicable in the usual sense for an IVD kit. There's no human "reader" adjudication described. The "adjudication" is inherent in the established clinical status of the samples used as ground truth or the comparison to a predicate device. For instances where samples were "clinically characterized," this implies a clinical diagnosis that served as the reference standard, rather than an adjudication process of human interpretations of imaging/data.

5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

Not Applicable. This is an IVD (laboratory diagnostic test kit), not an AI/ML-based medical imaging and interpretation device. MRMC studies are used for evaluating AI/ML systems that assist human readers in tasks like image interpretation.

6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) was done

Yes, in essence. The performance metrics (PPA, NPA, sensitivity, specificity, etc.) presented in the tables are the standalone performance of the Gold Standard Diagnostics Borrelia burgdorferi IgM ELISA Test Kit itself, analogous to an "algorithm only" performance for an IVD. There is no "human-in-the-loop" component for the performance of this diagnostic test kit once it is run according to its instructions. The interpretation of the overall Lyme disease diagnosis, however, is intended to be made by a clinician based on multiple factors, as stated in the Indications for Use.

7. The Type of Ground Truth Used (expert consensus, pathology, outcomes data, etc)

The ground truth for this IVD was established using a combination of:

• Clinical Diagnosis / Clinically Characterized Samples: For the "Sensitivity Study" and "CDC Panel," samples were derived from patients with known clinical diagnoses of Lyme disease stages (early, disseminated, late) or from healthy individuals.
• Reference Panels: Specifically, the CDC Panel which consists of "positive and negative specimens... for Lyme disease detection" that are "masked characterized serum panel." This implies a very high confidence in the true status of these samples.
• Confirmed Status from Vendors: For the "Cross Reactivity" study, samples were "obtained from serum vendors who confirmed their positivity for each respective marker."
• Predicate Device/Established Methodology: For the "Comparison with Predicate Device" and "MTTT Comparison" studies, the performance was measured against results obtained from a legally marketed predicate device (Trinity Biotech MarDx Borrelia burgdorferi EIA IgM Test Kit) or an established "Standard two-tier test methodology (STTT)" using the predicate IgM blot test. While the predicate is not "ground truth" in the pathological sense, it serves as the reference standard for substantial equivalence studies for IVDs.

8. The Sample Size for the Training Set

Not applicable for this type of IVD device. This is a laboratory immunoassay kit, not an AI/ML algorithm that undergoes a distinct "training" phase with a large dataset. The "training" in the context of IVD development would be the R&D and optimization process to develop the assay components and parameters (e.g., antigen formulation, antibody concentrations, incubation times, cutoff determination), which are iterative and not typically reported as a "training set" size in an FDA submission. The determination of the assay cutoff involved 208 normal sera, which could be considered part of the assay's "calibration" or optimization, but not a "training set" in the sense of supervised machine learning.

9. How the Ground Truth for the Training Set was Established

Not applicable. As explained in point 8, there isn't a "training set" in the AI/ML context for this IVD device. The assay development and cutoff determination process is a different methodology. The "ground truth" for establishing the assay cutoff was based on 208 normal sera (from endemic and non-endemic regions) and a subsequent ROC analysis to optimize sensitivity and specificity.

Ask a specific question about this device

The Gold Standard Diagnostics Borrelia burgdorferi VISE-OspC IgG/IgM ELISA Test Kit is intended as a qualitative test for the detection of IgG and IgM class antibodies to VIsE and OspC antigens from Borrelia burgdorferi sensu stricto in human serum from symptomatic patients or people suspected of having Lyme disease. When used as the first-tier screening test, positive and equivocal results must be confirmed through additional testing by one of the following methods:

• Standard two-tier test methodology (STTT) using an IgG and/or IgM blot testing following current interpretation guidelines. OR

• Modified two-tier test methodology (MTTT) using one or more of the following three ELISA based assays:

a. Gold Standard Diagnostics Borrelia burgdorferi IgG/IgM ELISA Test

b. Gold Standard Diagnostics Borrelia burgdorferi IgG ELISA Test

c. Gold Standard Diagnostics Borrelia burgdorferi IgM ELISA Test

The assay can also be used as a second-tier confirmation test using the MTTT methodology when used with one or more of the following three ELISA based assays:

a. Gold Standard Diagnostics Borrelia burgdorferi IgG/IgM ELISA Test

b. Gold Standard Diagnostics Borrelia burgdorferi IgG ELISA Test

c. Gold Standard Diagnostics Borrelia burgdorferi IgM ELISA Test

Positive test results by either the STTT or MTTT methodology are supportive evidence for the presence of antibodies and exposure to Borrelia burgdorferi, the cause of Lyme disease. A diagnosis of Lyme disease should be made based on the presence of Borrelia burgdorferi antibodies. history, symptoms, and other laboratory findings.

Not Found

This document is a 510(k) clearance letter for the Gold Standard Diagnostics Borrelia burgdorferi VlsE-OspC IgG/IgM ELISA Test Kit. It states that the device is substantially equivalent to legally marketed predicate devices. However, this document does not contain the acceptance criteria for the device, nor does it provide details of a study proving the device meets acceptance criteria, or information regarding sample sizes, ground truth establishment, or expert involvement.

The letter explicitly states: "We have reviewed your Section 510(k) premarket notification of intent to market the device referenced above and have determined the device is substantially equivalent (for the indications for use stated in the enclosure) to legally marketed predicate devices marketed in interstate commerce prior to May 28, 1976..."

Therefore, I cannot extract the requested information from the provided text. To answer your questions, the actual 510(k) summary or the full submission (which is usually publicly available on the FDA website) would be required.

Ask a specific question about this device

The LIAISON® Lyme IgM assay uses chemiluminescent immunoassay (CLIA) technology for the qualitative detection of IgM antibodies to Borrelia burgdorferi in human serum and plasma samples (K2-EDTA, Li-heparin). This assay is intended for use on samples from patients with signs and symptoms consistent with or patients suspected of having Lyme disease to assess the presence of antibodies and exposure to Borrelia burgdorferi. In addition, the LIAISON® Lyme IgM assay may be used as a confirmatory test in the modified two-tier test (MTTT) in combination with the DiaSorin LIAISON® Lyme Total Antibody Plus assay.

If used as a first stage test, positive or equivocal results with the LIAISON® Lyme IgM assay should be confirmed through additional testing with a Standard two-tier test (STTT) methodology using an IgM Borrelia burgdorferi Western blot test following current guidelines.

Positive supplemental results are supportive evidence of the presence of antibodies and exposure to Borrelia burgdorferi and may be used along with patient history, symptoms and other laboratory data to support a clinical diagnosis of Lyme disease.

Negative results by the LIAISON® Lyme IgM assay should not be used to exclude Lyme disease.

The test must be performed on the LIAISON® XL Analyzer.

The DiaSorin LIAISON® Lyme IgM Control Set is intended for use as assayed quality control samples to monitor the performance of the LIAISON® Lyme IgM assay. The performance characteristics of LIAISON® Lyme IgM controls have not been established for any other assays or instrument platforms different from the LIAISON® XL.

The LIAISON® Lyme IgM assay is an indirect chemiluminescence immunoassay (CLIA) for the qualitative detection of IgM antibodies to Borrelia burgdorferi in human serum and plasma samples. All assay steps (with the exception of magnetic particle resuspension) and incubations are performed by the Analyzer. The principal components of the test are magnetic particles (solid phase) coated with recombinant Borrelia antigens and a conjugate reagent containing an anti-human IgM mouse monoclonal antibody linked to an isoluminol derivative (isoluminol-antibody conjugate). During the first incubation, anti-Borrelia burgdorferi antibodies present in calibrators, samples or controls bind to the solid phase. Unbound material is then removed with a wash cycle. During the second incubation, the antibody conjugate reacts with anti-Borrelia burgdorferi IgM antibodies that have bound to the solid phase. Excess antibody conjugate is then removed with a wash cycle. Subsequently, the starter reagents are added and a flash chemiluminescence reaction is induced. The light signal, and hence the amount of isoluminol-antibody conjugate, is measured by a photomultiplier as relative light units (RLU) and is indicative of the presence of Borrelia burgdorferi IgM antibodies present in calibrators, samples or controls.

The provided document describes the LIAISON® Lyme IgM assay, which is a chemiluminescent immunoassay (CLIA) for the qualitative detection of IgM antibodies to Borrelia burgdorferi in human serum and plasma samples. The device performance was evaluated through various studies, including a method comparison with a predicate device, an evaluation using Standard Two-Tier Testing (STTT) and Modified Two-Tier Testing (MTTT) methodologies, testing of a characterized Lyme panel from the CDC, precision and reproducibility studies, a cross-reactivity study, and an interfering substances study.

Here's a breakdown of the requested information:

1. Table of Acceptance Criteria and Reported Device Performance

The document does not explicitly state pre-defined acceptance criteria values for agreement percentages (PPA, NPA) or specificity/sensitivity for the method comparison, STTT, or MTTT studies. Instead, it presents the calculated agreement results, implying these are the performance metrics. For precision and reproducibility, specific %CV ranges are not explicitly stated as acceptance criteria, but the calculated %CV values are reported.

2. Sample Size Used for the Test Set and the Data Provenance

• Method Comparison and Prospective MTTT Studies:
  • Sample Size: 2621 human serum specimens.
  • Data Provenance: Collected in 14 states across five (5) distinct U.S. geographical regions. This indicates prospective data.
• Characterized Lyme Panel and Retrospective MTTT Study:
  • Sample Size: 280 samples for the characterized Lyme Panel. For the retrospective MTTT, 279 samples were evaluated after one lacked sufficient volume.
  • Data Provenance: Acquired from the CDC. This indicates retrospective (or banked) data.
• Cross-Reactivity Study:
  • Sample Size: 191 specimens.
  • Data Provenance: From various disease states, implying samples from patients with known conditions, likely retrospective or banked.
• Interfering Substances Study:
  • Sample Size: Not explicitly stated, described as "serum specimens containing B. burgdorferi IgM antibodies."
  • Data Provenance: Not specified, likely laboratory-prepared samples.
• Matrix Equivalence Study:
  • Sample Size: 32 matched patient sets.
  • Data Provenance: Not specified, likely laboratory-prepared or procured patient samples, potentially retrospective.

3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts

The document does not specify the number or qualifications of experts used to establish the ground truth for the test sets.

4. Adjudication Method for the Test Set

The document does not explicitly describe an adjudication method for the test sets. For the STTT and MTTT, Western blot (WB IgM) is used as a confirmatory test, which acts as a gold standard in the two-tier testing methodology, but it's not described as an "adjudication" in the sense of multiple expert readers resolving discrepancies.

5. If a Multi Reader Multi Case (MRMC) Comparative Effectiveness Study Was Done, If So, What Was the Effect Size of How Much Human Readers Improve with AI vs Without AI Assistance

This document describes an in vitro diagnostic (IVD) device (an immunoassay), not an AI-powered diagnostic imaging or a reader-assisted device. Therefore, a multi-reader multi-case (MRMC) comparative effectiveness study focusing on human reader improvement with or without AI assistance is not applicable and was not performed.

6. If a Standalone (i.e. algorithm only without human-in-the-loop performance) Was Done

Yes, the studies detailed (Method Comparison, STTT, MTTT, Characterized Lyme Panel, Precision, Reproducibility, Cross-Reactivity, Interfering Substances, Matrix Equivalence) represent the standalone performance of the LIAISON® Lyme IgM assay, which operates as an automated chemiluminescent immunoassay on the LIAISON® XL Analyzer without human interpretation of the primary result (the index value is generated by the machine and then converted to qualitative results). Humans perform the test, but the device provides the result.

7. The Type of Ground Truth Used (expert consensus, pathology, outcomes data, etc.)

The type of ground truth used varies:

• Method Comparison: The predicate device, ZEUS ELISA Borrelia burgdorferi IgM Test System, served as a reference for comparison. While not a "ground truth" in terms of pathology, it's a legally marketed device used for establishing substantial equivalence.
• Standard Two-Tier Testing (STTT): IgM Borrelia burgdorferi Western blot (following current guidelines) was used as the second-tier confirmatory test, representing the established serological "gold standard" for Lyme disease diagnosis, especially when combined with a positive first-tier test and clinical context. This is akin to a reference method ground truth.
• Modified Two-Tier Testing (MTTT): For the prospective study, the STTT protocol (LIAISON® Lyme Total Antibody Plus followed by B. burgdorferi IgM Western Blot) was considered the reference to which the MTTT (LIAISON® Lyme Total Antibody Plus followed by LIAISON® Lyme IgM assay) was compared. For the retrospective study using CDC samples, the STTT WB IgM results associated with the characterized panel served as the comparator.
• Characterized Lyme Panel (CDC): The classification of these samples (Acute, Convalescent, Late Lyme disease, Look-alike Diseases, Healthy controls) implies that these samples have a pre-established clinical and/or laboratory diagnosis/classification, representing a form of clinical ground truth.

8. The Sample Size for the Training Set

The document describes studies for substantial equivalence based on performance evaluation. It does not mention a "training set" in the context of machine learning model development. This is an IVD device, not an AI/ML device that requires explicit training data. The "performance data" presented is for evaluation (test sets).

9. How the Ground Truth for the Training Set Was Established

As stated above, this is an IVD device and the document does not refer to a "training set" or "training data" in the typical AI/ML context. The various reference methods (predicate device, Western blot, CDC characterized panels) serve as the comparators or benchmarks for establishing the performance characteristics.

Ask a specific question about this device

The LIAISON® Lyme IgG assay uses chemiluminescent immunoassay (CLIA) technology for the qualitative detection of IgG antibodies to Borrelia burgdorferi in human serum and plasma specimens (K2-EDTA, Li-heparin). This assay is intended for use on samples from patients with signs and symptoms consistent with or patients suspected of having Lyme disease to assess the presence of IgG antibodies and exposure to Borrelia burgdorferi. In addition, the LIAISON® Lyme Ig G assay may be used as a confirmatory test in the modified two-tier test (MTTT) in combination with the DiaSorin LIAISON® Lyme Total Antibody Plus assay.

If used as a first stage test, positive or equivocal results with the LIAISON® Lyme IgG assay should be confirmed through additional testing with a Standard two-tier test (STT) methodology using an IgG Borrelia burgdorferi Western blot test following current guidelines.

Positive supplemental results are supportive evidence of the presence of antibodies and exposure to Borrelia burgdorferi and may be used along with patient history, symptoms and other laboratory data to support a clinical diagnosis of Lyme disease.

Negative results by the LIAISON® Lyme IgG assay should not be used to exclude Lyme disease.

The test must be performed on the LIAISON® XL Analyzer.

The DiaSorin LIAISON® Lyme IgG Control Set is intended for use as assayed quality control samples to monitor the performance of the LIAISON® Lyme IgG assay. The performance characteristics of LIAISON® Lyme IgG controls have not been established for any other assays or instrument platforms different from the LIAISON® XL.

The LIAISON® Lyme IgG assay is an indirect chemilyminescence immunoassay (CLIA) for the qualitative detection of IgG antibodies to Borrelia burgdorferi in human serum and plasma samples. All assay steps (with the exception of magnetic particle resuspension) and incubations are performed by the Analyzer. The principal components of the test are magnetic particles (solid phase) coated with recombinant Borrelia antigens and a conjugate reagent containing an anti-human IgG mouse monoclonal antibody linked to an isoluminol derivative (isoluminol-antibody coniugate). During the first incubation, anti-Borrelia burgdorferi antibodies present in calibrators, samples or controls bind to the solid phase. Unbound material is then removed with a wash cycle. During the second incubation, the antibody conjugate reacts with anti-Borrelia burgdorferi IgG antibodies that have bound to the solid phase. Excess antibody conjugate is then removed with a wash cycle. Subsequently, the starter reagents are added and a flash chemiluminescence reaction is induced. The light signal, and hence the amount of isoluminol-antibody conjugate, is measured by a photomultiplier as relative light units (RLU) and is indicative of the presence of Borrelia burgdorferi IgG antibodies present in calibrators, samples or controls.

Here's a breakdown of the acceptance criteria and study details for the LIAISON® Lyme IgG assay, based on the provided FDA 510(k) summary:

1. Table of Acceptance Criteria and Reported Device Performance:

The document implicitly defines acceptance criteria through its performance study results, specifically for percentage agreement (sensitivity and specificity) when compared to a predicate device and STTT/MTTT protocols.

Acceptance Criteria (Implicitly defined by performance targets in studies)

Note on Acceptance Criteria: The document does not explicitly state numerical acceptance criteria for each metric (e.g., "PPA must be >X%"). Instead, it presents the device's performance results and concludes substantial equivalence, implying that these results met the FDA's expectations for equivalence to legally marketed predicate devices.

2. Sample Size Used for the Test Set and Data Provenance:

• Method Comparison (First Tier and STTT):
  • Sample Size: 2621 human serum specimens.
  • Data Provenance: Collected in 14 states across five (5) distinct U.S. geographical regions. This was a prospective study ("All 2621 prospective (all comer) specimens").
• Modified Two Tier Testing Methodology (Prospective Population):
  • Sample Size: 225 specimens (from the initial 2621 that were positive or equivocal by the first-tier assay).
  • Data Provenance: U.S. geographical regions, prospective.
• Characterized Lyme Panel (CDC Panel):
  • Sample Size: 280 samples.
  • Data Provenance: Acquired from the CDC (Centers for Disease Control), making it a retrospective panel.
• Modified Two Tier Testing Methodology (Retrospective Population from CDC Panel):
  • Sample Size: 279 samples (1 sample from the 280 CDC panel lacked sufficient volume). 82 of these were further tested with STTT WB IgG or MTTT.
  • Data Provenance: CDC, retrospective.
• Cross-reactivity Study:
  • Sample Size: 222 specimens (from 22 different disease states).
  • Data Provenance: Not specified, but likely obtained from various sources or commercial vendors for specific disease states. Retrospective by nature of obtaining specific disease samples.
• Matrix Equivalence Study:
  • Sample Size: 32 matched patient sets.
  • Data Provenance: Not specified.

3. Number of Experts Used to Establish Ground Truth and Qualifications:

The document does not explicitly state the "number of experts" or their specific "qualifications" for establishing ground truth. However, the ground truth for some studies is based on established laboratory methods:

• For the Method Comparison and STTT/MTTT studies: The ground truth for confirming Borrelia burgdorferi infection or exposure is primarily established by Western blot testing (IgG Borrelia burgdorferi Western blot test) following current guidelines. This is a recognized laboratory "gold standard" or highly accepted confirmatory method for Lyme disease. While experts interpret WBs, the document doesn't detail the number or qualifications of individuals performing or interpreting these specific Western blots.
• For the Characterized Lyme Panel (CDC Panel): The samples were "characterized" by the CDC. This implies that the CDC itself, a leading public health agency with extensive expertise in infectious diseases, established the reference classification for these samples. The ground truth here is the CDC's reference classification, which would involve robust testing and expert consensus within the CDC, though specific expert numbers or qualifications are not provided in this submission summary.

4. Adjudication Method for the Test Set:

Not explicitly described in the document. The studies primarily compare the LIAISON® Lyme IgG assay results against either a predicate ELISA assay or Western Blot results (STTT/MTTT). There isn't mention of a separate adjudication process beyond the defined "ground truth" method (e.g., WB results).

5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was done:

No, a Multi-Reader Multi-Case (MRMC) comparative effectiveness study, as typically understood for AI-assisted image analysis where human readers improve with AI vs without AI assistance, was not explicitly mentioned or performed. This device is an in-vitro diagnostic (IVD) assay designed to detect antibodies, not an AI-powered diagnostic imaging system requiring human interpretation with AI assistance. Its performance is measured directly against other laboratory tests or characterized panels.

6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) was done:

Yes, the performance studies described are essentially standalone evaluations of the LIAISON® Lyme IgG assay. The assay is an automated chemiluminescent immunoassay (CLIA) performed on the LIAISON® XL Analyzer. The results (Index values) lead to a qualitative positive, negative, or equivocal determination by the instrument's algorithm based on a predefined cutoff. There is no human-in-the-loop performance described in the context of interpreting the assay's primary output. Human involvement is in running the test and interpreting the final qualitative result provided by the system within a clinical context.

7. The Type of Ground Truth Used:

• Expert Consensus / Established Gold Standard:
  • For the prospective and retrospective studies that compare the LIAISON® assay to STTT (Standard Two-Tier Test) or MTTT (Modified Two-Tier Test), the ground truth is primarily based on IgG Borrelia burgdorferi Western Blot testing following current guidelines. Western blot is generally considered the confirmatory "gold standard" for Lyme disease serology.
  • For the "Characterized Lyme Panel" (from CDC), the ground truth is the CDC Reference Classification, which would be based on comprehensive testing and expert knowledge.
• Predicate Device Comparison: In the initial method comparison, the ground truth for calculating agreement percentages is the ZEUS ELISA B. burgdorferi IgG Test System (predicate device).

8. The Sample Size for the Training Set:

The document describes performance studies (method comparison, STTT, MTTT, cross-reactivity, precision, reproducibility, etc.) of the LIAISON® Lyme IgG assay. It does not explicitly mention a "training set" or "validation set" in the context of an algorithm or AI model development. The reported studies represent the testing and validation of the already developed assay.

• However, for the assay development process itself (not detailed in this summary), a training phase would typically occur during the R&D of the assay to establish optimal reagent concentrations, cut-offs, and assay parameters. This information is generally proprietary to the manufacturer and not typically included in a 510(k) summary unless the device is a novel AI/ML product.
• The calibration described ("Two-point verification (in triplicate) of stored 10 point master curve") indicates a specific calibration approach for the instrument, which would have been established during initial assay development using a set of characterized samples. The number of samples for developing this master curve is not provided.

9. How the Ground Truth for the Training Set Was Established:

As noted above, a distinct "training set" for an AI/ML algorithm is not described here, as this is an immunoassay. For the development of the assay itself (e.g., establishing optimal cut-offs), the ground truth would have been established using well-characterized samples from known Lyme disease patients and healthy controls, likely confirmed by established methods like Western blot and/or clinical diagnosis, similar to the methods used to establish the ground truth for the test sets presented. The specifics of this internal R&D process are not detailed in the FDA summary.

Ask a specific question about this device