Search Filters

Search Results

Found 8 results

510(k) Data Aggregation

    K Number
    K191184
    Date Cleared
    2020-03-05

    (307 days)

    Product Code
    Regulation Number
    866.3300
    Reference & Predicate Devices
    Why did this record match?
    Product Code :

    MJH

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The ImmuView S. pneumoniae and L. pneumophila Urinary Antigen Test is an in vitro, rapid, lateral flow test, also known as a lateral flow immunochromatographic assay, intended for the qualitative detection of Streptococus pneumoniae and Legionella pneumophila antigens in urine specimens with symptoms of pneumonia. The assay is intended to aid in diagnosis of S. pneumoniae and L. pneumophila serogroup 1 infections. The assay is further intended to aid in the diagnosis of S. pneumoniae infection of S. pneumoniae antigen in cerebrospinal fluid (CSF). Results from the ImmuView S. pneumoniae and L. pneumophila Urinary Antigen Test should be interpreted in conjunction with the patient's clinical evaluation and other diagnostic methods.

    Device Description

    ImmuView S. pneumoniae and L. pneumophila Urinary Antigen Test is a rapid lateral flow test for qualitative detection of S. pneumoniae in human urine and CSF samples and L. pneumophila (primarily serogroup 1) antigens in human urine samples. The test is effective in presumptive diagnosis of pneumococcal pneumonia caused by S. pneumoniae or Legionella pneumonia (Legionnaires' disease) caused by L. pneumophila, in conjunction with culture and other methods. Correct and early treatment is vital for the prognosis of both diseases and therefore quick methods to confirm both diseases in the initial phase are very important in order to initiate the proper antibiotic treatment as soon as possible.

    AI/ML Overview

    This document describes the validation of the ImmuView S. pneumoniae and L. pneumophila Urinary Antigen Test, an in vitro lateral flow immunochromatographic assay.


    1. Acceptance Criteria and Reported Device Performance

    The acceptance criteria for the device are implicitly demonstrated by the reported sensitivities and specificities, and positive/negative percent agreements achieving certain levels across various studies (retrospective, prospective, analytical). While explicit numerical acceptance criteria are not stated in a dedicated table, the consistently high performance metrics across both S. pneumoniae and L. pneumophila detection in urine and CSF demonstrate the device's acceptable performance.

    Here's a summary of the reported device performance, which serves as evidence of meeting implicit acceptance criteria:

    Table 1: Summary of ImmuView S. pneumoniae and L. pneumophila Urinary Antigen Test Performance

    ParameterTarget AnalyteSample TypeStudy TypePerformance (ImmuView)95% Confidence IntervalComparator Performance (if applicable)
    Sensitivity (vs. Culture)S. pneumoniae (Urine)UrineRetrospective78% (78/100)(69.0-85.0%) / (67-85%)80% (76/95)
    L. pneumophila (Urine)UrineRetrospective87.8% (86/98)(79.8-92.9%)
    L. pneumophila Sg 1 (U.S.)UrineRetrospective97.7% (42/43)(88-100%)100% (43/43)
    L. pneumophila Sg 1 (Europe)UrineRetrospective80.0% (44/55)(68-88%)66.7% (36/54)
    Specificity (vs. Culture)S. pneumoniae (Urine)UrineRetrospective98.1% (217/221)(95.4-99.3%) / (95-99%)97.8% (218/223)
    L. pneumophila (Urine)UrineRetrospective99.6% (239/240)(97.4-100.0%)
    L. pneumophila (U.S.)UrineRetrospective100% (19/19)(83-100%)100% (19/19)
    L. pneumophila (Europe)UrineRetrospective99.5% (220/221)(97-100%)99.6% (223/224)
    Positive Percent AgreementS. pneumoniae (Urine)UrineProspective96.0% (72/75)(88.9%-98.6%)-
    Negative Percent AgreementS. pneumoniae (Urine)UrineProspective97.4% (225/231)(94.5%-98.8%)-
    Positive Percent AgreementL. pneumophila SG1 (Urine)UrineProspective100.0% (3/3)(43.9%-100%)-
    Negative Percent AgreementL. pneumophila SG1 (Urine)UrineProspective100.0% (303/303)(98.8%-100%)-
    Sensitivity (vs. Culture)S. pneumoniae (CSF)CSFClinical Study92.9% (13/14)(68.5%-98.7%)-
    Specificity (vs. Culture)S. pneumoniae (CSF)CSFClinical Study96.0% (162/169)(91.7%-98.0%)-
    Positive Percent AgreementS. pneumoniae (Spiked CSF)CSFSpiked Study100% (50/50)(92.9%-100%)100% (50/50) (Comparator)
    Negative Percent AgreementS. pneumoniae (Negative CSF)CSFSpiked Study100% (10/10)(72.2%-100%)100% (10/10) (Comparator)
    ReproducibilityVarious positive/negative samplesUrine/CSFReproducibility99.6% (1068/1072 correct results)--
    Limit of Detection (LOD)S. pneumoniae antigenUrineAnalytical62.5 pg/mL--
    L. pneumophila SG1 (Philadelphia) antigenUrineAnalytical25 ng/mL (0.025 µg/mL)--
    S. pneumoniae (whole cell)UrineAnalytical10^5^ CFU/mL--
    L. pneumophila SG1 (whole cell)UrineAnalytical10^4^ CFU/mL--
    S. pneumoniae (whole cell)CSFAnalytical10^3^ CFU/mL--

    2. Sample Sizes and Data Provenance

    • Retrospective Study (Urine Samples):

      • S. pneumoniae: 100 culture-positive urine samples (48 from Sweden, 52 from Denmark, all from blood culture positive patients). 221 known negative urine samples.
      • L. pneumophila: 98 culture-confirmed urine samples (55 from Europe, 43 from the United States (US), these 43 were previously determined positive in a urinary antigen test). 240 known negative urine samples.
      • Data Provenance: Retrospective, samples from Europe (Sweden, Denmark) and the United States.
    • Prospective Study (Urine Samples):

      • Total Samples: 306 freshly collected urine samples (with 92 having to be frozen before testing due to practicalities).
      • Data Provenance: Prospective, collected from two sites in Spain and Denmark. These were from "all comers" at risk of community-acquired pneumonia.
    • Clinical Study (CSF Samples):

      • S. pneumoniae: 14 culture-positive CSF specimens (9 from US labs, 5 from European labs). 169 known negative CSF samples (113 from US labs, 56 from European labs).
      • Data Provenance: Retrospective/Clinical, samples from US and Europe.
    • Spiked CSF Testing:

      • S. pneumoniae: 50 human CSF samples spiked at the LOD. 10 additional unspiked negative CSF samples.
    • Analytical Studies (Cross-Reactivity, LOD, Interfering Substances, Strain Reactivity): Sample sizes vary by test and are described in the relevant sections (e.g., 143 samples for cross-reactivity with spiked bacteria/viruses in urine, 47 interfering agents tested).


    3. Number of Experts and Qualifications for Ground Truth

    The document does not explicitly state the number of experts or their specific qualifications (e.g., "radiologist with 10 years of experience") used to establish the ground truth. However, the ground truth for clinical studies (both retrospective and prospective) is defined as culture-confirmed results for S. pneumoniae and L. pneumophila infections, and "known negative" samples based on culture.

    For the CSF study, patients were "suspected of meningitis," and the ground truth was also culture-confirmed S. pneumoniae.

    Given that these are in vitro diagnostic tests, the "experts" in establishing ground truth would primarily be laboratory personnel performing culture confirmation, which is the gold standard for defining infection status.


    4. Adjudication Method

    The document does not describe any specific adjudication method (e.g., 2+1, 3+1 concensus) for establishing the ground truth for the test sets. The ground truth appears to be based on culture results, which typically do not require adjudication by multiple human interpreters in the same way imaging studies might.

    For the reproducibility study, the reading and interpretation of the panels were performed visually by operators. Errors in reading (e.g., operator interpreted S. pneumoniae Band result as negative even though band was present) are mentioned, indicating potential for individual variability, but a formal adjudication process for disagreements is not explicitly stated beyond what happens when "invalid" results occur.


    5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

    No multi-reader, multi-case (MRMC) comparative effectiveness study was performed or described. This device is an in vitro diagnostic (IVD) lateral flow assay, which is primarily a standalone test designed to provide a direct result, not an AI-assisted diagnostic tool for human readers. Therefore, there is no discussion of how human readers' performance might improve with AI assistance.


    6. Standalone Performance

    Yes, extensive standalone performance testing was done. The entire study described focuses on the "algorithm only" (i.e., the ImmuView test's intrinsic performance) without human-in-the-loop assistance for interpretation. The results in the tables for sensitivity, specificity, and agreement are all measures of the device's standalone performance against established ground truth (culture or comparator tests).


    7. Type of Ground Truth Used

    The primary type of ground truth used was culture confirmation for S. pneumoniae and L. pneumophila from urine and CSF samples.

    • Urine Retrospective Study: Culture-positive urine samples (blood culture positive for S. pneumoniae, culture confirmed for L. pneumophila) and known negative (culture confirmed negative) urine samples.
    • CSF Clinical Study: Culture-positive CSF specimens.
    • Prospective Study: Comparison with other lateral flow urine antigen tests (Comparator) was used, implying the Comparator's results served as an indirect ground truth or reference in this specific study, although the retrospective studies relied on culture.
    • Analytical Studies: Ground truth was based on known concentrations of purified antigens (pg/mL, ng/mL) or specific colony-forming units (CFU/mL) for LOD and strain reactivity, and known substances/organisms for cross-reactivity and interfering substances.

    8. Sample Size for Training Set

    The document does not explicitly mention a "training set" in the context of an algorithm or AI development. This product is a lateral flow immunoassay, a biochemical test, not a machine learning algorithm that undergoes a training phase. Therefore, the concept of a "training set" as it pertains to AI/ML models is not applicable here. The samples described were used for validation and performance evaluation.


    9. How Ground Truth for Training Set Was Established

    As explained under point 8, the product is a lateral flow immunoassay, not an AI/ML model. Therefore, there is no "training set" in the computational sense, and thus no ground truth establishment specific to a training set for an algorithm. All samples were used for validation and performance assessment, with ground truth established primarily by culture confirmation as described in point 7.

    Ask a Question

    Ask a specific question about this device

    K Number
    K163273
    Device Name
    TRU Legionella
    Date Cleared
    2017-02-21

    (92 days)

    Product Code
    Regulation Number
    866.3300
    Reference & Predicate Devices
    N/A
    Why did this record match?
    Product Code :

    MJH

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The TRU LEGIONELLA® assay is an in vitro, rapid, lateral-flow immunoassay for the qualitative detection of Legionella pneumophila serogroup 1 antigen in human urine specimens from patients with symptoms of pneumonia. Test results are to be used as an aid in diagnosis of Legionella serogroup 1 infection. A negative result does not preclude infection with Legionella pneumophila serogroup 1. Test results are to be used in conjunction with information obtained from the patient's clinical evaluation and other diagnostic procedures.

    Device Description

    The TRU LEGIONELLA® assay is an in vitro, rapid, lateral-flow immunoassay.

    AI/ML Overview

    This is a letter acknowledging the receipt of a 510(k) premarket notification for a medical device called "Legionella. Spp., Elisa." While it indicates that the device has been found substantially equivalent to a predicate device, this document does not contain the detailed study information, acceptance criteria, or performance data that you requested.

    The letter explicitly states: "We have reviewed your Section 510(k) premarket notification of intent to market the device referenced above and have determined the device is substantially equivalent...". This means the FDA has evaluated the submission and deemed the device safe and effective for its stated indications based on comparisons to a legally marketed predicate. However, the supporting data and studies are part of the original 510(k) submission and are not publicly detailed in this acknowledgment letter.

    Therefore, I cannot extract the requested information from the provided text. To obtain that level of detail, you would typically need to review the actual 510(k) summary and supporting documentation submitted by Meridian Bioscience, Inc. to the FDA, which is usually found in a separate, more comprehensive public document associated with the 510(k) number (K163273).

    Ask a Question

    Ask a specific question about this device

    K Number
    K113190
    Device Name
    TRU LEGIONELLA
    Date Cleared
    2012-02-24

    (116 days)

    Product Code
    Regulation Number
    866.3300
    Reference & Predicate Devices
    Why did this record match?
    Product Code :

    MJH

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The TRU Legionella assay is an in vitro, rapid, lateral-flow immunoassay for the qualitative detection of Legionella pneumophila serogroup 1 antigen in human urine specimens. It is designed to test specimens from patients with symptoms of pneumonia. Test results are to be used as an aid in diagnosis of Legionella pneumophila serogroup 1 infection. A negative result does not preclude infection with Legionella pneumophila serogroup 1. Test results are to be used in conjunction with information obtained from the patient's clinical evaluation and other diagnostic procedures.

    Device Description

    The TRU Legionella assay is an in vitro, rapid, lateral-flow immunoassay for the qualitative detection of Legionella pneumophila serogroup 1 antigen in human urine specimens. The assay consists of Test Strips containing anti-Legionella pneumophila serogroup 1 as the capture antibody, Containing anti-Legionella pneumophila serogroup 1 as the detection antibody, Sample Diluent/Negative Control, and Positive Control.

    AI/ML Overview

    The provided text describes the performance of the TRU Legionella assay, an in vitro rapid lateral-flow immunoassay for the qualitative detection of Legionella pneumophila serogroup 1 antigen in human urine specimens. The study aims to demonstrate substantial equivalence to a predicate device, the BinaxNOW® Legionella Urinary Antigen test.

    Here's an analysis based on your requested points:

    1. Table of Acceptance Criteria and Reported Device Performance

    The document does not explicitly state pre-defined acceptance criteria in terms of specific percentages for positive or negative agreement. Instead, it presents the performance of the TRU Legionella assay in comparison to the predicate device, the BinaxNOW® Legionella test, and demonstrates high correlation. The overall performance metrics serve as the reported device performance.

    Performance MetricAcceptance Criteria (Implied by Predicate Comparison)Reported Device Performance (TRU Legionella)
    Positive AgreementHigh agreement with BinaxNOW® Legionella96.3% (95% CI: 91.7 - 98.4%)
    Negative AgreementHigh agreement with BinaxNOW® Legionella100.0% (95% CI: 98.7 - 100.0%)
    Overall CorrelationHigh correlation with BinaxNOW® Legionella98.8% (95% CI: 97.3 - 99.5%)
    Reproducibility (Overall)High correlation between expected and achieved results100% (98.7 - 100.0%)

    2. Sample Size Used for the Test Set and Data Provenance

    • Test Set Sample Size: 428 qualified patient samples.
    • Data Provenance:
      • Country of Origin: Southeastern regions of the United States and the Netherlands.
      • Retrospective/Prospective: The US clinical trial sites evaluated both retrospective frozen samples and prospectively collected samples. The retrospective samples were those previously submitted for Legionella testing. The site in the Netherlands evaluated 220 frozen samples from a well-characterized repository.

    3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts

    The ground truth for the clinical study was established by comparison to the Binax NOW® Legionella Urinary Antigen test (predicate device). The document does not describe the use of independent experts to establish ground truth for this comparison study, as it's a comparative effectiveness study against a legally marketed device. The predicate device itself serves as the reference standard for "truth" in this context.

    For the samples from the Netherlands, they were "chosen from a well characterized repository of urine samples collected from patients with confirmed Legionnaires Disease as well as negative specimens from patients suspected of infection by Legionella," implying an existing clinical diagnosis. However, the exact number and qualifications of experts involved in the initial confirmation of these Legionnaires' Disease cases are not specified in this document.

    4. Adjudication Method for the Test Set

    Not applicable. The study is a direct comparison of the TRU Legionella assay's results against the BinaxNOW® Legionella test. There is no mention of an adjudication method involving multiple readers or experts to resolve discrepancies between the two tests. The BinaxNOW® result is treated as the reference.

    5. Multi Reader Multi Case (MRMC) Comparative Effectiveness Study

    No, a multi-reader multi-case (MRMC) comparative effectiveness study was not performed to assess human reader improvement with AI assistance. This document describes the performance of an in vitro diagnostic (IVD) rapid immunoassay, not an AI-powered diagnostic imaging or interpretation tool. The test is visually read by a single operator, and the comparison is between the new device and a predicate device.

    6. Standalone (Algorithm Only Without Human-in-the-Loop Performance) Study

    Yes, this is effectively a standalone performance study. The TRU Legionella assay is an in vitro rapid lateral-flow immunoassay designed for direct visual interpretation of results. Its performance is measured independently against the predicate device without human-in-the-loop assistance for the assay itself (beyond the visual reading as intended).

    7. Type of Ground Truth Used

    The primary ground truth used for the clinical performance comparison was the results from the predicate device, BinaxNOW® Legionella Urinary Antigen test. For the samples from the Netherlands, the repository samples were "from patients with confirmed Legionnaires Disease," suggesting clinical diagnosis/outcomes data for positive cases, and "negative specimens from patients suspected of infection by Legionella" for negative cases.

    8. Sample Size for the Training Set

    The document does not explicitly describe a separate "training set" in the context of machine learning or AI development. This is a traditional IVD device. The analytical studies (sensitivity, interference, cross-reactivity, strain reactivity) involve testing numerous laboratory-prepared specimens, but these are for analytical validation rather than AI model training.

    9. How the Ground Truth for the Training Set Was Established

    Not applicable, as this is a traditional IVD device and not an AI-based system involving a training set in the machine learning sense. The analytical studies establishing limits of detection, interference, and cross-reactivity use known concentrations of L. pneumophila strains or other substances, which are internally controlled ground truths established through laboratory methods.

    Ask a Question

    Ask a specific question about this device

    K Number
    K061496
    Manufacturer
    Date Cleared
    2007-06-28

    (393 days)

    Product Code
    Regulation Number
    866.3300
    Reference & Predicate Devices
    N/A
    Why did this record match?
    Product Code :

    MJH

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The SAS™ Legionella Test is a visually read, in vitro immunochromatographic rapid assay for the presumptive qualitative detection of Legionella pneumophila serogroup 1 antigens in human urine. This test is intended to aid in the presumptive diagnosis of Legionnaires' disease in conjunction with culture and other methods for patients with signs and symptoms of pneumonia. This test is for prescription use only.

    Device Description

    The SAS™ Legionella test utilizes a combination of polyclonal antibodies against the antigens of Legionella pneumophila. The SAS™ Legionella test begins with the addition of urine to the test device. The specimen is absorbed by the sample pad and then moves through the conjugate pad which contains dried gold conjugated antibodies which are specific for Legionella pneumophila antigens; if the Legionella antigens are present in the urine sample, a "half-sandwich" immunocomplex is formed. This immuno-complex then migrates via capillary action along a nitrocellulose membrane containing immobilized antibodies to Legionella pneumophila antigens. The immobilized antibodies bind the "half-sandwich" immuno-complex to form a "whole sandwich" immuno-complex. Thus, when the "whole sandwich" is formed, a visible, pink colored line develops in the specimen zone on the test device. In the absence of a Legionella antigen, a "sandwich" immuno-complex is not formed and a negative result is indicated. To serve as a procedural control, a pink colored control line will always appear in the control zone regardless of the presence or absence of Legionella antigen. The test is available in cassette format.

    AI/ML Overview
    {
      "1_table_of_acceptance_criteria_and_reported_device_performance": {
        "Acceptance Criteria (Implicit)": "To demonstrate substantial equivalence to the predicate device (Binax™ Now® Legionella Urinary Antigen Test) and to culture methods for the detection of Legionella pneumophila serogroup 1 antigens in human urine.",
        "Reported Device Performance": "The SAS™ Legionella Test performed substantially equivalent to the predicate device, Binax™ Now® Legionella Urinary Antigen Test and to culture. Cross reactivity and interference studies showed no interference or cross-reaction with common viral and bacterial strains found in human urine."
      },
      "2_sample_size_used_for_the_test_set_and_data_provenance": {
        "Sample Size (Test Set)": "Not explicitly stated. The document mentions \"frozen and fresh urine specimens\" were used for comparison but does not provide a specific number.",
        "Data Provenance": "Not explicitly stated (e.g., country of origin). The data is retrospective based on the use of \"frozen and fresh urine specimens\" for comparison."
      },
      "3_number_of_experts_used_to_establish_the_ground_truth_for_the_test_set_and_qualifications": "Not applicable. The ground truth was established by comparison to a predicate device (Binax™ Now® Legionella Urinary Antigen Test) and culture methods, not by expert interpretation of the device results.",
      "4_adjudication_method_for_the_test_set": "Not applicable. Adjudication methods like 2+1 or 3+1 are typically used for expert consensus on image interpretation, which is not relevant for this immunochromatographic rapid assay.",
      "5_if_a_multi_reader_multi_case_mrmc_comparative_effectiveness_study_was_done": "No. This is an immunochromatographic rapid assay, not an imaging device requiring human reader interpretation in a MRMC study.",
      "6_if_a_standalone_performance_study_was_done": "Yes. The performance of the SAS™ Legionella Test (algorithm only, as it's a diagnostic kit) was directly compared against established methods (predicate device and culture) for diagnostic accuracy.",
      "7_the_type_of_ground_truth_used": "Comparison to a legally marketed predicate device (Binax™ Now® Legionella Urinary Antigen Test) and culture methods. Culture is generally considered a gold standard for bacterial identification.",
      "8_the_sample_size_for_the_training_set": "Not applicable. As a diagnostic test kit, there isn't a 'training set' in the machine learning sense. The device is developed through biochemical assays and optimizations, not by training an algorithm on a 'training set' of data.",
      "9_how_the_ground_truth_for_the_training_set_was_established": "Not applicable. See #8. The development of such a test relies on established scientific principles of immunology and antigen-antibody reactions, and validation against known Legionella-positive and -negative samples, rather than a 'ground truth' established for a training set in machine learning."
    }
    
    Ask a Question

    Ask a specific question about this device

    K Number
    K070522
    Date Cleared
    2007-03-15

    (20 days)

    Product Code
    Regulation Number
    866.3300
    Reference & Predicate Devices
    Why did this record match?
    Product Code :

    MJH

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The Binax NOW® Legionella Urinary Antigen Test is an in vitro rapid immunochromatographic assay for the qualitative detection of Legionella serogroup 1 antigen (L. pneumophila serogroup 1 antigen) in urine specimens from patients with symptoms of pneumonia. It is intended to aid in the presumptive diagnosis of Legionella infection ("Legionnaires" Disease) caused by L. pneumophila serogroup 1 in conjunction with culture and other methods.

    Device Description

    The Binax NOW® Legionella Urinary Antigen Test is an immunochromatographic membrane assay to detect Legionella pneumophila serogroup 1 antigen in human urine. A test strip, containing gold-conjugated and immobilized anti-Legionella pneumophila serogroup 1 antibodies, and a swab well are mounted on opposite sides of a cardboard, book-shaped hinged test device. A Dacron swab is dipped into the urine to be tested and then inserted into the swab well. A single reagent is added to the swab well from a dropper bottle before closing the test device. Legionella urinary antigen captured by immobilized anti-Legionella pneumophila antibody reacts to bind anti-Legionella pneumophila conjugated antibody, forming the Sample Line. Immobilized control antibody captures anti-species conjugate, forming the Control Line. There are no transferring steps, the sample is contained, and results are available in 15 minutes.

    AI/ML Overview

    This document describes the Binax NOW® Legionella Urinary Antigen Test, an immunochromatographic assay for detecting Legionella pneumophila serogroup 1 antigen in urine specimens. The 510(k) submission (K070522) aimed to demonstrate substantial equivalence to the unmodified Binax NOW® Legionella Urinary Antigen Test (K982238) after modifications to the device.

    1. Table of Acceptance Criteria and Reported Device Performance

    Acceptance Criteria CategorySpecific CriteriaReported Device PerformanceStudy Type
    Method Comparison100% agreement between modified and unmodified device for negative and positive samples.100% agreement between the modified and unmodified devices for 70 negative urine samples and 15 positive urine samples.Method Comparison
    Cross-ReactivityNo positive results with clinically relevant concentrations of common pneumonia-associated organisms and urogenital tract flora.None of the 11 organisms tested (at 1x10^6 to 2x10^3 concentrations) tested positive on the modified device.Cross-Reactivity Testing
    Loss of Signal (LOS)The same dilution of positive urine specimen should provide loss of signal on both the unmodified and modified devices.In all three studies, the same dilution of positive urine provided loss of signal on both the unmodified and modified devices.Loss of Signal (LOS) Testing
    StabilityNot explicitly stated in terms of acceptance criteria, but crucial for product efficacy.Stability studies of the modified test are currently ongoing.Stability Studies

    2. Sample Sizes and Data Provenance

    • Test Set (Method Comparison):

      • Negative Samples: 70 urine samples
      • Positive Samples: 15 known positive urine specimens
      • Data Provenance: The document states that the negative urine samples were "collected from presumed healthy individuals." The provenance of the positive samples is not explicitly detailed but they are described as "known positive urine specimens." It is retrospective data as it describes samples that were already collected and classified. The country of origin is not specified.
    • Test Set (Cross-Reactivity):

      • Number of Organisms Tested: 11
      • Concentrations: Ranged from 1 x 10^6 to 2 x 10^3 (depending on the organism).
      • Data Provenance: Whole organism cross-reactivity testing was performed. The organisms were grown in culture. Details on the origin of the cultures or their geographical provenance are not provided.
    • Test Set (Loss of Signal):

      • Positive Urine Specimen: 1
      • Lots Tested: 3 separate lots of the modified device.
      • Data Provenance: Serial two-fold dilutions of a known positive urine specimen. Details on the origin of the specimen are not provided.

    3. Number of Experts and Qualifications for Ground Truth

    The document does not mention the use of experts to establish ground truth for the test sets. For the method comparison study, "known positive urine specimens" and "presumed healthy individuals" were used, implying prior methods established positivity and negativity. For cross-reactivity, organisms were grown in culture, indicating laboratory-derived ground truth. For loss of signal, a "known positive urine specimen" was used.

    4. Adjudication Method

    No adjudication method is described for the test sets. The studies rely on direct comparison to the predicate device or established laboratory standards.

    5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

    No MRMC comparative effectiveness study was mentioned or performed. This device is an in vitro diagnostic (IVD) test, not an imaging device or an AI application designed to assist human readers in interpretation. Therefore, the concept of human readers improving with AI vs without AI assistance is not applicable here.

    6. Standalone Performance

    Yes, a standalone performance assessment was conducted for the modified device by comparing its results directly with the unmodified predicate device, and by testing its performance in cross-reactivity and loss-of-signal experiments. The device itself generates a qualitative result (positive/negative) without human interpretation in the loop to determine the primary outcome of the test.

    7. Type of Ground Truth Used

    The ground truth used appears to be a combination of:

    • Predicate Device Comparison: For the method comparison, the results of the unmodified predicate device served as the established "truth" for agreement.
    • Pre-classified Samples: "Known positive urine specimens" and urine from "presumed healthy individuals" imply prior diagnostic classification or health status determining the ground truth for these samples.
    • Laboratory-derived Standards: For cross-reactivity, the presence or absence of specific cultured organisms at known concentrations served as the ground truth. For loss of signal, the serial dilution of a known positive specimen was used.

    8. Sample Size for the Training Set

    No training set is mentioned in the provided text. This device is a rapid immunochromatographic assay, not an algorithm that requires a training set in the conventional sense of machine learning. The "training" in this context would refer to the development and optimization of the assay components (antibodies, membrane, etc.) rather than a data-driven model.

    9. How the Ground Truth for the Training Set Was Established

    As no training set is described or applicable in the context of this type of device, the method for establishing ground truth for a training set is not provided.

    Ask a Question

    Ask a specific question about this device

    K Number
    K033051
    Date Cleared
    2003-11-26

    (58 days)

    Product Code
    Regulation Number
    866.3300
    Reference & Predicate Devices
    N/A
    Why did this record match?
    Product Code :

    MJH

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The Trinity Biotech Captia™ Legionella pneumophila IgG/IgM ELISA kit is an Enzyme-Linked Immunosorbent Assay (ELISA) for the qualitative detection of total antibodies (IgG and IgM) to serogroups 1-6 in serum from patients with clinical suspicion of Legionella Disease. The assay is not intended to differentiate between the serotypes of Legionella pneumophila.

    Device Description

    The Legionella pneumophila IgG/IgM ELISA kit is an Enzyme-Linked Immunosorbent Assay (ELISA) for the qualitative detection of total antibodies (IgG and IgM) to Legionella pneumophila serogroups 1-6 in serum from patients with clinical suspicion of Legionella Disease.

    The Legionella pneumophila IgG/IgM ELISA test is an enzyme linked immunosorbent assay to detect IgG/IgM antibodies to legionella. Purified Legionella pneumophila antigen (serogroups 1, 2, 3, 4, 5, 6) is attached to a solid phase microtiter well. Diluted test sera is added to each well. If the antibodies are present that recognize the antigen, they will bind to the antigen in the well. After incubation, the wells are washed to remove unbound antibody. An enzyme labeled anti-human IgG/IgM is added to each well. If antibody is present, it will bind to the antibody attached to the antigen on the well. After incubation, the wells are washed to remove unbound conjugate. A substrate solution is added to each well. If enzyme is present, the substrate will undergo a color change. After an incubation period, the reaction is stopped and the color intensity is measured photometrically, producing an indirect measurement of specific antibody in the patient specimen.

    AI/ML Overview

    Here's a breakdown of the acceptance criteria and study details for the Trinity Biotech Legionella pneumophila IgG/IgM ELISA Test Kit, based on the provided text:

    1. Table of Acceptance Criteria and Reported Device Performance

    The document doesn't explicitly state pre-defined acceptance criteria in terms of numerical thresholds for sensitivity, specificity, or agreement. Instead, it presents the results of a comparative study against a predicate device (Legionella IFA) and implicitly suggests that these results demonstrate substantial equivalence. The precision study evaluates consistency rather than diagnostic accuracy.

    Performance MetricAcceptance Criteria (Implicit)Reported Device Performance (Site 1)Reported Device Performance (Site 2)
    % Agreement Positive (compared to IFA positive)Demonstrate substantial agreement with predicate device (IFA)90.00% (95% CI: 79.0% - 100%)98.53% (95% CI: 95.6% - 100%)
    % Agreement Negative (compared to IFA negative)Demonstrate substantial agreement with predicate device (IFA)NA (no IFA negative samples)98.57% (95% CI: 95.7% - 100%)
    Precision (Intra-assay CV)Not explicitly stated, but common industry practice aims for low CVs (e.g.,
    Ask a Question

    Ask a specific question about this device

    K Number
    K991074
    Manufacturer
    Date Cleared
    1999-12-21

    (265 days)

    Product Code
    Regulation Number
    866.3300
    Reference & Predicate Devices
    N/A
    Why did this record match?
    Product Code :

    MJH

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    Bartels Legionella Urinary Antigen ELISA Test is intended as an adjunct to culture for the presumptive diagnosis of past or current Legionnaires' Disease by qualitative detection of Legionella pneumophila Serogroup 1 antigen in human urine.

    Device Description

    Bartels Legionella Urinary Antigen ELISA Test is an enzyme-linked immunoassay intended for the qualitative detection of Legionella pneumophila Serogroup 1 antigen in human urine. The kit consists of microelisa stripwells with lid, positive and negative control reagents, conjugate, wash concentrate, colorimetric substrate (2 components) and stop solution. Sufficient materials are provided to perform 96 analyses. The microelisa wells have been pre-coated with purified rabbit antibodies to Legionella pneumophila Serotype 1 (capture antibody). An undiluted urine specimen (100 µL), or positive or negative controls (100 µL each) are each placed in a single microelisa well followed by the addition of 50 uL of Conjugate (horseradish peroxidase-conjugated rabbit antibodies to L. pneumophila). The loaded microelisa plate is then covered with the lid and incubated for 48 to 52 minutes at 34-37°C followed by 4 cycles of wash/aspiration using diluted Wash Solution (manual or automated wash procedure). Colorimetric substrate (tetramethyl benzidine/H2O2 100 µL/well) is then added and incubated for 10 to 12 minutes at 34-37℃ followed by the addition of Stop Solution (1M Phosphoric acid, 100 uL/well). The stopped plate is then read on a microelisa plate reader at 450 nm against an air blank. For a test to be considered valid, the Negative Control must have an optical density (OD) value of less than 0.100 and the Positive Control must be greater than the Positive Cutoff (pco). The pco is equal to 4X the O.D. value of the Negative Control value. Any specimen with an O.D. value ≥ the pco is considered positive. Any specimen with an O.D. value

    AI/ML Overview

    Here's a breakdown of the acceptance criteria and the study details for the Bartels Legionella Urinary Antigen ELISA Test, based on the provided text:

    1. Table of Acceptance Criteria and Reported Device Performance

    The acceptance criteria are implied by the comparison to the predicate device's performance, as the study aims to establish substantial equivalence.

    Performance MetricPredicate Device (Binax Legionella Urinary Antigen EIA)Bartels Legionella Urinary Antigen ELISA Test (Automated Reader)Bartels Legionella Urinary Antigen ELISA Test (Visual Interpretation)
    Sensitivity87.2%94.7%92.6%
    Specificity86.7%91.1%93.9%
    Accuracy86.9%92.3%93.4%

    Note: The acceptance criteria for the Bartels device would be meeting or exceeding these performance characteristics, particularly in comparison to the predicate device, to demonstrate substantial equivalence. The text explicitly states that "Substantial equivalence was established between the Bartels LUA and the predicate device" and that "there is equivalence between reading the results with an automated plate reader and performing a visual interpretation."

    2. Sample Size Used for the Test Set and Data Provenance

    • Sample Size (Test Set): 274 clinically well-defined urine specimens.
      • 94 urine specimens from patients whose respiratory specimens were culture-positive for Legionella pneumophila Serogroup 1.
      • 150 urine specimens from patients who did not have a diagnosis of Legionella pneumophila.
      • 30 urine specimens from normal healthy volunteers.
    • Data Provenance: The study was performed "at a major infectious disease reference laboratory." The country of origin is not specified but is likely the USA given the FDA 510(k) submission. The data is retrospective, as it uses "clinically well-defined urine specimens" which implies they were collected and characterized prior to the study.

    3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications

    • The text does not explicitly state the number of experts used to establish the ground truth.
    • Qualifications: The ground truth for positive cases was established by "respiratory specimens were culture-positive for Legionella pneumophila Serogroup 1." This indicates that microbiology experts would have performed these cultures, which is a standard diagnostic method. For negative cases, it's based on "patients who did not have a diagnosis of Legionella pneumophila" and "normal healthy volunteers," implying clinical diagnoses and health assessments.

    4. Adjudication Method for the Test Set

    • The text does not explicitly state an adjudication method. The ground truth appears to be based on established clinical and laboratory diagnostic methods (culture, absence of diagnosis).

    5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done

    • No, a typical MRMC study comparing human readers with and without AI assistance was not performed.
    • Instead, a comparison was made for the Bartels LUA ELISA Test itself between two interpretation methods:
      • Automated plate reader.
      • Visual interpretation using a provided card.
    • Effect Size: The comparison showed that the visual interpretation had slightly different, but still strong, performance characteristics:
      • Automated Reader: Sensitivity 94.7%, Specificity 91.1%, Accuracy 92.3%
      • Visual Interpretation: Sensitivity 92.6%, Specificity 93.9%, Accuracy 93.4%
      • The conclusion states "there is equivalence between reading the results with an automated plate reader and performing a visual interpretation."

    6. If a Standalone (Algorithm Only Without Human-in-the-Loop Performance) Was Done

    • Yes, the performance of the Bartels Legionella Urinary Antigen ELISA Test using an automated plate reader represents a standalone algorithm-only performance. The device provides a quantitative optical density (OD) value, and the cutoff for positive/negative is applied algorithmically (OD value ≥ the pco is considered positive).

    7. The Type of Ground Truth Used

    • Expert Consensus / Clinical Diagnosis / Pathology:
      • For positive cases: Legionella pneumophila Serogroup 1 culture results from respiratory specimens (considered the "gold standard" as stated in Table 1).
      • For negative cases: Patients "who did not have a diagnosis of Legionella pneumophila" and "normal healthy volunteers." This implies a combined approach of clinical assessment and likely other diagnostic tests (absence of culture results, etc.).

    8. The Sample Size for the Training Set

    • The text does not mention a separate training set or details on its size. This device is an ELISA test, not a machine learning algorithm in the modern sense. Therefore, it does not typically undergo "training" with a distinct dataset in the way an AI model would. The "design/format" and reagent composition are developed and validated during the product development phase, and the cited clinical study is for performance validation.

    9. How the Ground Truth for the Training Set Was Established

    • As noted above, there isn't a specified "training set" in the context of an AI model. The development of an ELISA test involves extensive research and development to identify appropriate antibodies, optimize concentrations, and establish reaction conditions. The "ground truth" during this development phase would rely on laboratory-derived standards, cultured pathogens, and potentially internal studies with banked clinical samples to refine the assay's components and cutoff values. However, these details are not provided in this 510(k) summary.
    Ask a Question

    Ask a specific question about this device

    K Number
    K982238
    Manufacturer
    Date Cleared
    1998-08-21

    (57 days)

    Product Code
    Regulation Number
    866.3300
    Reference & Predicate Devices
    N/A
    Why did this record match?
    Product Code :

    MJH

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The Binax NOW™ Legionella Urinary Antigen Test is a rapid immunochromatographic assay for the qualitative detection of Legionella pneumophila serogroup 1 antigen (L. pneumophila serogroup 1 antigen) in human urine as an adjunct to culture for the presumptive diagnosis of Legionnaires' Disease. It is intended for in vitro diagnostic use.

    Device Description

    The Binax NOW™ Legionella Urinary Antigen Test is an immunochromatographic membrane assay to detect Legionella pneumophila serogroup 1 antigen in human urine. A test strip, containing gold-conjugated and immobilized anti-Legionella pneumophila serogroup 1 antibodies, and a swab well are mounted on opposite sides of a cardboard, book-shaped hinged test device. A dacron swab is dipped into the urine to be tested and then inserted into the swab well. A single reagent is added to the swab well from a dropper bottle before closing the test device. Soluble antigen captured by immobilized anti-Legionella pneumophila serogroup 1 antibody reacts to bind the visualizing gold-conjugate. There are no transferring steps, the sample is contained, and results are available within 15 minutes.

    AI/ML Overview

    Here's a breakdown of the acceptance criteria and study information for the Binax NOW™ Legionella Urinary Antigen Test, based on the provided text:

    Acceptance Criteria and Reported Device Performance

    CriteriaAcceptance Threshold (Implicit)Reported Device Performance (Binax NOW™)Predicate Device Performance (Binax Legionella Urinary Antigen EIA)
    SensitivityNot explicitly stated97%95%
    SpecificityNot explicitly stated98%94%
    Cross-ReactivityNot explicitly stated98% specificity (against 200 non-Legionella pneumonia and UTI samples)Not explicitly stated (compared against the same 200 samples)
    ReproducibilityNot explicitly stated100% (360 samples correctly interpreted)Not applicable (study performed on NOW™ test)
    Quality ControlNot explicitly stated100% of 90 devices correctly interpreted (positive, negative, or invalid)Not applicable (study performed on NOW™ test)

    Note: The acceptance thresholds are implicit as the submission focuses on demonstrating substantial equivalence to the predicate device. The performance of the NOW™ test is presented as being comparable or superior to the predicate device.


    Study Details

    2. Sample size used for the test set and the data provenance:
    * Sample Size: 300 well-characterized frozen urine specimens were used for sensitivity and specificity determination. An additional 200 urine samples with other bacterial/fungal pneumonia or urinary tract infections were used for cross-reactivity testing. A separate 106 presumed negative urine specimens were also tested for specificity. For reproducibility, a panel of 360 coded specimens (negative, low, moderate, and high positive swabs) was used.
    * Data Provenance: The specimens were "well characterized frozen urine specimens." The location of the main sensitivity and specificity testing was The University of Indiana. No country of origin is explicitly stated, but given the US submitter and testing location, it's highly likely to be US-based. The samples appear to be retrospective as they are "well characterized frozen urine specimens."

    3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts:
    * The document does not specify the number of experts or their qualifications used to establish the ground truth. It states that "Specimens were considered true positives when the presence of infection was confirmed by culture, RIA, DFA or IFA." This implies reliance on established laboratory methods rather than direct expert consensus on each case.

    4. Adjudication method for the test set:
    * The document does not explicitly state an adjudication method (like 2+1 or 3+1). Ground truth was established by laboratory confirmation (culture, RIA, DFA, or IFA) for true positives. For reproducibility, it was a blind study where individuals from diverse educational backgrounds performed testing across different days. The correctness of interpretation refers to agreement with the known status of the coded specimens.

    5. If a multi-reader multi-case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:
    * No, a multi-reader multi-case (MRMC) comparative effectiveness study was not done, nor is there any mention of AI assistance. This device is an immunochromatographic assay, not an AI-powered diagnostic tool. The performance is for the device itself.

    6. If a standalone (i.e., algorithm only without human-in-the-loop performance) was done:
    * Yes, this study represents a standalone performance evaluation of the Binax NOW™ Legionella Urinary Antigen Test. The test produces visually interpreted results, but the performance metrics (sensitivity, specificity) are based on the device's output compared to a "clinical diagnosis" (ground truth), not on a human interpreting the device's output and then being compared to another human or an AI. The reproducibility study directly assesses the device's consistency of output.

    7. The type of ground truth used (expert consensus, pathology, outcomes data, etc.):
    * The ground truth for true positives was established by laboratory confirmation (culture, RIA, DFA or IFA) of Legionella pneumophila infection, coupled with a "Clinical Diagnosis." For other aspects like cross-reactivity and general specificity, it relied on "presumed negative" status or confirmation of other bacterial/fungal pneumonia or urinary tract infections.

    8. The sample size for the training set:
    * The document does not mention a training set. This is a point-of-care immunoassay, not a machine learning model, so the concept of a training set as used in AI/ML is not applicable here.

    9. How the ground truth for the training set was established:
    * Not applicable, as there is no training set mentioned for this type of device.

    Ask a Question

    Ask a specific question about this device

    Page 1 of 1