Search Results
Found 4 results
510(k) Data Aggregation
(262 days)
NOM
The MycoMEIA® Aspergillus Assay (MycoMEIA) is an enzyme immunoassay (EIA) for the in vitro qualitative detection of Aspergillus antigens in human urine from adults (>/= 18 years old) with suspected invasive aspergillosis (IA). The assay is not intended for use in lung transplant recipients. The results should be interpreted by trained healthcare professionals, incorporating other diagnostic procedures such as microbiological culture, histological examination of biopsy samples, and radiographic evidence to support the diagnosis of IA.
The MycoMEIA® Aspergillus Assay (MycoMEIA) is a sandwich enzyme immunoassay (EIA) that detects Aspergillus antigens in urine. The assay uses two mouse monoclonal antibodies that recognize galactofuranose (galf) epitopes. Both monoclonal antibodies are used to coat the wells of the microplate to bind the antigen, and to detect the antigen bound to the sensitized microplate as horseradish-peroxidase conjugates.
The design of the assay is in 96-well plates to enable large-volume testing in clinical laboratories.
Urine is first processed through Sample Processing Columns to eliminate an inhibitor of antibody-antigen recognition. The processed urine samples are added to the plate wells coated with the antibodies, incubated, and washed to remove unbound material. The bound antigen is incubated with antibodies linked to horseradish peroxidase and washed to remove the unbound material.
Next, the peroxidase substrate solution is added, which reacts with the complexes bound to the well to form a blue color reaction. The enzyme reaction is stopped by the addition of acid, which changes the blue color to yellow. The absorbance (optical density) of specimens and controls is determined with a spectrophotometer set at 450 and 620 nm wavelengths.
The amount of antigen in the clinical sample is determined by optical density (OD) using a spectrophotometer and interpreted as an OD index relative to the mean OD of a threshold control provided in the kit.
The MycoMEIA-ASP kit contains the following components:
- Microwell Plate
- Negative Control (NC) Sample (green)
- Threshold Control (TC) Sample (blue)
- Positive Control (PC) Sample (red)
- Conjugate (100X) (white)
- Conjugate Diluent (white)
- Chromogen Solution (yellow)
- Stop Solution (blue)
- Column Rinse
- Plate sealers
25X Concentrated Wash Solution and Sample Processing columns are required to perform the assay and are provided separately from the kit.
If a partial plate is used, empty ELISA plates to fill in the ELISA frame are available to customers as a separate product.
Each laboratory will be required to test positive and negative controls provided in the kit to confirm or authenticate the assay results and to determine the sample index factor that is calculated using the assay ODs. Calculations can be performed manually or using the WS001 MycoMEIA Calculation Worksheet, which is available separately.
The provided FDA 510(k) clearance letter and summary for the MycoMEIA Aspergillus Assay details the device's analytical and clinical performance. Here's a breakdown of the acceptance criteria and study information:
1. Table of Acceptance Criteria and Reported Device Performance
The document does not explicitly state formal "acceptance criteria" for clinical performance in a pass/fail manner. Instead, it presents the determined performance characteristics. For several analytical aspects, the criteria are implicitly defined by standard guidelines (e.g., CLSI EP17-A2 for LoD, CLSI EP05-A3 for precision and reproducibility).
Acceptance Criteria Category | Specific Metric (Implicit or Explicit) | Reported Device Performance |
---|---|---|
Analytical Sensitivity | Limit of Detection (LoD) | 3 ng/mL |
Precision (Repeatability) | MycoMEIA Positive Control OD CV | 5% |
MycoMEIA Positive Control IDX CV | 5% | |
Precision (Within-Lab) | MycoMEIA Positive Control OD CV | 9% |
MycoMEIA Positive Control IDX CV | 10% | |
Reproducibility (Overall) | MycoMEIA Positive Control OD CV | 13% |
MycoMEIA Positive Control Index CV | 13% | |
Interfering Substances | No interference at defined levels | Observed cross-reactivity with 10% v/v Plasma-Lyte A and certain high concentrations of other substances. |
Cross-Reactivity | No cross-reactivity with specified organisms | Observed cross-reactivity with Fusarium (8.80 x 10e5 CFU/mL). Also detected from clinical samples with histoplasmosis, blastomycosis, candidemia, streptococcus, rhinovirus/parainfluenzavirus, mixed bacterial infection, mixed GI complications, and disseminated fusariosis. |
Clinical Sensitivity (Per-Subject) | For proven & probable IA | 92.4% (95% CI 82.1-97.0%) |
Clinical Sensitivity (Per-Sample) | For proven & probable IA | 58.2% (95% CI 54.3-61.9%) |
Clinical Specificity (Prospective Study) | No IA, using Positive cutoff ≥ 0.6 | 86.1% (95% CI 75.7-92.5%) |
High-Dose Hook Effect | Absence of hook effect | No high-dose hook effect observed up to 1,000 ng/mL. |
2. Sample Size Used for the Test Set and Data Provenance
- Analytical Sensitivity (LoD): 60 determinations with low target analyte level replicates.
- Precision (Repeatability and Within-Laboratory): 80 replicates per sample (run twice daily for 20 days, by two operators, in duplicate). Samples included kit controls, contrived samples, and clinical sample pools.
- Reproducibility: 90 replicates per sample (run twice daily for 5 days, by two operators, in triplicate) across three sites. Samples included kit controls, contrived samples, and clinical sample pools.
- Interfering Substances: Endogenous and exogenous substances spiked into pooled healthy urine, and clinical samples from patients with known endogenous conditions.
- Cross-Reactivity (Microorganisms): Tested in duplicate (n=2) for each microorganism listed.
- Cross-Reactivity (Clinical Samples): Urine samples from people with various medical conditions, including fungal, viral, and bacterial infections.
- Specific numbers for each condition are listed in the summary (e.g., 1 with histoplasmosis, 2 with streptococcus, etc.).
- Additional cross-reactivity testing involved 21 subjects with documented bacterial pneumonia, 1 with mixed bacterial infection, 2 with mixed GI complications, 2 with histoplasmosis, 1 with blastomycosis, 1 with candidemia, and 1 with disseminated fusariosis.
- Clinical Performance:
- Archived, Retrospective Study: 475 samples collected from 290 subjects. 226 samples from 50 subjects with proven (n=3) or probable (n=47) IA.
- Prospective Study:
- Initiated with 210 consented subjects providing 254 urine samples during 213 suspected infection episodes.
- Excluded 34 lung transplant recipients, 2 pediatric subjects, 1 contaminated sample, 3 subjects without CT scans, and 4 subjects who received mold-active antifungal therapy.
- Final analysis: 166 subjects and 169 infectious episodes for specificity.
- "Possible" IA cases (n=106) were excluded from the analysis for specificity.
- 38 subjects were adjudicated as having no invasive fungal infection.
- 26 subjects were adjudicated as having mixed or other (non-IA) infections.
Data Provenance:
- Clinical Performance: Comprised of both archived, retrospective samples and prospectively collected samples.
- Cross-Reactivity, Interfering Substances, Analytical Sensitivity, Precision, Reproducibility: Laboratory-based studies using spiked samples, controls, and some clinical samples (origin of clinical samples not explicitly stated beyond "healthy urine" or "clinical samples from patients with known endogenous conditions" or "urine samples obtained from people with different medical conditions").
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications
- Clinical Performance (Prospective Study): Clinical diagnoses were adjudicated by "a reviewer who was blinded to MycoMEIA test results."
- Qualifications: The specific qualifications of this reviewer (e.g., specialty, years of experience) are not specified in the provided text.
4. Adjudication Method for the Test Set
- Clinical Performance (Prospective Study): The adjudication method involved "a reviewer who was blinded to MycoMEIA test results." The reviewer applied the 2020 EORTC/MSG diagnostic criteria to establish diagnoses of proven IA, probable IA, and possible IA.
- No specific multi-expert adjudication method (e.g., 2+1, 3+1) is mentioned.
5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done, and Effect Size of Human Improvement with AI vs. without AI Assistance
- The MycoMEIA Aspergillus Assay is an enzyme immunoassay (EIA), an in vitro diagnostic (IVD) device for detecting antigens.
- This is not an AI-powered device or imaging-based device that would involve human readers interpreting images with or without AI assistance.
- Therefore, an MRMC comparative effectiveness study involving human readers and AI assistance was not conducted, and such data is not applicable here.
6. If a Standalone (i.e., Algorithm Only Without Human-in-the-Loop Performance) Was Done
- This is an in vitro diagnostic assay, which intrinsically provides a standalone (assay-only) result (an index value). The device itself is the algorithm/assay.
- The clinical performance section (sensitivity and specificity tables) represents the standalone performance of the MycoMEIA assay in detecting Aspergillus antigens in urine.
- While results are "interpreted by trained healthcare professionals, incorporating other diagnostic procedures," the reported sensitivity and specificity values reflect the assay's direct performance against the established ground truth.
7. The Type of Ground Truth Used
- Clinical Performance: The ground truth for Invasive Aspergillosis (IA) was established using 2020 EORTC/MSG diagnostic criteria for proven and probable IA. This is a consensus-based diagnostic standard.
- Analytical Studies (LoD, Precision, Reproducibility, Interfering Substances, Cross-Reactivity): Ground truth was based on known concentrations of Aspergillus antigen, specific microorganisms, or specific interfering substances as used in controlled spiking experiments.
8. The Sample Size for the Training Set
- The provided document describes a 510(k) submission for a clinical assay. It details analytical and clinical performance studies, which serve as validation.
- Unlike machine learning or AI-based devices, traditional IVDs typically do not involve a distinct "training set" in the same sense. The assay's design and optimization (analogous to training) would have occurred during its development phase, but specific "training set" sample sizes are not applicable or provided in this context. The study data presented are for validation/testing.
9. How the Ground Truth for the Training Set Was Established
- As explained above, a distinct "training set" with established ground truth in the context of machine learning is not relevant for this traditional immunoassay device. The ground truth for validation data was established as per point 7.
Ask a specific question about this device
(412 days)
NOM
The Platelia™ Aspergillus EIA is an immunoenzymatic sandwich microplate assay for the detection of Aspergillus galactomannan antigen in adult and pediatric serum and Bronchoalveolar Lavage (BAL) fluid samples.
The Platelia™ Aspergillus EIA is a test which, when used in conjunction with other diagnostic procedures such as microbiological culture, histological examination of biopsy samples and radiographic evidence, can be used as an aid in the diagnosis of Invasive Aspergillosis.
The Platelia™ Aspergillus EIA is a one-stage immunoenzymatic sandwich microplate assay which detects galactomannan in human serum and BAL fluid samples. The assay uses rat EBA-2 monoclonal antibodies, which are directed against Aspergillus galactomannan, and have been characterized in previous studies. The monoclonal antibodies are used, (1) to coat the wells of the microplate and bind the antigen, and (2) to detect the antigen bound to the sensitized microplate reagent: peroxidase-linked monoclonal antibodies).
Serum or BAL fluid samples are heat-treated in the presence of EDTA in order to dissociate immune complexes and to precipitate proteins that could possibly interfere with the test. The treated samples and conjugate are added to the wells coated with monoclonal antibodies, and incubated. A monoclonal antibody - galactomannan monoclonal antibody / peroxidase complex is formed in the presence of galactomannan antigen.
The strips are washed to remove any unbound material. Next, the substrate solution is added, which will react with the complexes bound to the well to form a blue color reaction. The enzyme reaction is stopped by the addition of acid, which changes the blue color to yellow. The absorbance (optical density) of specimens and controls is determined with a spectrophotometer set at 450 and 620/630 nm wavelength.
Here's a breakdown of the acceptance criteria and the study that proves the device meets them, based on the provided text:
Device: Platelia™ Aspergillus EIA (Catalog 62793)
Intended Use: Immunoenzymatic sandwich microplate assay for the detection of Aspergillus galactomannan antigen in adult and pediatric serum and Bronchoalveolar Lavage (BAL) fluid samples, as an aid in the diagnosis of Invasive Aspergillosis when used with other diagnostic procedures.
1. Table of Acceptance Criteria and Reported Device Performance
The document does not explicitly state pre-defined acceptance criteria in terms of numerical thresholds for sensitivity and specificity. Instead, it presents the performance results. Assuming the "reported device performance" are the de facto acceptance criteria for this 510(k) submission, here are the key performance metrics:
Metric (Sample Type) | Acceptance Criteria (from study results) | Reported Device Performance |
---|---|---|
Serum Samples | ||
Sensitivity (Pediatric Patients) | 31.0-73.8% (95% CI for combined Proven & Probable) | 52.9% (9/17) |
Sensitivity (Adult Patients) | 61.6-90.2% (95% CI for combined Proven & Probable) | 79.3% (23/29) |
Specificity (Pediatric Patients) | 79.4-92.1% (95% CI for combined sites) | 87.0% (94/108) |
Specificity (Pediatric Samples) | 97.7-99.0% (95% CI for combined sites) | 98.5% (1600/1625) |
Specificity (Adult Patients) | 82.6-93.0% (95% CI for combined sites) | 88.8% (127/143) |
Specificity (Adult Samples) | 97.7-99.0% (95% CI for combined sites) | 98.5% (1243/1262) |
BAL Fluid Samples | ||
Sensitivity (SOT Recipients) | 56.5-100% (95% CI for combined P+P) | 100% (5/5) |
Sensitivity (Lung Transplant Recipients) | 30.0-90.3% (95% CI for combined P+P) | 66.7% (4/6) |
Sensitivity (Hematologic Disease Patients) | 90.8-99.7% (95% CI for combined P+P) | 98.3% (57/58) |
Specificity (Combined SOT & Lung Transplant Recipients, without colonization) | 94.3-98.2% (95% CI) | 96.8% (330/341) |
Specificity (Combined SOT & Lung Transplant Recipients, with colonization) | 69.1-88.6% (95% CI) | 80.6% (50/62) |
Specificity (Combined SOT & Lung Transplant Recipients, Total) | 91.6-96.2% (95% CI) | 94.3% (380/403) |
Specificity (Hematologic Disease Patients) | 66.0-89.8% (95% CI) | 80.5% (33/41) |
The acceptance criteria appear to be implicitly defined by the sponsor's demonstration of these performance characteristics, particularly with confidence intervals, which indicate variability.
2. Sample Size Used for the Test Set and Data Provenance
-
Serum Samples:
- Pediatric Patients: 1954 serum samples from 129 immunocompromised pediatric patients (age ≤ 21 years) at high risk for Invasive Aspergillosis (IA), covering those diagnosed with Proven and Probable IA and controls.
- Controls: 1625 serum samples from 108 pediatric patients.
- IA Diagnosed: 249 serum samples from 17 pediatric patients.
- Adult Patients: 1724 serum samples from 172 bone marrow transplant (BMT) and leukemic patients, covering those diagnosed with and without IA.
- Controls: 1262 serum samples from 143 adult patients.
- IA Diagnosed: 462 serum samples from 29 adult patients.
- Provenance: "three testing centers in the United States" for pediatric studies and "three testing centers in North America" for adult studies. The studies are described as clinical studies, implying prospective collection of samples related to patient diagnosis/monitoring.
- Pediatric Patients: 1954 serum samples from 129 immunocompromised pediatric patients (age ≤ 21 years) at high risk for Invasive Aspergillosis (IA), covering those diagnosed with Proven and Probable IA and controls.
-
BAL Fluid Samples:
- Study 1 (SOT & Lung Transplant): 449 BAL samples from 178 Solid Organ Transplant (SOT) and lung transplant recipients.
- Controls: 403 BAL samples from 167 SOT and lung transplant recipients (United States).
- IA Diagnosed (SOT): 5 recipients.
- IA Diagnosed (Lung): 6 recipients.
- Study 2 (Hematology Patients): 99 evaluable BAL samples from 99 high-risk hematology patients.
- IA Diagnosed: 58 patients.
- Controls: 41 patients.
- Provenance: Two studies from the "United States" (SOT & Lung Transplant) and one "retrospective analysis... from a study outside the United States" (Hematology Patients).
- Study 1 (SOT & Lung Transplant): 449 BAL samples from 178 Solid Organ Transplant (SOT) and lung transplant recipients.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications
The document does not specify the number or qualifications of experts used to establish the ground truth. It states that diagnoses of Invasive Aspergillosis (Proven or Probable) were defined by EORTC/NIAID definitions. This implies that the ground truth was established based on these standardized clinical and microbiological criteria, likely applied by clinical specialists at the participating sites, rather than an independent panel of experts reviewing cases.
4. Adjudication Method for the Test Set
The document does not describe a specific adjudication method (e.g., 2+1, 3+1) for establishing the ground truth. The reliance on EORTC/NIAID definitions suggests a criteria-based diagnosis rather than a read-by-committee adjudication process.
5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study
No, a Multi-Reader Multi-Case (MRMC) comparative effectiveness study was not done. The studies evaluate the performance of the device itself (standalone algorithm) against a clinical diagnosis (ground truth), not in a human-in-the-loop context or comparing human reader performance with and without AI assistance.
6. Standalone Performance Study
Yes, a standalone (algorithm only without human-in-the-loop performance) study was done. The entire performance evaluation section describes the sensitivity and specificity of the Platelia™ Aspergillus EIA (the device/algorithm) when tested against various patient samples. The results presented are exclusively based on the device's output (index values) compared to the patient's clinical diagnosis.
7. Type of Ground Truth Used
The ground truth used was clinical diagnosis based on established criteria, specifically the Invasive Fungal Infection Cooperative Group (IFICG) of the European Organization for Research and Treatment of Cancer (EORTC) and the Mycosis Study Group (MSG) of the National Institute of Allergy and Infectious Diseases (NIAID) definitions for Proven and Probable Invasive Aspergillosis. Controls were defined as patients without signs of Invasive Aspergillosis.
8. Sample Size for the Training Set
The document does not mention a separate training set or its sample size. The provided performance evaluation focuses entirely on the "test set" or clinical validation set. Based on the context, this device is a laboratory assay, not a machine learning algorithm requiring a distinct training phase in the same way an AI imaging algorithm might. The reproducibility studies detail the use of "panel members" which are likely used for internal quality control and assay validation, but not a "training set" in the context of developing an AI model.
9. How the Ground Truth for the Training Set Was Established
As no specific training set for an AI model is described, this question is not applicable. The device is a diagnostic assay, and its development would typically involve assay design, optimization, and analytical validation rather than an AI training process.
Ask a specific question about this device
(84 days)
NOM
The Platelia™ Aspergillus EIA is an immunoenzymatic sandwich microplate assay for the detection of Aspergillus galactomannan antigen in adult and pediatric serum samples.
The Platelia™ Aspergillus EIA is a test which, when used in conjunction with other diagnostic procedures such as microbiological culture, histological examination of biopsy samples and radiographic evidence, can be used as an aid in the diagnosis of Invasive Aspergillosis.
The Platelia™ Aspergillus EIA is a one-stage immunoenzymatic sandwich microplate assay which detects galactomannan in human serum. The assay uses rat EBA-2 monoclonal antibodies, which are directed against Aspergillus galactomannan, and have been characterized in previous studies 19,16. The monoclonal antibodies are used to coat the wells of the microplate and bind the antigen, and to detect the antigen bound to the sensitized microplate (conjugate reagent: peroxidase-linked monoclonal antibodies).
Serum samples are heat-treated in the presence of EDTA in order to dissociate immune complexes and to precipitate serum proteins that could possibly interfere with the test . The treated serum samples and conjugate are added to the wells coated with monoclonal antibodies, and incubated. A monoclonal antibody - galactomannan - monoclonal antibody / peroxidase complex is formed in the presence of galactomannan antigen. The strips are washed to remove any unbound material. Next, the substrate solution is added, which will react with the complexes bound to the well to form a blue color reaction. The enzyme reaction is stopped by the addition of acid, which changes the blue color to yellow. The absorbance (optical density) of specimens and controls is determined with a spectrophotometer set at 450 and 620/630 nm wavelength.
Here's a summary of the acceptance criteria and study details for the Bio-Rad Platelia™ Aspergillus EIA, extracted from the provided 510(k) summary:
Acceptance Criteria and Device Performance:
Performance Metric | Acceptance Criteria (Implied) | Reported Device Performance (Pediatric) | Reported Device Performance (Adult) |
---|---|---|---|
Sensitivity (Patients) | Sufficiently high to aid in diagnosis of Invasive Aspergillosis. | Combined Proven & Probable IA: | Combined Proven & Probable IA: |
52.9% (9/17) [95% CI: 31.0-73.8%] | 79.3% (23/29) [95% CI: 61.6-90.2%] | ||
Proven IA: 44.4% (4/9) | Proven IA: 81.8% (9/11) | ||
Probable IA: 62.5% (5/8) | Probable IA: 77.8% (14/18) | ||
Specificity (Patients) | Sufficiently high to minimize false positives, when used in conjunction with other diagnostic procedures. | 87.0% (94/108) [95% CI: 79.4-92.1%] | 88.8% (127/143) [95% CI: 82.6-93.0%] |
Specificity (Samples) | Sufficiently high to minimize false positives at the sample level. | 98.5% (1600/1625) [95% CI: 97.7-99.0%] | 98.5% (1243/1262) [95% CI: 97.7-99.0%] |
Positive Predictive Value (PPV) - Study Prevalence | (No explicit numerical criteria stated, expected to be clinically useful) | 39.1% [95% CI: 22.2-59.2%] | 59.0% [95% CI: 43.4-72.9%] |
Negative Predictive Value (NPV) - Study Prevalence | (No explicit numerical criteria stated, expected to be clinically useful) | 92.2% [95% CI: 85.3-96.0%] | 95.5% [95% CI: 90.5-97.9%] |
Positive Predictive Value (PPV) - 5% Prevalence | (No explicit numerical criteria stated, expected to be clinically useful) | 17.6% [95% CI: 6.5-39.8%] | 27.2% [95% CI: 13.7-46.7%] |
Negative Predictive Value (NPV) - 5% Prevalence | (No explicit numerical criteria stated, expected to be clinically useful) | 97.2% [95% CI: 92.1-99.1%] | 98.8% [95% CI: 95.4-99.7%] |
Reproducibility (Inter-assay & Intra-assay %CV) | (No explicit numerical criteria stated, expected to be acceptable for lab diagnostics) | Generally below 20-30% for most panels | (Assumed similar, studies were prior) |
Cross-Reactivity | No (or minimal) positive results with common interfering conditions. | 0 positives across 15 interfering conditions (10 samples/condition) | (Assumed similar, studies were prior) |
Note: The document implies acceptance criteria by presenting performance data within clinical contexts and stating that the device is "substantially equivalent" to a predicate device, which inherently means it meets similar performance standards.
Study Details:
-
Sample Sizes and Data Provenance (Test Set):
- Pediatric (new study for this submission):
- Total Patients: 129 immunocompromised pediatric patients.
- Total Samples: 1954 serum samples.
- Invasive Aspergillosis (IA) Patients: 17 (9 Proven, 8 Probable).
- Control/Non-IA Patients: 108 (from whom 1625 samples were tested).
- Data Provenance: United States (three testing centers).
- Retrospective/Prospective: Not explicitly stated, but the collection of patients diagnosed with IA and controls suggests it could be a mix or primarily retrospective given the diagnostic criteria often established over time.
- Adult (previously conducted study for K023857):
- Total Patients: 172 bone marrow transplant (BMT) and leukemic patients.
- Total Samples: 1724 serum samples.
- Invasive Aspergillosis (IA) Patients: 29 (11 Proven, 18 Probable).
- Control/Non-IA Patients: 143 (from whom 1262 samples were tested).
- Data Provenance: North America (three testing centers).
- Retrospective/Prospective: Not explicitly stated, likely retrospective as it refers to a "previously conducted" study with diagnosed patients.
- Pediatric (new study for this submission):
-
Number of Experts and Qualifications (Ground Truth for Test Set):
- The ground truth for Invasive Aspergillosis (IA) was established based on EORTC/NIAID definitions. These definitions are rigorous and rely on a combination of:
- Proven IA: Positive microbiological culture from a sterile site AND histopathological demonstration of fungal forms.
- Probable IA: At least one microbiological criterion AND one major or two minor clinical criteria.
- The document does not specify the number or qualifications of individual experts who applied these definitions to each patient/sample. It relies on the widely accepted, expert-consensus-derived EORTC/NIAID criteria.
- The ground truth for Invasive Aspergillosis (IA) was established based on EORTC/NIAID definitions. These definitions are rigorous and rely on a combination of:
-
Adjudication Method (Test Set):
- The document does not explicitly state an adjudication method (e.g., 2+1, 3+1) for establishing the ground truth of IA. The reliance on EORTC/NIAID definitions suggests a standardized, objective application of these criteria, which may involve review by treating clinicians or infectious disease specialists as part of the diagnostic process.
-
Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study:
- No, an MRMC comparative effectiveness study was not done. This device is an in-vitro diagnostic (IVD) assay designed to detect a biomarker (galactomannan antigen). Its performance is evaluated biochemically (sensitivity, specificity, reproducibility) rather than by human readers interpreting outputs, so a study comparing human reader performance with and without AI assistance is not applicable.
-
Standalone Performance Study (Algorithm Only):
- Yes, this is a standalone performance study of the diagnostic assay. The "Performance Evaluation Studies" sections detail the assay's sensitivity and specificity based on its direct measurements of galactomannan antigen in serum, independent of human interpretation or a human-in-the-loop scenario.
- The reproducibility and cross-reactivity studies also evaluate the algorithm's intrinsic performance.
-
Type of Ground Truth Used:
- The ground truth used was "Proven or Probable Invasive Aspergillosis" as defined by EORTC/NIAID definitions. This is a robust clinical standard for diagnosing IA, incorporating:
- Pathology: Histological examination of biopsy samples.
- Microbiological culture: Positive culture from sterile sites.
- Clinical evidence/outcomes data: Major/minor clinical criteria defined by the EORTC/NIAID.
- The ground truth used was "Proven or Probable Invasive Aspergillosis" as defined by EORTC/NIAID definitions. This is a robust clinical standard for diagnosing IA, incorporating:
-
Sample Size for the Training Set:
- The document does not explicitly describe a separate "training set" in the context of an algorithm that learns from data.
- This is an enzymatic immunoassay (EIA) kit, a traditional IVD device. The development and calibration of such a kit typically involve internal studies and optimization (analogous to "training" in AI), but these details are not provided as a distinct "training set" and "validation set" in the way they would be for a software algorithm. The performance evaluation discussed in the 510(k) is essentially the validation of the finalized assay itself.
-
How Ground Truth for the Training Set Was Established:
- As there isn't a traditional "training set" for an AI algorithm in this context, the question of its ground truth establishment is not directly applicable.
- For the initial development and optimization of the Platelia™ Aspergillus EIA (which would be analogous to "training"), the ground truth for positive and negative controls would have been established through well-characterized samples (e.g., purified galactomannan antigens, sera from confirmed IA patients, sera from healthy controls) using established reference methods and standards. However, these specific details for the "training" phase are not presented in this 510(k) summary.
Ask a specific question about this device
(177 days)
NOM
The Platelia® Aspergillus EIA is an immunoenzymatic sandwich microplate assay for the detection of Aspergillus galactomannan antigen in serum.
The Platelia® Aspergillus EIA is a test which, when used in conjunction with other diagnostic procedures such as microbiological culture, histological examination of biopsy samples and radiographic evidence, can be used as an aid in the diagnosis of invasive aspergillosis.
The Platelia Aspergillus EIA is a one-stage immunoenzymatic sandwich microplate assay which detects galactomannan in human serum. The assay uses the rat monoclonal antibody EBA-2, which is directed antibody is used: to coat the wells of the microplate and bind the antigen, and as the detector antibody in the conjugate reagent (peroxidase-linked monoclonal antibody).
Serum samples are heat-treated in the presence of EDTA in order to dissociate immune-complexes and to precipitate serum proteins that could possibly interfere with the test. The treated serum samples and conjugate are added to the wells coated with monoclonal antibody, and incubated. A monoclonal antibody - galactomannan - monoclonal antibody / peroxidase complex is formed in the presence of Aspergillus antigen. The strips are washed to remove any unbound material. Next, the substrate solution is added, which will react with the complexes bound to the well to form a blue color reaction. The enzyme reaction is stopped by the addition of acid, which changes the blue color to yellow. The optical absorbance of specimens and controls is determined with a spectrophotometer set at 450 and 620/630 nm wavelength.
Here's a breakdown of the acceptance criteria and the study details for the Bio-Rad Platelia® Aspergillus EIA, based on the provided text:
Acceptance Criteria and Reported Device Performance
The document does not explicitly state pre-defined "acceptance criteria" in terms of specific performance thresholds for sensitivity and specificity. Instead, these values are presented as the results of the clinical study. The reproducibility study, however, shows internal targets for coefficient of variation (%CV).
Metric | Acceptance Criteria (Implicit) | Reported Device Performance (Combined Sites) |
---|---|---|
Reproducibility | Low intra- and inter-assay variability (demonstrated by %CV) | %CVs range from 2.4% to 29.2% (depending on panel member and site) |
Cross-Reactivity | No cross-reactivity with tested interfering conditions | 0 positives in all 151 tested sera from various pathologies |
Sensitivity | Not explicitly stated as a target | 80.7% (Combined Proven and Probable Aspergillosis) |
Specificity | Not explicitly stated as a target | 89.2% (Combined sites, 148 control patients) |
Positive Predictive Value (PPV) | Not explicitly stated as a target, dependent on prevalence | 54.8% (at 14% prevalence) (68.3% after repeat testing) |
Negative Predictive Value (NPV) | Not explicitly stated as a target, dependent on prevalence | 96.6% (at 14% prevalence) (95.5% after repeat testing) |
Study Details
-
Sample sizes used for the test set and the data provenance:
- Clinical Testing (Test Set):
- Total Patients: 179
- Total Serum Samples: 1890
- Proven/Probable Invasive Aspergillosis Patients: 31 (528 serum samples)
- Control Patients (without IA): 148 (1362 serum samples)
- Data Provenance: Retrospective, collected from three sites in the U.S. and Canada.
- Reproducibility Study:
- Panel Samples: 6 pooled patient serum samples (1 negative, 1 low positive, 2 positive, 2 high positive).
- Replicates: 9 replicates per panel member at two sites, 6 replicates per panel member at a third site.
- Cross-Reactivity Study:
- Sera Tested: 151 sera from patients with various medical conditions.
- Clinical Testing (Test Set):
-
Number of experts used to establish the ground truth for the test set and the qualifications of those experts:
The document does not specify the exact number or qualifications of experts who established the ground truth. However, it explicitly states that the diagnostic criteria for Invasive Aspergillosis (IA) were based on the Invasive Fungal Infection Cooperative Group (IFICG) of the European Organization for Research (EORTC) and the Mycosis Study Group (MSG of the National Institute of Allergy and Infectious Diseases (NIAID) definitions. These are established, expert-driven criteria in the field. -
Adjudication method for the test set:
The document does not detail a specific adjudication method (e.g., 2+1, 3+1). The use of established IFICG/EORTC/NIAID definitions for "Proven" and "Probable" Invasive Aspergillosis implies a standardized diagnostic approach, which would inherently involve clinical judgment often involving multiple medical specialists (e.g., infectious disease specialists, pathologists, radiologists), but the process of arriving at these "ground truth" diagnoses for the study is not explicitly described as having a specific adjudication model. -
If a multi-reader multi-case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:
No. This study describes the performance of an immunoassay (Platelia Aspergillus EIA) for antigen detection, not an AI software or a device requiring human interpretation for image analysis or similar tasks. Therefore, an MRMC comparative effectiveness study involving human readers and AI assistance is not applicable and was not performed. -
If a standalone (i.e. algorithm only without human-in-the loop performance) was done:
Yes, this was a standalone performance study. The Platelia® Aspergillus EIA is an automated immunoassay that provides a quantitative index value. The reported sensitivity and specificity values are based solely on the output of this assay compared to the established ground truth, without human interpretation of the assay results impacting the "device performance" metrics themselves. Human interpretation would come into play when using the device in conjunction with other diagnostic procedures as per its intended use, but the reported performance here is of the assay itself. -
The type of ground truth used (expert consensus, pathology, outcomes data, etc.):
The ground truth for the clinical study was established using standardized definitions for Invasive Aspergillosis:- Proven Invasive Aspergillosis: Defined by positive microbiological culture obtained by sterile procedure from the affected site, AND histopathological demonstration of appropriate morphological forms in a host with symptoms.
- Probable Invasive Aspergillosis: Defined as at least one microbiological criterion, and one major or two minor clinical criteria from a site consistent with infection, in a host with symptoms.
- Control Patients: Patients without signs of Invasive Aspergillosis.
-
The sample size for the training set:
The document does not explicitly describe a separate "training set" for the device, as it is an immunoassay kit rather than a machine learning algorithm. The performance evaluation focuses on a "test set" to assess its diagnostic accuracy. The development of the assay itself (e.g., antibody selection, assay parameters) would involve internal validation and optimization, but this is distinct from the concept of a training set for an AI/ML model. -
How the ground truth for the training set was established:
As there is no described "training set" in the context of an AI/ML model, this question is not applicable. The assay's development would be based on biochemical and immunological principles, and calibration/validation would use characterized positive and negative controls.
Ask a specific question about this device
Page 1 of 1