Search Results
Found 9 results
510(k) Data Aggregation
(61 days)
VYSIS
The Vysis® AutoVysion™ System is an automated scanning microscope and image analysis system. It is intended for in vitro diagnostic use with the Vysis® PathVysion® HER-2 DNA Probe Kit to aid in the detection and enumeration of FISH signals in interphase nuclei. and to determine the LSI® HER-2 to CEP® 17 signal ratio of the HER-2/neu gene via FISH in formalinfixed, paraffin-embedded human breast cancer tissue specimens. The AutoVysion System is intended to reduce overall hands-on time by performing automated enumeration. For a small percentage of samples (less than 7%) manual enumeration may be required.
The Vysis® AutoVysion™ System is an adjunctive computer-assisted methodology to assist in the acquisition and measurement of images from microscope slides of formalin-fixed, paraffin-embedded breast cancer tissue sections for the presence of amplified HER-2/neu gene. The Vysis® AutoVysion™ System is intended for use as aid in determining HER-2/neu amplification status. in coniunction with optional manual visualization directly through the fluorescence microscope.
When used with the Vysis® PathVysion® HER-2 DNA Probe Kit, the Vysis® AutoVysion™ System is indicated for use as
a) an adjunct to existing clinical and pathologic information currently used as prognostic factors in stage II, node-positive breast cancer patients
b) an aid to predict disease-free and overall survival in patients with stage II. node positive breast cancer treated with adjuvant cyclophosphamide, doxorubicin and 5-fluorouracil (CAF) chemotherapy; and,
c) aid in the assessment of patients for whom HERCEPTIN® (Trastuzumab) treatment is being considered (see HERCEPTIN package insert).
The Vysis® AutoVysion™ System consists of an automated fluorescence microscope with motorized scanning stage, a large-format monochrome CCD camera, computer and scanning and assay specific analysis software. The microscope is equipped with a mercury arc lamp for fluorescence epi-illumination; three single-pass fluorescence filter sets for DAPI, SpectrumGreen™ (SG) and SpectrumOrange™ (SO) and a triple-pass fluorescence filter set for DAPI/SG/SQ, all mounted in a motorized filter turret; 10x and 40x objectives in a motorized objective turret; 10x eyepieces; a CCD camera; and a motorized scanning stage that holds up to 8 slides. Images of single fluorescence colors are captured by the CCD camera and transferred to the computer. All functions are controlled by the System software.
Here is a summary of the acceptance criteria and the study proving the device meets them, based on the provided text:
1. Table of Acceptance Criteria and Reported Device Performance
Acceptance Criteria Category | Specific Metric | Acceptance Criteria (Implicit) | Reported Device Performance |
---|---|---|---|
Reproducibility | Day-to-day LSI HER-2/neu to CEP 17 ratio variability | No statistically significant differences in variance across study days (p-value > 0.05 for Levene's test). | All p-values for Levene's test (testing homogeneity of day-to-day variances) were > 0.05, indicating no statistically significant differences. CVs ranged from 5.12% to 29.34%. (Note: For one data point, SD and %CV were "NR" - Not Reported). |
Reproducibility | Inter-site LSI HER-2/neu to CEP 17 ratio variability | No statistically significant differences in variance across study sites. | All p-values for inter-site reproducibility were > 0.05, indicating no statistically significant differences. CVs ranged from 1.02% to 31.23%. (Note: For one data point, SD and %CV were "NR" - Not Reported). |
Method Comparison | Overall Concordance with Manual Enumeration | High agreement with manual enumeration. (Specific numerical threshold not explicitly stated but implied by "correctly classified"). | 92.5% (196/212) overall agreement for all informative results. If equivocal range (1.5-3.0) excluded, total agreement was 98.8% (169/171). |
Method Comparison | Positive Agreement with Manual Enumeration | High positive agreement. | 96.0% positive agreement for all informative results. If equivocal range excluded, 100% positive agreement. |
Method Comparison | Negative Agreement with Manual Enumeration | High negative agreement. | 89.2% negative agreement for all informative results. If equivocal range excluded, 97.5% negative agreement. |
Method Comparison | Bias relative to Manual Enumeration (1.18-4.49 ratio) | Average bias within ±15% of the average manual enumeration ratio in this range (as per NCCLS guideline EP9-A2). | Average bias was 0.472 (SD = 1.24), which is 11.7% of the average manual enumeration ratio (4.05). This met the acceptable error of ±15%. |
Re-tests of Discrepancies | Consistency for initial "false positives" | Repeat tests should demonstrate consistency, indicating the initial discrepancy might be due to variability rather than systematic error. | Two "false positive" results by AutoVysion™ were re-tested six times manually and by the scanner. Both methods (manual and scanner) gave positive results in five of the six repeats for these two samples, suggesting consistency on re-testing. |
2. Sample Size Used for the Test Set and the Data Provenance
- Reproducibility Test Set: 36 specimen slides prepared from four human breast tissue specimens (one normal, one borderline, one moderate, one high amplification). Each site received three of each specimen randomized over three days.
- Method Comparison Test Set: 234 clinical slides from 39 tumors with varying levels of HER-2/neu copy number.
- Data Provenance: Not explicitly stated, but it conducted at "3 clinical sites" and refers to "clinical slides from 39 tumors," implying a source from a clinical setting. It is a retrospective analysis in the sense that the slides were prepared "prior to shipment to the study sites" and then retrospectively analyzed using both methods. However, the exact country of origin or broader demographic information is not provided.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and the Qualifications of Those Experts
- For the reproducibility and method comparison studies, the "ground truth" or reference method was conventional manual microscopy performed in accordance with Vysis® PathVysion® HER-2 DNA Probe Kit.
- The study states: "A qualified user visually inspects the tumor regions...identifies areas of tumor invasion...and records the coordinates." and "Final review and reporting of sample results is performed by a qualified user."
- It also states that the predicate method was "manual microscopy performed in accordance with Vysis® PathVysion® HER-2 DNA Probe Kit." This implies that the standard manual reading by trained personnel using the established kit constitutes the reference.
- The number of experts/manual readers for the comparison is not explicitly given, but it implies standard clinical practice where at least one "qualified user" would perform the manual enumeration. For the "two false positive results," the "manual" repetition implies multiple manual reads.
- Qualifications of experts: Described as "qualified user" or standard manual enumeration. Specific qualifications (e.g., "radiologist with 10 years of experience") are not provided.
4. Adjudication Method for the Test Set
- No formal adjudication method (e.g., 2+1, 3+1) is explicitly described for the initial ground truth establishment. The "ground truth" is defined by the results of "conventional manual microscopy performed in accordance with Vysis® PathVysion® HER-2 DNA Probe Kit." This suggests a single or standard manual read serves as the reference.
- For the two "false positive" discrepancies, a re-testing protocol was used where samples were "repeated six times manually and by the scanner," which could be considered a form of informal adjudication/re-evaluation for specific discrepant cases.
5. If a Multi Reader Multi Case (MRMC) Comparative Effectiveness Study was Done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance
- No, a MRMC comparative effectiveness study was not performed in the context of human readers improving with AI vs without AI assistance.
- This study is a standalone performance study that compares the automated system's performance directly against the manual enumeration (the gold standard at the time).
- The device is described as an "adjunctive computer-assisted methodology to assist in the acquisition and measurement of images...in conjunction with optional manual visualization directly through the fluorescence microscope." However, the study presented compares the automated system's result to manual enumeration rather than measuring how human performance changes when using the system as an aid.
6. If a Standalone (i.e. algorithm only without human-in-the loop performance) was done
- Yes, a standalone performance study was done. The "Method comparison" section directly compares the "Vysis® AutoVysion™ System produced HER-2 to CEP 17 signal ratio" to "manually enumerated... HER-2 to CEP 17 signal ratio."
- The system operates "fully automatically" once target areas are identified by a user, then "hybridization signals in each area are detected and enumerated automatically." Final review and reporting are performed by a qualified user, but the core enumeration is automated. The performance metrics reported (concordance, agreement, bias) are for this standalone automated enumeration process compared to manual.
7. The Type of Ground Truth Used (expert consensus, pathology, outcomes data, etc.)
- The ground truth used was expert manual enumeration (or "conventional manual microscopy") following the Vysis® PathVysion® HER-2 DNA Probe Kit protocol. This is considered the established clinical method for determining HER-2/neu amplification status at the time.
8. The Sample Size for the Training Set
- The document does not specify the sample size for the training set for the AutoVysion™ System. It only describes the test sets used for analytical performance evaluations.
9. How the Ground Truth for the Training Set Was Established
- The document does not describe how the ground truth for any potential training set was established. It focuses solely on the validation/performance evaluation of the already developed system.
Ask a specific question about this device
(30 days)
VYSIS
The UroVysion Bladder Cancer Recurrence Kit (UroVysion Kit) is designed to detect aneuploidy for chromosomes 3, 7, 17, and loss of the 9p21 locus via fluorescence in situ hybridization (FISH) in urine specimens from subjects with transitional cell carcinoma of the bladder. Results from the UroVysion Kit are intended for use as a noninvasive method for monitoring for tumor recurrence in conjunction with cystoscopy in patients previously diagnosed with bladder cancer.
The UroVysion Kit is based upon fluorescence in situ hybridization (FISH) DNA probe technology. The UroVysion probes are fluorescently labeled nucleic acid probes for use in in situ hybridization assays on urine specimens fixed on slides. The UroVysion Kit consists of a 4-color, four-probe mixture of DNA probe sequences homologous to specific regions on chromosomes 3, 7, 9, and 17. The UroVysion probe mixture consists of Chromosome Enumeration Probe (CEP®) 3 SpectrumRed™, CEP 7 SpectrumGreen™, CEP 17 SpectrumAqua™ and Locus Specific Identifier (LSI®) 9p21 SpectrumGold™.
Here's an analysis of the acceptance criteria and the study that proves the UroVysion Bladder Cancer Recurrence Kit meets those criteria, based on the provided text:
1. Table of Acceptance Criteria and Reported Device Performance
The document doesn't explicitly state quantitative acceptance criteria in a dedicated section. However, based on the "Substantial Equivalence vs. BTAstat Test" section, the key performance metric for substantial equivalence appears to be that the 95% Confidence Intervals (CIs) for UroVysion's agreement percentages (positive, negative, and overall) are greater than the BTAstat test's scores minus 15%.
For other aspects, the "acceptance criteria" are implied by the reported performance deemed satisfactory for marketing authorization.
Criteria Category | Acceptance Criteria (Implied/Derived) | Reported Device Performance |
---|---|---|
Hybridization Efficiency | ≥ 87% (for clinical practice simulation) | 87% (clinical study) |
Analytical Specificity | No cross-hybridization to other chromosome loci | 100% (No cross-hybridization observed in 42 metaphase spreads) |
Interference | No interference from tested substances/microbes/therapeutic agents | No interference detected from any tested substance |
Preservative Equivalence | Acceptable microbial inhibition; average percent variation of signals per nucleus 95% accurate) | Mean signal numbers vary within a narrow range; 95% of observations on specimen 2 correctly classified as 9p21 loss; 1 false positive out of 16 normal specimen evaluations |
Specificity (Non-cancer pts) | Overall specificity considered high (e.g., >90%) | Overall Specificity: 93.0% (332/357), Unique Patients: 94.5% (260/275) |
Positive Agreement vs. SOCO | 95% CI > BTAstat score - 15% | 95% CI for UroVysion positive agreement (58.1%-81.8%) > BTAstat positive agreement (50.0%) - 15% (35.0%) |
Negative Agreement vs. SOCO | 95% CI > BTAstat score - 15% | 95% CI for UroVysion negative agreement (56.3%-74.4%) > BTAstat negative agreement (69.3%) - 15% (54.3%) |
Overall Agreement vs. SOCO | 95% CI > BTAstat score - 15% | 95% CI for UroVysion overall agreement (60.2%-74.5%) > BTAstat overall agreement (62.5%) - 15% (47.5%) |
Longitudinal Study (Recurrence) | Statistically significant difference in recurrence rate between FISH+/cysto:histo- and FISH-/cysto:histo- groups | Significant difference (p=0.014) observed: 41.7% recurrence in FISH+/cysto:histo- vs. 19.1% in FISH-/cysto:histo- |
Automated System Equivalence | Equivalent results with manual vs. semi-automated methods | All tested compounds and preservatives performed within 2 standard deviations of controls, supporting equivalence |
2. Sample Size Used for the Test Set and Data Provenance
- Specificity Study (Non-cancer patients):
- Sample Size: 315 patient visits initially, resulting in 309 usable office visits and ultimately 275 unique patients yielding informative results. The data points used for specificity calculation totaled 357 (some patients had multiple conditions).
- Data Provenance: Multi-center, prospective study. Patients were "healthy volunteers and urology patients without prior history or clinical evidence of bladder cancer." (implicitly from the US, given FDA submission context).
- Performance vs. Standard of Care (Bladder cancer recurrence monitoring):
- Sample Size: 309 patient visits initially, resulting in 251 usable office visits and 176 unique patients with informative FISH results.
- Data Provenance: Multi-center, prospective, longitudinal study. Patients had a "history of bladder cancer." (implicitly from the US, given FDA submission context).
- Reproducibility: 4 specimens from bladder carcinoma cell lines.
- Interference/Preservative: Three voided urine pools from normal healthy volunteers, spiked with various substances.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts
The document does not explicitly state the number of experts used to establish the ground truth or their specific qualifications (e.g., "radiologist with 10 years of experience").
- For the Performance vs. Standard of Care study, the comparative reference was "cystoscopy followed by histology." Histology is typically interpreted by pathologists. The document mentions "central pathologist" in the longitudinal study details (Page 18), but doesn't specify how many or their experience level.
4. Adjudication Method for the Test Set
The document does not explicitly detail an adjudication method (e.g., 2+1, 3+1) for the ground truth establishment.
- For the "Performance vs. Standard of Care" study:
- "The comparative reference used for all percent agreement calculations was cystoscopy with histology confirmation for positive or suspicious cystoscopies."
- "If a patient had a positive cystoscopy but histology was absent (e.g., the lesion was fulgurated), then the specimen was considered positive for bladder cancer."
- "If a test had a suspicious cystoscopy but histology was absent, then the case was omitted from analysis."
This indicates a defined hierarchy and decision rule for establishing the ground truth (cystoscopy + histology).
5. Multi Reader Multi Case (MRMC) Comparative Effectiveness Study
A MRMC study was not explicitly done comparing human readers with and without AI assistance, because the device is a Fluorescence in situ hybridization (FISH) DNA probe technology, not an AI-assisted diagnostic tool.
However, the study did compare the UroVysion Kit's performance to two other human-interpreted methods:
- BTAstat test (lateral flow assay, antigen-specific antibodies, qualitative interpretation)
- Cytology (visual interpretation of cells)
The study demonstrated the superiority of the UroVysion Kit over BTAstat and cytology, particularly in agreement of positive results across various tumor stages and grades. For example:
- Overall Agreement of (+) Results:
- UroVysion: 71.0%
- BTAstat: 50.0%
- Cytology: 26.2%
- For patients treated with BCG:
- UroVysion: 92.3%
- BTAstat: 69.2%
- Cytology: 30.8%
The basis for substantial equivalence was to demonstrate that the UroVysion Kit's 95% CIs for agreement were greater than the BTAstat test's score minus 15%, which it met across positive, negative, and overall agreement categories. This showcases a significant effectiveness improvement compared to a legally marketed predicate directly by the device itself, rather than human readers improving with AI assistance.
6. Standalone (Algorithm Only Without Human-in-the-Loop Performance) Study
The UroVysion Kit is a FISH assay that involves human visual interpretation by an analyst to recognize fluorescent signals. Therefore, its performance is inherently human-in-the-loop, and a standalone (algorithm only) performance study, in the context of AI, is not applicable. The detection relies on DNA probes and fluorescence, with an analyst visually counting signals, rather than an automated algorithm making the final call.
7. Type of Ground Truth Used
- Specificity Study: Ground truth was "healthy volunteers and urology patients without prior history or clinical evidence of bladder cancer."
- Performance vs. Standard of Care Study: Ground truth for bladder cancer recurrence was established by cystoscopy followed by histology confirmation. If cystoscopy was positive but histology was absent (e.g., lesion fulgurated), it was considered positive. Suspicious cystoscopies without histology were omitted. This can be categorized as a form of clinical outcome/pathology-confirmed diagnosis.
- Reproducibility and Analytical Specificity: Used cultured human bladder carcinoma cell lines (positive target) and normal lymphoblast cell lines (negative target), and metaphase spreads for structural analysis.
8. Sample Size for the Training Set
The document describes premarket clinical studies and does not refer to a "training set" in the context of machine learning. The studies are for device validation.
9. How the Ground Truth for the Training Set Was Established
As there is no mention of a "training set" for an AI algorithm, this question is not applicable to the provided document. The studies describe validation of a diagnostic kit based on established biological principles (FISH technology).
Ask a specific question about this device
(86 days)
VYSIS
The UroVysion Bladder Cancer Recurrence Kit (UroVysion Kit) is designed to detect aneuploidy for chromosomes 3, 7, 17, and loss of the 9p21 locus via fluorescence in situ hybridization (FISH) in urine specimens from subjects with transitional cell carcinoma of the bladder. Results from the UroVysion Kit are intended for use as a noninvasive method for monitoring for turnor recurrence in conjunction with cystoscopy in patients previously diagnosed with bladder cancer.
The UroVysion Kit is based upon fluorescence in situ hybridization (FISH) DNA probe technology. The UroVysion probes are fluorescently labeled nucleic acid probes for use in in situ hybridization assays on urine specimens fixed on slides. . The UroVysion Kit consists of a 4-color, four-probe mixture of DNA probe sequences homologous to specific regions on chromosomes 3, 7, 9, and 17. The UroVysion probe mixture consists of Chromosome Enumeration Probe (CEP®) 3 SpectrumRed™, CEP 7 SpectrumGreen™, CEP 17 SpectrumAqua™, and Locus Specific Identifier (LSI®) 9p21 SpectrumGold TM .
The UroVysion Bladder Cancer Recurrence Kit is intended for use as a noninvasive method for monitoring for tumor recurrence in conjunction with cystoscopy in patients previously diagnosed with bladder cancer. The study demonstrated that the device is substantially equivalent to the predicate device, the Bard® (Bion) BTAstat™ Test, and meets the acceptance criteria for specificity and performance compared to the standard of care (cystoscopy/histology).
Acceptance Criteria and Reported Device Performance
Acceptance Criteria | Reported Device Performance |
---|---|
Specificity | Overall Specificity: 93.0% (332/357), with 95% CI not provided, but based on a multi-center, prospective study of healthy volunteers and urology patients without a history of bladder cancer. |
Specificity for unique patients: 94.5% (260/275). | |
Performance vs. Standard of Care | Overall Agreement with Cystoscopy/Histology: |
Agreement of (+) results: 71.0% (95% CI = 58.1% - 81.8%) | |
Agreement of (-) results: 65.8% (95% CI = 56.3% - 74.4%) | |
Overall Agreement: 67.6% (95% CI = 60.2% - 74.5%) | |
(+) Predictive Value: 53.0% (95% CI = 41.7% - 64.1%) | |
(-) Predictive Value: 80.6% (95% CI = 71.1% - 88.1%) | |
Performance in patients on BCG therapy within 3 months: | |
Agreement of (+) results: 92.3% (95% CI = 64.0% - 99.8%) | |
Agreement of (-) results: 61.5% (95% CI = 40.6% - 79.8%) | |
Substantial Equivalence (vs. BTAstat) | The 95% CIs for UroVysion's Agreement (+), Agreement (-), and Overall Agreement were all greater than the BTAstat scores minus 15%. |
UroVysion Agreement (+): 58.1% (lower 95% CI) vs. BTAstat - 15%: 35.0% | |
UroVysion Agreement (-): 56.3% (lower 95% CI) vs. BTAstat - 15%: 54.3% | |
UroVysion Overall Agreement: 60.2% (lower 95% CI) vs. BTAstat - 15%: 47.5% | |
For patients on BCG therapy within 3 months: | |
UroVysion Agreement (+): 64.0% (lower 95% CI) vs. BTAstat - 15%: 54.2% | |
UroVysion Agreement (-): 40.6% (lower 95% CI) vs. BTAstat - 15%: 27.3% | |
UroVysion Overall Agreement: 55.1% (lower 95% CI) vs. BTAstat - 15%: 36.3% | |
Hybridization Efficiency | ≥87% in conditions simulating clinical practice (observed: 87% in clinical study, 92.7% in specificity study using patient urine). |
Analytical Specificity | No cross-hybridization to other chromosome loci observed (limited to intended target regions). |
Interference | No interference detected from any of the numerous substances tested at high concentrations. |
Reproducibility | Mean number of signals for each probe varied within a narrow range with acceptable %CVs (e.g., for CEP 3: 6.79% in Specimen 1, 2.49% in Specimen 2). No false negative results in bladder carcinoma cell line study (48/48 classified positive). One false positive out of 16 normal specimen evaluations. Informative results in 95.0% (76/80) of specimens on the first attempt using cell lines. |
Longitudinal Study | Statistical difference in recurrence rates (p=0.014) between FISH+/cysto:histo- group (41.67% recurrence) and FISH-/cysto:histo- group (19.12% recurrence). |
Study Information
-
Sample size used for the test set and the data provenance:
- Specificity Study: 309 usable office visits (resulting in 357 data points due to patients having multiple conditions) from healthy volunteers and urology patients without a prior history or clinical evidence of bladder cancer. This was a multi-center, prospective study. The country of origin is not explicitly stated but implies US clinical sites due to FDA submission.
- Performance vs. Standard of Care Study: 251 usable office visits (representing 176 unique patients) from patients with a history of bladder cancer. This was a multi-center, prospective, longitudinal study conducted at 21 investigation sites. The country of origin is not explicitly stated but implies US clinical sites.
- Reproducibility (Cell Lines): 80 specimens prepared from human bladder carcinoma cell lines.
- Interference Study: Three voided urine pools from normal healthy volunteers, spiked with 29 different substances.
- HYBrite/VP 2000 Validation: Three human urine pools from normal donors.
-
Number of experts used to establish the ground truth for the test set and the qualifications of those experts:
- The document implies that the "standard of care" (cystoscopy with histology confirmation) was the ground truth. While no specific number of experts is given for the histological analysis, it is implicitly performed by qualified pathologists, which is standard practice for histology confirmation. No specific qualifications (e.g., 10 years of experience) are provided for these pathologists.
-
Adjudication method for the test set:
- For the "Performance vs. Standard of Care" study, the comparative reference for all percent agreement calculations was cystoscopy with histology confirmation for positive or suspicious cystoscopies.
- If a patient had a positive cystoscopy but histology was absent (e.g., lesion fulgurated), the specimen was considered positive for bladder cancer.
- If a test had a suspicious cystoscopy but histology was absent, the case was omitted from analysis.
- This indicates a hierarchical adjudication or ground truth definition rather than a consensus among multiple readers of the test device's results.
-
If a multi-reader multi-case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:
- No MRMC comparative effectiveness study involving human readers and AI assistance was conducted. The device is a diagnostic kit (FISH probes), and its interpretation relies on visual recognition by an analyst. The studies compare the UroVysion kit's performance against the standard of care (cystoscopy/histology) and the predicate device (BTAstat), and there is no mention of AI.
-
If a standalone (i.e. algorithm only without human-in-the-loop performance) was done:
- The UroVysion Kit requires visual analysis by an analyst to recognize fluorescent signals on chromosomes. Therefore, this is not a standalone algorithm-only device. The "analyst visually recognizes chromosomes" (page 1) indicating human-in-the-loop performance.
-
The type of ground truth used (expert consensus, pathology, outcomes data, etc.):
- Pathology/Outcomes Data: The primary ground truth for the "Performance vs. Standard of Care" study was cystoscopy with histology confirmation. For cases where biopsy was not performed but cystoscopy was positive, it was still considered positive. The longitudinal study also used recurrence confirmed by cystoscopy/histology as an outcome.
-
The sample size for the training set:
- The document does not explicitly describe a "training set" in the context of machine learning. The studies described are for validation/testing of the UroVysion Kit itself. The device is a FISH-based diagnostic kit, not an AI/ML algorithm that undergoes a distinct training phase with a labeled dataset. Its "training" would align more with its development and optimization, rather than a quantifiable dataset used for algorithm training.
-
How the ground truth for the training set was established:
- As there is no explicit "training set" for an AI/ML algorithm described, this question is not directly applicable. The performance of the UroVysion Kit itself (hybridization efficiency, specificity, etc.) was established through laboratory tests and clinical studies, where outcomes like histology served as the reference standard.
Ask a specific question about this device
(120 days)
VYSIS
Ask a specific question about this device
(72 days)
VYSIS
Ask a specific question about this device
(132 days)
VYSIS
The AneuVysion™ (CEP 18, X, Y-alpha satellite, LSI 13 and 21) Multicolor Probe Panel is intended to use CEP 18/X/Y probe to detect alpha satellite sequences in the centromere regions of chromosomes 18, X, and Y, and LSI 13/21 probe to detect the 13q14 region and the 21q22.13 to 21q22.2 region. The AneuVysion™ kit is indicated for use as an adjunct to standard cytogenetic metaphase analysis for identifying and enumerating chromosomes 13, 18, 21, X, and Y via fluorescence in situ hybridization (FISH) in metaphase cells and interphase nuclei obtained from amniotic fluid in subjects with presumed high risk pregnancies. It is not intended to be used as a stand alone assay for test reporting. FISH results are intended to be reported and interpreted only in conjunction with results of standard cytogenetic analysis, performed concurrently, utilizing the same patient specimen. FISH results should not be reported prior to standard cytogenetic results except in instances where reporting of FISH results alone is medically indicated or standard cytogenetic results are not available, e.g., culture failure. Reporting and interpretation of FISH should be consistent with professional standards of practice! This device is intended for use only with amniocyte cells; it is not intended for and has not been validated for use with other test matrices. This FISH assay will not detect the presence of structural chromosome abnormalities frequently associated with birth defects. This FISH assay will be performed in cytogenetics laboratories.
The AneuVysion™ kit is a combination of two DNA probe mixtures; CEP 18/X/Y and LSI 13/21. The CEP 18/X/Y probe is a mixture of directly labeled fluorescent DNA probes specific for the D18Z1, DXZ1 and DYZ3 regions of chromosomes 18, X, and Y respectively. The LSI 13/21 probe contains a mixture of unique DNA sequences that hybridize in the 13q14 region of chromosome 13, and unique DNA sequences complementary to the D21S259, D21S341, and D21S342 loci contained within the 21q22.13 to 21q22.2 region on the long arm of chromosome 21. The LSI 13 probe was created from a set of overlapping clones which contain the entire RB-1 gene as well as regions extending beyond the gene on both sides. The probe extends beyond the 180 kb RB-1 gene for 110-170 kb in the 5' direction and approximately 120 kb in the 3' direction; the entire probe is 410-470 kb. CEP 18/X/Y is an aqua, green, and orange tri-color probe mixture and LSI 13/21 is a green and orange dual-color probe mixture.
Table of Acceptance Criteria and Reported Device Performance
Performance Metric | Acceptance Criteria | Reported Device Performance |
---|---|---|
Hybridization Efficiency |
Ask a specific question about this device
(502 days)
VYSIS
This assay is designed to provide a reliable method for the simultaneous detection and enumeration of X and Y chromosomes in interphase nuclei and metaphase spreads in bone marrow by fluorescence in situ hybridization (FISH).
The CEP X/Y probe is a combination of CEP X SpectrumOrange and CEP Y SpectrumGreen continuous DNA probes for the centromeric region of chromosome X and the satellite III DNA at the Yq12 region of chromosome Y.
Here's a breakdown of the acceptance criteria and study details for the CEP X SpectrumOrange/Y SpectrumGreen DNA Probe Kit, based on the provided text:
1. Table of Acceptance Criteria and Reported Device Performance
Acceptance Criteria | Reported Device Performance |
---|---|
Hybridization Efficiency: |
Ask a specific question about this device
(174 days)
VYSIS
The CEP 12 SpectrumOrange Direct Labeled Chromosome Enumeration DNA Probe Kit is designed to be an adjunct to standard cytogenetic analysis for in vitro diagnostic use in identifying and enumerating chromosome 12 via fluorescence in situ hybridization (FISH) in interphase nuclei of cells obtained from peripheral blood lymphocytes in patients with chronic lymphocytic leukemia (CLL). Results from the CEP 12 SpectrumOrange Direct Labeled Chromosome Enumeration DNA Probe Kit are intended for use in conjunction with standard cytogenetics and for further assessing the trisomy 12 status in normal and abnormal tissue specimens characterized by standard cytogenetics, in patients with and/or without clinical symptoms of CLL. It is not intended to be a stand alone assay for test reporting.
The CEP 12 SpectumOrange DNA Probe is a SpectumOrange fluorescent labeled DNA probe specific for the centromeric region of chronosome 12. This assey is designed IDN provide a rapid and reliable method for the desertion and quantification of chromosome 12 In interphase nuclei by fluorescence in situ hybridization (FISH).
Here's a breakdown of the acceptance criteria and study information for the CEP 12 SpectrumOrange DNA Probe Kit, based on the provided text:
Acceptance Criteria and Reported Device Performance
Acceptance Criteria Category | Specific Metric | Acceptance Standard | Reported Device Performance |
---|---|---|---|
Hybridization Efficiency | Percentage of cells with no hybridization signal | ≤ 2% (realistic standard) | Average of 0.43% (S.D.=1.48%) on 402 peripheral blood specimens. |
Analytical Sensitivity | Limit of Detection (LOD) | 4.0% (estimated) | 0% specimen estimated with mean 1.72%. Slight overlap with 5% specimen (upper 95% CI for 0% was 3.86%, lower 95% CI for 5% was 2.93%). |
Analytical Specificity | Cross-hybridization to other loci | No cross-hybridization to other chromosomes | No cross-hybridization observed in any of the 56 metaphase spreads examined. Hybridization was limited to chromosome 12 centromere. |
Reproducibility | Intra-assay variation (CV) for 0% specimen | Not explicitly stated as a numerical acceptance criterion, but implicitly expected low CV. | CV of 63.1% for 0% specimen (Mean=1.72%, SD=1.09%, N=22). |
Intra-assay variation (CV) for 5% specimen | Not explicitly stated as a numerical acceptance criterion. | CV of 20.4% for 5% specimen (Mean=4.87%, SD=0.99%, N=23). | |
Intra-assay variation (CV) for 10% specimen | Not explicitly stated as a numerical acceptance criterion. | CV of 19.4% for 10% specimen (Mean=9.19%, SD=1.78%, N=23). | |
Intra-assay variation (CV) for 13% specimen | Not explicitly stated as a numerical acceptance criterion. | CV of 13.3% for 13% specimen (Mean=12.07%, SD=1.61%, N=24). | |
Inter-site/inter-observer variation | Expected to be acceptable reflecting visual enumeration | "significant site-to-site and observer-to-observer variations were observed, reflecting the subjectivity of the visual enumeration process." | |
Clinical Sensitivity | Relative Sensitivity | Not explicitly stated as a numerical acceptance criterion, but expected high. | 100% (95% CI 91.2% to 100%) compared to standard cytogenetics. |
Clinical Specificity | Relative Specificity | Not explicitly stated as a numerical acceptance criterion, but expected high. | 91.47% (95% CI 86.66% to 96.22%) compared to standard cytogenetics. |
Study Details
2. Sample Size Used for the Test Set and Data Provenance:
- Pivotal Study (Hybridization Efficiency): 402 peripheral blood specimens.
- Analytical Specificity: 56 metaphase spreads.
- Reproducibility Study:
- 0% specimen: 22 replicates
- 5% specimen: 23 replicates
- 10% specimen: 23 replicates
- 13% specimen: 24 replicates
- Provenance: Hematologically derived human cells (mixtures with known percentages of trisomy 12).
- Clinical Specimens (Methods Comparison):
- Total 402 peripheral blood specimens from patients with B-cell chronic lymphocytic leukemia (B-CLL).
- Provenance: Multi-center study; specimens from three sites (Site 1: 97 specimens, Site 2: 205 specimens, Site 3: 100 specimens). One site (from the United Kingdom) provided 157 specimens.
- Retrospective/Prospective: Not explicitly stated, but the collection of "peripheral blood specimens... from a total of 402 patients" suggests they were likely retrospective, selected for the study.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts:
- Analytical Specificity: Examination "sequentially by G-banding" followed by FISH. This implies cytogeneticists, but the number and specific qualifications are not detailed.
- Reproducibility Study: "Known percentages of trisomy 12" in the cell mixtures suggests a predefined truth, likely established by advanced cytogenetic techniques, but no "experts" are explicitly described for this part of ground truth establishment.
- Clinical Specimens (Methods Comparison): Standard cytogenetic analysis was used as the comparator (ground truth). Each site followed "its own in-house protocol for standard cytogenetic analysis." This implies trained cytogeneticists performed the standard cytogenetic analysis and interpretation due to the nature of G-banding and karyotyping. The number of experts per site is not specified, nor are their detailed qualifications (e.g., years of experience).
4. Adjudication Method for the Test Set:
The document does not explicitly describe a formal adjudication method (e.g., 2+1, 3+1) for the interpretation of either the FISH results or the standard cytogenetic results. For clinical specimens, it notes that "inter-site and observer-to-observer variations were observed" in the reproducibility study, suggesting independent assessments without a specific adjudication process mentioned for discrepancies in the broader clinical study.
5. Multi Reader Multi Case (MRMC) Comparative Effectiveness Study:
No, an MRMC comparative effectiveness study, in the sense of evaluating how much human readers improve with AI vs. without AI assistance, was not performed. This study compares a device (FISH probe) to a standard clinical method (cytogenetics), which are both human-interpreted methods, not an AI system.
6. Standalone (Algorithm Only Without Human-in-the-Loop Performance) Study:
Yes, the analytical sensitivity, specificity, and reproducibility studies for the CEP 12 SpectrumOrange DNA Probe Kit essentially represent standalone performance where the probe kit itself is being evaluated. The reading of the FISH signals is a human-in-the-loop step, but the performance metrics (hybridization efficiency, LOD, cross-hybridization) are inherent to the probe and its interaction with the biological sample.
7. Type of Ground Truth Used:
- Analytical Specificity: G-banding (a traditional cytogenetic technique for chromosome identification).
- Reproducibility: "Known percentages of trisomy 12" in cell mixtures, implying a highly characterized true state.
- Clinical Specimens (Methods Comparison): Standard cytogenetic analysis (G-banded karyotyping).
8. Sample Size for the Training Set:
The document does not mention a training set or machine learning/AI algorithms that would require one. This submission is for a DNA probe kit, not an AI-powered diagnostic device.
9. How the Ground Truth for the Training Set Was Established:
Not applicable, as there is no training set mentioned.
Ask a specific question about this device
(486 days)
VYSIS
This assay is designed to provide a method for the detection and quantification of chromosome 8 in both interphase nuclei and metaphase spreads by fluorescence in situ hybridization (FISH).
The CEP 8 SpectrumOrange DNA Probe is a SpectrumOrange fluorescent labeled DNA probe specific for the centromeric region of chromosome 8.
Here's a breakdown of the acceptance criteria and the study that proves the device meets them, based on the provided text:
Acceptance Criteria and Device Performance for CEP 8 SpectrumOrange DNA Probe Kit
1. Table of Acceptance Criteria and Reported Device Performance
Performance Metric | Acceptance Criteria (Implicit) | Reported Device Performance |
---|---|---|
Analytical Sensitivity & Specificity | ||
Hybridization Failure Rate | =2 tri-signaled metaphases for metaphase). The sensitivity, specificity, and correlation coefficients reported are for the device's performance when applied according to its instructions. |
7. Type of Ground Truth Used
- For the clinical methods comparison study, the ground truth was expert consensus / established diagnostic method: Standard Cytogenetic Analysis. This method is referred to as "the standard of care."
8. Sample Size for the Training Set
- The text does not explicitly describe a separate training set in the way modern machine learning models would have one.
- The "pilot study" and "pivotal study" results for hybridization efficiency and reproducibility involve smaller numbers of specimens (35 BM, 60 BM, single normal and single trisomy 8 specimens) that could be considered part of the development and refinement of the assay and its interpretation rules, but not a formal "training set" for an algorithm. The 2.2% cutoff for interphase analysis appears to have been 'validated by the same pivotal clinical study,' suggesting it was developed and then verified within the context of the overall validation.
9. How the Ground Truth for the Training Set Was Established
- Since there's no explicitly defined "training set" for an algorithm in the modern sense, the concept of establishing ground truth for it doesn't directly apply here.
- However, the underlying biological understanding and the methodology of interpreting FISH signals (e.g., what constitutes a "tri-signaled nuclei") would be based on established cytogenetic principles and likely refined through internal studies during the probe's development, informed by standard cytogenetic analysis, which is the gold standard for chromosomal abnormalities. The cutoff values (like 2.2%) were likely empirically determined and then validated against the clinical performance.
Ask a specific question about this device
Page 1 of 1