K Number
DEN060007

Validate with FDA (Live)

Date Cleared
2006-10-12

(59 days)

Product Code
Regulation Number
866.5910
Reference & Predicate Devices
N/A
Predicate For
N/A
AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
Intended Use

INTROL™ CF Panel I Control is intended for in vitro diagnostic use as a quality control to monitor analytical performance of the extraction, amplification and detection steps of diagnostic assays used in the detection of the Cystic Fibrosis Transmembrane Conductance Regulator (CFTR) gene mutations and variants. This product is intended to be extracted and analyzed routinely with each CFTR assay run.

The INTROL™ CF Panel I Control is designed to monitor the detection of 38 CFTR mutations associated with cystic fibrosis, including the 23 mutations recommended for testing by American College of Medical Genetics (ACMG) and American College of Obstetricians and Gynecologists (ACOG). The INTROLTM CF Panel I Control also monitors 3 polymorphisms (1506V, 1507V, F508C) and the 5/7/9T variants.

Device Description

INTROL™ CF Panel I Control consists of synthetic CFTR DNA suspended in a matrix of synthetic DNA targets, carrier DNA of a non-human species, preservatives, dye, and stabilizers. The synthetic DNA contains all 27 CFTR gene exons plus intronic borders, and contains specific mutations and polymorphisms which are divided among 5 bottles (bottles a, b, c, d, and e). The 5 bottles exist in two versions: Version G106ac includes bottles (a), (b), and (c), while Version G106de includes bottles (a), (b), (d), and (e). The specific mutations present in each bottle are listed below in Table 1; all other CFTR sequence is wild type. CFTR mutations that are not listed cannot be detected in the INTROL™ CF Panel I Control.

Control sequences include the mutations, wild type alleles, and polymorphisms recommended for testing by the American College of Medical Genetics (ACMG) and American College of Obstetricians and Gynecologists (ACOG). CFTR mutations that are not listed cannot be detected in the INTROL™ CF Panel I Control.

CFTR DNA is stabilized in the matrix and released when processed through common extraction methods as if it were a whole blood specimen. Following extraction, the released DNA can be used in common amplification based molecular assays techniques. Because INTROL™ CF Panel I Control is designed to mimic the whole blood sample, the resulting copy number of the artificial CFTR segment, after extraction, will be similar to that found in a processed human whole blood sample (v/v).

AI/ML Overview

Here's a breakdown of the requested information based on the provided text:

1. Table of Acceptance Criteria and Reported Device Performance

Acceptance Criteria (from Product Acceptance Criteria and Testing section)Reported Device Performance (from Performance Characteristics section)
All INTROL™ CF Panel I Control products are tested by an FDA-cleared CFTR mutation detection method before being released for market distribution.External site evaluations show that across 10 sites and 6 different methods (including Tag-It™ and eSensor, both presumably FDA-cleared), there were 100% correct calls for 1133 calls over 66 runs and 11 lots. This indicates successful detection of mutations.
Any mutations not tested by the FDA-cleared method are sequenced bidirectionally before product is released."Bidirectional sequencing of INTROL™ CF Panel I DNA is used to validate the presence of mutant or wild type sequence." This confirms the method used for mutations not covered by FDA-cleared assays.
All mutations must be detected.The external site evaluations consistently show 100% correct calls, indicating all intended detectable mutations were detected across various methods and sites. Additionally, for each bottle (a-e), the specific mutations and polymorphisms are designed to be present and are therefore expected to be detected.
Unopened INTROL™ CF Panel I Control material is stable through the expiration date printed on each bottle when stored refrigerated (2° - 8°C).Real-time stability study (up to 12 months) showed 100% correct calls for 5 different lots at various time points (1, 2, 3, 4, and 12 months).
Opened material returned to the refrigerator (2° - 8°C) shortly after use is stable for thirty (30) days from the date of opening.Two open vial stability studies demonstrated no loss of signal when used in CFTR assay at the end of the test period (49 days in one study, 35 days in another), exceeding the 30-day criterion.
Product stability during prolonged shipping without refrigeration (elevated temperature).Elevated temperature studies (simulating shipping and incubation at 60°C for 21-24 days) showed no loss of signal.
Stability after one cycle of freeze/thaw.Freeze/Thaw studies showed no loss of signal after one cycle.
The level of synthetic CFTR DNA present in the extracted control should be detectable and mimic whole blood samples as if it were a whole blood specimen (implicitly, through successful extraction and detection).96% successful laboratory extractions across 134 laboratories using 21 different methods. The 4% (5 labs) that didn't continue were due to a different quantitation method, not necessarily a failure of extraction itself. This suggests the device successfully mimics whole blood for extraction.

2. Sample Size Used for the Test Set and Data Provenance

  • Test Set Sample Size: In the external site evaluations, samples from 11 different manufacturing lots were tested. The total number of "Calls" (presumably individual tests for specific mutations) was 1133. It's not explicitly stated how many unique samples or cases were used for the test set, but rather the number of lots, runs, and calls.
  • Data Provenance: The data was generated through external site evaluations (clinical laboratory study performed at external sites) involving 10 external sites, 8 of which were clinical laboratories representing intended users. The origin country is not specified, but the context of "FDA-cleared" suggests the study was conducted within the United States or under FDA guidelines. The study appears to be prospective as it involves evaluations of the manufactured control materials at various external sites.

3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts

The concept of "experts" establishing ground truth in the traditional sense (e.g., radiologists, pathologists) is not directly applicable here.

  • For the test set validation (external site evaluations), FDA-cleared CFTR mutation detection methods and bidirectional sequencing were used to determine if the mutations were correctly detected. The "ground truth" for the content of the control material (which mutations and polymorphisms it contains) was established during the manufacturing process by Maine Molecular Quality Controls, Inc. (MMQCI) before product release.
  • The control material itself contains predefined synthetic DNA with specific mutations and wild-type sequences (Table 1). The 'truth' of what the control contains is intrinsic to its design and manufacturing.
  • The "experts" involved are those within MMQCI responsible for designing and manufacturing the synthetic DNA, and those performing the bidirectional sequencing, which is a highly accurate molecular technique for confirming DNA sequences. Their specific qualifications are not detailed beyond "experts."

4. Adjudication Method for the Test Set

Adjudication methods like "2+1" or "3+1" are typically used when multiple human readers or algorithms provide potentially discordant interpretations, which then need to be resolved. This is not directly applicable to this device.

  • The "adjudication" for the performance study (external site evaluations) essentially involved checking if the CFTR assays correctly identified the mutations known to be present in the control material.
  • The control materials have a pre-defined composition (Table 1) and are validated internally by FDA-cleared CFTR mutation detection methods and bidirectional sequencing before release. The process is a comparison against this known-good standard. Any discrepancy from the expected result would be a failure. There is no mention of a human review or adjudication of conflicting interpretations from different tests, but rather a direct comparison to the expected truth (the known composition of the control).

5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done, If So, What Was the Effect Size of How Much Human Readers Improve with AI vs Without AI Assistance

  • No Multi-Reader Multi-Case (MRMC) comparative effectiveness study was done.
  • This device is a quality control material, not an AI-powered diagnostic device, so the concept of "human readers improve with AI vs. without AI assistance" is not relevant here. The studies focused on the analytical performance and stability of the control material itself within various CFTR assays.

6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) Was Done

  • A standalone performance evaluation was done, but it pertains to the performance of the various CFTR mutation detection assays (which are algorithms or protocols, but not "AI") when using the INTROL™ CF Panel I Control.
  • The "Performance Characteristics" section details how the control material performed when tested by these various FDA-cleared and other amplification methods without direct human intervention in the interpretation of the control result itself. The control material is expected to produce a specific, interpretable result (detection of known mutations), and this was assessed at 10 external sites using different methods. The "100% correct calls" across these methods serve as the standalone analytical performance.

7. The Type of Ground Truth Used

  • The ground truth used is primarily synthetic DNA with a precisely known sequence and mutation composition (defined at manufacturing) for the control material, validated by bidirectional sequencing and comparison to FDA-cleared CFTR mutation detection methods.
  • This is a form of "known composition" or "reference standard" ground truth, rather than expert consensus, pathology, or outcomes data, which are typically found in clinical diagnostic studies.

8. The Sample Size for the Training Set

  • Not applicable. This device is a quality control material and does not involve a "training set" in the context of machine learning or AI models. Its intended use is to monitor the performance of other diagnostic assays, not to be a diagnostic algorithm itself.

9. How the Ground Truth for the Training Set Was Established

  • Not applicable, as there is no training set. The intrinsic "truth" of the control material is its precisely engineered synthetic DNA sequence designed to contain specific CFTR mutations and polymorphisms. This content is verified during manufacturing using established molecular biology techniques (sequencing and cleared CFTR assays).

{0}------------------------------------------------

510(k) SUBSTANTIAL EQUIVALENCE DETERMINATION DECISION SUMMARY

  • A. 510(k) Number: K060070
  • B. Purpose for Submission: New device
  • C. Measurand:

Controls for assays detecting Cystic Fibrosis Transmembrane Conductance Regulator (CFTR) gene mutations and variants

  • D. Type of Test: Assayed quality control material
  • E. Applicant: Maine Molecular Quality Controls, Inc. (MMQCI)
  • F. Proprietary and Established Names: INTROL™ CF Panel I Control
  • G. Regulatory Information:
      1. Regulation section: 866.5910 DNA quality control material for genetic testing
      1. Classification: De novo, Class II
      1. Product code: NZB, Quality control material, genetics, DNA
      1. Panel: Immunology (82)

H. Intended Use:

    1. Intended use(s):
      INTROL™ CF Panel I Control is intended for in vitro diagnostic use as a quality control to monitor analytical performance of the extraction, amplification and detection steps of diagnostic assays used in the detection of the Cystic Fibrosis Transmembrane Conductance Regulator (CFTR) gene mutations and variants. This product is intended to be extracted and analyzed routinely with each CFTR assay run.
    1. Indication(s) for use:
      INTROL™ CF Panel I Control is intended for in vitro diagnostic use as a quality control to monitor analytical performance of the extraction, amplification and detection steps of diagnostic assays used in the detection of the Cystic Fibrosis Transmembrane Conductance Regulator (CFTR) gene mutations and variants. This product is intended to be extracted and analyzed routinely with each CFTR assay run.

The INTROL™ CF Panel I Control is designed to monitor the detection of 38 CFTR mutations associated with cystic fibrosis, including the 23 mutations recommended for testing by American College of Medical Genetics (ACMG) and American College of Obstetricians and Gynecologists (ACOG). The INTROLTM CF Panel I Control also monitors 3 polymorphisms (1506V, 1507V, F508C) and

{1}------------------------------------------------

the 5/7/9T variants.

    1. Special conditions for use statement(s): For prescription use only.
      The INTROL™ CF Panel I Control is designed to monitor the presence of 38 CFTR mutations associated with cystic fibrosis, including the 23 mutations recommended for testing by American College of Medical Genetics (ACMG) and American College of Obstetricians and Gynecologists (ACOG). The INTROLTM CF Panel I Control also monitors 3 polymorphisms (1506V, 1507V, F508C) and the 5/7/9T variants.
    1. Special instrument requirements: Not applicable.

I. Device Description:

INTROL™ CF Panel I Control consists of synthetic CFTR DNA suspended in a matrix of synthetic DNA targets, carrier DNA of a non-human species, preservatives, dye, and stabilizers. The synthetic DNA contains all 27 CFTR gene exons plus intronic borders, and contains specific mutations and polymorphisms which are divided among 5 bottles (bottles a, b, c, d, and e). The 5 bottles exist in two versions: Version G106ac includes bottles (a), (b), and (c), while Version G106de includes bottles (a), (b), (d), and (e). The specific mutations present in each bottle are listed below in Table 1; all other CFTR sequence is wild type. CFTR mutations that are not listed cannot be detected in the INTROL™ CF Panel I Control.

Control sequences include the mutations, wild type alleles, and polymorphisms recommended for testing by the American College of Medical Genetics (ACMG) and American College of Obstetricians and Gynecologists (ACOG). CFTR mutations that are not listed cannot be detected in the INTROL™ CF Panel I Control.

CFTR DNA is stabilized in the matrix and released when processed through common extraction methods as if it were a whole blood specimen. Following extraction, the released DNA can be used in common amplification based molecular assays techniques. Because INTROL™ CF Panel I Control is designed to mimic the whole blood sample, the resulting copy number of the artificial CFTR segment, after extraction, will be similar to that found in a processed human whole blood sample (v/v).

{2}------------------------------------------------

Table 1. Composition of INTROLTM CF Panel I Control includes following combinations of CFTR mutations and polymorphisms (plus wild type sequence covering 27 CFTR exons).

AlleleGenotypeAlleleGenotype
Bottle a (both versions)Bottle b (both versions)
7T*7T / 7TE60XHomozygous mutant
(I507V)*I507V / WTG85E*Homozygous mutant
(F508C)*F508C / WTI148THomozygous mutant
S549N/ S549RHeterozygous621+1G>T*Homozygous mutant
S1251NHeterozygous711+1G>T*Homozygous mutant
1078delTHomozygous mutant
Bottle c (Version ac only)R334W*Homozygous mutant
394delTTHeterozygousR347P*Homozygous mutant
R117H*Heterozygous9T*9T / 9T
R347HHeterozygousA455E*Homozygous mutant
5T* / 7T*Heterozygousdel F508*Homozygous mutant
(I506V)*I506V / WTV520FHomozygous mutant
del 1507*Heterozygous1717-1G>A*Homozygous mutant
R553X*HeterozygousG542X*Homozygous mutant
2183AA>GHeterozygousG551D*Homozygous mutant
R560T*Homozygous mutant
Bottle d (Version de only)1898+1G>A*Homozygous mutant
394delTTHomozygous mutant2143delTHomozygous mutant
R117H*Homozygous mutant2184delA*Homozygous mutant
R347HHomozygous mutant2789+5G>A*Homozygous mutant
5T*5T / 5T3120+1G>A*Homozygous mutant
del 1507*Homozygous mutant3199del6Homozygous mutant
R553X*Homozygous mutantD1152HHomozygous mutant
2183AA>GHomozygous mutantR1162X*Homozygous mutant
3659delC*Homozygous mutant
Bottle e (Version de only)3849+10kbC>T*Homozygous mutant
7T*7T / 7T3876delAHomozygous mutant
(I506V)*I506V / I506V3905insTHomozygous mutant
W1282X*Homozygous mutant
N1303K*Homozygous mutant

*ACMG / ACOG Panel

J. Substantial Equivalence Information:

    1. Predicate device name(s): Not applicable.
    1. Predicate 510(k) number(s): Not applicable.
    1. Comparison with predicate: Not applicable

K. Standard/Guidance Document Referenced (if applicable): None referenced.

{3}------------------------------------------------

L. Test Principle:

Not applicable.

M. Performance Characteristics (if/when applicable):

    1. Analytical performance:
      All INTROL™ CF Panel I Control products are tested by an FDA-cleared CFTR mutation detection method before being released for market distribution. Any mutations not tested by the FDA-cleared method are sequenced bidirectionally before product is released. All mutations must be detected.
  • a. Precision/Reproducibility:
    The clinical study performed at the external sites evaluated reproducibility of INTROL™ CF Panel I quality control material with respect to within run, between run, between sites, between lots, and between methods. External site evaluations:

The clinical laboratory study performed at the external sites evaluated reproducibility of INTROL™ CF Panel I Control quality control material with respect to within run, between run, between sites, between lots, and between methods.

Evaluation using different extraction methods:

# extractionmethods#laboratories# successful laboratoryextractionspercentsuccessful
2113412996% *
  • Five laboratories didn't continue after DNA extraction because DNA quantitation method they used indicated that no DNA was extracted/isolated. Considering that the level of synthetic CFTR DNA present in the extracted control may not be detectable with certain quantitation methods, there is a possibility that extractions in these 5 laboratories may have been successful; however this could not be assessed because the assays were not performed.

INTROL™ CF Panel I quality control material has been tested using CFTR assays at 10 external sites. 8 of which were clinical laboratories representing intended user. Samples from 11 different manufacturing lots were tested at minimally 3 external sites in at least 3 separate runs. Results are summarized in the Table 2.

MethodSite# ofLots1# ofRunsTotalCallsPercentCorrectCalls
Tag-ItTM1109223100%
Tag-ItTM239138100%
Tag-ItTM3116100%
Tag-ItTM4117100%
Tag-ItTM5114100%
eSensor65130100%
eSensor75138100%
Other Amplificationmethods83131100%
Other Amplificationmethods9127100%
Other Amplificationmethods10540649100%
6 methods11 Lots66Runs1133Calls100%

Table 2. External site evaluations.

Each bottle is processed independently and has its own lot number.

{4}------------------------------------------------

  • b. Linearity/assay reportable range: Not applicable.
  • Traceability, Stability, Expected values (controls, calibrators, or methods): C. Bidirectional sequencing of INTROL™ CF Panel I DNA is used to validate the presence of mutant or wild type sequence.

Product acceptance criteria and testing: All INTROL™ CF Panel I Control products are tested by an FDA-cleared CFTR mutation detection method before being released for market distribution. Any mutations not tested by the FDA-cleared method are sequenced bidirectionally before product is released. All mutations must be detected.

Upon receipt and after opening, the material should be stored at 2° - 8°C. INTROL™ CF Panel I Control material is shipped with a "Do not freeze" warning in the device labeling.

Unopened INTROLTM CF Panel I Control material is stable through the expiration date printed on each bottle when stored refrigerated (2° - 8°C). Opened material returned to the refrigerator (2° - 8°C) shortly after use is stable for thirty (30) days from the date of opening.

Real time stability study:

Results of the real time studies are in the tables below. Stability was tested using 4 different methods, including cleared Tag-It™ Cystic Fibrosis (CF) Kit from Tm Bioscience, and bidirectional sequencing. Testing was performed at 1, 2, 3, 4, and 12 months. In addition, real time testing was performed with 5 different lots of quality control material. At 12 months, all mutations and variants were tested using either the FDA cleared assay or bidirectional sequencing. Data from this ongoing study currently supports a shelf-life of 12 months.

Stability TestingNumber ofLotsPercentCorrect Calls
Date of Manufacture5100%
1 month5100%
2 months3100%
3 months1100%
4 months2100%
12 months3100%

Stress testing:

Elevated Temperature Studies:

The study goal was to demonstrate product stability during prolonged shipping without refrigeration. A bottle of INTROLTM CF Panel I was removed from storage and mailed across the US and back without wet ice. Testing of the stressed product in the CFTR assay showed no loss of signal.

{5}------------------------------------------------

Two samples of INTROL™ CF Panel were compared after one was incubated at 60°C for 21-24 days, and the other incubated at 4°C, extracted and tested in duplicate in CFTR assay. There was no loss of signal after incubation at 60°C.

Freeze/Thaw Studies:

A bottle of INTROL™ CF Panel I was placed at -20℃ for 48 hours, thawed and tested in CFTR assay. No loss of signal was detectable after one cycle of freeze/ thaw.

Open Vial Stability:

Two open vial studies were performed. In the first study, a bottle of INTROLTM CF Panel I was mixed, opened briefly, then stored at 2-8℃ for 49 days. In the second study, a bottle of INTROL™ CF Panel I was mixed and opened with pipette simulation six times over 35 days. Both studies demonstrated no loss of signal when used in CFTR assay at the end of the test period.

Expected Results:

Expected results with the INTROLTM CF Panel I Control using two FDAcleared CFTR assays are presented in Table 3.

MethodCorrectly Identified AllelesNo Call or otherNot Tested
Tag-ItAll wt alleles7T, I507V, F508C, S549R, G85E, I148T, 621+1G>T,1078delT, R334W, R347P, 9T, A455E, delF508,V520F, 1717+1G>A, G542X, G551D, R560T,1898+1G>A, 2184delA, 3120+1G>A, R1162X,3659delC, 3849+10kbC>T, 3876delA, 3905insT,W1282X, N1303K, 394delTT, R117H, R347H, 5T/7T,I506, dell507, R553X, 2183AA>GS549N MUT1711+1G>T No Call22789+5G>A No Call3S1251N, E60X, 2143delT3199del6, D1152H,
eSensorAll wt alleles7T, I148T, 621+1G>T, 1078delT, R334W, R347P, 9T,A455E, delF508, 1717+1G>A, G542X, G551D, R560T,1898+1G>A, 2184delA, 2789+5G>A, 3120+1G>A,R1162X, 3659delC, 3849+10kbC>T, W1282X,N1303K, R117H, 5T/7T, dell507, R553X,G85E No Amp3711+1G>T No Amp4I507V, F508C, S549N,S549R, S1251N, E60X,1078delT V520F,2143delT, 3199del6,D1152H, 3876delA,3905insT, 394delTT,R347H, I506V,2183AA>G,

Table 3. Results with the INTROL™ CF Panel I using two FDA cleared CFTR assays.

' Detected as homozyqous mutant.

Insufficient control sequence for one of the 711+1G>T amplicon primers.

3 Insufficient control sequence for one of the 2789+5G>A amplicon primers.

4 Mutation E60X interferes with a G85E amplicon primer.

  • d. Detection limit: Not applicable
  • e. Analytical specificity: Not applicable.
  • f. Assay cut-off: Not applicable.

{6}------------------------------------------------

    1. Comparison studies:
    • Method comparison with predicate device: a. Not applicable.
    • b. Matrix comparison: Not applicable.
    1. Clinical studies:
    • a. Clinical Sensitivity: Not applicable.
    • Clinical specificity: b. Not applicable.
    • c. Other clinical supportive data (when a. and b. are not applicable): Not applicable
    1. Clinical cut-off: Not applicable
    1. Expected values/Reference range: Not applicable

N. Proposed Labeling:

The labeling is sufficient and it satisfies the requirements of 21 CFR Part 809.10.

O. Conclusion:

The petition for Evaluation of Automatic Class III Designation for this device is accepted. The device is classified as Class II under regulation 21 CFR 866.5910 with special controls. The special control guidance document "Class II Special Controls Guidance Document: Quality Control Material for Cystic Fibrosis Nucleic Acid Assays" is available at http://www.fda.gov/cdrh/oivd/guidance/1614.html.

§ 866.5910 Quality control material for cystic fibrosis nucleic acid assays.

(a)
Identification. Quality control material for cystic fibrosis nucleic acid assays. A quality control material for cystic fibrosis nucleic acid assays is a device intended to help monitor reliability of a test system by detecting analytical deviations such as those that may arise from reagent or instrument variation in genetic testing. This type of device includes recombinant, synthetic, and cell line-based DNA controls.(b)
Classification. Class II (special controls). The device is exempt from the premarket notification procedures in subpart E of part 807 of this chapter subject to the limitations in § 866.9. The special control is FDA's guidance document entitled “Class II Special Controls Guidance Document: Quality Control Material for Cystic Fibrosis Nucleic Acid Assays.” See § 866.1(e) for the availability of this guidance document.