(233 days)
The FlexSure ® OBT (Occult Blood Test) is a rapid, visually read, qualitative immunochemical chromatographic method for detection of human hemoglobin from blood in fecal samples. Fecal occult blood tests are useful screening aids for detecting primarily lower gastrointestinal (g.i.) disorders that may be related to iron deficiency anemia, diverticulitis, ulcerative colitis, polyps, adenomas, colorectal cancers or other g.i. lesions that can bleed. FlexSure ® OBT is recommended for use by health professionals as part of routine physical examinations or when lower g.i. disorders are suspected.
Not Found
Here's an analysis of the acceptance criteria and the studies performed for the FlexSure OBT device, based on the provided text:
Acceptance Criteria and Device Performance for FlexSure® OBT
1. Table of Acceptance Criteria and Reported Device Performance
The document does not explicitly state pre-defined "acceptance criteria" with specific numerical targets. Instead, it describes performance characteristics and compares them to the predicate device or demonstrates the device's capability. I've extrapolated the implied acceptance criteria from the reported performance results, assuming that the observed performance was deemed acceptable for market clearance.
| Characteristic | Implied Acceptance Criteria (Based on Study Results) | Reported Device Performance (FlexSure® OBT) | Study Section |
|---|---|---|---|
| Analytical Sensitivity | Reliably detect ≥ 0.2 mL blood/100g feces (approx. 2-3 mL daily GI bleeding). | Reliably detected 0.2 mL or more of added blood per 100 g of feces (0.3 mg hemoglobin per g of stool). This level is approximately equal to 2 to 3 mL of daily in vivo lower g.i. bleeding. | Analytical Performance - Sensitivity |
| Prozone Effect | Reliably detect blood levels up to where blood is generally visible in stool (~17mL/100g). | Reliably detected up to 17 mL of added blood per 100 g of feces (25 mg hemoglobin per g of stool). | Analytical Performance - Sensitivity |
| Cross-Reactivity | No cross-reactivity with common dietary animal hemoglobins or horse myoglobin. | Results were negative for horse myoglobin and hemoglobin from beef, chicken, fish, horse, pig, rabbit, goat, sheep, and turkey, even at levels exceeding normal dietary intake. | Analytical Performance - Cross Reactivity |
| Interference | 100% accurate results with known interfering substances (plant peroxidases, ferrous iron, Vitamin C + hemoglobin). | Yielded 100% accurate test results with FlexSure® OBT when fecal samples spiked with excessive quantities of plant peroxidases, ferrous iron (to check for false-positives), and mixture of vitamin C and human hemoglobin (to check for false-negatives). | Analytical Performance - Interference |
| Reproducibility (Within-site) | High agreement (e.g., ≥95-100%) for negative, borderline, and positive results. | 100% (90/90) | Analytical Performance - Reproducibility |
| Reproducibility (Between-site) | High agreement (e.g., ≥95%) for negative, borderline, and positive results. | 97% (30/30 for negative, 30/30 for positive, and 27/30 for borderline positive sample). | Analytical Performance - Reproducibility |
| Readability / Repeatability (Agreement b/w readers) | Greater than 95% agreement between experienced and inexperienced readers, with expected variation at analytical cutoff. | Greater than 95% agreement among the two reader groups (experienced vs. inexperienced) except at the analytical cutoff of the test. | Analytical Performance - Readability/Repeatability |
| Apparent Specificity (Average Risk - Colorectal Neoplasia) | Comparable to or better than predicate device (Hemoccult®). | 98.4% (1,702/1,729) for FlexSure® OBT vs. 97.2% (1,680/1,729) for Hemoccult®. (FlexSure® OBT performed better) | Clinical Performance - Average Risk Screening |
| Apparent Specificity (Average Risk - Any lower G.I. Pathology) | Comparable to or better than predicate device (Hemoccult®). | 99.0% (1,666/1,682) for FlexSure® OBT vs. 98.8% (1,661/1,682) for Hemoccult®. (FlexSure® OBT performed slightly better) | Clinical Performance - Average Risk Screening |
| Positive Predictive Value (Average Risk - Colorectal Neoplasia) | Comparable to or better than predicate device (Hemoccult®). | 15.6% (5/32) for FlexSure® OBT vs. 3.9% (2/51) for Hemoccult®. (FlexSure® OBT performed better) | Clinical Performance - Average Risk Screening |
| Relative Sensitivity (High Risk - Colorectal Neoplasia) | Comparable to or better than predicate device (Hemoccult®). | 55.6% (25/45) for FlexSure® OBT vs. 51.1% (23/45) for Hemoccult®. (FlexSure® OBT performed better) | Clinical Performance - High Risk Population |
| Lower G.I. Specificity (Presumed Normal) | High specificity (e.g., ≥95%). | 97.7% (86/88) | Clinical Performance - Studies with Presumed Normal Subjects |
| Effect of Diet (Specificity) | 100% specificity regardless of restricted, unrestricted, or rare red meat diets. | 100% specificity regardless of diet (restricted, unrestricted, and rare red meat). | Clinical Performance - Studies with Presumed Normal Subjects |
| Simulated Upper G.I. Bleeding (Specificity) | 100% specificity for lower G.I. bleeding. | 100% specificity in the four individuals who participated (ingested own blood to simulate upper g.i. bleeding). | Clinical Performance - Studies with Presumed Normal Subjects |
2. Sample Size and Data Provenance (Test Set)
- Average Risk Screening: 1,734 individuals.
- Data Provenance: Not explicitly stated, but clinical studies are generally assumed to be prospective in nature unless otherwise specified. The setting "worldwide" and mention of "U.S., Europe, Australia and Canada" for reader locations suggests potential multi-national data, or at least a multi-national perspective in study design, but the actual data collection for this cohort is not precisely identified by country. The context of a 510(k) submission to the FDA implies a focus on U.S. regulatory requirements, but doesn't preclude international data.
- High Risk Population: 283 individuals.
- Data Provenance: Same as above.
- Presumed Normal Subjects (Lower G.I. Specificity): 88 individuals.
- Data Provenance: Same as above.
- Presumed Normal Subjects (Effect of Diet): 19 individuals.
- Data Provenance: Same as above.
- Presumed Normal Subjects (Simulated Upper G.I. Bleeding): 4 individuals.
- Data Provenance: Same as above.
- Analytical studies (cross-reactivity, interference, reproducibility, readability): Number of individual fecal samples or spiked samples varied; specific numbers are mentioned in some sections (e.g., 90 for within-site reproducibility, 30 for between-site, 16 for inexperienced readers). These are laboratory-based studies.
3. Number of Experts and Qualifications for Ground Truth
- Analytical Studies (Readability/Repeatability):
- Number of experts: 3 "experienced" SKD technicians.
- Qualifications: "one with a doctorate degree and two with BA/BS degrees," who had "used the test extensively."
- An "inexperienced" group of 16 individuals with varied educational backgrounds (High School to M.D.) also participated for comparison, but were not establishing ground truth.
- Clinical Studies (Colorectal Neoplasia, Lower G.I. Pathology):
- The document does not explicitly state the number or qualifications of experts used to establish the ground truth (e.g., diagnosis of colorectal neoplasia or other lower G.I. pathology). However, for these types of conditions, the ground truth would typically be established by clinical diagnoses from specialists (e.g., gastroenterologists, pathologists) based on colonoscopy, biopsy, and other clinical findings. The text states "apparent specificity for colorectal neoplasia" and "for any lower g.i. pathology," implying that a clinical follow-up or diagnostic gold standard was used, but the details of the specialists involved are absent.
4. Adjudication Method (Test Set)
- The document does not specify an adjudication method (e.g., 2+1, 3+1, none) for the clinical ground truth. The clinical diagnoses were presumably based on standard medical practice for confirming conditions like colorectal neoplasia or other lower G.I. pathologies.
5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study
- No, a typical MRMC comparative effectiveness study was not performed as commonly understood for AI/CAD devices.
- The study did involve:
- Comparison of device performance to a predicate device (Hemoccult®) in clinical settings. This is a comparative effectiveness study in a broad sense, but not specifically an MRMC study comparing human readers with and without AI assistance.
- A "readability/repeatability" study comparing experienced vs. inexperienced device users (readers) using the device. This is a type of reader variability study, but not an MRMC study assessing AI's impact on diagnostic accuracy. The device itself is a visually-read, qualitative test; it's not an AI system assisting interpretation of complex images.
6. Standalone (Algorithm Only) Performance Study
- Yes, the FlexSure® OBT demonstrably performs as a standalone device. The entire document details the performance of the OBT device itself, which is a rapid, visually-read immunochemical chromatographic method for detecting hemoglobin. There is no "human-in-the-loop" component in the sense of an AI interpreting images for a human. The human reader simply observes the qualitative result on the test strip. The "readability" study confirms that the device's output is consistently interpreted.
7. Type of Ground Truth Used
- Analytical Studies:
- Spiked Samples: For sensitivity, cross-reactivity, interference, and reproducibility, the ground truth was established by precisely known quantities of human hemoglobin or other substances added to fecal samples in vitro.
- Expected Results: For interference, knowledge of substances' effects was used (e.g., plant peroxidases should not yield a positive result with FlexSure® OBT).
- Clinical Studies:
- Clinical Diagnosis / Pathology: For colorectal neoplasia, lower G.I. pathology, and presumed normal status, the ground truth would have been established through a medical gold standard, likely involving colonoscopy, biopsy, and pathological examination for positive cases, and clinical assessment for presumed normal subjects. The text refers to "colorectal neoplasia" and "lower g.i. pathology," which are clinically diagnosed conditions.
- Simulated in vivo (for upper G.I. bleeding): For the simulated upper G.I. bleeding study, the ground truth was the knowledge that individuals ingested their own blood, and thus should not show lower G.I. bleeding as detected by the device.
8. Sample Size for the Training Set
- The document does not mention a training set in the context of an AI/ML algorithm. This device is a manual, visually-read immunochemical test, not an AI-powered diagnostic system. Its development would involve chemical and biological optimization, not algorithm training on data like an AI.
9. How the Ground Truth for the Training Set Was Established
- Not applicable, as there is no mention or indication of a training set or AI algorithm for this device.
{0}------------------------------------------------
This 510(k) summary of safety and effectiveness information is being submitted in accordance with the requirements of SMDA 1990.
| Manufacturer: | SmithKline Diagnostics, Inc.1050 Page Mill Rd.Palo Alto, CA 94303-0105Attention: Ronald J. Schoengold |
|---|---|
| Proprietary Name: | FlexSure ® OBT |
| Classification Name: | Occult Blood Reagent |
| Intended Use: | The FlexSure ® OBT (Occult Blood Test) is a rapid, visuallyread, qualitative immunochemical chromatographic method fordetection of human hemoglobin from blood in fecal samples.Fecal occult blood tests are useful screening aids for detectingprimarily lower gastrointestinal (g.i.) disorders that may be relatedto iron deficiency anemia, diverticulitis, ulcerative colitis, polyps,adenomas, colorectal cancers or other g.i. lesions that can bleed.FlexSure ® OBT is recommended for use by health professionals aspart of routine physical examinations or when lower g.i. disordersare suspected. |
| Predicate Product: | Hemoccult ® BRAND Routine Screening Test for Fecal OccultBlood Manufactured by SmithKline Diagnostics, Inc. |
| Performance Summary: | The FlexSure ® OBT Immunochemical Fecal Occult Blood Testis substantially equivalent to the predicate device Hemoccult ®, soldprior to May 28, 1976. The performance of FlexSure ® OBT wasverified by sensitivity, specificity, cross reactivity, interference,reproducibility and readability studies in laboratory and clinicalsettings. Refer to the attached PERFORMANCECHARACTERISTICS. |
Kasen L.M.S. for Marshall C. McCarthy
Marshall C. McCarthy
Manager, Regulatory Affairs
10/28/96
Date
000015
{1}------------------------------------------------
PERFORMANCE CHARACTERISTICS
Background
Fecal occult blood testing (FOBT) is utilized worldwide as a screening aid for persons 50 years of age or older to detect gastrointestinal (g.i.) bleeding disorders. Recent studies indicate that detection of 2 mL or more of daily g.i. blood loss can be an early indicator of significant lower g.i. pathology including colorectal neoplasia (adenomas ≥1cm and colorectal cancers.)
Analytical Performance Studies
ANALYTICAL SENSITIVITY:
- ♦ Lower Sensitivity Limit In vitro studies demonstrated that following the recommended procedures for sample collection and storage, FlexSure OBT reliably detected 0.2 mL or more of added blood per 100 g of feces (0.3 mg hemoglobin per g of stool). This level of blood is approximately equal to 2 to 3 mL of daily in vivo lower g.i. bleeding.
- ♦ Prozone Effect In vitro studies demonstrated that FlexSure® OBT reliably detected up to 17 mL of added blood per 100 g of feces (25 mg hemoglobin per g of stool). At this level and above, blood is generally visible in the stool.
ACCURACY OF TEST RESULTS:
- ◆ Cross Reactivity Studies Individual fecal samples were spiked with horse myoglobin and hemoglobin from beef, chicken, fish, horse, pig. rabbit, goat, sheep and turkey to determine whether dietary substances cross react with the test. The FlexSure®OBT results were negative even at levels in excess of normal dietary intake or levels which consistently give false-positive results with guaiac-based tests.
{2}------------------------------------------------
ACCURACY OF TEST RESULTS (continued):
- ♦ Interference / Effect of Dietary Substances Fecal samples from different individuals spiked with excessive quantities of substances known to interfere with guaiac-based tests (plant peroxidases and ferrous iron to check for possible false-positive test results, and a mixture of vitamin C and human hemoglobin to check for possible false-negative test results) vielded 100% accurate test results with FlexSure® OBT.
- ♦ Reproducibility The within-site and between-site reproducibility of FlexSure OBT was demonstrated with a range of blood levels spiked into stool samples to give negative, borderline positive and positive test results. The within-site reproducibility was 100% (90/90). The between-site reproducibility was 97% (30/30 for the negative, 30/30 for the positive and 27/30 for the borderline positive sample).
- � Readability / Repeatability Comparable results were obtained with experienced and inexperienced reader groups, each using fecal samples spiked with low to moderate levels of human blood. The results indicated greater than 95% agreement among the two reader groups except at the analytical cutoff of the test where greater variation is expected. The "experienced" group was comprised of three SKD technicians who had used the test extensively, one with a doctorate degree and two with BA/BS degrees. The "inexperienced" group consisted of 16 individuals with varied educational backgrounds from High School to M.D. located in the U.S., Europe, Australia and Canada.
{3}------------------------------------------------
Clinical Performance Studies
AVERAGE RISK SCREENING:
- � Apparent Specificity and Positive Predictive Value in a Comparison of Paired Fecal Occult Blood Tests - The performance of FlexSure®OBT in an average risk screening population of 1,734 individuals on a restricted diet vielded an apparent specificity for colorectal neoplasia of 98.4% (1,702/1,729) for FlexSure® OBT and 97.2% (1,680/1,729) for Hemoccult . For any lower g.i. pathology, the apparent specificity was 99.0% (1,666/1,682) for FlexSure "OBT and 98.8% (1.661/1.682) for Hemoccult . The positive predictive value for colorectal neoplasia was 15.6% (5/32) for FlexSure® OBT and 3.9% (2/51) for Hemoccult".
HIGH RISK POPULATION:
- ♦ Sensitivity The performance of FlexSure® OBT in a high risk population of 283 individuals with a personal or family history of colorectal cancer or adenomas who were on a restricted diet yielded a relative sensitivity for colorectal neoplasia of 55.6% (25/45) for FlexSure OBT and 51.1% (23/45) for Hemoccult . The Negative Predictive Values were not calculated for this group since this parameter is only meaningful in a screening population.
STUDIES WITH PRESUMED NORMAL SUBJECTS:
- ◆ Lower G.I. Specificity The apparent specificity (an estimate of specificity due to the inability and inappropriateness of performing colonoscopy on individuals with a negative FOBT result) of FlexSure® OBT for lower gastrointestinal pathology using a group of 88 presumed normal young adults was 97.7% (86/88).
- ♦ Effect of Diet The specificity of FlexSure® OBT for human hemoglobin in 19 presumed normal subjects on restricted, unrestricted, and rare red meat diets was tested. FlexSure®OBT yielded a specificity of 100% regardless of diet.
{4}------------------------------------------------
STUDIES WITH PRESUMED NORMAL SUBJECTS (continued):
- ♦ Simulated Upper G.I. Bleeding The specificity of FlexSure® OBT for lower g.i. bleeding was studied in a group of presumed normal volunteers who ingested their own blood to simulate upper g.i. bleeding. FlexSure® OBT yielded a specificity of 100% in the four individuals who participated in the study.
§ 864.6550 Occult blood test.
(a)
Identification. An occult blood test is a device used to detect occult blood in urine or feces. (Occult blood is blood present in such small quantities that it can be detected only by chemical tests of suspected material, or by microscopic or spectroscopic examination.)(b)
Classification. Class II (special controls). A control intended for use with an occult blood test is exempt from the premarket notification procedures in subpart E of part 807 of this chapter subject to the limitations in § 864.9.