Search Filters

Search Results

Found 6 results

510(k) Data Aggregation

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticPediatricDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The Detectabuse® Liquid control is an In Vitro Diagnostic (IVD) device, for prescription use only, that is intended for use as quality control urine to monitor the precision of laboratory urine toxicology testing procedures for the analytes listed in the package insert.

    The Detectabuse® controls are designed to provide an estimation of the precision of a device test system, and to detect and monitor systematic deviations from accuracy resulting from reagent or instrument defects, at levels established by SAMHSA, CAP/AACC, many state programs and device manufacturers QC requirements. The Detectabuse® control urines are compatible with all quantitative and qualitative drug detection procedures which are sufficiently sensitive to detect the control constituents. They should be treated as any "unknown" specimen while following the specific protocol of the assay being used. This product is intended to be used under the supervision of health care professionals as an integral part of good laboratory practices.

    Device Description

    Each bottle contains stabilized human based urine. Multi-constituent and single constituent positive control urines have been gravimetrically spiked with authentic reference drug standards and/or appropriate metabolites. Negative control urines are certified negative by combination of immunoassay, GC/MS and/or LC/MS for the constituents listed on our target sheets. The products contain less than 1% sodium azide as a preservative. For assays sensitive to sodium azide such as ELISA we substitute a proprietary preservative approved by the manufacturers and DEA.

    AI/ML Overview

    This document describes the performance characteristics and acceptance criteria for the Detectabuse® Liquid Control Urine device. This device is an In Vitro Diagnostic (IVD) intended for use as quality control urine to monitor the precision of laboratory urine toxicology testing procedures.

    The study that proves the device meets the acceptance criteria is primarily an analytical performance study focusing on stability and traceability.


    1. Table of Acceptance Criteria and Reported Device Performance

    | Evaluation Parameter | Acceptance Criteria | Reported Device Performance |
    |---------------------------------------------------------------------------|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
    | Open Bottle Stability at 2-8°C | 31 days | Data support the 31-day open bottle stability at 2-8°C for all analytes. All analytes passed specifications, Positive controls tested positive, and Negative controls tested negative. |
    | Closed Bottle Stability - Product Shelf Life (2-8°C) | Storage with Oxazepam expected to be negatively affected if >6 months. Other drugs within ±15% of target until expiration. | At 1 year, Oxazepam dropped 15-22%. At 3 years, Oxazepam dropped to 25%. Other drugs were within acceptable criteria of +/-15% from target until expiration date. Recommendation: Do not store Oxazepam-containing controls refrigerated for more than six months. |
    | Closed Bottle Stability - Product Shelf Life (-10°C to -20°C) | Up to 4 years. Values within ±15% of target or original test value. | Multiple studies with various lots showed all drugs were stable within 15% of target or original test value between 3 and 4 years of frozen storage. |
    | Room Temperature (open vial) Stability - Product Shelf Life (18°C to 21°C) | 31 days. Values within ±18% of target or original test value. | All drugs tested for 31 days were within 18% of target value or original test value. This supports stability during shipping or brief periods of customer error. |
    | Value Assignment Criteria | Initially: ±5% agreement (acceptable to ±10% for certain difficult-to-test drugs). For Stat-Skreen® controls, positive controls must test positive and negative controls test negative. Final testing at shelf life: ±10% of target (acceptable to ±15% for certain stability-prone constituents like Oxazepam). | Initial production batch samples sent to 4-5 certified laboratories (at least 3 proficient for specific constituents). If a testing laboratory does not report within 10% of target, the sample is repeated. Once acceptable convergence of values is achieved, the lot is released. Stat-Skreen® controls are also tested on handheld devices against the criteria. Final testing at shelf life (GC/MS or LC/MS) aims for ±10% of target but accepts up to ±15% for specific constituents like Oxazepam. |


    2. Sample Size Used for the Test Set and Data Provenance

    The document does not explicitly state a numerical sample size for "test sets" in the context of typical algorithm validation (i.e., a distinct set used for performance evaluation after training). Instead, the performance evaluations are described for stability studies and value assignment verification.

    • Stability Studies: "Multiple bottles of a single lot" were pulled from beginning, middle, and end of production. "Several lots" of controls were selected for the room temperature study. "Multiple studies were conducted using various different lots."
    • Value Assignment: "An initial production batch is sampled as described in the protocol and single or multiple samples (depending on our past experience with the constituent(s), are ordinarily sent out to 4 or 5 certified laboratories..."
    • Data Provenance: The data is generated through laboratory testing of the control materials. The document implies a prospective data collection for stability studies (testing at initial, then at intervals) and for value assignment. The "certified independent laboratories" or "SAMHSA licensed laboratories or CAP inspected and certified" are likely located in the USA, given the FDA submission context.

    3. Number of Experts and Qualifications for Ground Truth

    • Ground Truth Establishment for Value Assignment: "Certified Independent laboratories" test by either GC/MS, LC/MS, or Immunoassay screening. For initial value assignment, "4 or 5 certified laboratories" (or at least 3 for less common constituents) perform testing. The qualifications for personnel performing these tests at "certified" or "SAMHSA licensed" or "CAP inspected and certified" labs are implied to be high, but specific expert qualifications (e.g., "radiologist with 10 years of experience") are not detailed. The expertise is in the analytical methods (GC/MS, LC/MS, immunoassay).

    4. Adjudication Method

    The adjudication method for value assignment resembles a form of consensus or agreement-based approach.

    • "A minimum of 3 data points are collected for each assay."
    • "Data collected from at least two test sites, testing performed within 1 week of receipt of test samples."
    • "Our target acceptance criteria Is ±5% of the target value, but if we cannot get ± 5% agreement from our testing laboratories we will accept ± 10%... If a testing laboratory does not report within 10% of target we ask that the sample be repeated. Once we have an acceptable convergence of values from all of the testing laboratories the lot is released."

    This suggests repeated testing and comparison among multiple labs with defined acceptance thresholds for agreement, rather than a formal 2+1 or 3+1 adjudication by individual experts in the traditional sense for image interpretation.


    5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

    • No MRMC comparative effectiveness study was done. This device is a quality control material, not an AI diagnostic tool intended to assist human readers. Therefore, the concept of improving human reader performance with AI assistance is not applicable.

    6. Standalone (Algorithm Only) Performance Study

    • A standalone performance study was done in the sense that the device, as a quality control material, is evaluated on its own analytical properties (stability, assigned values, precision monitoring capability) using laboratory instruments. There isn't an "algorithm" in the typical AI sense; the "device" itself is the control material. Its performance is measured by how precisely and accurately analytical instruments can detect the specified concentrations within the control.

    7. Type of Ground Truth Used

    The ground truth used for this device is based on analytical quantification methods and certified reference standards:

    • Gravimetric spiking with authentic reference drug standards and/or appropriate metabolites.
    • Purity determination using analytical tools including GC/MS, LC/MS, and NMR.
    • Balances calibrated with weights traceable to National Institute of Standards and Technology (NIST).
    • Testing by SAMHSA or CAP certified independent laboratories using GC/MS, LC/MS, or Immunoassay screening.
    • Negative control urines are certified negative by combination of immunoassay, GC/MS and/or LC/MS.

    This constitutes a highly rigorous, metrologically traceable analytical ground truth.


    8. Sample Size for the Training Set

    The concept of a "training set" as understood in machine learning is not applicable here. This device is a chemical control material, not an AI algorithm that learns from data. The manufacturing and validation processes involve:

    • Reference standards and gravimetric preparation: These form the basis for the intended concentrations.
    • Initial production batches: These are the manufacturing lots that undergo value assignment and stability testing as described above.

    9. How the Ground Truth for the Training Set Was Established

    As noted above, there is no "training set" in the AI sense. The "ground truth" (i.e., the known and verified concentrations of analytes in the control material) is established through:

    • Precise gravimetric preparation: Spiking authentic reference drug standards (traceable to NIST) into the human-based urine matrix at known concentrations.
    • Purity verification of reference standards: Using advanced analytical techniques such as GC/MS, LC/MS, and NMR.
    • Verification by multiple independent certified laboratories: The value assignment process, involving multiple labs and stringent acceptance criteria, serves to confirm the prepared concentrations with high confidence.
    Ask a Question

    Ask a specific question about this device

    K Number
    K121206

    Validate with FDA (Live)

    Device Name
    DETECT
    Date Cleared
    2013-01-10

    (265 days)

    Product Code
    Regulation Number
    N/A
    Panel
    Dental
    Age Range
    All
    Reference & Predicate Devices
    Predicate For
    N/A
    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticPediatricDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    Detect is an electronic device used to indicate the location of the apex and the working length. This product must only be used in hospital environments, clinics or dental offices, by qualified practitioners.

    Device Description

    Detect is a modern apex locator intended for precise localization of root canal apex. The measurements in Detect are performed utilizing AC signals at two frequencies - 500 Hz and 8 kHz. The frequencies are alternated and not mixed, eliminating the need for signal mixing and frequency discrimination electronic circuits. The patented signal measuring method utilized in Detect is based on measurements of RMS (Root Mean Square) level of the signal. Advanced user interface implemented in Detect is based on high resolution TFT color graphic display. Clear real time presentation of endodontic file movement inside the canal is designed to make dentist's work easier and to increase his confidence. Display indicators are carefully designed to be intuitively understood and to serve for instant troubleshooting during device usage. Detect shows the movement of the file inside the canal from the beginning of the measurements to the end, providing uninterrupted feedback to the dentist. File tracking algorithm enables full-scale display of the file movement during the treatment while Apical Zoom feature enables high-resolution indication of the file advance in pre-apical and apical zones. Large, clearly recognizable graphical and numerical readings in Apical Zoom are designed to enable precise control over the file advance matching the individual technique of the dentist. Visual information is accompanied by optional audio signals. Numerical values and the numerical scale shown in the Apical Zoom do not represent actual distance from the apex in mm; they serve as a convenient reference to judge the file tip position in relation to the apex. Operation of Detect is fully automatic, no manual calibrations or adjustments are required. The measured signal is analyzed and automatic adjustments are made if required. The device may operate within different conditions in the root canal: dry or wet. Very dry canals should be wetted by hypochlorite or saline solution. Full automation of the apex locator operation simplifies the use and increases the reliability of the measurements. Detect may only be used with stainless steel or nickel titanium endodontic files. Built-in Demo mode of Detect enables easy simulation of all stages of the treatment and is designed to simplify familiarization of the user with the device.

    AI/ML Overview

    1. A table of acceptance criteria and the reported device performance:

    The document does not explicitly state numerical acceptance criteria for the "Detect" device. However, it implicitly uses the performance of the predicate device, "BINGO PRO," as the benchmark for substantial equivalence. The key performance aspect for both devices is "precise apex localization" and "clinically acceptable results".

    Acceptance Criteria (Implied)Reported Device Performance (Detect)
    Precise apex localizationThe apex localization obtained with Detect is the same as BINGO PRO.
    Clinically acceptable resultsDetect provides clinically acceptable results.
    Same intended use as BINGO PRODetect has the same intended use as BINGO PRO.
    Same fundamental scientific technology as BINGO PRODetect has the same fundamental scientific technology as BINGO PRO.

    2. Sample size used for the test set and the data provenance (e.g. country of origin of the data, retrospective or prospective):

    • Sample Size: Not explicitly stated, the document only mentions "ex-vivo test was performed on extracted teeth." The exact number of teeth used is not provided.
    • Data Provenance: "ex-vivo test was performed on extracted teeth." This indicates the data was collected from biological samples (extracted teeth) outside of a live patient setting. The country of origin is not specified. The study is ex-vivo, which is a form of prospective testing on biological specimens.

    3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g. radiologist with 10 years of experience):

    This information is not provided in the document. The document simply states that the results of "Detect" were compared to the results of "BINGO PRO," implying that "BINGO PRO" served as a reference or a form of ground truth for the comparison, but without detailing how the true apex location was established for either device or if experts determined this.

    4. Adjudication method (e.g. 2+1, 3+1, none) for the test set:

    This information is not provided in the document.

    5. If a multi-reader multi-case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:

    This is not applicable. The device, "Detect," is an electronic apex locator, not an AI system designed to assist human readers (e.g., radiologists interpreting images). The study compares the performance of one device to another, not human performance with and without AI.

    6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done:

    Yes, a standalone performance test was done. The "Detect" device's performance was evaluated independently during the ex-vivo test and then compared to the "BINGO PRO" device. The document describes the device's automatic operation ("fully automatic, no manual calibrations or adjustments are required") which supports the idea of a standalone assessment of its measurement capabilities.

    7. The type of ground truth used (expert consensus, pathology, outcomes data, etc.):

    The document implies that the ground truth was established by comparing "Detect" to the results obtained from the "BINGO PRO" apex locator, which is an FDA-cleared device. Therefore, the ground truth is essentially comparison against a predicate device with established performance, rather than an independent gold standard like direct anatomical measurement or pathology results.

    8. The sample size for the training set:

    This information is not provided in the document. The document describes an ex-vivo test for performance evaluation, but does not detail any internal training sets for the device's development.

    9. How the ground truth for the training set was established:

    This information is not provided in the document, as no training set details are given.

    Ask a Question

    Ask a specific question about this device

    K Number
    K121122

    Validate with FDA (Live)

    Date Cleared
    2012-07-03

    (81 days)

    Product Code
    Regulation Number
    862.3280
    Age Range
    All
    Reference & Predicate Devices
    N/A
    Predicate For
    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticPediatricDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The Detectabuse® Liquid control is intended for use as quality control urine to monitor the precision of laboratory urine toxicology testing procedures for the analytes listed in the package insert.

    Device Description

    Not Found

    AI/ML Overview

    This is a 510(k) premarket notification for a medical device called "Detectabuse® Liquid Control." This document focuses on the regulatory approval of this device, rather than a detailed study report with specific acceptance criteria and performance data in the format requested.

    Therefore, the requested information regarding specific acceptance criteria, reported device performance, sample sizes, expert qualifications, adjudication methods, MRMC studies, standalone performance, and ground truth establishment for a clinical study is not present in the provided document.

    The document states that the FDA has determined the device is "substantially equivalent" to legally marketed predicate devices. This determination is based on the device meeting the same "indications for use" as existing devices, rather than providing specific performance metrics against pre-defined acceptance criteria in a clinical study context.

    In the context of this 510(k) summary, the "acceptance criteria" are broad regulatory requirements for substantial equivalence, and the "study" referred to would be the comparison to predicate devices, which is not detailed in terms of performance metrics.

    In summary, the provided document does not contain the specific performance data and study details requested in your prompt.

    Ask a Question

    Ask a specific question about this device

    K Number
    K040812

    Validate with FDA (Live)

    Manufacturer
    Date Cleared
    2004-09-02

    (157 days)

    Product Code
    Regulation Number
    870.3680
    Age Range
    All
    Reference & Predicate Devices
    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticPediatricDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The DETECT™ Surgical Pacing and Mapping Tool is a handheld, single use device designed to provide temporary cardiac pacing or monitoring.

    Device Description

    The Medtronic® Detect™ Temporary Pacing and Mapping Device Description: Electrode Probe consists of a handle, a malleable stainless steel shaft with a flouropolymer sheath ending in a textured ball tip electrode, and a cable for connection to diagnostic device. Sterile, Nonpyrogenic, Disposable, Single use only.

    The Grounding Electrode consists of a needle and a cable for connection to a diagnostic device. Sterile, Nonpyrogenic, Disposable, Single use only.

    The Detect™ Electrode Probe is compatible with the Medtronic External Temporary Pacemaker (Model 5388), and the Medtronic Programmer/ Analyzer (Model 2090/2290).

    AI/ML Overview

    The provided 510(k) summary does not contain detailed acceptance criteria and a study proving the device meets them in the way a modern AI/ML device submission would. This document pertains to a medical device (a temporary pacing and mapping tool) from 2004, which predates the widespread regulatory frameworks for AI/ML-driven devices.

    The "study" referenced is a regulatory review for substantial equivalence to a predicate device, rather than a performance study with detailed metrics and statistical significance for a novel AI algorithm.

    However, based on the provided text, I can infer and extract information to address your points as best as possible within the context of a 2004 medical device submission.

    Here's an analysis of the provided text in response to your questions:


    1. A table of acceptance criteria and the reported device performance

    Based on the document, the "acceptance criteria" are not explicitly defined as pass/fail thresholds for specific quantitative performance metrics of a novel algorithm. Instead, the acceptance is based on the device being deemed "safe and effective" and "substantially equivalent" to a predicate device, primarily through compliance with established medical device standards and preliminary guidance.

    Acceptance Criteria (Inferred from regulatory context)Reported Device Performance (Inferred)
    Safety and Effectiveness: Meets general requirements for medical devices.The device has been "tested and are considered safe and effective."
    Substantial Equivalence: Similar in principle and intended use to a predicate device.The device is deemed "substantially equivalent" to legally marketed predicate devices (specifically, the Medtronic® Model 6494 Unipolar Temporary Myocardial Pacing Wire).
    Compliance with Standards: Adheres to relevant international and FDA guidance documents.**The device meets standards set by: - "Electrode Recording Catheter Preliminary guidance" (FDA, 1995) - IEC 60601-1 - IEC 60601-27
    Intended Use Fulfilled: Capable of temporary cardiac pacing or monitoring.The device is designed and demonstrated to provide "temporary cardiac pacing or monitoring."
    Compatibility: Works with specified Medtronic devices.Compatible with Medtronic External Temporary Pacemaker (Model 5388) and Medtronic Programmer/ Analyzer (Model 2090/2290).

    2. Sample size used for the test set and the data provenance (e.g., country of origin of the data, retrospective or prospective)

    The document does not describe a "test set" in the context of an AI/ML algorithm's performance evaluation using patient data. It refers to testing of the physical device for safety and effectiveness, which would typically involve bench testing, biocompatibility testing, electrical safety testing, and potentially some limited animal or human clinical data for a novel device, but not a "test set" for an algorithm.

    Therefore, this information is not applicable or available in the provided text.


    3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts

    As there is no mention of a "test set" for an algorithm's performance, there is no discussion of experts establishing ground truth for such a set. The "ground truth" here is the regulatory assessment of device safety and effectiveness and substantial equivalence by regulatory bodies (FDA) based on submitted data and adherence to standards.

    Therefore, this information is not applicable or available in the provided text.


    4. Adjudication method (e.g., 2+1, 3+1, none) for the test set

    Similarly, since there's no "test set" for algorithm performance described, there's no adjudication method mentioned.

    Therefore, this information is not applicable or available in the provided text.


    5. If a multi-reader multi-case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

    The document does not describe an MRMC comparative effectiveness study or any study involving human readers interacting with an AI system. This is a physical device (an electrode probe), not an AI diagnostic or assistive tool.

    Therefore, this information is not applicable or available in the provided text.


    6. If a standalone (i.e. algorithm only without human-in-the loop performance) was done

    This refers to an AI algorithm's performance. The device described is a physical medical tool, not an AI algorithm.

    Therefore, this information is not applicable or available in the provided text.


    7. The type of ground truth used (expert consensus, pathology, outcomes data, etc)

    For this type of traditional medical device, the "ground truth" for regulatory approval would be established through a combination of:

    • Bench Testing Data: Verification of electrical performance, mechanical integrity, material compatibility, and sterile barrier integrity against predefined specifications.
    • Biocompatibility Testing: Data demonstrating the device's materials do not cause adverse biological reactions.
    • Performance Data: Evidence (often from preclinical studies or, if applicable, limited clinical data) that the device performs its intended function (pacing or monitoring) effectively and safely.
    • Comparison to Predicate: The predicate device itself serves as a "ground truth" reference for safety and effectiveness, meaning the new device must demonstrate comparable performance characteristics.
      The studies mentioned in the document are compliance with IEC standards, which cover aspects like electrical safety and electromagnetic compatibility.

    No human expert consensus, pathology, or specific outcomes data for defining an "algorithm ground truth" is mentioned.


    8. The sample size for the training set

    The concept of a "training set" is specific to machine learning algorithms. This document describes a physical medical device, not an AI/ML algorithm.

    Therefore, this information is not applicable or available in the provided text.


    9. How the ground truth for the training set was established

    As there is no "training set" for an AI/ML algorithm, the method for establishing its ground truth is not applicable.

    Therefore, this information is not applicable or available in the provided text.


    In summary: The provided 510(k) summary is for a traditional physical medical device from 2004 and does not address the criteria typically associated with AI/ML device submissions (e.g., test sets, training sets, AI performance metrics, expert adjudication for algorithms). The "proof" for this device lies in its substantial equivalence to a legally marketed predicate and its compliance with established safety and performance standards.

    Ask a Question

    Ask a specific question about this device

    K Number
    K023367

    Validate with FDA (Live)

    Manufacturer
    Date Cleared
    2003-06-25

    (260 days)

    Product Code
    Regulation Number
    872.4565
    Panel
    Dental
    Age Range
    All
    Reference & Predicate Devices
    Predicate For
    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticPediatricDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    DETECTAR is indicated for use in the detection of subgingival dental calculus.
    DETECTAR is indicated for the detection of subgingival dental calculus

    Device Description

    The DETECTAR probe is similar in intended use, size, and shape to a manual periodontal probe. The DETECTAR probe contains an optical fiber that reads the optical signature of dental calculus and converts it into an electrical signal. From that electrical signal a computer analysis identifies the dental calculus.

    AI/ML Overview

    1. Acceptance Criteria and Reported Device Performance

    The acceptance criteria are not explicitly stated in the provided document. However, the study aims to show that DETECTAR performs better than a manual periodontal probe in detecting subgingival dental calculus. The reported device performance is that "The DETECTAR significantly outperformed the manual periodontal probe" in an in vitro evaluation.

    Acceptance Criteria (Inferred)Reported Device Performance
    Detects subgingival dental calculus effectivelyDETECTAR significantly outperformed the manual periodontal probe
    Better than or equal to manual periodontal probe in detectionDETECTAR significantly outperformed the manual periodontal probe

    2. Sample Size Used for the Test Set and Data Provenance

    • Sample Size: Not explicitly stated. The study involved a "piece of pig gingiva... on the root surface of the teeth" and a comparison with a manual periodontal probe. The number of teeth or calculus samples tested is not quantified.
    • Data Provenance: In vitro evaluation. The country of origin is not specified but the submitter is from Quebec, Canada. Retrospective or prospective is not applicable for an in vitro study of this nature.

    3. Number of Experts Used to Establish Ground Truth for the Test Set and Qualifications

    • Number of Experts: Three experienced clinicians.
    • Qualifications: Described as "experienced clinicians." Specific qualifications (e.g., years of experience, specialty) are not provided beyond "experienced." The document implies these clinicians are performing the evaluations and their observations contribute to the findings.

    4. Adjudication Method for the Test Set

    The document does not describe an explicit adjudication method. The three experienced clinicians appear to have individually conducted the evaluations and their findings were then compared, leading to the conclusion that DETECTAR "significantly outperformed" the manual probe. It does not mention a consensus-building or tie-breaking process.

    5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

    No, a multi-reader multi-case (MRMC) comparative effectiveness study was not explicitly described in terms of human readers improving with AI vs. without AI assistance. The study described is a comparison of a device (DETECTAR) against a manual instrument (periodontal probe) in vitro, with clinicians performing the evaluations. It's not a study of human readers' diagnostic accuracy before and after AI assistance.

    6. Standalone Performance Study

    Yes, a standalone (algorithm only without human-in-the-loop performance) study was effectively done. The DETECTAR device, which contains an optical fiber and uses "computer analysis" to identify dental calculus, was evaluated on its own in detecting calculus, with the output then presumably interpreted by the clinicians. The "significant outperformance" refers to the device's capability relative to a manual probe.

    7. Type of Ground Truth Used

    The ground truth used is implicitly the known presence or absence of subgingival dental calculus on the in vitro model (pig gingiva and tooth root). The "drops of blood" were introduced to simulate conditions, suggesting a controlled environment where the presence of calculus could be pre-established or observed reliably by the "experienced clinicians." It is not explicitly stated if a gold standard like histology or micro-CT was used to definitively label the calculus, but rather the clinicians' assessments appear to contribute to the understanding of ground truth or at least the comparative performance.

    8. Sample Size for the Training Set

    The document does not provide any information about a training set since this appears to be a direct evaluation of the device's performance rather than a validation of a machine learning model that would require a separate training phase. The "computer analysis" identifies dental calculus from an electrical signal, implying a pre-trained algorithm, but the details of that training are not included.

    9. How Ground Truth for the Training Set Was Established

    Not applicable, as information regarding a training set is not provided in the document.

    Ask a Question

    Ask a specific question about this device

    K Number
    K960469

    Validate with FDA (Live)

    Date Cleared
    1996-03-14

    (42 days)

    Product Code
    Regulation Number
    884.4530
    Age Range
    All
    Reference & Predicate Devices
    N/A
    Predicate For
    N/A
    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticPediatricDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    for collecting vaginal and cervical cell samples for cytological evaluation and infection diagnosis. The device is not indicated for endometrial cell sampling or for use on pregnant patients.

    Device Description

    The Detect™ Cytology Brush II is a one-time use device for collecting vaginal and cervical cell samples for cytological evaluation and infection diagnosis. The device is not indicated for endometrial cell sampling or for use on pregnant patients. The materials of construction have undergone biocompatibility testing and met the requirements of the tests. Testing was also conducted to characterize the performance and integrity of the device. Results were comparable to those obtained when similarly testing a predicate device.

    AI/ML Overview

    This 510(k) Premarket Notification for the Detect Cytology Brush II is a pre-amendment filing from 1996. It falls under a different regulatory framework than modern medical devices that rely on extensive clinical studies and AI performance metrics.

    Therefore, the requested information regarding "acceptance criteria" based on device performance, "study that proves the device meets the acceptance criteria," "sample sizes," "expert ground truth," "adjudication methods," "MRMC studies," "standalone performance," and "training set details" is not applicable to this document.

    This document describes a medical device, a cytology brush, that is substantially equivalent to predicate devices already on the market at the time. The 510(k) pathway for this type of device in 1996 primarily focused on:

    • Indications for Use: Ensuring the new device is intended for the same purpose as existing devices.
    • Technology/Design: Demonstrating that the technology and design are similar to already approved devices.
    • Safety (Biocompatibility): Confirming that the materials used are safe for human contact.
    • Performance and Integrity (Bench Testing): Showing that the device functions as intended and is robust, often through comparison to a predicate device in controlled lab settings.
    • Manufacturing and Quality Assurance: Describing the processes in place to ensure consistent product quality.

    Here's a breakdown of what can be extracted from the document in relation to your questions, and why most of your requested fields are not applicable:

    1. A table of acceptance criteria and the reported device performance:

    Acceptance Criteria (Implied)Reported Device Performance
    Biocompatibility: Device materials are safe for human contact."The materials of construction have undergone biocompatibility testing and met the requirements of the tests."
    Performance and Integrity: Device effectively collects cell samples and maintains structural integrity."Testing was also conducted to characterize the performance and integrity of the device. Results were comparable to those obtained when similarly testing a predicate device."
    Substantial Equivalence to Predicate: Similar indications for use and design."This device is similar with respect to indications for use and design to predicate devices in terms of section 510(k) substantial equivalency."

    2. Sample sized used for the test set and the data provenance (e.g. country of origin of the data, retrospective or prospective):

    • Not applicable. This document describes bench testing and comparison to a predicate device, not clinical studies with human participants that would involve "test sets" for performance evaluation in the context of diagnostic accuracy. The "testing" mentioned refers to internal engineering and materials testing.

    3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g. radiologist with 10 years of experience):

    • Not applicable. See point 2. No clinical "test set" requiring expert ground truth in the diagnostic sense was used for this premarket notification.

    4. Adjudication method (e.g. 2+1, 3+1, none) for the test set:

    • Not applicable. See point 2.

    5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:

    • Not applicable. This device is a manual cytology brush, a physical instrument. It does not involve AI or human "readers" in the context of image interpretation or diagnostic effectiveness.

    6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done:

    • Not applicable. This device is a manual instrument, not an algorithm.

    7. The type of ground truth used (expert consensus, pathology, outcomes data, etc):

    • Not applicable. The "ground truth" for this device involved engineering specifications and material science for biocompatibility and mechanical performance, and a comparison to an existing predicate device for functional equivalence. It doesn't relate to diagnostic accuracy ground truth.

    8. The sample size for the training set:

    • Not applicable. This device does not use machine learning or AI, and therefore has no "training set."

    9. How the ground truth for the training set was established:

    • Not applicable. This device does not use machine learning or AI, and therefore has no "training set."

    In summary: The provided document is a 510(k) summary for a relatively simple, non-AI manual medical device from 1996. The regulatory requirements and the type of evidence presented are fundamentally different from what would be expected for a diagnostic AI device today.

    Ask a Question

    Ask a specific question about this device

    Page 1 of 1