Search Filters

Search Results

Found 2 results

510(k) Data Aggregation

    K Number
    K173574
    Device Name
    DenSeeMammo
    Manufacturer
    Date Cleared
    2018-06-26

    (218 days)

    Product Code
    Regulation Number
    892.2050
    Reference & Predicate Devices
    Predicate For
    N/A
    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    DenSeeMammo is a software application intended for use with Full Field Digital Mammography systems.

    DenSeeMammo estimates Bl-RADS breast density category by analyzing processed digital 2D mammograms using a fully automated comparison procedure.

    DenSeeMammo provides a BI-RADS breast density 5th Edition category to aid radiologists in the assessment of breast density. DenSeeMammo produces adjunctive information. It is not a diagnostic aid since the final assessment of breast density category is made by an MQSA qualified interpreting physician.

    DenSeeMammo core software has been built and tested on OS X based computers.

    DenSeeMammo graphical use interface software has been built and tested on Windows, OS X and Linux based computers. DenSeeMammo is compatible for images obtained from GE Senographe Essentials and Hologic Selenia Dimension systems.

    Device Description

    DenSeeMammo is a software application intended for use with Full Field Digital Mammography systems. DenSeeMammo estimates BI-RADS breast density category by analyzing processed digital 2D mammograms using a fully automated comparison procedure. DenSeeMammo provides a BI-RADS breast density 5th Edition category to aid radiologists in the assessment of breast density. DenSeeMammo produces adjunctive information. It is not a diagnostic aid since the final assessment of breast density category is made by an MQSA qualified interpreting physician. DenSeeMammo core software has been built and tested on OS X based computers. DenSeeMammo graphical use interface software has been built and tested on Windows, OS X and Linux based computers. DenSeeMammo v1.2 is compatible for images obtained from GE Senographe Essentials and Hologic Selenia Dimension systems.

    The software use processed digital 2D mammograms in a fully automated comparison procedure that produces a BI-RADS breast density category. The software processes and analyses the image according to proprietary algorithms that allow comparison to qualified databases containing images previously visually assessed by radiologists. For each patient it provides measures of BI-RADS breast density category. DenSeeMammo provides results per patient based on the maximum density category of the two breasts.

    The software works in a client-server mode and requires that the user computer be on the same local network as the server. Computations are made on the server part of the system that also provide the graphical user interface to display the results. A web browser is required to display the graphical user interface: to select the patients' images and to display the assessment of the breast density according to the BI-RADS standards and the similar images.

    The software was developed using the Java-1.8 language as a 3-component web application. The software was developed following an adapted version of the model – view – controller software architectural pattern.

    The device does not contact the patient, nor does it control any life-sustaining devices.

    AI/ML Overview

    The provided text describes the DenSeeMammo software, a device that estimates BI-RADS breast density category from digital 2D mammograms. The document is a 510(k) summary, specifically for DenSeeMammo v1.2, which is an updated version of the previously cleared DenSeeMammo v1.0.

    Here's an analysis of the acceptance criteria and the study that proves the device meets them, based on the provided text:

    1. A table of acceptance criteria and the reported device performance:

    The document does not provide a formal table of explicit acceptance criteria with specific numerical targets for performance metrics (e.g., accuracy, sensitivity, specificity). Instead, it broadly states that "All verification and validation testing was successful in that established acceptance criteria was met for all of the tests conducted."

    The performance testing section (Section 9) describes various tests performed to demonstrate the device's functionality and consistency. While it indicates that the tests were successful, it does not report specific quantitative performance metrics for DenSeeMammo v1.2 against radiologists' assessments, nor does it define what "established acceptance criteria" were.

    Observed Performance (as described, but without numerical values):

    Performance AspectDescription from Document
    ReproducibilityDenSeeMammo v1.2 software was run over twice on data sets of images to test reproducibility. DenSeeMammo v1.2 software was run over on a sample of exams, and left and right breast densities were compared to test reproducibility. (Implicit success, but no statistical measure provided).
    Accuracy/AgreementDenSeeMammo v1.2 software results were compared to visual assessment from MQSA-qualified radiologists. (Implicit success, but no statistical measure provided).
    CompatibilityDenSeeMammo v1.2 software was run over substantial data sets of two views images (CC + MLO) from GE and Hologic systems, which had been previously assessed by MQSA-qualified radiologists. DenSeeMammo v1.2 software was run over substantial data sets of one view images from GE (CC) and Hologic (CC or MLO) systems, which had been previously assessed by MQSA-qualified radiologists. (Implicit success).
    UsabilityBeta site testing to assess the ability of physicians to successfully integrate the software into their existing systems as well as assess usability for target users. (Implicit success).

    2. Sample sizes used for the test set and the data provenance:

    • Test Set Sample Size: The document repeatedly uses the phrase "substantial data sets" when referring to the images used for testing (e.g., "substantial data sets of two views images," "substantial data sets of one view images"). However, it does not specify the exact number of cases or images in these test sets.
    • Data Provenance: The document does not explicitly state the country of origin of the data. It mentions compatibility with GE Senographe Essentials and Hologic Selenia Dimension systems, which are widely used globally, but offers no specific geographic information for the data sources. It is also unclear if the data was retrospective or prospective; however, given that it refers to images "previously assessed by MQSA-qualified radiologists," it strongly implies a retrospective collection of existing images.

    3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts:

    • Number of Experts: The document does not specify the exact number of MQSA-qualified radiologists used to establish the ground truth. It consistently refers to them in the plural ("radiologists").
    • Qualifications of Experts: The experts are described as "MQSA-qualified radiologists." MQSA (Mammography Quality Standards Act) qualification is a specific requirement in the United States for interpreting mammography. This indicates a high level of expertise in mammography interpretation.

    4. Adjudication method for the test set:

    The document mentions "comparison to qualified databases containing images previously visually assessed by MQSA-qualified radiologists." It implies that assessments from these radiologists serve as the ground truth. However, it does not describe any specific adjudication method (e.g., 2+1, 3+1 consensus, or independent reads with a tie-breaker) if there were discrepancies among radiologists for the ground truth establishment. It simply states "previously visually assessed," suggesting a single or pre-determined ground truth per image.

    5. If a multi-reader multi-case (MRMC) comparative effectiveness study was done, if so, what was the effect size of how much human readers improve with AI vs without AI assistance:

    The document does not describe an MRMC comparative effectiveness study designed to assess how human readers improve with AI assistance versus without it. The device is intended to "aid radiologists in the assessment of breast density" and "produces adjunctive information," but the studies described focus on the standalone performance of the algorithm compared to radiologists' assessments, not on the human-AI team performance.

    6. If a standalone (i.e., algorithm only without human-in-the-loop performance) was done:

    Yes, a standalone performance assessment was conducted. The "Performance Testing" section states:

    • "DenSeeMammo v1.2 software results were compared to visual assessment from MQSA-qualified radiologists."
    • "DenSeeMammo v1.2 software was run over substantial data sets... which had been previously assessed by MQSA-qualified radiologists."

    This indicates that the algorithm's output (BI-RADS breast density category) was compared directly to the expert-determined ground truth, representing a standalone performance evaluation.

    7. The type of ground truth used:

    The ground truth used for the test set was expert consensus / visual assessment by MQSA-qualified radiologists using ACR BI-RADS V recommendations. This is explicitly stated: "Comparison to qualified databases containing images previously visually assessed by MQSA-qualified radiologists using ACR BI-RADS V recommendations."

    8. The sample size for the training set:

    The document does not provide any information regarding the sample size for the training set. It implicitly refers to "qualified databases" that the algorithm uses for "comparison," but it does not specify if these databases also served as training data, nor their size.

    9. How the ground truth for the training set was established:

    The document does not provide details on how the ground truth for any potential training set was established. It mentions that the software's algorithms "allow comparison to qualified databases containing images previously visually assessed by radiologists." This suggests a similar process to the test set ground truth (visual assessment by radiologists), but specific methodology for a training set is not described.

    Ask a Question

    Ask a specific question about this device

    K Number
    K152009
    Device Name
    DENSEEMAMMO v1.0
    Manufacturer
    Date Cleared
    2016-12-05

    (503 days)

    Product Code
    Regulation Number
    892.2050
    Reference & Predicate Devices
    Predicate For
    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    DenSeeMammo is a software application intended for use with digital mammography systems. DenSeeMammo estimates BI-RADS breast density value by analyzing processed digital 2D mammograms using a fully automated comparison procedure.

    DenSeeMammo provides a BI-RADS breast density 5th Edition category to aid radiologists in the assessment of breast density.

    DenSeeMammo produces adjunctive information. It is not an interpretive or diagnostic aid when the final assessment of breast density category is made by an MQSA qualified interpreting physician.

    DenSeeMammo core software has been built and tested on OS X based computers.

    DenSeeMammo graphical use interface software has been built and tested on Windows, OS X and Linux based computers.

    DenSeeMammo is compatible for images obtained from GE Senographe Essentials systems.

    Device Description

    DenSeeMammo analyzes processed digital 2D mammograms in a fully automated comparison procedure that produces a BI-RADS breast density value.

    DenSeeMammo handles processed images extracted from DICOM files as input.

    DenSeeMammo core software has been built and tested on OS X based computers.

    DenSeeMammo graphical user interface software has been built and tested on Windows, OS X and Linux based computers.

    DenSeeMammo software is a component which accepts digital mammography images as an input. The software processes and analyses the image according to proprietary algorithms which allow comparison to qualified databases containing images previously quoted by radiologists.

    For each patient it provides measures of BI-RADS breast density category. DenSeeMammo provides results per patient based on the maximum density category of the two breasts. The patient population is symptomatic and asymptomatic women undergoing mammography. The software does perform illustrative image display but only for illustrative purposes and not for interpretation or diagnostic.

    AI/ML Overview

    Here's a summary of the acceptance criteria and study information for DenSeeMammo v1.0, based on the provided text:

    1. Table of Acceptance Criteria and Reported Device Performance:

    The document broadly states that "established acceptance criteria was met for all of the tests conducted." However, it does not provide specific quantitative acceptance criteria values or detailed performance metrics for DenSeeMammo v1.0. It only describes the types of tests performed.

    Test TypeAcceptance Criteria (Not Explicitly Stated Quantitatively)Reported Device Performance (Not Explicitly Stated Quantitatively)
    Reproducibility (over same data sets)Consistency of resultsSuccessful (Criteria met)
    Reproducibility (left/right breast density comparison)Consistency of resultsSuccessful (Criteria met)
    Comparison to visual assessment by MQSA radiologistsAgreement with expert ratingsSuccessful (Criteria met)
    Run over substantial data sets (previously assessed)Agreement with expert ratings on a larger scaleSuccessful (Criteria met)
    Beta site testing (integration & usability)Successful integration into existing systems and usability for target usersSuccessful (Criteria met)

    2. Sample Size Used for the Test Set and Data Provenance:

    • Sample Size for Test Set: The document mentions "a data sets of images" and "a sample of exams" for reproducibility tests, and "substantial data sets of images" for comparison with expert assessments. However, specific numerical sample sizes are not provided for any of these test sets.
    • Data Provenance: Not explicitly stated (e.g., country of origin). The document indicates the data used were "previously visually assessed by MOSA radiologists," implying real-world mammograms. It does not clarify if the data was retrospective or prospective.

    3. Number of Experts Used to Establish Ground Truth for the Test Set and Qualifications:

    • Number of Experts: Not explicitly stated. The document consistently refers to "MQSA radiologists" or "MOSA radiologists" (likely a typo for MQSA), implying multiple qualified experts.
    • Qualifications of Experts: "MQSA qualified interpreting physician" or "MQSA radiologists." MQSA (Mammography Quality Standards Act) qualified indicates they are certified for mammography interpretation in the US. Specific years of experience are not mentioned.

    4. Adjudication Method for the Test Set:

    Not explicitly stated. The document only mentions that DenSeeMammo results were "compared to visual assessment from MQSA radiologists" and run on data "previously visually assessed by MOSA radiologists." It does not describe how discrepancies among multiple radiologists (if present) were resolved.

    5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done:

    No, an MRMC comparative effectiveness study demonstrating how human readers improve with AI vs. without AI assistance was not reported. The study focused on the performance of the DenSeeMammo software itself compared to expert assessment. The device is explicitly stated as "adjunctive information. It is not an interpretive or diagnostic aid when the final assessment of breast density category is made by an MQSA qualified interpreting physician."

    6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) Was Done:

    Yes, the verification bench testing and the clinical validation testing appear to describe standalone performance evaluations. DenSeeMammo was "run over twice on a data sets of images to test reproducibility" and "was run over substantial data sets of images." The core function is "fully automated comparison procedure." The results from the device were then compared to expert assessment, suggesting the algorithm's standalone output was the subject of evaluation.

    7. The Type of Ground Truth Used:

    The ground truth used was expert consensus/visual assessment by MQSA qualified radiologists. The device's results were compared to "qualified databases containing images previously quoted by radiologists" and "visual assessment from MQSA radiologists."

    8. The Sample Size for the Training Set:

    The sample size for the training set is not mentioned in the provided document. The document refers to "qualified databases" that the algorithm uses for comparison, but it does not specify the size or details of these databases or how they relate to the development/training of the software.

    9. How the Ground Truth for the Training Set Was Established:

    The document states that the software "analyses the image according to proprietary algorithms which allow comparison to qualified databases containing images previously quoted by radiologists." This implies that the ground truth for these "qualified databases" was established by radiologists' assessments. However, further details on the process of establishing this ground truth for the training data (e.g., number of radiologists, adjudication, specific criteria) are not provided.

    Ask a Question

    Ask a specific question about this device

    Page 1 of 1