Search Filters

Search Results

Found 6 results

510(k) Data Aggregation

    Why did this record match?
    Device Name :

    SOMATOM Edge Plus, SOMATOM Confidence, SOMATOM Definition Edge, SOMATOM Definition AS/AS+, SOMATOM Definition
    AS Open, SOMATOM Drive, SOMATOM Force, SOMATOM Definition Flash

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    This computed tomography system is intended to generate and process cross-sectional images of patients by computer reconstruction of x-ray transmission data.

    The images delivered by the system can be used by trained staff as an aid in diagnosis, treatment and radiation therapy planning as well as for diagnostic and therapeutic interventions.

    This CT system can be used for low dose lung cancer screening in high risk populations*.

    *As defined by professional medical societies. Please refer to clinical literature, including the results of the National Lung Screening Trial (N Engl J Med 2011; 365:395-409) and subsequent literature, for further information.

    Device Description

    The subject device SOMATOM CT Scanner Systems with SOMARIS/7 syngo CT VB30 are Computed Tomography X-ray Systems which feature one (single source) continuously rotating tube-detector system and function according to the fan beam principle. The SOMATOM CT Scanner Systems with Software SOMARIS/7 syngo CT VB30 produces CT images in DICOM format, which can be used by trained staff for post-processing applications commercially distributed by Siemens Healthcare and other vendors as an aid in diagnosis, treatment preparation and therapy planning support (including, but not limited to, Brachytherapy, Particle including Proton Therapy, External Beam Radiation Therapy, Surgery). The computer system delivered with the CT scanner is able to run optional post processing applications.

    The platform software for the SOMATOM CT Scanner Systems, SOMARIS/7 syngo CT VB30, is a commandbased program used for patient management, data management, X-ray scan control, image reconstruction, and image archive/evaluation.

    AI/ML Overview

    Here's a breakdown of the acceptance criteria and the study that proves the device meets them, based on the provided text.

    1. Table of Acceptance Criteria and Reported Device Performance

    The document primarily focuses on functional verification and validation testing rather than explicit, quantifiable acceptance criteria with corresponding performance metrics for each feature in a tabular format. Instead, it describes the objective of each test and then states that the results were found to be acceptable or passed.

    However, we can extract the objectives and the documented outcomes for features where some quantifiable or descriptive performance is mentioned:

    Feature TestedAcceptance Criteria (Objective of Test)Reported Device Performance
    FAST BolusDeviation from an ideal post-bolus delay.Found in an acceptable margin when compared to averaged dynamic scans (ground truth).
    Supporting publications show:
    • Median difference between true and personalized delay 90% of patients.
    • Higher overall and more uniform attenuation in individualized cohort vs. fixed.
    • Higher contrast-to-noise ratio (CNR) and subjective image quality in individualized cohort.
    • Able to adjust scan timing to altered protocols to reach diagnostic image quality despite slower injection rate and reduced iodine dose.
    • Images with individualized post-trigger delay provided higher attenuation for all organs.
    • Mean vessel enhancement significantly higher in individualized scan timing group. |
      | FAST 3D Camera (Adolescent support) | Achieve comparable or more accurate results than predicate for adults, while supporting adolescent patients (120 cm+) with comparable accuracy as adult patients. | Achieves the objective of the test. (Implies comparable or more accurate results). |
      | FAST Isocentering (Adolescent support) | Lateral isocenter accuracy of subject device comparable to predicate for adult patients, and similar accuracy for adolescent patients. | Comparable to predicate for adult patients; similar accuracy for adolescent patients. |
      | FAST Range (Adolescent support) | Robustness of groin landmark improved; other landmarks detected with comparable accuracy for adults; accuracy of landmark detection for adolescents similar to adults. | Robustness of groin landmark improved; other landmarks with comparable accuracy. For adolescents, similar accuracy to adults. |
      | FAST Direction | Comparable accuracy of pose detection to predicate device. | Comparable accuracy. |
      | FAST Planning | Fraction (percentage) of correct ranges that can be applied without change; calculation time meets interactive requirements. | For >90% of ranges, no editing action was necessary to cover standard ranges. For >95%, the speed of the algorithm was sufficient. |
      | Tin Filtration (New kV combinations) | Successful implementation of new voltage combinations (80/Sn140 kV and 100/Sn140 kV) verified; description of spectral properties given; improved CNR in spectral results (monoenergetic images). | Successful implementation verified via phantom scans and image quality criteria evaluation. All applied tests concerning image quality passed. Different spectral properties with and without Sn filter evident, and Sn filter improves spectral separation considerably. Results support claims related to improved CNR. |
      | General Non-Clinical Testing (Integration & Functional) | Verify and validate functionality of modifications. Ensure safe and effective integration. Conformance with special controls for software medical devices. Risk mitigation. | All software specifications met acceptance criteria. Testing supports claims of substantial equivalence. |

    2. Sample Size Used for the Test Set and Data Provenance

    • FAST Bolus: The test describes using a "real contrast enhancement curve" determined by measurements with a dynamic scan mode. The subsequent supporting peer-reviewed studies provide more detail:

      • Korporaal et al. (2015): Not explicitly stated, but implies a cohort undergoing bolus tracking.
      • Hinzpeter et al. (2019): 108 patients received patient-specific trigger delay (subject), 108 patients received fixed trigger delay (reference). Prospective CT angiography scans of the aorta.
      • Gutjahr et al. (2019): 3 groups, 20, 20, and 40 patients respectively.
      • Yu et al. (2021): 104 patients (52 per group, implied) in abdominal multiphase CT, comparing individualized vs. fixed post-trigger delay.
      • Yuan et al. (2023): 204 consecutive participants randomly divided into two groups (102 patients each). A prospective study in coronary CT angiography (CCTA).
      • Schwartz et al. (2018): Not explicitly stated, but implied patient-specific data.
      • Data Provenance: The supporting studies imply a mix of retrospective analysis (e.g., Korporaal et al. simulating retrospectively differences) and prospective studies based on the descriptions provided. The locations of these studies are not explicitly mentioned in the excerpt, but given Siemens' global presence, it's likely multi-national.
    • FAST 3D Camera, FAST Isocentering, FAST Range, FAST Direction, FAST Planning, Tin Filtration: For these features, the testing is described as "bench testing" using phantoms and internal validation. "Patient data" is mentioned for FAST Planning but without specific numbers.

      • Sample Size: Not specified for these internal bench tests; often involves phantom studies rather than patient-level data for performance metrics. For FAST Planning, it refers to "patient data" for validation, but the sample size is not indicated.
      • Data Provenance: Implied internal testing, likely at Siemens R&D facilities. No external patient data provenance details are given.

    3. Number of Experts Used to Establish Ground Truth for the Test Set and Qualifications

    • For FAST Bolus, the "ground truth" for the internal bench test was defined as an "ideal post bolus delay" determined by measurements with a dynamic scan mode. This suggests an objective, data-driven approach rather than expert consensus on individual cases for the initial ground truth. However, the supporting studies mention:
      • Hinzpeter et al. (2019): Mentions subjective image quality and CNR, which would typically involve expert readers, but the number and qualifications are not provided.
      • Yuan et al. (2023): Mentions "Both readers rated better subjective image quality." suggesting at least two readers, but their qualifications are not provided.
    • For other features (FAST 3D Camera, FAST Planning, etc.), the ground truth seems to be established through objective measurement against predefined targets (e.g., "calculated by FAST Planning algorithm that are correct and can be applied without change"). No specific expert involvement for ground truth establishment for these features is detailed.

    4. Adjudication Method for the Test Set

    • The document does not describe a formal adjudication method (e.g., 2+1, 3+1) for the establishment of ground truth or for reader studies. Where multiple readers are mentioned (e.g., Yuan et al. for FAST Bolus), it only states their findings without detailing an adjudication process. This suggests either independent readings or consensus where needed, but not a formal adjudication protocol.

    5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was Done, and Effect Size

    • Yes, implicitly for FAST Bolus: The supporting publications function as comparative effectiveness studies where human assessment (e.g., subjective image quality, diagnostic confidence) is evaluated with or without the aid of the FAST Bolus prototype.
      • Hinzpeter et al. (2019): "higher overall and more uniform attenuation in the individualized cohort compared to the fixed cohort. No difference between the cohorts for image noise was found, but a higher contrast-to-noise ratio (CNR) and higher subjective image quality in the individualized cohort compared to the fixed cohort." This indicates improvement with the AI-assisted timing.
      • Yu et al. (2021): "In the arterial phase, the images of group A with the individualized post-trigger delay provided higher attenuation for all organs... Furthermore, the contrast-to-noise ratio (CNR) of liver, pancreas and portal vein were significantly higher in the group with the individualized scan timing compared to the fixed scan delay. The overall subjective image quality and diagnostic confidence between the two groups were similar." This indicates improved quantitative metrics, with subjective similar.
      • Yuan et al. (2023): "Both readers rated better subjective image quality for Group B with the individualized scan timing. Also, the mean vessel enhancement was significantly higher in Group B in all coronary vessels. After adjusting for the patient variation, the FAST Bolus prototype was associated with an average of 33.5 HU higher enhancement compared to the fixed PTD." This provides a direct effect size for enhancement.
    • For the other features, the description is focused on the device's inherent performance (e.g., accuracy of landmark detection, successful implementation) rather than human reader improvements. So, no MRMC study for those.

    6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) Study was Done

    • Yes, for multiple features. The "Bench Testing" descriptions primarily evaluate the algorithm's performance in a standalone manner against a defined ground truth or objective:
      • FAST Bolus: "the post bolus delay as calculated by FAST Bolus to an ideal post bolus delay... was calculated. The objectives of the test were to investigate the deviation from the post bolus delay as determined by FAST Bolus to an ideal/ground truth delay..." This is standalone.
      • FAST 3D Camera, FAST Isocentering, FAST Range, FAST Direction: The tests "demonstrate that the FAST 3D Camera feature... achieves comparable or more accurate results," "lateral isocenter accuracy... comparable," "robustness of the groin landmark is improved," "comparable accuracy of the pose detection." These are assessments of the algorithm's direct performance.
      • FAST Planning: "assess the fraction (percentage) of ranges calculated by the FAST Planning algorithm that are correct and can be applied without change." This is a direct measurement of the algorithm's output quality.
      • Tin Filtration: Verifies "successful implementation" and investigates "improved contrast-to-noise ratio (CNR) in spectral results." This is standalone performance of the image reconstruction/processing.

    7. The Type of Ground Truth Used

    • Objective/Measured Data:
      • FAST Bolus: "ideal post bolus delay" determined by "measurements with a dynamic scan mode" and "averaged dynamic scans."
      • FAST 3D Camera, FAST Isocentering, FAST Range, FAST Direction: Implied ground truth based on objective measurements of spatial accuracy relative to predefined targets or phantoms.
      • FAST Planning: "correct" ranges are the ground truth, implying comparison to a predefined standard or ideal plan.
      • Tin Filtration: Objective image quality criteria and spectral property measurements are used as ground truth indicators.
    • Expert Consensus/Subjective Assessment (as secondary metric in supporting studies): Some of the supporting publications for FAST Bolus also incorporate subjective image quality ratings by human readers, which would likely involve some form of expert consensus or individual expert assessment.

    8. The Sample Size for the Training Set

    • The document does not provide information on the sample size used for the training set for any of the AI/algorithm features. This information is typically proprietary and not usually disclosed in a 510(k) summary unless specifically requested or deemed critical for demonstrating substantial equivalence.

    9. How the Ground Truth for the Training Set was Established

    • The document does not provide information on how the ground truth for the training set was established. Given the nature of these features (automated bolus timing, patient positioning, scan range planning), the training data would likely involve large datasets of CT scans annotated with physiological events, anatomical landmarks, and optimal scan parameters. These annotations would typically be established by highly qualified medical professionals (e.g., radiologists, technologists) or through automated processes validated against gold standards. However, the specific methodology is not detailed in this excerpt.
    Ask a Question

    Ask a specific question about this device

    Why did this record match?
    Device Name :

    SOMATOM Force, SOMATOM Definition Flash, SOMATOM Drive, SOMATOM Definition Edge, SOMATOM Definition AS
    Open, SOMATOM Edge Plus, SOMATOM Definition AS/AS+, SOMATOM Confidence

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    This computed tomography system is intended to generate and process cross-sectional images of patients by computer reconstruction of x-ray transmission data.

    The images delivered by the system can be used by a trained physician as an aid in diagnosis. The images delivered by the system can be used by trained staff as an aid in diagnosis, treatment preparation and radiation therapy planning.

    This CT system can be used for low dose lung cancer screening in high risk populations *

    • As defined by professional medical societies. Please refer to clinical literature, including the results of the National Lung Screening Trial (N Engl J Med 2011; 365:395-409) and subsequent literature, for further information.
    Device Description

    The subject device SOMATOM CT Scanner Systems with SOMARIS/7 syngo CT VB20 are Computed Tomography X-ray Systems which feature one (single source) or two (dual source) continuously rotating tubedetector system and function according to the fan beam principle. The SOMATOM CT Scanner Systems with Software SOMARIS/7 syngo CT VB20 produces CT images in DICOM format, which can be used by trained staff for post-processing applications commercially distributed by Siemens Healthcare and other vendors as an aid in diagnosis, treatment preparation and therapy planning support (including, but not limited to, Brachytherapy, Particle including Proton Therapy, External Beam Radiation Therapy, Surgery). The computer system delivered with the CT scanner is able to run optional post processing applications.

    The platform software for the SOMATOM CT Scanner Systems, SOMARIS/7 syngo CT VB20, is a commandbased program used for patient management, data management, X-ray scan control, image reconstruction, and image archive/evaluation.

    AI/ML Overview

    Here's an analysis of the acceptance criteria and supporting study information based on the provided text, broken down by your requested points:

    Acceptance Criteria and Study Information for SOMATOM CT Scanner Systems-Software Version SOMARIS/7 syngo CT VB20

    The provided document (a 510(k) summary) describes an update to existing Computed Tomography (CT) scanner systems (SOMATOM Force, SOMATOM Definition Flash, SOMATOM Drive, SOMATOM Definition Edge, SOMATOM Definition AS Open, SOMATOM Definition AS/AS+, SOMATOM Confidence, and SOMATOM Edge Plus) with new software version SOMARIS/7 syngo CT VB20. The primary goal of the submission is to demonstrate substantial equivalence to previously cleared predicate devices (K173630 and K173607).

    The document does not explicitly list specific numerical acceptance criteria for device performance beyond stating that "all software specifications have met the acceptance criteria" and "the SOMATOM CT Scanner Systems perform comparably to the predicate devices." It focuses on confirming the updated device maintains the safety and effectiveness of the predicate devices.

    1. Table of Acceptance Criteria and Reported Device Performance

    As specific numerical acceptance criteria are not presented in the document, I will infer the high-level acceptance criteria from the submission's focus on demonstrating substantial equivalence and list the general performance statements made.

    Acceptance Criteria (Inferred)Reported Device Performance
    Safety and Effectiveness Equivalence: Device maintains equivalent safety and effectiveness to predicate devices."The subject and predicate devices are based on the following same technological elements: Scanner Principle, System Acquisition, Iterative Reconstruction, Workplaces, Patient table, Patient table foot switch for movement, Tin filtration technology, Stellar detector technology."
    "Testing and validation is completed. Test results show that the subject devices, the SOMATOM CT Scanner Systems, are comparable to the predicate devices in terms of technological characteristics and safety and effectiveness and therefore are substantially equivalent to the predicate devices."
    "The non-clinical data supports the device and the hardware and software verification and validation demonstrates that the subject device SOMATOM CT Scanner Systems should perform as intended in the specified use conditions."
    Conformance to Standards: Device complies with relevant electrical safety, EMC, software, and risk management standards."Electrical Safety and Electromagnetic Compatibility (EMC) testing were conducted on the SOMATOM CT Scanner Systems in accordance with the following standards: 60601-2-44, and 60601-1-2. A list of recognized and general consensus standards considered for the subject devices is provided as Table 9." (Table 9 and 10 list numerous IEC, ANSI AAMI, NEMA, and ISO standards).
    "Software Documentation for a Moderate Level of Concern software per FDA's Guidance Document... is also included... The Risk Analysis was completed and risk control implemented to mitigate identified hazards."
    Software Specifications Met: All software features and updates function as intended."The test results show that all of the software specifications have met the acceptance criteria."
    Verification and Validation: Comprehensive testing proves the device's claims."The modifications described in this Premarket Notification were supported with verification and validation testing."
    "Verification and validation testing of the device was found acceptable to support the claim of substantial equivalence."
    Cybersecurity: Device meets cybersecurity requirements."Siemens conforms to the Cybersecurity requirementing a process of preventing unauthorized access, modifications, misuse or denial of use, or the unauthorized use of information that is stored, accessed, or transferred from a medical device to an external recipient... is included within this submission."
    Image Quality / Performance (Implicit): Image reconstruction and diagnostic aid functionality are maintained or improved."Non-clinical test (integration and functional) including phantom tests were conducted for the SOMATOM CT Scanner Systems during product development."
    "dosimetry and imaging performance, and analysis of phantom images to assess device and feature performance during product development." (The document implies these tests confirmed performance but doesn't provide specific numerical results).

    2. Sample Size Used for the Test Set and Data Provenance

    The document states that "phantom tests were conducted" and refers to "dosimetry and imaging performance, and analysis of phantom images to assess device and feature performance." However, no specific sample size for the test set (number of phantom scans, patient data, etc.) is provided.

    Data Provenance: The tests are described as "non-clinical test (integration and functional) including phantom tests... during product development." This indicates that the testing was conducted internally by the manufacturer,Siemens, likely on prototypes or production units, using phantoms. There is no mention of human subject data, country of origin, or whether the tests utilized retrospective or prospective data. The nature of phantom studies typically makes them prospective in this context.

    3. Number of Experts Used to Establish Ground Truth and Qualifications

    The document does not provide information on the number of experts used to establish ground truth or their specific qualifications (e.g., number of radiologists, years of experience). Given the nature of this submission (software upgrade for a CT system, focusing on technical performance and substantial equivalence rather than a new diagnostic algorithm's clinical efficacy), it's less likely to involve extensive expert-driven ground truth establishment as would be seen for AI/CADe devices. The "ground truth" for technical performance is typically established via physical measurements and established phantom metrics.

    4. Adjudication Method for the Test Set

    The document does not specify an adjudication method (e.g., 2+1, 3+1). As stated above, the testing appears to be primarily technical and phantom-based, where ground truth is often objectively measurable through physical properties or established methods, rather than subjective expert interpretation requiring adjudication.

    5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

    No MRMC comparative effectiveness study was done or reported in this document. The submission focuses on demonstrating substantial equivalence of the updated CT system to its predicates through technical and non-clinical testing, not on measuring improvements in human reader performance with or without AI assistance.

    6. Standalone (Algorithm Only Without Human-in-the-Loop Performance) Study

    While the document focuses on the performance of the CT system and its software, it does not specifically describe a standalone algorithm-only performance study in the context of an AI/CADe device. The SOMARIS/7 syngo CT VB20 is a platform software update for CT scanners, enhancing system functionality and image reconstruction capabilities (e.g., "Enhanced FAST DE Results," "Precision Matrix," "DirectDensity™"). The "performance" being evaluated is the system's ability to generate cross-sectional images and support diagnostic tasks, as opposed to a specific AI algorithm. The performance evaluation discussed would inherently be of the "algorithm" integrated into the system, contributing to the overall image quality and functional capabilities.

    7. Type of Ground Truth Used

    The ground truth for the non-clinical testing appears to be based on:

    • Physical Measurements and Phantom Readings: "Non-clinical test (integration and functional) including phantom tests were conducted." This implies that phantoms with known properties or simulated pathologies were used, and the system's output (image quality, dose metrics, etc.) was measured against these known values.
    • Engineering Specifications / Reference Data: For software functional tests ("all software specifications have met the acceptance criteria"), the ground truth would be the defined engineering and design specifications for the software's intended behavior.

    There is no mention of pathology, outcomes data, or expert consensus (in the typical sense of clinical ground truth for diagnostic accuracy) for establishing the ground truth described in this submission.

    8. Sample Size for the Training Set

    The document does not mention a training set sample size or the use of a separate training set. This is consistent with the nature of the submission, which describes a software update for a CT system rather than a machine learning or AI algorithm submission where training data sets are explicitly separated from test data. The software updates described are enhancements to the system's core functionality, reconstruction, and workflow, which are typically developed and verified through engineering processes rather than large-scale machine learning training.

    9. How the Ground Truth for the Training Set Was Established

    Since no training set is mentioned in the context of typical AI/ML development, this information is not applicable based on the provided document. The "training" for such system software updates primarily refers to the iterative development and internal testing processes by the engineers, where specifications serve as the "ground truth."

    Ask a Question

    Ask a specific question about this device

    Why did this record match?
    Device Name :

    SOMATOM Force, SOMATOM Definition Flash, SOMATOM Drive, SOMATOM Definition Edge, SOMATOM Definition AS
    Open, SOMATOM Deinition AS/AS+, SOMATOM Confidence

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    This computed tomography system is intended to generate and process cross-sectional images of patients by computer reconstruction of x-ray transmission data.

    The images delivered by the system can be used by a trained physician as an aid in diagnosis. The images delivered by the system can be used by trained staff as an aid in diagnosis, treatment preparation and radiation therapy planning.

    This CT system can be used for low dose lung cancer screening in high risk populations *

    • As defined by professional medical societies. Please refer to clinical literature, including the results of the National Lung Screening Trial (N Engl J Med 2011; 365:395-409) and subsequent literature, for further information.
    Device Description

    Siemens intends to market a new software version, SOMARIS/7 syngo CT VB10 for the following SOMATOM Computed Tomography (CT) Scanner Systems:

    Dual Source CT Systems:

    • SOMATOM Force
    • SOMATOM Drive
    • SOMATOM Flash

    Single Source CT Systems:

    • SOMATOM Definition AS/AS+
    • SOMATOM Definition AS Open
    • SOMATOM Definition Edge
    • SOMATOM Confidence

    The subject device SOMATOM CT Scanner Systems with SOMARIS/7 syngo CT VB10 are Computed Tomography X-ray Systems which feature one (single source) or two (dual source) continuously rotating tube-detector system and function according to the fan beam principle. The SOMATOM CT Scanner Systems with Software SOMARIS/7 syngo CT VB10 produces CT images in DICOM format, which can be used by trained staff for post-processing applications commercially distributed by Siemens Healthcare and other vendors as an aid in diagnosis, treatment preparation and therapy planning support (including, but not limited to, Brachytherapy, Particle including Proton Therapy, External Beam Radiation Therapy, Surgery). The computer system delivered with the CT scanner is able to run optional post processing applications.

    The platform software for the SOMATOM CT Scanner Systems, SOMARIS/7 syngo CT VB10, is a command-based program used for patient management, data management, X-ray scan control, image reconstruction, and image archive/evaluation.

    AI/ML Overview

    The provided document is a 510(k) premarket notification for Siemens SOMATOM CT Scanner Systems with software version SOMARIS/7 syngo CT VB10. It describes the device, its intended use, and a comparison with predicate devices to establish substantial equivalence.

    However, the document does not contain specific details about acceptance criteria, reported device performance metrics (e.g., sensitivity, specificity, AUC), sample sizes for test sets, data provenance, number or qualifications of experts for ground truth, adjudication methods, multi-reader multi-case (MRMC) comparative effectiveness studies, standalone algorithm performance, or specific ground truth types for image-based diagnostic performance assessments.

    The "Performance Data" section primarily focuses on non-clinical testing for system functionality, adherence to general medical device standards (ISO, NEMA, IEC), electrical safety, EMC, software verification and validation (including cybersecurity), and phantom tests to assess device and feature performance. It broadly states that "The test results show that all of the software specifications have met the acceptance criteria" and that "Verification and validation testing of the device was found acceptable to support the claim of substantial equivalence," but it does not quantify these acceptance criteria or the specific performance results in a table or detailed study findings.

    The indications for use mention "aid in diagnosis, treatment preparation and radiation therapy planning" and "low dose lung cancer screening in high risk populations," which typically would involve performance metrics like sensitivity and specificity. However, these metrics are not presented. The reference to the National Lung Screening Trial (NLST) is for the clinical context of low-dose lung cancer screening, not for the performance validation of the Siemens CT system itself against a ground truth.

    Therefore, I cannot populate a table with acceptance criteria and reported device performance, nor can I provide answers to the majority of the requested points, as that information is not present in the provided text.

    Based on the provided text, here's what can be extracted regarding the study and performance claims:

    1. A table of acceptance criteria and the reported device performance

    The document does not provide specific quantitative acceptance criteria (e.g., sensitivity, specificity, reader performance metrics) or corresponding reported device performance values for diagnostic tasks. It broadly states that "all of the software specifications have met the acceptance criteria" and that testing demonstrates "comparability to the predicate devices in terms of technological characteristics and safety and effectiveness."

    2. Sample sized used for the test set and the data provenance (e.g. country of origin of the data, retrospective or prospective)

    This information is not provided in the document. The testing mentioned is primarily "non-clinical test (integration and functional) including phantom tests."

    3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g. radiologist with 10 years of experience)

    This information is not provided in the document. The testing described does not involve expert-adjudicated ground truth as it pertains to diagnostic performance on patient data.

    4. Adjudication method (e.g. 2+1, 3+1, none) for the test set

    This information is not provided in the document.

    5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

    This information is not provided in the document. The study described focuses on technical verification and validation, and comparability to predicate devices, not on human-AI comparative effectiveness.

    6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done

    The document mentions "phantom tests" to assess device and feature performance. However, it does not specify performance metrics for a standalone algorithm related to diagnostic accuracy on clinical cases. The device is a CT scanner, and the software updates are for image processing and system functionality, not a standalone diagnostic AI algorithm.

    7. The type of ground truth used (expert consensus, pathology, outcomes data, etc)

    For the non-clinical and phantom tests conducted, the ground truth would be the known and controlled parameters of the phantoms and the expected technical performance outputs. There is no mention of ground truth types for clinical diagnostic accuracy related to patient data.

    8. The sample size for the training set

    Not applicable. The document describes a software update for a medical imaging device (CT scanner) validated through non-clinical testing and phantom studies, not an AI model trained on a dataset.

    9. How the ground truth for the training set was established

    Not applicable, as this is not an AI model requiring a training set with established ground truth.

    Ask a Question

    Ask a specific question about this device

    Why did this record match?
    Device Name :

    SOMATOM Force, SOMATOM Definition Flash, SOMATOM Definition Edge, SOMATOM Definition AS/AS+, SOMATOM
    Definition AS Open, SOMATON Emotion 6/16, SOMATOM Sensation 64/Sensation Cardiac , SOMATOM Perspective

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    This computed tomography system is intended to generate and process cross-sectional images of patients by computer reconstruction of x-ray transmission data. The images delivered by the system can be used by a trained physician as an aid in diagnosis. This CT system can be used for low dose lung cancer screening in high risk populations * * As defined by professional medical societies. Please refer to clinical literature, including the results of the National Lung Screening Trial (N Engl J Med 2011; 365:395-409) and subsequent literature, for further information.

    Device Description

    Siemens SOMATOM Computed Tomography System family scanners are whole body X-ray computed tomography systems which feature a continuously rotating tube-detector system and functions according to the fan beam principle. The SOMATOM Computed Tomography System family scanners vary in configurations from 6 to 192 slices, and are intended to produce cross sectional images of the body by computer reconstruction of x-ray transmission data from either the same axial plane taken at different angles or spiral planes taken at different angles. The system software is a command-based program used for patient management, data management, X-ray scan control, image reconstruction, and image archive/evaluation. The systems described in this submission provide pre-defined low dose scan modes similar to the modes used for The National Lung Screening Trial (NLST), and the features as recommend by the study. This allows use of these systems for screening in the same way the CT systems were used for NLST. The computer system delivered with the CT scanner is able to run post processing applications optionally.

    AI/ML Overview

    The provided text describes Siemens' application for expanded indications for use for their SOMATOM Computed Tomography (CT) System family scanners to include low-dose lung cancer screening in high-risk populations. The submission asserts that the devices are substantially equivalent to previously cleared versions and that the new indication does not constitute a new intended use.

    Here's a breakdown of the requested information based on the provided document:


    1. Table of Acceptance Criteria and Reported Device Performance

    The submission does not explicitly state specific quantitative acceptance criteria for performance metrics for the low-dose lung cancer screening indication. Instead, it states that the devices perform "comparably or better than" older devices which were used in the NLST study. The performance characteristics compared are standard CT image quality metrics.

    Acceptance Criteria (Implied)Reported Device Performance
    CT Number Accuracy (comparable or better than NLST devices)"perform comparably or better than the older devices"
    CT Number Uniformity (comparable or better than NLST devices)"perform comparably or better than the older devices"
    Spatial Resolution (MTF, max in-plane resolution) (comparable or better than NLST devices)"perform comparably or better than the older devices"
    Slice Thickness/Sensitivity Profile (minimum slice width) (comparable or better than NLST devices)"perform comparably or better than the older devices"
    Noise Properties (NPS, Image noise (standard deviation)) (comparable or better than NLST devices)"perform comparably or better than the older devices"
    Contrast to Noise Ratio (comparable or better than NLST devices)"perform comparably or better than the older devices"
    Maximum Scan Speed (comparable or better than NLST devices)"perform comparably or better than the older devices"
    Minimum Reconstructed Slice Interval (comparable or better than NLST devices)"perform comparably or better than the older devices"

    2. Sample Size Used for the Test Set and Data Provenance

    The document explicitly states: "Non clinical tests (integration and functional) and phantom testing were conducted for the SOMATOM Computed Tomography System family during product development." It further mentions: "The test results demonstrate that the subject devices perform comparably or better than the older devices. Since the older devices have been identified as suitable for lung cancer screening within the NLST, the respective performance of the subject devices can be regarded as suitable for lung cancer screening as well."

    • Sample Size for Test Set: Not specified for new testing. The reliance is on comparability to devices used in the NLST study. The NLST study itself included over 53,000 participants.
    • Data Provenance: The new testing focuses on non-clinical phantom testing. The clinical basis for the indication relies on existing clinical literature, specifically referencing the National Lung Screening Trial (NLST) which was a prospective, randomized controlled trial conducted in the United States.

    3. Number of Experts Used to Establish Ground Truth for the Test Set and Qualifications of Those Experts

    The document does not describe the use of human experts to establish ground truth for the non-clinical phantom testing performed for this submission. The "ground truth" for the acceptance of the lung cancer screening application is implicitly tied to the performance characteristics of the devices used in the NLST study and subsequent literature, as defined by professional medical societies.

    4. Adjudication Method for the Test Set

    Not applicable, as expert adjudication for performance metrics within this submission is not described.

    5. If a Multi Reader Multi Case (MRMC) Comparative Effectiveness Study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

    A Multi-Reader Multi-Case (MRMC) comparative effectiveness study was not performed as part of this submission. The devices are CT scanners, not AI-powered diagnostic aids that directly assist human readers. The submission focuses on the performance of the CT system itself for low-dose lung cancer screening.

    6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) was done

    This is not applicable as the device in question is a CT scanner, not an algorithm, and it requires clinical interpretation by a trained physician.

    7. The type of ground truth used (expert consensus, pathology, outcomes data, etc.)

    The ground truth for the suitability of the CT systems for low-dose lung cancer screening relies on:

    • Clinical Literature: Specifically, the results of the National Lung Screening Trial (NLST) which involved clinical outcomes data (lung cancer incidence, mortality).
    • Professional Medical Society Definitions: The indications for use explicitly state "As defined by professional medical societies."
    • Technical Guidelines: From organizations like the American College of Radiology (ACR) and National Comprehensive Cancer Network (NCCN).

    For the non-clinical performance tests conducted for this submission, the ground truth would be based on physical phantom measurements and known parameters of the phantoms.

    8. The Sample Size for the Training Set

    The document does not describe a training set in the context of an AI/ML algorithm. The devices are CT scanners, and their development and validation involve engineering, physics, and clinical studies (like NLST, which is referenced as foundational for the indication).

    9. How the Ground Truth for the Training Set was Established

    Not applicable, as no training set for an AI/ML algorithm is described.

    Ask a Question

    Ask a specific question about this device

    K Number
    K143409
    Date Cleared
    2015-03-26

    (118 days)

    Product Code
    Regulation Number
    892.1750
    Reference & Predicate Devices
    Why did this record match?
    Device Name :

    SOMATOM Definition AS Open (VA48)

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The Siemens SOMATOM Definition AS Open systems are intended to produce cross-sectional images of the body by computer reconstruction of x-ray transmission data from either the same axial plane taken at different angles or spiral planes* taken at different angles.

    (*spiral planes: the axial planes resulted from the continuous rotation of detectors and x-ray tube, and the simultaneous translation of the patient.)

    Device Description

    New software version syngo® VA48 (SOMARIS/7 VA48) is a command-based program used for patient management, data management, X-ray scan control, image reconstruction, and image archive/evaluation that will be available on the SOMATOM Definition AS Open Computed Tomography systems. syngo® VA48 (SOMARIS/7 VA48) is a further development to the SOMARIS/7 operating software cleared as part of the predicate device.

    syngo® VA48 is scanner platform software that supports the following device features:

    • 1). New system scanner software version synqo® VA48 (SOMARIS/7 VA48) which includes:
      • -Respiratory Analysis of Respiratory Rate & Pitch Adjustment -FAST 3D Reconstruction (FAST 3D Align)
      • -Multiphase reconstruction with extended Field of View
      • -FAST DE Results (Dual Energy PACS-ready images)
      • -FAST contact
      • -Iterative Reconstruction with extended Field of View
      • -OEM Varian RGSC Online Mode
      • -Full 4D Lung Scan
      • -Applications at CT syngo.via client
      • -TrueD 4D Viewer
    • 2). ADMIRE Iterative Reconstruction (Option)
    • 3). iMAR Improved Metal Artifact Reduction (Option)

    There are no modifications to the hardware of the device.

    AI/ML Overview

    This document, a 510(k) Summary for the Siemens SOMATOM Definition AS Open CT system with software version syngo® VA48, primarily focuses on demonstrating substantial equivalence to a predicate device rather than presenting a detailed clinical study demonstrating improved human reader performance with AI assistance. It describes software updates and their verification and validation against technical standards.

    Therefore, many of the requested details, such as specific acceptance criteria for AI performance, clinical study design for improved human reader performance, sample sizes for test sets in an MRMC study, expert qualifications for ground truth in a clinical context, or the effect size of AI assistance on human reader performance, are not explicitly available within this document. This submission is for a computed tomography x-ray system, and the "AI" or "machine learning" components mentioned (e.g., ADMIRE Iterative Reconstruction, iMAR Improved Metal Artifact Reduction) are features of the imaging system and reconstruction algorithms, not typically standalone AI interpretation tools that would undergo an MRMC study in the way a diagnostic AI would.

    Given the information provided, here's what can be extracted and inferred, with limitations noted:

    1. Table of Acceptance Criteria and Reported Device Performance:

    The document doesn't provide a table of performance acceptance criteria in the sense of a diagnostic AI's clinical metrics (e.g., sensitivity, specificity, AUC). Instead, it refers to acceptance criteria for software specifications and conformance to technical standards.

    Acceptance Criterion (Inferred from Document)Reported Device Performance (Inferred from Document)
    Conformance to IEC 60601-2-44"SOMATOM Definition AS/AS+ configured with software version syngo® VA48 is designed to fulfill the requirements... The test results show that all the software specifications have met the acceptance criteria."
    Conformance to IEC 61223-3-5"SOMATOM Definition AS/AS+ configured with software version syngo® VA48 is designed to fulfill the requirements... The test results show that all the software specifications have met the acceptance criteria."
    Conformance to NEMA XR-25"SOMATOM Definition AS/AS+ configured with software version syngo® VA48 is designed to fulfill the requirements... The test results show that all the software specifications have met the acceptance criteria."
    Conformance to IEC 61223-2-6"SOMATOM Definition AS/AS+ configured with software version syngo® VA48 is designed to fulfill the requirements... The test results show that all the software specifications have met the acceptance criteria."
    Conformance to NEMA PS 3.1 3.18 (DICOM)"SOMATOM Definition AS/AS+ configured with software version syngo® VA48 is designed to fulfill the requirements... The test results show that all the software specifications have met the acceptance criteria."
    Conformance to IEC 62304 Ed. 1.0"SOMATOM Definition AS/AS+ configured with software version syngo® VA48 is designed to fulfill the requirements... The test results show that all the software specifications have met the acceptance criteria."
    Conformance to IEC 60601-1"SOMATOM Definition AS/AS+ configured with software version syngo® VA48 is designed to fulfill the requirements... The test results show that all the software specifications have met the acceptance criteria."
    Conformance to ISO 14971 (Risk Management)"The Risk analysis was completed, and risk control implemented, to mitigate identified hazards." (Implies acceptance criteria for risk mitigation were met)
    Conformance to NEMA XR-29"SOMATOM Definition AS/AS+ configured with software version syngo® VA48 is designed to fulfill the requirements... The test results show that all the software specifications have met the acceptance criteria."
    Conformance to ISO/IEC 10918-1 (JPEG)"SOMATOM Definition AS/AS+ configured with software version syngo® VA48 is designed to fulfill the requirements... The test results show that all the software specifications have met the acceptance criteria."
    Software specifications functionality"The test results show that all the software specifications have met the acceptance criteria."
    Software verification and validation acceptability"Verification and validation testing of the device was found acceptable to support the claims of substantial equivalence."
    Performance as intended"The results of these tests demonstrate that the subject device performs as intended. The result of all conducted testing was found acceptable to support the claim of substantial equivalence."

    2. Sample Size Used for the Test Set and Data Provenance:

    The document refers to "Performance tests" and "Non-clinical tests (integration and functional)" but does not specify a sample size for a clinical test set of patient data, nor its provenance (country, retrospective/prospective). This type of information would be expected for a diagnostic AI device, not typically for a CT system software update focusing on features like iterative reconstruction or metal artifact reduction.

    3. Number of Experts and Qualifications for Ground Truth:

    Not applicable to this type of submission. There is no mention of human experts establishing ground truth for a diagnostic test set in the context of this 510(k). The "ground truth" here likely refers to technical specifications and expected performance characteristics of the CT system and its software, validated through engineering and phantom testing, rather than clinical interpretation.

    4. Adjudication Method for the Test Set:

    Not applicable. No clinical adjudication process is described as there isn't a stated clinical test set requiring human interpretation for ground truth.

    5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study:

    No, an MRMC study was explicitly not done or described in this document. This regulatory submission is for a computed tomography x-ray system, specifically a software update (syngo® VA48) that includes features like iterative reconstruction (ADMIRE) and metal artifact reduction (iMAR). These are image processing and acquisition technologies, not AI-driven diagnostic assistance tools designed to change human reader performance in a comparative effectiveness study.

    6. Standalone Performance (Algorithm Only without Human-in-the-Loop Performance):

    The document describes "Performance tests" to "test the functionality of the SOMATOM Definition AS Open configured with software version syngo VA48." While not using the term "standalone performance" in the context of a diagnostic AI, the testing described appears to be algorithm-only, focused on the technical performance and functional verification of the software features themselves (e.g., image reconstruction quality, artifact reduction effectiveness) against technical standards. "The results of these tests demonstrate that the subject device performs as intended."

    7. Type of Ground Truth Used:

    The ground truth for this submission appears to be based on:

    • Technical specifications and engineering standards: Conformance to various IEC and NEMA standards (e.g., IEC 60601-2-44, IEC 61223-3-5, NEMA XR-25, DICOM).
    • Internal software specifications and functional requirements: "The test results show that all the software specifications have met the acceptance criteria."
    • Risk analysis and mitigation: "The Risk analysis was completed, and risk control implemented, to mitigate identified hazards." (The "ground truth" here is the identified hazards and their successful mitigation).

    There is no mention of expert consensus, pathology, or outcomes data as a ground truth for clinical performance in this document.

    8. Sample Size for the Training Set:

    Not applicable. This document is not describing a machine learning model that was "trained" on a dataset in the way a diagnostic AI would be. The software updates described (like ADMIRE and iMAR) are based on algorithms and iterative processes, but the traditional concept of a "training set" for a deep learning model isn't presented here.

    9. How Ground Truth for the Training Set Was Established:

    Not applicable, as there is no described training set for an AI model in this document.

    Ask a Question

    Ask a specific question about this device

    K Number
    K130901
    Date Cleared
    2014-01-02

    (276 days)

    Product Code
    Regulation Number
    892.1750
    Reference & Predicate Devices
    Why did this record match?
    Device Name :

    SOMATOM DEFINITION AS OPEN

    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    The Siemens SOMATOM Definition AS Open systems are intended to produce cross-sectional images of the body by computer reconstruction of x-ray transmission data from either the same axial plane taken at different angles or spiral planes* taken at different angles.

    (*spiral planes: the axial planes resulted from the continuous rotation of detectors and x-ray tube, and the simultaneous translation of the patient.)

    Device Description

    The Siemens SOMATOM Definition AS Open is a whole body X-ray Computed Tomography System. The SOMATOM Definition AS Open produces CT images in DICOM format, which can be used by post-processing applications commercially distributed by Siemens and other vendors.

    The system software is a command-based program used for patient management, data management, X-ray scan control, image reconstruction, and image archive/evaluation. The new version of system software, syngo® CT 2013B (SOMARIS/7 VA46A), supports the following features:

    • MARIS (Metal Artifact Reduction in Image Space) A image . reconstruction mode designed to reduce image artifacts caused by metal
    • HD FoV Pro (HD FoV 2.0) Designed to enable a more reliable . visualization of the skin line of human body parts located outside of the standard field of view
    • t-MIP -- Image manipulation method for arithmetic operations which allows . the calculation of temporal Maximum or Minimum Intensity Projection (MIP) images from a set of series.
    AI/ML Overview

    Here's a breakdown of the acceptance criteria and the study information for the SOMATOM Definition AS Open configured with software version syngo® CT 2013B (SOMARIS/7 VA46A), based on the provided text:

    Important Note: The provided document is a 510(k) summary for a medical device which is largely about demonstrating "substantial equivalence" to a predicate device. This type of submission often focuses on verifying that new features don't introduce new safety or effectiveness concerns, rather than conducting a full-scale clinical trial to prove a specific level of diagnostic performance against a robust ground truth. As such, some of the requested information (especially about specific performance metrics tied to acceptance criteria, MRMC studies, and detailed ground truth establishment for clinical effect) might not be explicitly present or as detailed as in a typical in vitro diagnostic (IVD) or AI-only software submission.


    1. Table of Acceptance Criteria and Reported Device Performance:

    Acceptance Criteria / FeatureReported Device Performance (as described in the document)
    MARIS (Metal Artifact Reduction in Image Space) EffectivenessValidated through clinical tests in different clinical scenarios. Designed to reduce image artifacts caused by metal.
    HD FoV Pro (HD FoV 2.0) Visualization RangeDesigned to enable a more reliable visualization of the skin line of human body parts located outside of the standard field of view. Allows visualization of up to 80 cm.
    t-MIP (Temporal Maximum or Minimum Intensity Projection) CapabilityAllows the calculation of temporal Maximum or Minimum Intensity Projection (MIP) images from a set of series.
    Software SpecificationsAll software specifications have met the acceptance criteria (general statement from risk analysis and V&V).
    Substantial Equivalence (General)No new potential safety risks; performs as well as the predicate devices.
    Conformance to Standards (e.g., IEC 60601-1-4, IEC 62304, ISO 14971, DICOM, IEC 60601-2-44, IEC 61223-3-5, IEC 61223-2-6)Designed to fulfill the requirements of these standards. Performance data demonstrates continued conformance with special controls for medical devices containing software.
    EMC/Electrical SafetyEvaluated according to IEC Standards; Siemens certifies conformance to Voluntary Standards covering Electrical and Mechanical Safety.
    Risk MitigationRisk analysis completed and risk control implemented to mitigate identified hazards.

    2. Sample Size Used for the Test Set and Data Provenance:

    • Sample Size (Clinical Tests): Not specified. The document states "Clinical tests were performed... to validate the performance of the MARIS algorithm" and "These tests include testing of the metal artifact reduction capabilities of MARIS in different clinical scenarios." However, the number of patients, scans, or images is not provided.
    • Data Provenance: Not explicitly stated (e.g., country of origin). The tests were "clinical tests," implying real patient data. It is highly likely to be retrospective clinical data, as typical for 510(k) submissions focusing on software improvements, but this is not explicitly confirmed.

    3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications:

    • The document mentions "clinical tests" for MARIS validation, but it does not specify how ground truth was established for these tests, nor does it mention the number or qualifications of experts involved in any ground truth assessment. In the context of metal artifact reduction, "ground truth" might be subjective visual assessment by radiologists if not compared to a gold standard imaging modality.

    4. Adjudication Method for the Test Set:

    • The document does not specify any adjudication method (e.g., 2+1, 3+1). Given the lack of detail on expert involvement, it's unlikely a formal adjudication process was described for the submission.

    5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was Done:

    • No, an MRMC comparative effectiveness study was not done (or at least not described in this summary). The studies mentioned focus on validating the performance of features (MARIS, HD FoV Pro) in the device itself, not on comparing human reader performance with and without AI assistance from this specific device.

    6. If a Standalone (i.e. algorithm only without human-in-the-loop performance) was Done:

    • The document describes "bench tests were performed to verify and validate the performance of the MARIS and HD FoV Pro (HD FoV 2.0) features," which are likely standalone algorithm evaluations using phantoms or controlled datasets.
    • "Clinical tests" were also performed for the MARIS algorithm, which would involve the algorithm processing clinical data. While these involve physicians interpreting the output of the CT system, the focus of the "clinical tests" was on validating the algorithm's performance (e.g., artifact reduction), rather than a human reading study. So, in terms of the algorithm itself, yes, standalone performance was assessed.

    7. The Type of Ground Truth Used:

    • For the "bench tests" of MARIS and HD FoV Pro, the ground truth would likely be phantom-based measurements and technical specifications. Phantoms provide a known, controlled environment to assess image quality, artifact reduction, and field of view accuracy.
    • For the "clinical tests" of MARIS, the document does not explicitly state the type of ground truth used. In the context of artifact reduction, it could involve visual assessment by clinicians comparing images with and without MARIS, or a comparison to an established 'gold standard' image if available (e.g., a non-metallic scan of the same area if feasible). However, no specifics are provided.

    8. The Sample Size for the Training Set:

    • The document does not specify the sample size for any training set. This is not uncommon for 510(k) submissions where the software updates are incremental and rely on established engineering practices, rather than a deep learning model requiring a distinct, large training dataset. The MARIS algorithm is described as an "image reconstruction mode," implying an algorithmic approach rather than a machine learning model that undergoes explicit "training" on a labeled dataset.

    9. How the Ground Truth for the Training Set Was Established:

    • As the document does not mention a training set in the context of machine learning, there is no information on how its ground truth was established. For algorithmic development, the "training" (design and tuning) is based on engineering principles, image science, and potentially smaller, internally-derived datasets with known properties or simulated artifacts.
    Ask a Question

    Ask a specific question about this device

    Page 1 of 1