Search Results
Found 5 results
510(k) Data Aggregation
(120 days)
Confidence, SOMATOM Definition Edge, SOMATOM Definition AS/AS+, SOMATOM Definition AS Open, SOMATOM Drive, SOMATOM
Force, SOMATOM Definition Flash
This computed tomography system is intended to generate and process cross-sectional images of patients by computer reconstruction of x-ray transmission data.
The images delivered by the system can be used by trained staff as an aid in diagnosis, treatment and radiation therapy planning as well as for diagnostic and therapeutic interventions.
This CT system can be used for low dose lung cancer screening in high risk populations*.
*As defined by professional medical societies. Please refer to clinical literature, including the results of the National Lung Screening Trial (N Engl J Med 2011; 365:395-409) and subsequent literature, for further information.
The subject device SOMATOM CT Scanner Systems with SOMARIS/7 syngo CT VB30 are Computed Tomography X-ray Systems which feature one (single source) continuously rotating tube-detector system and function according to the fan beam principle. The SOMATOM CT Scanner Systems with Software SOMARIS/7 syngo CT VB30 produces CT images in DICOM format, which can be used by trained staff for post-processing applications commercially distributed by Siemens Healthcare and other vendors as an aid in diagnosis, treatment preparation and therapy planning support (including, but not limited to, Brachytherapy, Particle including Proton Therapy, External Beam Radiation Therapy, Surgery). The computer system delivered with the CT scanner is able to run optional post processing applications.
The platform software for the SOMATOM CT Scanner Systems, SOMARIS/7 syngo CT VB30, is a commandbased program used for patient management, data management, X-ray scan control, image reconstruction, and image archive/evaluation.
Here's a breakdown of the acceptance criteria and the study that proves the device meets them, based on the provided text.
1. Table of Acceptance Criteria and Reported Device Performance
The document primarily focuses on functional verification and validation testing rather than explicit, quantifiable acceptance criteria with corresponding performance metrics for each feature in a tabular format. Instead, it describes the objective of each test and then states that the results were found to be acceptable or passed.
However, we can extract the objectives and the documented outcomes for features where some quantifiable or descriptive performance is mentioned:
Feature Tested | Acceptance Criteria (Objective of Test) | Reported Device Performance |
---|---|---|
FAST Bolus | Deviation from an ideal post-bolus delay. | Found in an acceptable margin when compared to averaged dynamic scans (ground truth). |
Supporting publications show: |
- Median difference between true and personalized delay 90% of patients.
- Higher overall and more uniform attenuation in individualized cohort vs. fixed.
- Higher contrast-to-noise ratio (CNR) and subjective image quality in individualized cohort.
- Able to adjust scan timing to altered protocols to reach diagnostic image quality despite slower injection rate and reduced iodine dose.
- Images with individualized post-trigger delay provided higher attenuation for all organs.
- Mean vessel enhancement significantly higher in individualized scan timing group. |
| FAST 3D Camera (Adolescent support) | Achieve comparable or more accurate results than predicate for adults, while supporting adolescent patients (120 cm+) with comparable accuracy as adult patients. | Achieves the objective of the test. (Implies comparable or more accurate results). |
| FAST Isocentering (Adolescent support) | Lateral isocenter accuracy of subject device comparable to predicate for adult patients, and similar accuracy for adolescent patients. | Comparable to predicate for adult patients; similar accuracy for adolescent patients. |
| FAST Range (Adolescent support) | Robustness of groin landmark improved; other landmarks detected with comparable accuracy for adults; accuracy of landmark detection for adolescents similar to adults. | Robustness of groin landmark improved; other landmarks with comparable accuracy. For adolescents, similar accuracy to adults. |
| FAST Direction | Comparable accuracy of pose detection to predicate device. | Comparable accuracy. |
| FAST Planning | Fraction (percentage) of correct ranges that can be applied without change; calculation time meets interactive requirements. | For >90% of ranges, no editing action was necessary to cover standard ranges. For >95%, the speed of the algorithm was sufficient. |
| Tin Filtration (New kV combinations) | Successful implementation of new voltage combinations (80/Sn140 kV and 100/Sn140 kV) verified; description of spectral properties given; improved CNR in spectral results (monoenergetic images). | Successful implementation verified via phantom scans and image quality criteria evaluation. All applied tests concerning image quality passed. Different spectral properties with and without Sn filter evident, and Sn filter improves spectral separation considerably. Results support claims related to improved CNR. |
| General Non-Clinical Testing (Integration & Functional) | Verify and validate functionality of modifications. Ensure safe and effective integration. Conformance with special controls for software medical devices. Risk mitigation. | All software specifications met acceptance criteria. Testing supports claims of substantial equivalence. |
2. Sample Size Used for the Test Set and Data Provenance
-
FAST Bolus: The test describes using a "real contrast enhancement curve" determined by measurements with a dynamic scan mode. The subsequent supporting peer-reviewed studies provide more detail:
- Korporaal et al. (2015): Not explicitly stated, but implies a cohort undergoing bolus tracking.
- Hinzpeter et al. (2019): 108 patients received patient-specific trigger delay (subject), 108 patients received fixed trigger delay (reference). Prospective CT angiography scans of the aorta.
- Gutjahr et al. (2019): 3 groups, 20, 20, and 40 patients respectively.
- Yu et al. (2021): 104 patients (52 per group, implied) in abdominal multiphase CT, comparing individualized vs. fixed post-trigger delay.
- Yuan et al. (2023): 204 consecutive participants randomly divided into two groups (102 patients each). A prospective study in coronary CT angiography (CCTA).
- Schwartz et al. (2018): Not explicitly stated, but implied patient-specific data.
- Data Provenance: The supporting studies imply a mix of retrospective analysis (e.g., Korporaal et al. simulating retrospectively differences) and prospective studies based on the descriptions provided. The locations of these studies are not explicitly mentioned in the excerpt, but given Siemens' global presence, it's likely multi-national.
-
FAST 3D Camera, FAST Isocentering, FAST Range, FAST Direction, FAST Planning, Tin Filtration: For these features, the testing is described as "bench testing" using phantoms and internal validation. "Patient data" is mentioned for FAST Planning but without specific numbers.
- Sample Size: Not specified for these internal bench tests; often involves phantom studies rather than patient-level data for performance metrics. For FAST Planning, it refers to "patient data" for validation, but the sample size is not indicated.
- Data Provenance: Implied internal testing, likely at Siemens R&D facilities. No external patient data provenance details are given.
3. Number of Experts Used to Establish Ground Truth for the Test Set and Qualifications
- For FAST Bolus, the "ground truth" for the internal bench test was defined as an "ideal post bolus delay" determined by measurements with a dynamic scan mode. This suggests an objective, data-driven approach rather than expert consensus on individual cases for the initial ground truth. However, the supporting studies mention:
- Hinzpeter et al. (2019): Mentions subjective image quality and CNR, which would typically involve expert readers, but the number and qualifications are not provided.
- Yuan et al. (2023): Mentions "Both readers rated better subjective image quality." suggesting at least two readers, but their qualifications are not provided.
- For other features (FAST 3D Camera, FAST Planning, etc.), the ground truth seems to be established through objective measurement against predefined targets (e.g., "calculated by FAST Planning algorithm that are correct and can be applied without change"). No specific expert involvement for ground truth establishment for these features is detailed.
4. Adjudication Method for the Test Set
- The document does not describe a formal adjudication method (e.g., 2+1, 3+1) for the establishment of ground truth or for reader studies. Where multiple readers are mentioned (e.g., Yuan et al. for FAST Bolus), it only states their findings without detailing an adjudication process. This suggests either independent readings or consensus where needed, but not a formal adjudication protocol.
5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was Done, and Effect Size
- Yes, implicitly for FAST Bolus: The supporting publications function as comparative effectiveness studies where human assessment (e.g., subjective image quality, diagnostic confidence) is evaluated with or without the aid of the FAST Bolus prototype.
- Hinzpeter et al. (2019): "higher overall and more uniform attenuation in the individualized cohort compared to the fixed cohort. No difference between the cohorts for image noise was found, but a higher contrast-to-noise ratio (CNR) and higher subjective image quality in the individualized cohort compared to the fixed cohort." This indicates improvement with the AI-assisted timing.
- Yu et al. (2021): "In the arterial phase, the images of group A with the individualized post-trigger delay provided higher attenuation for all organs... Furthermore, the contrast-to-noise ratio (CNR) of liver, pancreas and portal vein were significantly higher in the group with the individualized scan timing compared to the fixed scan delay. The overall subjective image quality and diagnostic confidence between the two groups were similar." This indicates improved quantitative metrics, with subjective similar.
- Yuan et al. (2023): "Both readers rated better subjective image quality for Group B with the individualized scan timing. Also, the mean vessel enhancement was significantly higher in Group B in all coronary vessels. After adjusting for the patient variation, the FAST Bolus prototype was associated with an average of 33.5 HU higher enhancement compared to the fixed PTD." This provides a direct effect size for enhancement.
- For the other features, the description is focused on the device's inherent performance (e.g., accuracy of landmark detection, successful implementation) rather than human reader improvements. So, no MRMC study for those.
6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) Study was Done
- Yes, for multiple features. The "Bench Testing" descriptions primarily evaluate the algorithm's performance in a standalone manner against a defined ground truth or objective:
- FAST Bolus: "the post bolus delay as calculated by FAST Bolus to an ideal post bolus delay... was calculated. The objectives of the test were to investigate the deviation from the post bolus delay as determined by FAST Bolus to an ideal/ground truth delay..." This is standalone.
- FAST 3D Camera, FAST Isocentering, FAST Range, FAST Direction: The tests "demonstrate that the FAST 3D Camera feature... achieves comparable or more accurate results," "lateral isocenter accuracy... comparable," "robustness of the groin landmark is improved," "comparable accuracy of the pose detection." These are assessments of the algorithm's direct performance.
- FAST Planning: "assess the fraction (percentage) of ranges calculated by the FAST Planning algorithm that are correct and can be applied without change." This is a direct measurement of the algorithm's output quality.
- Tin Filtration: Verifies "successful implementation" and investigates "improved contrast-to-noise ratio (CNR) in spectral results." This is standalone performance of the image reconstruction/processing.
7. The Type of Ground Truth Used
- Objective/Measured Data:
- FAST Bolus: "ideal post bolus delay" determined by "measurements with a dynamic scan mode" and "averaged dynamic scans."
- FAST 3D Camera, FAST Isocentering, FAST Range, FAST Direction: Implied ground truth based on objective measurements of spatial accuracy relative to predefined targets or phantoms.
- FAST Planning: "correct" ranges are the ground truth, implying comparison to a predefined standard or ideal plan.
- Tin Filtration: Objective image quality criteria and spectral property measurements are used as ground truth indicators.
- Expert Consensus/Subjective Assessment (as secondary metric in supporting studies): Some of the supporting publications for FAST Bolus also incorporate subjective image quality ratings by human readers, which would likely involve some form of expert consensus or individual expert assessment.
8. The Sample Size for the Training Set
- The document does not provide information on the sample size used for the training set for any of the AI/algorithm features. This information is typically proprietary and not usually disclosed in a 510(k) summary unless specifically requested or deemed critical for demonstrating substantial equivalence.
9. How the Ground Truth for the Training Set was Established
- The document does not provide information on how the ground truth for the training set was established. Given the nature of these features (automated bolus timing, patient positioning, scan range planning), the training data would likely involve large datasets of CT scans annotated with physiological events, anatomical landmarks, and optimal scan parameters. These annotations would typically be established by highly qualified medical professionals (e.g., radiologists, technologists) or through automated processes validated against gold standards. However, the specific methodology is not detailed in this excerpt.
Ask a specific question about this device
(113 days)
SOMATOM Force, SOMATOM Definition Flash, SOMATOM Drive, SOMATOM Definition Edge, SOMATOM Definition AS
This computed tomography system is intended to generate and process cross-sectional images of patients by computer reconstruction of x-ray transmission data.
The images delivered by the system can be used by a trained physician as an aid in diagnosis. The images delivered by the system can be used by trained staff as an aid in diagnosis, treatment preparation and radiation therapy planning.
This CT system can be used for low dose lung cancer screening in high risk populations *
- As defined by professional medical societies. Please refer to clinical literature, including the results of the National Lung Screening Trial (N Engl J Med 2011; 365:395-409) and subsequent literature, for further information.
The subject device SOMATOM CT Scanner Systems with SOMARIS/7 syngo CT VB20 are Computed Tomography X-ray Systems which feature one (single source) or two (dual source) continuously rotating tubedetector system and function according to the fan beam principle. The SOMATOM CT Scanner Systems with Software SOMARIS/7 syngo CT VB20 produces CT images in DICOM format, which can be used by trained staff for post-processing applications commercially distributed by Siemens Healthcare and other vendors as an aid in diagnosis, treatment preparation and therapy planning support (including, but not limited to, Brachytherapy, Particle including Proton Therapy, External Beam Radiation Therapy, Surgery). The computer system delivered with the CT scanner is able to run optional post processing applications.
The platform software for the SOMATOM CT Scanner Systems, SOMARIS/7 syngo CT VB20, is a commandbased program used for patient management, data management, X-ray scan control, image reconstruction, and image archive/evaluation.
Here's an analysis of the acceptance criteria and supporting study information based on the provided text, broken down by your requested points:
Acceptance Criteria and Study Information for SOMATOM CT Scanner Systems-Software Version SOMARIS/7 syngo CT VB20
The provided document (a 510(k) summary) describes an update to existing Computed Tomography (CT) scanner systems (SOMATOM Force, SOMATOM Definition Flash, SOMATOM Drive, SOMATOM Definition Edge, SOMATOM Definition AS Open, SOMATOM Definition AS/AS+, SOMATOM Confidence, and SOMATOM Edge Plus) with new software version SOMARIS/7 syngo CT VB20. The primary goal of the submission is to demonstrate substantial equivalence to previously cleared predicate devices (K173630 and K173607).
The document does not explicitly list specific numerical acceptance criteria for device performance beyond stating that "all software specifications have met the acceptance criteria" and "the SOMATOM CT Scanner Systems perform comparably to the predicate devices." It focuses on confirming the updated device maintains the safety and effectiveness of the predicate devices.
1. Table of Acceptance Criteria and Reported Device Performance
As specific numerical acceptance criteria are not presented in the document, I will infer the high-level acceptance criteria from the submission's focus on demonstrating substantial equivalence and list the general performance statements made.
Acceptance Criteria (Inferred) | Reported Device Performance |
---|---|
Safety and Effectiveness Equivalence: Device maintains equivalent safety and effectiveness to predicate devices. | "The subject and predicate devices are based on the following same technological elements: Scanner Principle, System Acquisition, Iterative Reconstruction, Workplaces, Patient table, Patient table foot switch for movement, Tin filtration technology, Stellar detector technology." |
"Testing and validation is completed. Test results show that the subject devices, the SOMATOM CT Scanner Systems, are comparable to the predicate devices in terms of technological characteristics and safety and effectiveness and therefore are substantially equivalent to the predicate devices." | |
"The non-clinical data supports the device and the hardware and software verification and validation demonstrates that the subject device SOMATOM CT Scanner Systems should perform as intended in the specified use conditions." | |
Conformance to Standards: Device complies with relevant electrical safety, EMC, software, and risk management standards. | "Electrical Safety and Electromagnetic Compatibility (EMC) testing were conducted on the SOMATOM CT Scanner Systems in accordance with the following standards: 60601-2-44, and 60601-1-2. A list of recognized and general consensus standards considered for the subject devices is provided as Table 9." (Table 9 and 10 list numerous IEC, ANSI AAMI, NEMA, and ISO standards). |
"Software Documentation for a Moderate Level of Concern software per FDA's Guidance Document... is also included... The Risk Analysis was completed and risk control implemented to mitigate identified hazards." | |
Software Specifications Met: All software features and updates function as intended. | "The test results show that all of the software specifications have met the acceptance criteria." |
Verification and Validation: Comprehensive testing proves the device's claims. | "The modifications described in this Premarket Notification were supported with verification and validation testing." |
"Verification and validation testing of the device was found acceptable to support the claim of substantial equivalence." | |
Cybersecurity: Device meets cybersecurity requirements. | "Siemens conforms to the Cybersecurity requirementing a process of preventing unauthorized access, modifications, misuse or denial of use, or the unauthorized use of information that is stored, accessed, or transferred from a medical device to an external recipient... is included within this submission." |
Image Quality / Performance (Implicit): Image reconstruction and diagnostic aid functionality are maintained or improved. | "Non-clinical test (integration and functional) including phantom tests were conducted for the SOMATOM CT Scanner Systems during product development." |
"dosimetry and imaging performance, and analysis of phantom images to assess device and feature performance during product development." (The document implies these tests confirmed performance but doesn't provide specific numerical results). |
2. Sample Size Used for the Test Set and Data Provenance
The document states that "phantom tests were conducted" and refers to "dosimetry and imaging performance, and analysis of phantom images to assess device and feature performance." However, no specific sample size for the test set (number of phantom scans, patient data, etc.) is provided.
Data Provenance: The tests are described as "non-clinical test (integration and functional) including phantom tests... during product development." This indicates that the testing was conducted internally by the manufacturer,Siemens, likely on prototypes or production units, using phantoms. There is no mention of human subject data, country of origin, or whether the tests utilized retrospective or prospective data. The nature of phantom studies typically makes them prospective in this context.
3. Number of Experts Used to Establish Ground Truth and Qualifications
The document does not provide information on the number of experts used to establish ground truth or their specific qualifications (e.g., number of radiologists, years of experience). Given the nature of this submission (software upgrade for a CT system, focusing on technical performance and substantial equivalence rather than a new diagnostic algorithm's clinical efficacy), it's less likely to involve extensive expert-driven ground truth establishment as would be seen for AI/CADe devices. The "ground truth" for technical performance is typically established via physical measurements and established phantom metrics.
4. Adjudication Method for the Test Set
The document does not specify an adjudication method (e.g., 2+1, 3+1). As stated above, the testing appears to be primarily technical and phantom-based, where ground truth is often objectively measurable through physical properties or established methods, rather than subjective expert interpretation requiring adjudication.
5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study
No MRMC comparative effectiveness study was done or reported in this document. The submission focuses on demonstrating substantial equivalence of the updated CT system to its predicates through technical and non-clinical testing, not on measuring improvements in human reader performance with or without AI assistance.
6. Standalone (Algorithm Only Without Human-in-the-Loop Performance) Study
While the document focuses on the performance of the CT system and its software, it does not specifically describe a standalone algorithm-only performance study in the context of an AI/CADe device. The SOMARIS/7 syngo CT VB20 is a platform software update for CT scanners, enhancing system functionality and image reconstruction capabilities (e.g., "Enhanced FAST DE Results," "Precision Matrix," "DirectDensity™"). The "performance" being evaluated is the system's ability to generate cross-sectional images and support diagnostic tasks, as opposed to a specific AI algorithm. The performance evaluation discussed would inherently be of the "algorithm" integrated into the system, contributing to the overall image quality and functional capabilities.
7. Type of Ground Truth Used
The ground truth for the non-clinical testing appears to be based on:
- Physical Measurements and Phantom Readings: "Non-clinical test (integration and functional) including phantom tests were conducted." This implies that phantoms with known properties or simulated pathologies were used, and the system's output (image quality, dose metrics, etc.) was measured against these known values.
- Engineering Specifications / Reference Data: For software functional tests ("all software specifications have met the acceptance criteria"), the ground truth would be the defined engineering and design specifications for the software's intended behavior.
There is no mention of pathology, outcomes data, or expert consensus (in the typical sense of clinical ground truth for diagnostic accuracy) for establishing the ground truth described in this submission.
8. Sample Size for the Training Set
The document does not mention a training set sample size or the use of a separate training set. This is consistent with the nature of the submission, which describes a software update for a CT system rather than a machine learning or AI algorithm submission where training data sets are explicitly separated from test data. The software updates described are enhancements to the system's core functionality, reconstruction, and workflow, which are typically developed and verified through engineering processes rather than large-scale machine learning training.
9. How the Ground Truth for the Training Set Was Established
Since no training set is mentioned in the context of typical AI/ML development, this information is not applicable based on the provided document. The "training" for such system software updates primarily refers to the iterative development and internal testing processes by the engineers, where specifications serve as the "ground truth."
Ask a specific question about this device
(126 days)
SOMATOM Force, SOMATOM Definition Flash, SOMATOM Drive, SOMATOM Definition Edge, SOMATOM Definition AS
This computed tomography system is intended to generate and process cross-sectional images of patients by computer reconstruction of x-ray transmission data.
The images delivered by the system can be used by a trained physician as an aid in diagnosis. The images delivered by the system can be used by trained staff as an aid in diagnosis, treatment preparation and radiation therapy planning.
This CT system can be used for low dose lung cancer screening in high risk populations *
- As defined by professional medical societies. Please refer to clinical literature, including the results of the National Lung Screening Trial (N Engl J Med 2011; 365:395-409) and subsequent literature, for further information.
Siemens intends to market a new software version, SOMARIS/7 syngo CT VB10 for the following SOMATOM Computed Tomography (CT) Scanner Systems:
Dual Source CT Systems:
- SOMATOM Force
- SOMATOM Drive
- SOMATOM Flash
Single Source CT Systems:
- SOMATOM Definition AS/AS+
- SOMATOM Definition AS Open
- SOMATOM Definition Edge
- SOMATOM Confidence
The subject device SOMATOM CT Scanner Systems with SOMARIS/7 syngo CT VB10 are Computed Tomography X-ray Systems which feature one (single source) or two (dual source) continuously rotating tube-detector system and function according to the fan beam principle. The SOMATOM CT Scanner Systems with Software SOMARIS/7 syngo CT VB10 produces CT images in DICOM format, which can be used by trained staff for post-processing applications commercially distributed by Siemens Healthcare and other vendors as an aid in diagnosis, treatment preparation and therapy planning support (including, but not limited to, Brachytherapy, Particle including Proton Therapy, External Beam Radiation Therapy, Surgery). The computer system delivered with the CT scanner is able to run optional post processing applications.
The platform software for the SOMATOM CT Scanner Systems, SOMARIS/7 syngo CT VB10, is a command-based program used for patient management, data management, X-ray scan control, image reconstruction, and image archive/evaluation.
The provided document is a 510(k) premarket notification for Siemens SOMATOM CT Scanner Systems with software version SOMARIS/7 syngo CT VB10. It describes the device, its intended use, and a comparison with predicate devices to establish substantial equivalence.
However, the document does not contain specific details about acceptance criteria, reported device performance metrics (e.g., sensitivity, specificity, AUC), sample sizes for test sets, data provenance, number or qualifications of experts for ground truth, adjudication methods, multi-reader multi-case (MRMC) comparative effectiveness studies, standalone algorithm performance, or specific ground truth types for image-based diagnostic performance assessments.
The "Performance Data" section primarily focuses on non-clinical testing for system functionality, adherence to general medical device standards (ISO, NEMA, IEC), electrical safety, EMC, software verification and validation (including cybersecurity), and phantom tests to assess device and feature performance. It broadly states that "The test results show that all of the software specifications have met the acceptance criteria" and that "Verification and validation testing of the device was found acceptable to support the claim of substantial equivalence," but it does not quantify these acceptance criteria or the specific performance results in a table or detailed study findings.
The indications for use mention "aid in diagnosis, treatment preparation and radiation therapy planning" and "low dose lung cancer screening in high risk populations," which typically would involve performance metrics like sensitivity and specificity. However, these metrics are not presented. The reference to the National Lung Screening Trial (NLST) is for the clinical context of low-dose lung cancer screening, not for the performance validation of the Siemens CT system itself against a ground truth.
Therefore, I cannot populate a table with acceptance criteria and reported device performance, nor can I provide answers to the majority of the requested points, as that information is not present in the provided text.
Based on the provided text, here's what can be extracted regarding the study and performance claims:
1. A table of acceptance criteria and the reported device performance
The document does not provide specific quantitative acceptance criteria (e.g., sensitivity, specificity, reader performance metrics) or corresponding reported device performance values for diagnostic tasks. It broadly states that "all of the software specifications have met the acceptance criteria" and that testing demonstrates "comparability to the predicate devices in terms of technological characteristics and safety and effectiveness."
2. Sample sized used for the test set and the data provenance (e.g. country of origin of the data, retrospective or prospective)
This information is not provided in the document. The testing mentioned is primarily "non-clinical test (integration and functional) including phantom tests."
3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g. radiologist with 10 years of experience)
This information is not provided in the document. The testing described does not involve expert-adjudicated ground truth as it pertains to diagnostic performance on patient data.
4. Adjudication method (e.g. 2+1, 3+1, none) for the test set
This information is not provided in the document.
5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance
This information is not provided in the document. The study described focuses on technical verification and validation, and comparability to predicate devices, not on human-AI comparative effectiveness.
6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done
The document mentions "phantom tests" to assess device and feature performance. However, it does not specify performance metrics for a standalone algorithm related to diagnostic accuracy on clinical cases. The device is a CT scanner, and the software updates are for image processing and system functionality, not a standalone diagnostic AI algorithm.
7. The type of ground truth used (expert consensus, pathology, outcomes data, etc)
For the non-clinical and phantom tests conducted, the ground truth would be the known and controlled parameters of the phantoms and the expected technical performance outputs. There is no mention of ground truth types for clinical diagnostic accuracy related to patient data.
8. The sample size for the training set
Not applicable. The document describes a software update for a medical imaging device (CT scanner) validated through non-clinical testing and phantom studies, not an AI model trained on a dataset.
9. How the ground truth for the training set was established
Not applicable, as this is not an AI model requiring a training set with established ground truth.
Ask a specific question about this device
(406 days)
SOMATOM Force, SOMATOM Definition Flash, SOMATOM Definition Edge, SOMATOM Definition AS/AS+, SOMATOM
This computed tomography system is intended to generate and process cross-sectional images of patients by computer reconstruction of x-ray transmission data. The images delivered by the system can be used by a trained physician as an aid in diagnosis. This CT system can be used for low dose lung cancer screening in high risk populations * * As defined by professional medical societies. Please refer to clinical literature, including the results of the National Lung Screening Trial (N Engl J Med 2011; 365:395-409) and subsequent literature, for further information.
Siemens SOMATOM Computed Tomography System family scanners are whole body X-ray computed tomography systems which feature a continuously rotating tube-detector system and functions according to the fan beam principle. The SOMATOM Computed Tomography System family scanners vary in configurations from 6 to 192 slices, and are intended to produce cross sectional images of the body by computer reconstruction of x-ray transmission data from either the same axial plane taken at different angles or spiral planes taken at different angles. The system software is a command-based program used for patient management, data management, X-ray scan control, image reconstruction, and image archive/evaluation. The systems described in this submission provide pre-defined low dose scan modes similar to the modes used for The National Lung Screening Trial (NLST), and the features as recommend by the study. This allows use of these systems for screening in the same way the CT systems were used for NLST. The computer system delivered with the CT scanner is able to run post processing applications optionally.
The provided text describes Siemens' application for expanded indications for use for their SOMATOM Computed Tomography (CT) System family scanners to include low-dose lung cancer screening in high-risk populations. The submission asserts that the devices are substantially equivalent to previously cleared versions and that the new indication does not constitute a new intended use.
Here's a breakdown of the requested information based on the provided document:
1. Table of Acceptance Criteria and Reported Device Performance
The submission does not explicitly state specific quantitative acceptance criteria for performance metrics for the low-dose lung cancer screening indication. Instead, it states that the devices perform "comparably or better than" older devices which were used in the NLST study. The performance characteristics compared are standard CT image quality metrics.
Acceptance Criteria (Implied) | Reported Device Performance |
---|---|
CT Number Accuracy (comparable or better than NLST devices) | "perform comparably or better than the older devices" |
CT Number Uniformity (comparable or better than NLST devices) | "perform comparably or better than the older devices" |
Spatial Resolution (MTF, max in-plane resolution) (comparable or better than NLST devices) | "perform comparably or better than the older devices" |
Slice Thickness/Sensitivity Profile (minimum slice width) (comparable or better than NLST devices) | "perform comparably or better than the older devices" |
Noise Properties (NPS, Image noise (standard deviation)) (comparable or better than NLST devices) | "perform comparably or better than the older devices" |
Contrast to Noise Ratio (comparable or better than NLST devices) | "perform comparably or better than the older devices" |
Maximum Scan Speed (comparable or better than NLST devices) | "perform comparably or better than the older devices" |
Minimum Reconstructed Slice Interval (comparable or better than NLST devices) | "perform comparably or better than the older devices" |
2. Sample Size Used for the Test Set and Data Provenance
The document explicitly states: "Non clinical tests (integration and functional) and phantom testing were conducted for the SOMATOM Computed Tomography System family during product development." It further mentions: "The test results demonstrate that the subject devices perform comparably or better than the older devices. Since the older devices have been identified as suitable for lung cancer screening within the NLST, the respective performance of the subject devices can be regarded as suitable for lung cancer screening as well."
- Sample Size for Test Set: Not specified for new testing. The reliance is on comparability to devices used in the NLST study. The NLST study itself included over 53,000 participants.
- Data Provenance: The new testing focuses on non-clinical phantom testing. The clinical basis for the indication relies on existing clinical literature, specifically referencing the National Lung Screening Trial (NLST) which was a prospective, randomized controlled trial conducted in the United States.
3. Number of Experts Used to Establish Ground Truth for the Test Set and Qualifications of Those Experts
The document does not describe the use of human experts to establish ground truth for the non-clinical phantom testing performed for this submission. The "ground truth" for the acceptance of the lung cancer screening application is implicitly tied to the performance characteristics of the devices used in the NLST study and subsequent literature, as defined by professional medical societies.
4. Adjudication Method for the Test Set
Not applicable, as expert adjudication for performance metrics within this submission is not described.
5. If a Multi Reader Multi Case (MRMC) Comparative Effectiveness Study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance
A Multi-Reader Multi-Case (MRMC) comparative effectiveness study was not performed as part of this submission. The devices are CT scanners, not AI-powered diagnostic aids that directly assist human readers. The submission focuses on the performance of the CT system itself for low-dose lung cancer screening.
6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) was done
This is not applicable as the device in question is a CT scanner, not an algorithm, and it requires clinical interpretation by a trained physician.
7. The type of ground truth used (expert consensus, pathology, outcomes data, etc.)
The ground truth for the suitability of the CT systems for low-dose lung cancer screening relies on:
- Clinical Literature: Specifically, the results of the National Lung Screening Trial (NLST) which involved clinical outcomes data (lung cancer incidence, mortality).
- Professional Medical Society Definitions: The indications for use explicitly state "As defined by professional medical societies."
- Technical Guidelines: From organizations like the American College of Radiology (ACR) and National Comprehensive Cancer Network (NCCN).
For the non-clinical performance tests conducted for this submission, the ground truth would be based on physical phantom measurements and known parameters of the phantoms.
8. The Sample Size for the Training Set
The document does not describe a training set in the context of an AI/ML algorithm. The devices are CT scanners, and their development and validation involve engineering, physics, and clinical studies (like NLST, which is referenced as foundational for the indication).
9. How the Ground Truth for the Training Set was Established
Not applicable, as no training set for an AI/ML algorithm is described.
Ask a specific question about this device
(146 days)
SOMATOM FORCE
This computed tomography system is intended to generate and process cross-sectional images of patients by computer reconstruction of x-ray transmission data. The images delivered by the system can be used by a trained physician as an aid in diagnosis.
The SOMATOM Force is a whole body X-ray Computed Tomography System which features two continuously rotating tube-detector systems and functions according to the fan beam principle. The SOMATOM Force produces CT images in DICOM format, which can be used by postprocessing applications commercially distributed by Siemens and other vendors.
The system software is a command-based program used for patient management, data management, X-ray scan control, image reconstruction, and image archive/evaluation.
The computer system delivered with the CT scanner is able to run the post processing applications optionally.
The Siemens SOMATOM Force is a whole-body X-ray Computed Tomography System.
1. Acceptance Criteria and Device Performance:
The provided document does not contain a specific table of acceptance criteria with corresponding device performance metrics for diagnostic accuracy or clinical effectiveness. Instead, the submission focuses on demonstrating safety, technical equivalence, and compliance with recognized standards.
The acceptance criteria for the SOMATOM Force appear to be primarily based on conformance to established safety and performance standards and substantial equivalence to a legally marketed predicate device (SOMATOM Definition Flash). The performance is assessed through nonclinical testing (integration and functional), phantom testing, and verification/validation testing.
Acceptance Criteria Category | Specific Criteria (Implied) | Reported Device Performance (Summary) |
---|---|---|
Safety | Adherence to IEC and other recognized safety standards (e.g., electrical, mechanical, radiation hazards). | Fulfilled requirements of listed safety standards (e.g., IEC 60601 series, ISO 14971 for risk management). Risk analysis completed and controls implemented. EMC/electrical safety evaluated. |
Performance/Functionality | Generation and processing of cross-sectional images; computer reconstruction of X-ray transmission data. Image quality. | Nonclinical tests (integration and functional) and phantom testing conducted. IBHC feature designed to improve image quality. |
Substantial Equivalence | Comparable indications for use, design, material, functionality, technology, and energy source to the predicate device. | Considered substantially equivalent to SOMATOM Definition Flash (K121072). Intended use, materials, energy source, and fundamental scientific technology are similar. |
Software Integrity | Conformance with special controls for medical devices containing software; all software specifications meet acceptance criteria. | Performance data submitted for special controls. Software verification and validation found acceptable. Software documentation for a moderate level of concern included. |
Risk Management | Identification and mitigation of potential hazards. | Risk analysis completed, and risk controls implemented. Testing results support mitigation of identified hazards. |
2. Sample Size for Test Set and Data Provenance:
The document does not specify a "test set" in the context of clinical images or patient data for validating diagnostic performance. The testing described is primarily technical and phantom-based.
- Sample Size for Test Set: Not applicable in the context of diagnostic accuracy assessment with patient data in this submission. The tests mentioned are "nonclinical tests (integration and functional) and phantom testing."
- Data Provenance: Not applicable in the context of patient data. The nonclinical tests would have been performed by Siemens as part of product development.
3. Number of Experts for Ground Truth and Qualifications:
Not applicable. This submission focuses on the technical safety and performance of the CT scanner itself, not on the diagnostic performance of a software algorithm requiring expert ground truth for interpretation of patient images.
4. Adjudication Method:
Not applicable, as no external expert independent review of diagnostic performance with patient images is described.
5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study:
No MRMC comparative effectiveness study is mentioned in the provided document. The submission focuses on the technical capabilities and safety of the CT scanner, not on comparing diagnostic accuracy with or without AI assistance.
6. Standalone (Algorithm Only) Performance:
Not applicable. The SOMATOM Force is a physical CT scanner, not a standalone algorithm. The "Iterative Beam Hardening Correction (IBHC)" is a feature within the system to improve image quality, not a separate diagnostic algorithm.
7. Type of Ground Truth Used:
For the evaluation described:
- Technical Performance: Likely based on physical phantom measurements, engineering specifications, and established scientific principles for image quality metrics (e.g., resolution, noise, contrast).
- Safety Compliance: Based on compliance with international and national safety standards (e.g., IEC standards for electrical safety, radiation protection, and medical device software).
- Substantial Equivalence: Based on comparison of technical characteristics and intended use with a legally marketed predicate device.
8. Sample Size for the Training Set:
Not applicable. The SOMATOM Force is a hardware system with integrated software for image acquisition and reconstruction. It is not an AI/ML-based diagnostic algorithm that undergoes a distinct "training phase" on a dataset in the manner described for typical AI submissions. The IBHC feature is a predefined algorithm rather than a continuously learning system.
9. How the Ground Truth for the Training Set was Established:
Not applicable, as there isn't a "training set" in the context of a machine learning model for diagnostic interpretation. The algorithms (like IBHC) are developed based on physics principles and engineering.
Ask a specific question about this device
Page 1 of 1