(185 days)
ClearRead CT is comprised of computer-assisted reading tools designed to aid the radiologist in the detection and characterization of pulmonary nodules during the review of screening and surveillance (low-dose) CT examinations of the chest on a non-oncological patient population. ClearRead CT requires both lungs be in the field of view and is not intended for monitoring patients undergoing therapy for lung cancer or limited field of view CT scans. ClearRead CT provides adjunctive information and is not intended to be used without the original CT series.
ClearRead CT Compare is a post-processing application which processes a prior chest CT to determine whether a nodule detected in the current exam was present in the prior exam using the same detection algorithm used on the current exam. ClearRead CT Compare requires both lungs to be in the field of view. ClearRead CT Compare provides adjunctive information and is not intended to be used without the original CT series and is only invoked on those patients where a prior exam exists and if a nodule is detected in the current exam. ClearRead CT Compare receives images according to the DICOM® protocol, processes the Lung CT series, and delivers the resulting information through the same DICOM network interface in conjunction with results provided for the current exam, specifically whether the nodule is present on the prior exam and if so, the percent volume change between the current and prior exam along with the volume doubling time. Series inputs are limited to Computed Tomography (CT). The ClearRead CT Compare Processor processes each prior series received. The ClearRead CT Compare output is sent to a destination device that conforms to the ClearRead CT DICOM Conformance Statement, such as a storage archive. ClearRead CT Compare does not support printing or DICOM media. ClearRead CT Compare is a product extension of our FDA cleared and marketed ClearRead CT device (K161201). The initial device contained ClearRead CT Vessel Suppress as well as ClearRead CT Detect. ClearRead CT (the base system), includes normalization, segmentation, and characterization of nodules, and provides the following key features: ● ClearRead CT Vessel Suppress aids radiologists by suppressing normal structures in the input chest CT series. . ClearRead CT Detect aids radiologists in the detection and characterizations of nodules in the input chest CT series. ● ClearRead CT Compare includes Scan Registration and Nodule Matching functions and adds the following key features: ClearRead CT Compare aids radiologists in ● tracking nodule changes over time, providing additional characterizations per nodule, including percent nodule change and volume doubling time.
Here's a detailed breakdown of the acceptance criteria and the study proving the device meets them, based on the provided text:
1. Table of Acceptance Criteria and Reported Device Performance
| Acceptance Criteria | Reported Device Performance |
|---|---|
| Nodule Match Rate (Overall Target) | Minimum of 90% for each selected stratum. |
| Nodule Match Rate (Solid Nodule Type) | 0.961 (0.952, 0.978) - Exceeds 90% benchmark |
| Nodule Match Rate (Part-solid Nodule Type) | 0.957 (0.942, 0.971) - Exceeds 90% benchmark |
| Nodule Match Rate (Ground Glass Nodule Type) | 0.946 (0.934, 0.965) - Exceeds 90% benchmark |
| Nodule Match Rate (Isolated Nodule Location) | 0.940 (0.934, 0.947) - Exceeds 90% benchmark |
| Nodule Match Rate (Juxta-Vascular Nodule Location) | 0.969 (0.963, 0.975) - Exceeds 90% benchmark |
| Nodule Match Rate (Juxta-Pleura Nodule Location) | 0.955 (0.949, 0.961) - Exceeds 90% benchmark |
| Volume Doubling Time (VDT) and % Change Calculation Accuracy | Manual and automated calculations matched in every instance. |
| Vessel Suppress Performance for Thicker Slices (3.5mm - 5mm) | Performance across different slice thickness values (3.5mm, 4.0mm, 4.5mm, 5.0mm) had little impact compared to baseline (1mm data), remaining well within the predefined 10% significance threshold for rejecting a test (non-contrast and contrast cases). Average performance change ranged from -4.5% to 4.6%. |
| Nodule Registration Error | Average registration error of 4.46mm, with a standard deviation of 2.69mm, well within the predefined 15mm tolerance. |
| New Nodule Identification (Real Cases) | All 3 new nodules were detected and correctly identified as new. |
2. Sample Size Used for the Test Set and Data Provenance
- Quantitative Nodule Matching Performance: A total of 900 nodules were used for assessment.
- Vessel Suppress Thicker Slice Evaluation: The same data previously used to assess vessel suppression performance for 1mm to 3mm slice thickness was used, extended to include 3.5mm, 4.0mm, 4.5mm, and 5.0mm.
- Clinical Performance Testing (Real Nodules): A 25-patient cohort containing 40 real nodules (42 actionable nodules identified by radiologists, with 39 having prior counterparts and 3 being new).
Data Provenance:
The document does not explicitly state the country of origin for the data. It also does not specify whether the data was retrospective or prospective for the 900 nodules or the vessel suppress evaluation. For the "clinical performance testing," the use of "real nodules" from a "25 patient cohort" suggests existing patient data, which is typically retrospective.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications
- Quantitative Nodule Matching Performance: The document does not explicitly state how the ground truth for the 900 nodules was established, nor the number or qualifications of experts involved. It only states that "detected nodules were split into three categories based on their attenuation pattern."
- Clinical Performance Testing (Real Nodules): Ground truth for the 42 actionable nodules was established by "the radiologist." The document uses "radiologist" in the singular, implying one expert, but does not provide specific qualifications (e.g., years of experience).
4. Adjudication Method for the Test Set
The document does not describe a formal adjudication method (like 2+1 or 3+1) for establishing the ground truth of the test sets. For the "clinical performance testing," it states "42 actionable nodules were ground-truthed by the radiologist," implying a single observer established the ground truth.
5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done
No, an MRMC comparative effectiveness study involving human readers' improvement with AI vs. without AI assistance was not explicitly described or presented in the provided text. The studies focused on the performance of the ClearRead CT Compare algorithm itself, not its impact on human reader performance.
6. If a Standalone (Algorithm Only Without Human-in-the-Loop Performance) Was Done
Yes, the studies presented primarily focus on standalone (algorithm only) performance.
- The nodule matching performance tables (Tables 5.2 and 5.3) report the algorithm's match and mismatch rates.
- The VDT and % change calculation accuracy was checked against "manual computation," implying a comparison of algorithm output to a reference, not human interaction.
- The vessel suppress evaluation directly assesses the algorithm's output (residual changes).
- The "clinical performance testing" assessed the algorithm's ability to detect and match nodules and identify new ones, again without a human-in-the-loop component for the reported metrics.
The device's indication for use explicitly states it provides "adjunctive information and is not intended to be used without the original CT series," suggesting it is designed to aid radiologists, but the studies described focus on its internal performance metrics rather than its performance in an assisted reading workflow.
7. The Type of Ground Truth Used
- Quantitative Nodule Matching Performance: The type of ground truth used for the 900 nodules is not explicitly stated beyond classification by attenuation pattern.
- Volume Doubling Time and % Change Calculation: Manual computation of these values was used as ground truth.
- Vessel Suppress Performance for Thicker Slices: The ground truth for this evaluation appears to be based on a baseline performance (1mm data) and a predefined significance threshold for residual changes. The "residual analysis" implies comparing the algorithm's output to an expected or ideal output for vessel suppression.
- Clinical Performance Testing (Real Nodules): Expert radiologist assessment ("ground-truthed by the radiologist") was used to identify "actionable nodules" and their presence in prior scans.
8. The Sample Size for the Training Set
The document does not provide information regarding the sample size used for the training set for any component of ClearRead CT or ClearRead CT Compare.
9. How the Ground Truth for the Training Set Was Established
The document does not provide information regarding how the ground truth for the training set was established, as the training set details are not mentioned.
{0}------------------------------------------------
Image /page/0/Picture/0 description: The image contains the logo of the U.S. Food and Drug Administration (FDA). On the left is the Department of Health & Human Services logo. To the right of that is the FDA logo, which is a blue square with the letters "FDA" in white. To the right of the blue square is the text "U.S. FOOD & DRUG ADMINISTRATION" in blue.
December 5, 2022
Riverain Technologies, Inc. % Jonathan Jackson Director of Regulatory Affairs & Quality Assurance 3130 South Tech Blvd. MIAMISBURG OH 45342
Re: K221612
Trade/Device Name: ClearRead CT Regulation Number: 21 CFR 892.2050 Regulation Name: Medical image management and processing system Regulatory Class: Class II Product Code: OEB, LLZ Dated: October 31, 2022 Received: November 1, 2022
Dear Jonathan Jackson:
We have reviewed your Section 510(k) premarket notification of intent to market the device referenced above and have determined the device is substantially equivalent (for the indications for use stated in the enclosure) to legally marketed predicate devices marketed in interstate commerce prior to May 28, 1976, the enactment date of the Medical Device Amendments, or to devices that have been reclassified in accordance with the provisions of the Federal Food, Drug, and Cosmetic Act (Act) that do not require approval of a premarket approval application (PMA). You may, therefore, market the device, subject to the general controls provisions of the Act. Although this letter refers to your product as a device, please be aware that some cleared products may instead be combination products. The 510(k) Premarket Notification Database located at https://www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfpmn/pmn.cfm identifies combination product submissions. The general controls provisions of the Act include requirements for annual registration, listing of devices, good manufacturing practice, labeling, and prohibitions against misbranding and adulteration. Please note: CDRH does not evaluate information related to contract liability warranties. We remind you, however, that device labeling must be truthful and not misleading.
If your device is classified (see above) into either class II (Special Controls) or class III (PMA), it may be subject to additional controls. Existing major regulations affecting your device can be found in the Code of Federal Regulations, Title 21, Parts 800 to 898. In addition, FDA may publish further announcements concerning your device in the Federal Register.
Please be advised that FDA's issuance of a substantial equivalence determination does not mean that FDA has made a determination that your device complies with other requirements of the Act or any Federal statutes and regulations administered by other Federal agencies. You must comply with all the Act's requirements, including, but not limited to: registration and listing (21 CFR Part 807); labeling (21 CFR Part
{1}------------------------------------------------
801); medical device reporting of medical device-related adverse events) (21 CFR 803) for devices or postmarketing safety reporting (21 CFR 4, Subpart B) for combination products (see https://www.fda.gov/combination-products/guidance-regulatory-information/postmarketing-safety-reportingcombination-products); good manufacturing practice requirements as set forth in the quality systems (QS) regulation (21 CFR Part 820) for devices or current good manufacturing practices (21 CFR 4, Subpart A) for combination products; and, if applicable, the electronic product radiation control provisions (Sections 531-542 of the Act); 21 CFR 1000-1050.
Also, please note the regulation entitled, "Misbranding by reference to premarket notification" (21 CFR Part 807.97). For questions regarding the reporting of adverse events under the MDR regulation (21 CFR Part 803), please go to https://www.fda.gov/medical-device-safety/medical-device-reportingmdr-how-report-medical-device-problems.
For comprehensive regulatory information about medical devices and radiation-emitting products, including information about labeling regulations, please see Device Advice (https://www.fda.gov/medicaldevices/device-advice-comprehensive-regulatory-assistance) and CDRH Learn (https://www.fda.gov/training-and-continuing-education/cdrh-learn). Additionally, you may contact the Division of Industry and Consumer Education (DICE) to ask a question about a specific regulatory topic. See the DICE website (https://www.fda.gov/medical-device-advice-comprehensive-regulatoryassistance/contact-us-division-industry-and-consumer-education-dice) for more information or contact DICE by email (DICE@fda.hhs.gov) or phone (1-800-638-2041 or 301-796-7100).
Sincerely,
2022.12.05
09:08:19
-05'00'
Lu Jiang
Lu Jiang, Ph.D. Assistant Director Diagnostic X-Ray Systems Team DHT8B: Division of Imaging Devices and Electronic Products OHT8: Office of Radiological Health Office of Product Evaluation and Quality Center for Devices and Radiological Health
Enclosure
{2}------------------------------------------------
Indications for Use
510(k) Number (if known) K221612
Device Name ClearRead CT
Indications for Use (Describe)
ClearRead CT is comprised of computer-assisted reading tools designed to aid the radiologist in the detection and characterization of pulmonary nodules during the review of screening and surveillance (low-dose) CT examinations of the chest on a non-oncological patient population. ClearRead CT requires both lungs be in the field of view and is not intended for monitoring patients undergoing therapy for lung cancer or limited field of view CT scans. ClearRead CT provides adjunctive information and is not intended to be used without the original CT series.
Type of Use (Select one or both, as applicable):
| Prescription Use (Part 21 CFR 801 Subpart D) | Over-The-Counter Use (21 CFR 801 Subpart C) |
|---|---|
| ------------------------------------------------------------ | ----------------------------------------------------------- |
CONTINUE ON A SEPARATE PAGE IF NEEDED.
This section applies only to requirements of the Paperwork Reduction Act of 1995.
DO NOT SEND YOUR COMPLETED FORM TO THE PRA STAFF EMAIL ADDRESS BELOW.
The burden time for this collection of information is estimated to average 79 hours per response, including the time to review instructions, search existing data sources, gather and maintain the data needed and complete and review the collection of information. Send comments regarding this burden estimate or any other aspect of this information collection, including suggestions for reducing this burden, to:
Department of Health and Human Services Food and Drug Administration Office of Chief Information Officer Paperwork Reduction Act (PRA) Staff PRAStaff@fda.hhs.gov
"An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB number."
{3}------------------------------------------------
Riverain Technologies Page 5-1
5.0 510(K) SUMMARY
| Submission Date: | December 1, 2022 |
|---|---|
| Submitter Information: | |
| Company Name: | Riverain Technologies, Inc. |
| Company Address: | 3130 South Tech Blvd.Miamisburg, OH 45342-4860 |
| Contact Person: | Jonathan JacksonDirector of RAQARiverain Technologies, Inc.937.531.5092jjackson@riveraintech.com |
Device Information:
| Trade Name: | ClearRead CT |
|---|---|
| Regulation Number: | 21 CFR §892.2050 |
| Regulation Name: | Medical Image Management and Processing System |
| Regulatory Class: | Class II |
| Product Code: | OEB/LLZ |
| Device Description: | ClearRead CT Compare is a post-processing |
Compare is a pos application which processes a prior chest CT to determine whether a nodule detected in the current exam was present in the prior exam using the same detection algorithm used on the current exam. ClearRead CT Compare requires both lungs to be in the field of view. ClearRead CT Compare provides adjunctive information and is not intended to be used without the original CT series and is only invoked on those patients where a prior exam exists and if a nodule is detected in the current exam. ClearRead CT Compare receives images according to the DICOM® protocol, processes the Lung CT series, and delivers the resulting information through the same DICOM network interface in conjunction with results provided for the current exam, specifically whether the nodule is present on the prior exam and if so, the percent volume change between the current and prior exam along with the volume doubling time. Series inputs are limited to Computed Tomography (CT). The ClearRead CT Compare Processor processes each prior series received. The ClearRead CT Compare
{4}------------------------------------------------
output is sent to a destination device that conforms to the ClearRead CT DICOM Conformance Statement, such as a storage archive. ClearRead CT Compare does not support printing or DICOM media. ClearRead CT Compare is a product extension of our FDA cleared and marketed ClearRead CT device (K161201). The initial device contained ClearRead CT Vessel Suppress as well as ClearRead CT Detect. ClearRead CT (the base system), includes normalization, segmentation, and characterization of nodules, and provides the following key features: ● ClearRead CT Vessel Suppress aids radiologists by suppressing normal structures in the input chest CT series. . ClearRead CT Detect aids radiologists in the detection and characterizations of nodules in the input chest CT series. ● ClearRead CT Compare includes Scan Registration and Nodule Matching functions and adds the following key features: ClearRead CT Compare aids radiologists in ● tracking nodule changes over time, providing additional characterizations per nodule, including percent nodule change and volume doubling time. ClearRead CT is comprised of computer-assisted Indications for Use: reading tools designed to aid the radiologist in the detection and characterization of pulmonary nodules during the review of screening and surveillance (lowdose) CT examinations of the chest on a non-oncological patient population. ClearRead CT requires both lungs be in the field of view and is not intended for monitoring patients undergoing therapy for lung cancer or limited field of view CT scans. ClearRead CT provides adjunctive information and is not intended to be used without the original CT series. Primary Predicate Device: Riverain Technologies, Inc. (K161201) ClearRead CT Class II 21 CFR §892.2050 Secondary Predicate Device: Philips Medical Systems Nederland B.V.
(K162484) Lung Nodule Assessment and Comparison Option (LNA)
{5}------------------------------------------------
Class II
Comparison to Predicate Device Technical Characteristics:
Riverain Technologies, Inc. is of the opinion that ClearRead CT Compare is substantially equivalent, both in intended use as well as to the technical characteristics of the listed predicate devices. Differences in the design and performance from the cited predicate device does not affect either the safety or the effectiveness of ClearRead CT Compare for its intended use. Table 5.1 shows the predicate devices listed along with the subject device, including the Product Code as well as the Indications for Use for each device.
| Primary Predicate:ClearRead CT(RiverainTechnologies, Inc.)K161201 | SecondaryPredicate:Lung NoduleAssessment andComparison Option(LNA)(Philips MedicalSystems NederlandB.V.) K162484 | Subject Device:ClearRead CT,includingClearRead CTCompare(RiverainTechnologies, Inc.) | |
|---|---|---|---|
| ProductCode | OEB/LLZ | LLZ/JAK | OEB/LLZ |
| Indications forUse | ClearRead™ CT iscomprised ofcomputer assistedreading toolsdesigned to aid theradiologist in thedetection ofpulmonary nodulesduring review of CTexaminations of thechest on anasymptomaticpopulation. | The Philips MedicalSystems LungNodule Assessmentand ComparisonOption is intendedfor use as adiagnostic patient-imaging tool.It is intended for thereview and analysisof thoracic CTimages, providingquantitative andcharacterizinginformation aboutnodules in the lung ina single study, orover the time courseof several thoracicstudies.Characterizationsinclude diameter | ClearRead CT iscomprised ofcomputer-assistedreading toolsdesigned to aid theradiologist in thedetection andcharacterization ofpulmonary nodulesduring the review ofscreening andsurveillance (low-dose) CTexaminations of thechest on a non-oncological patientpopulation.ClearRead CTrequires both lungsbe in the field ofview and is notintended for |
| volume and volumeover time. Thesystem automaticallyperforms themeasurements,allowing lungnodules andmeasurements to bedisplayed. | monitoring patientsundergoing therapyfor lung cancer orlimited field of viewCT scans. ClearReadCT providesadjunctiveinformation and isnot intended to beused without theoriginal CT series. | ||
| Intended User | Radiologist | Radiologists andTechnologists | Radiologist |
| Modality | Thoracic CT Series | Thoracic CT Series | Thoracic CT Series |
| AnatomicalRegion | Chest | Chest | Chest |
| ClinicalCondition | Lung Nodules | Lung Nodules | Lung Nodules |
| Nodule Types | Solid, Part-solid,Ground-glass | Solid, Part-solid,Ground-glass,Calcified | Solid, Part-solid,Ground-glass |
| ROISegmentation | Yes | Yes | Yes |
| AutomaticCalculation ofMeasurementsfor eachSegmentedNodule | Yes | Yes | Yes |
| TemporalComparison(NoduleMatching) | No | Yes, Semi-Automatic | Yes, Fully Automatic |
| VolumeDoublingTime and %ChangeCalculation | No | Yes | Yes |
| Segmentationof Lung | Yes, Segmentation ofthe Lungs | Yes | Yes, Segmentation ofthe Lungs |
| Lungs, andLung Lobes | |||
| Alteration ofInput Images | No | No | No |
| AverageDiameter | No | Yes | Yes |
| MaximumSliceThickness forVesselSuppress | 3mm | N/A | 5mm |
| Micro-NoduleFiltering | No | No | Yes |
| Output Objects | Vessel SuppressSeries, Detect Series | Interactive Viewing | Vessel SuppressSeries, Detect Series,Summary Report |
{6}------------------------------------------------
{7}------------------------------------------------
Table 5.1: Predicate Devices vs. Subject Device
Key features identified that differ from the predicate are discussed below.
Temporal Comparison
The purpose of ClearRead CT Compare is to augment ClearRead CT, without modification, by adding a nodule matching capability. The current scan is processed with the nodule detection algorithm as defined by ClearRead CT. If any regions are detected in the current scan, the system then processes the prior scan using the same automatic detection process. If regions were detected in the prior scan, alignment of the current and prior scans is carried out with a volume registration step.
Volume Doubling Time and % Change Calculation
Given an ROI from a current scan is matched with an associated ROI from the prior scan, the ClearRead CT Compare engine adds to the output nodule characteristics the percentage volume change and volume doubling time. These added measurements are derived quantities from existing validated measurements, namely the volume estimate of a region within the current and prior scans.
Average Diameter
The average diameter is derived by taking the average of the minimum and maximum diameters that were measured. These diameters are not new measurements as they were included in the predicate device, ClearRead CT.
5mm Slice Thickness for Vessel Suppress
The volume normalization step includes a process for normalizing slice thickness to 1mm. The module works for slice thickness values up to 5mm; however, it has only been utilized for 3mm and less. As there are sites processing thicker slice data, the module for CT scans with slice thickness values within the 3mm to 5mm range was evaluated. The same data that was previously used to assess the performance of vessel suppression for
{8}------------------------------------------------
slice thickness values ranging from 1mm to 3mm was used to evaluate the extended range. No changes were made to the vessel suppression module to accommodate the thicker slices.
While ClearRead CT may produce a vessel suppressed series for CT scans in the 3mm to 5mm range, the Detect component will not, however, be applied for slice thicknesses greater than 3 mm.
Micro-Nodule Filtering
ClearRead CT Detect locates nodules that are 5mm in diameter and above, while ClearRead CT Vessel Suppress allows visualization of nodules smaller than 5mm. We added a step to Vessel Suppression that will, optionally, remove objects whose approximate diameter is less than 5mm. This option can be turned on at the site, where the size for defining what constitutes a micro-nodule can be specified. However, the size threshold is not allowed to exceed 5mm to keep the performance of the system in line with existing label and product performance indicators.
In addition to the items listed in Table 5.1, several features and enhancements have been added to ClearRead CT since the initial release. A summary of these is provided below:
- Minor updates to improve performance and throughput ●
- Additional output options and interfaces to facilitate workflow, marker ● verification and 3rd party integrations
- . Administrative and monitoring functions to streamline installations and application health monitoring
Testing Summary:
Non-clinical Testing
Non-clinical tests were conducted during the development process in accordance with the Riverain Technologies Design Control Process, which is compliant with the FDA Quality System Regulations, ISO 13485:2016 with MDSAP and the following standards.
- IEC 62304:2006/AMD1:2015, Medical devices Software life cycle processes ●
- IEC62366-1:2015, Medical device Part1: Application of usability engineering to ● medical devices
- ISO14971:2007, Medical devices Application of risk management to medical ● devices (2nd Ed.)
- NEMA PS 3.1-3-20, Digital Imaging and Communications in Medicine (DICOM) Set 2016
Testing verified the requirements according to the ClearRead CT device specifications.
The ClearRead CT Risk Analysis for this update was reviewed and updated to Revision H, with risk control measures implemented to mitigate identified hazards. Documentation required for software with a Moderate Level of Concern is included as part of this submission. Device labeling, together with the results from verification and validation testing demonstrate that the device is safe and effective.
{9}------------------------------------------------
Target Nodule Match Rate was set to a minimum of 90% for each selected stratum based on a literature review of existing solutions. The hypotheses tested the performance of the matching routine to ensure that its performance is sufficiently high and that it does not depend on the size, attenuation, or location of the nodule. To this end, detected nodules were split into three categories based on their attenuation pattern: solid, part-solid, and ground glass.
Using a total of 900 nodules for assessment, Tables 5.2 and 5.3 below show ClearRead CT Compare matching performance for each nodule type (solid, part-solid, ground-glass) and each clinical location category (isolated, juxta-vascular, juxta-pleural). Match rate is consistent across nodule type and location, and far exceeds the intended performance benchmark of 90%.
| Nodule Type | Match Rate | Mismatch Rate |
|---|---|---|
| Solid | 0.961 (0.952,0.978) | 0.033 (0.027,0.038) |
| Part-solid | 0.957 (0.942,0.971) | 0.039 (0.031,0.044) |
| Ground Glass | 0.946 (0.934,0.965) | 0.040 (0.033,0.046) |
Table 5.2: Nodule Match Performance Estimates by Type.
| Nodule Location | Match Rate | Mismatch Rate |
|---|---|---|
| Isolated | 0.940 (0.934,0.947) | 0.042 (0.035,0.047) |
| Juxta-Vascular | 0.969 (0.963,0.975) | 0.031 (0.024,0.035) |
| Juxta-Pleura | 0.955 (0.949,0.961) | 0.039 (0.033,0.044) |
Table 5.3: Nodule Match Performance Estimates by Location
The computation of the Volume Doubling Time (VDT) and percentage volume change were checked against manual computation to ensure the accuracy of the implemented expression. The manual and automated calculations matched in every instance.
To evaluate the effect of using Vessel Suppress on slices up to 5mm, we used the same data that was previously used to assess the performance of vessel suppression for slice thickness values ranging from 1mm to 3mm. This process, in effect, extends the test. It is important to note that no changes were made to the vessel suppression module to accommodate the thicker slices.
The algorithm was run on 1mm data as a baseline, and across a set of 4 slice thickness values: 3.5, 4.0, 4.5, and 5.0, all in mm. By testing a span of thicker slice values, we ensured that vessel suppression performance is maintained up to 5mm. The data used for evaluation was not used in the development of the vessel suppression module.
Some noise in performance is to be anticipated, but a significant increase in residual is not: 10% was our predefined significance threshold for rejecting a test.
The data from residual analysis can be seen in Tables 5.4 and 5.5 below. As shown, the performance across different slice thickness values had little impact on performance, either for non-contrast or contrast scans.
| rest of the comments of the comments of the comments of the comments of the contribution of the first of the first of the first of the first of the first of the first of theSlice thickness | Interior Region | Exterior Region | |
|---|---|---|---|
| -- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ----------------- | ----------------- |
{10}------------------------------------------------
| 3.5 mm | -2.3% | -0.1% |
|---|---|---|
| 4.0 mm | 0.4% | 2.9% |
| 4.5 mm | 1.8% | 2.9% |
| 5.0 mm | -3.7% | 3.8% |
Table 5.4: The average performance for each indicator for Non-Contrast Cases
| Slice thickness | Interior Region | Exterior Region |
|---|---|---|
| 3.5 mm | -2.2% | 1.1% |
| 4.0 mm | -1.5% | 3.3% |
| 4.5 mm | -2.3% | 2.7% |
| 5.0 mm | -4.5% | 4.6% |
Table 5.5: The average performance for each indicator for Contrast Cases
We added a step to Vessel Suppression, micro-nodule filtering, that will, optionally, remove objects whose approximate diameter is less than 5mm. This option can be turned on at the site, where the size for defining what constitutes a micro-nodule can be specified. However, the size threshold is not allowed to exceed 5mm to keep the performance of the system in line with existing label and product performance indicators.
Clinical Performance Testing
To complement non-clinical testing, 40 real nodules for a 25 patient cohort was assessed. The results are consistent with results derived from simulated data and are summarized below.
Over the 25 cases, a total of 42 actionable nodules were ground-truthed by the radiologist. Of the 42 nodules, 39 were found to have a corresponding region within the prior scan, leaving 3 nodules characterized as new nodules. All 39 nodules pairs were detected and correctly matched, while each of the 3 new ones was detected and correctly identified as new.
The frequency plot below shows the carina offset distance (between current and prior), in mm, for the scans containing real nodules.
{11}------------------------------------------------
Image /page/11/Figure/2 description: The image is a histogram titled "Real Nodule Cases". The x-axis is labeled "Carina Offset Dist (mm)" and ranges from 0 to 25. The y-axis is labeled "Frequency" and ranges from 0 to 5. The histogram shows the frequency distribution of carina offset distances, with the highest frequency occurring around 5 mm.
Carina offset distances for the real nodule cases
The box plot below shows the local displacement about matched nodules post affine alignment. These distances capture the needed amount of warp, in mm, to align the nodules after subtracting out the potentially large rigid (translational and rotational) effects.
Image /page/11/Figure/5 description: This image is a boxplot titled "Real Nodules". The y-axis is labeled "Warp Dist (mm)" and ranges from 0 to 30. The boxplot shows the distribution of the data, with the median around 12, the interquartile range between 6 and 18, and the whiskers extending to approximately 1 and 28.
Length of the warp required to align nodule centers, in mm, over the real cases
{12}------------------------------------------------
The registration, or alignment error (distance between post aligned nodule centroids), of each of the 39 real nodules successfully matched in the prior scan was performed. The figure below shows the distribution of error over all nodules.
Image /page/12/Figure/3 description: The image is a bar graph that shows the frequency of nodule registration errors. The x-axis represents the error distance in millimeters, ranging from 0 to 16. The y-axis represents the frequency, ranging from 0 to 14. The bar graph shows that the most frequent error distance is 4 mm, with a frequency of approximately 13.
Nodule Registration Error
Distribution of Nodule Registration Errors for Real Nodules
The average registration error was 4.46mm, with an associated standard deviation of 2.69mm. As shown, most nodules are aligned with high precision, well within our predefined 15mm tolerance.
ClearRead CT Compare is an extension of an existing, approved medical device. Nodule detection performance and measurements were validated as part of the initial submission of ClearRead CT (K161201). The current and prior scans are analyzed independently using the already cleared ClearRead CT Detect application.
Conclusion:
In preparing this 510(k) submission, Riverain Technologies has carefully considered the relevant statutory and regulatory requirements and believes that the information contained within satisfies the requirements for demonstrating substantial equivalence in terms of design features, fundamental technology, indications for use, and the safety and effectiveness of the device. Additionally, verification and validation testing demonstrate the safety and efficacy of the device to meet its intended use and specifications when operated as intended, with no detrimental impact upon the benefit / risk ratio of the device.
§ 892.2050 Medical image management and processing system.
(a)
Identification. A medical image management and processing system is a device that provides one or more capabilities relating to the review and digital processing of medical images for the purposes of interpretation by a trained practitioner of disease detection, diagnosis, or patient management. The software components may provide advanced or complex image processing functions for image manipulation, enhancement, or quantification that are intended for use in the interpretation and analysis of medical images. Advanced image manipulation functions may include image segmentation, multimodality image registration, or 3D visualization. Complex quantitative functions may include semi-automated measurements or time-series measurements.(b)
Classification. Class II (special controls; voluntary standards—Digital Imaging and Communications in Medicine (DICOM) Std., Joint Photographic Experts Group (JPEG) Std., Society of Motion Picture and Television Engineers (SMPTE) Test Pattern).