(248 days)
ArteraAI Prostate is a software only device intended to analyze scanned histopathology whole slide images (WSIs) from treatment-naïve prostate core needle biopsies prepared from formalin fixed paraffin-embedded (FFPE) tissue and stained using Hematoxylin & Eosin (H&E) stains. ArteraAI Prostate provides 10-year risks of distant metastasis and prostate cancer specific mortality and is intended to assist physicians with prognostic risk-based decisions along with other clinicopathological factors in non-metastatic prostate cancer patients.
ArteraAI Prostate is intended for males 55 years of age or older without clinically or pathologically defined metastases, and who are candidates for curative intent management (surgery, radiation therapy with or without systemic therapy, or active surveillance).
ArteraAI Prostate is intended to utilize WSIs acquired from an FDA-cleared interoperable scanner with which ArteraAI Prostate has been authorized for use or a 510(k)-cleared scanner that has been assessed in accordance with the Predetermined Change Control Plan (PCCP) for qualifying additional interoperable scanners.
ArteraAI Prostate is a software only device that utilizes deep learning algorithms developed with WSI of H&E-stained prostate needle biopsies to assess risk of distant metastasis and prostate cancer specific mortality. The software performs an algorithmic assessment of features extracted from WSIs using self-supervised learning. ArteraAI Prostate consists of one algorithm, comprised of multiple building block models that intake image data to calculate ArteraAI raw scores. These raw scores are used to estimate risk categories (High, Intermediate, Low) for 10-year risk of DM and PCSM. The algorithm is locked; it is not a continuous learning (continual machine learning model) algorithm.
ArteraAI Prostate includes the ArteraAI Platform (which includes the sub-components ArteraAI Web Portal and ArteraAI Back-End) and ArteraAI Prostate (which includes the sub-components ArteraAI Image Converter and the ArteraAI AI Engine). The ArteraAI Prostate interacts with the ArteraAI Platform. The functions of the above components are provided in the Table 1 below.
Here's a breakdown of the acceptance criteria and the study that proves the ArteraAI Prostate device meets them, based on the provided document:
1. Acceptance Criteria and Reported Device Performance
The document doesn't explicitly state a table of pre-defined "acceptance criteria" with numerical targets for clinical performance. Instead, it describes the desired clinical significance of the risk categories produced by the device, and then presents the results of a retrospective clinical study to demonstrate that the device achieved these desired outcomes.
Therefore, I've constructed a table based on the desired clinical significance statements mentioned in the "Summary of Clinical Validation Results" section, and mapped them to the reported performance.
| Acceptance Criteria (Derived from Desired Clinical Significance) | Reported Device Performance (10-Year Risk) |
|---|---|
| For Distant Metastasis (DM): | |
| 10-year risk of DM for ArteraAI Prostate Risk category High is statistically significantly higher than the overall risk, with a clinically significant difference. | High: 28.1% (Overall Risk: 8.1%) Difference: 20.0% (Statistically and clinically significant) |
| 10-year risk of DM for ArteraAI Prostate Risk category Low is statistically significantly lower than the overall risk, with a clinically significant difference. | Low: 3.3% (Overall Risk: 8.1%) Difference: 4.8% (Statistically and clinically significant) |
| For Prostate Cancer Specific Mortality (PCSM): | |
| 10-year risk of PCSM for ArteraAI Prostate Risk category High is statistically significantly higher than the overall risk, with a clinically significant difference. | High: 10.2% (Overall Risk: 2.3%) Difference: 7.9% (Statistically and clinically significant) |
| 10-year risk of PCSM for ArteraAI Prostate Risk category Low is statistically significantly lower than the overall risk, with a clinically significant difference. | Low: 0.6% (Overall Risk: 2.3%) Difference: 1.7% (Statistically and clinically significant) |
2. Sample Size Used for the Test Set and Data Provenance
- Sample Size (Test Set/Clinical Validation Set): 886 patients.
- Data Provenance: Retrospective clinical study across three sites in the US. Patients were diagnosed since 2005.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications
The document indicates that pathologists were involved in the initial diagnosis and identification of the highest Gleason score, which is a key input to the device. However, it does not specify the number of experts explicitly used to establish the ground truth for the prognostic outcomes (distant metastasis and prostate cancer specific mortality) in the clinical validation test set. The ground truth for these outcomes would typically be derived from long-term follow-up clinical data, not directly from expert review of the images for the purpose of the study. Pathologists' initial diagnoses determined the patient cohort for the study.
4. Adjudication Method for the Test Set
The document does not describe an adjudication method for establishing the ground truth of the outcomes in the clinical validation study. The outcomes (distant metastasis and prostate cancer specific mortality) are factual events observed during patient follow-up, not subjective interpretations requiring adjudication.
5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done
No, a MRMC comparative effectiveness study was not done as described in this document. The study evaluated the standalone performance of the ArteraAI Prostate device in predicting patient outcomes, not its improvement of human reader performance with AI assistance.
6. If a Standalone (Algorithm only without human-in-the loop performance) Was Done
Yes, a standalone study was done. The clinical performance evaluation focused on the ArteraAI Prostate device's ability to predict 10-year risks of DM and PCSM based on its algorithmic analysis of WSIs, without human readers "in-the-loop" during the prognosis prediction phase for the study purpose. The device output is a report for physician interpretation, but the core clinical performance evaluation was of the algorithm's prognostic capability itself.
7. The Type of Ground Truth Used
The ground truth used for the clinical validation study was outcomes data. Specifically:
- Actual distant metastasis (DM) events experienced by the patients.
- Actual prostate cancer specific mortality (PCSM) events experienced by the patients.
These events were tracked over a 10-year period (and up to 18.7 years of follow-up for censored patients) using Kaplan-Meier survival analysis.
8. The Sample Size for the Training Set
The document states: "There were 1,133 distant metastasis events and 931 prostate cancer specific mortality events in the dataset used to train the model." While it provides the number of events, it does not explicitly state the total sample size (number of patients or WSIs) used for the training set. It refers to "multiple, multi-center, prospective randomized controlled clinical trials and clinical studies" for the training data (Table 2 describes the characteristics of this training data but does not provide a total N).
9. How the Ground Truth for the Training Set Was Established
The ground truth for the training set was established using outcomes data. The model was trained on "the ground truth of actual metastasis or prostate cancer specific mortality events experienced by the patients in the trials from which the data is extracted." This implies that the historical clinical follow-up data from these trials served as the ground truth for training the AI model to predict these events.
EVALUATION OF AUTOMATIC CLASS III DESIGNATION FOR ArteraAI Prostate
DECISION SUMMARY
Page 1
I Background Information:
A De Novo Number
B Applicant
Artera Inc.
C Proprietary and Established Names
ArteraAI Prostate
D Regulatory Information
| Product Code(s) | Classification | Regulation Section | Panel |
|---|---|---|---|
| SFH | Class II | 21 CFR 864.3755 Software algorithm device analyzing digital images for cancer prognosis | 88 – PATHOLOGY |
II Submission/Device Overview:
A Purpose for Submission:
De Novo request for evaluation of automatic class III designation for ArteraAI Prostate.
B Measurand:
Scanned whole slide images (WSI) of Hematoxylin & Eosin (H&E)-stained prostate needle core biopsies.
Page 2
C Type of Test:
Evaluation of scanned WSIs of H&E-stained prostate needle biopsies by Artificial Intelligence/Machine Learning (AI/ML) based algorithm to provide cancer associated prognostic 10-year risk estimates of distant metastasis (DM) and prostate cancer specific mortality (PCSM).
III Indications for Use:
A. Indication(s) for Use:
ArteraAI Prostate is a software only device intended to analyze scanned histopathology whole slide images (WSIs) from treatment-naïve prostate core needle biopsies prepared from formalin fixed paraffin-embedded (FFPE) tissue and stained using Hematoxylin & Eosin (H&E) stains. ArteraAI Prostate provides 10-year risks of distant metastasis and prostate cancer specific mortality and is intended to assist physicians with prognostic risk-based decisions along with other clinicopathological factors in non-metastatic prostate cancer patients.
ArteraAI Prostate is intended for males 55 years of age or older without clinically or pathologically defined metastases, and who are candidates for curative intent management (surgery, radiation therapy with or without systemic therapy, or active surveillance).
ArteraAI Prostate is intended to utilize WSIs acquired from an FDA-cleared interoperable scanner with which ArteraAI Prostate has been authorized for use or a 510(k)-cleared scanner that has been assessed in accordance with the Predetermined Change Control Plan (PCCP) for qualifying additional interoperable scanners.
B Special Conditions for Use Statement(s):
Rx - For Prescription Use Only
Warnings
- The ArteraAI Prostate should be used in conjunction with a complete standard of care evaluation.
- The ArteraAI Prostate patient report is to be utilized by trained physicians after being released by the pathology laboratory user.
- The ArteraAI Prostate results correctness is based on the quality requirements of the slide images and appropriate whole slide imaging scanner usage.
- Ensure proper traceability of the scanned images to the patient using an anonymized patient ID.
Please refer to the labeling for a complete list of warnings and precautions.
Page 3
C Special Instrument Requirements:
Philips Ultra Fast Scanner (DEN160056)
IV Device/System Characteristics:
A Device Description:
ArteraAI Prostate is a software only device that utilizes deep learning algorithms developed with WSI of H&E-stained prostate needle biopsies to assess risk of distant metastasis and prostate cancer specific mortality. The software performs an algorithmic assessment of features extracted from WSIs using self-supervised learning. ArteraAI Prostate consists of one algorithm, comprised of multiple building block models that intake image data to calculate ArteraAI raw scores. These raw scores are used to estimate risk categories (High, Intermediate, Low) for 10-year risk of DM and PCSM. The algorithm is locked; it is not a continuous learning (continual machine learning model) algorithm.
ArteraAI Prostate includes the ArteraAI Platform (which includes the sub-components ArteraAI Web Portal and ArteraAI Back-End) and ArteraAI Prostate (which includes the sub-components ArteraAI Image Converter and the ArteraAI AI Engine). The ArteraAI Prostate interacts with the ArteraAI Platform. The functions of the above components are provided in the Table 1 below.
Table 1. ArteraAI Prostate Sub-Components Overview
| Sub-Component | Description |
|---|---|
| ArteraAI Platform | |
| ArteraAI Web Portal | Allows users to interact with the platform to perform the following functions:1. Select the test to be performed.2. Input data.3. Pass data to the Back-End component.4. Receive report generated for the given patient ID.5. Manage records from the previously executed tests.6. Access instructions for use and labeling information.The sub-component does not modify the data or take any action other than transmitting it to the back end. |
| ArteraAI Back-End | Manages the task execution of other components and performs the following functions:1. Send and retrieve data associated with a given ID to/from the database.2. Start Image Converter jobs and pass the location of slide images to the Image Converter. |
Page 4
| Sub-Component | Description |
|---|---|
| ArteraAI Platform | |
| 3. Start AI jobs and pass location of slide images to the AI Engine.4. Compile PDF reports.5. Manage user authentication.The sub-component does not modify the data or take any action other than transmitting it to the AI Engine and Image Converter and populate the PDF report with results from the AI Engine. | |
| ArteraAI Prostate | |
| ArteraAI Image Converter | Converts images to a format usable by the AI Engine (iSyntax to TIFF). |
| ArteraAI AI Engine | Includes the AI/ML algorithm and performs the evaluation of WSIs that are uploaded and provides the device output as described in the intended use. |
Device Input:
The only input to the device is WSIs of H&E-stained prostate needle biopsy. WSIs are generated from the FDA cleared Philips Ultra Fast Scanner with below Settings:
- Magnification: 40x
- Resolution: 0.25 μm/pixel
- Compression: Proprietary of Philips
- File format: iSyntax, Philips proprietary file format with either RAW or iSyntax compression.
All WSIs from prostate cancer biopsy slides with the same highest Gleason grade determined by the pathologist are uploaded to the ArteraAI web portal which are then analyzed by the ArteraAI Prostate device. The ArteraAI Prostate device initially calculates a raw score for a patient. Then two cutoffs C1 and C2 are applied to the raw score for determination of the ArteraAI Prostate risk categories:
- Raw Score > C2, then category=High
- C1<Raw Score ≤C2, then category=Intermediate
- Raw Score ≤C1, then category=Low
The highest ArteraAI Prostate risk category is provided in the patient report.
Device Output:
The test output is a patient specific report, which includes the following:
Page 5
- 10-year ArteraAI Prostate Categorical Risk for Distant Metastasis (High, Intermediate, Low)
- Individual 10-year risk for Distant Metastasis (Low and Intermediate)
- 10-year ArteraAI Prostate Categorical Risk for Prostate Cancer Specific Mortality (PCSM) (High, Intermediate, Low)
The ArteraAI Prostate patient report is intended to be interpreted by the physician to aid in understanding the risk of DM or PCSM in the prostate cancer patient. The results are provided to support risk-based decisions within the recommended professional guidelines.
B Principle of Operation
ArteraAI Prostate is intended to be operated within a pathology laboratory with digital scanning capabilities. The ArteraAI Prostate workflow is depicted in Figure 1 below.
Figure 1. ArteraAI Prostate Workflow
[Workflow diagram showing the process from pathology laboratory through to test report generation]
The slide review and image selection procedure for uploading to the ArteraAI web portal is as follows:
Page 6
-
ArteraAI Prostate is performed on WSI images of prostate core biopsy specimen after a patient's diagnosis of prostate cancer per standard of care. A qualified pathologist must have already determined that prostate cancer is present in the patient prostate core biopsy specimen. ArteraAI Prostate is intended for use only with slide images that contain non-metastatic prostate cancer. If there is no prostate cancer in any of the biopsy cores, ArteraAI Prostate should not be used.
-
The pathologist will identify the WSI(s) of the biopsy specimen containing the highest Gleason score. The WSIs are obtained using the FDA-cleared Philips Ultra Fast scanner at 40x magnification in accordance with the scanner's Instructions for Use.
-
The WSIs are reviewed to verify that the image is not blurry, no defects are present and the whole tissue region is included in the image. Additional image and other related quality control steps are performed per the ArteraAI Prostate Instructions for Use.
-
The WSI(s) and a unique patient identifier are entered as data inputs to the ArteraAI web portal that is then transferred to Artera's back-end infrastructure. The patient identifier is intended to provide end-to-end traceability while protecting patient health information privacy.
-
During the WSI transfer process, a web worker (thread) which is a web browser feature, is used to manage the upload of the WSI to parallelize the data transfer. This allows the image and other data upload to proceed in the background, allowing the operator to continue interacting with the system without interruption.
-
ArteraAI Prostate uses the uploaded WSI(s) as input. Additional clinical data, if entered into the web portal, are not used as an input to ArteraAI Prostate but are only for the purposes of including this information in the ArteraAI Prostate Test Report.
-
ArteraAI Prostate produces a test report that summarizes the ArteraAI Prostate results and transfers the test report to the pathology laboratory via the ArteraAI web portal.
-
The pathologist will confirm the presence of cancer within the uploaded WSI, review and approve the report in accordance with the local laboratory procedures and release the test report to the requesting clinician.
C. ArteraAI Prostate Prognostic Model Development
The AI algorithm used in the ArteraAI Prostate was developed using deep learning machine learning algorithms trained on WSIs of H&E- stained prostate needle biopsy slides from multiple, multi-center, prospective randomized controlled clinical trials and clinical studies to assess 10-year risk of DM and PCSM. As indicated in the Table 2 below the datasets included a representative spectrum of cases with diagnostic variability including a range of Gleason scores, tumor stages. The model was trained on the data summarized in Table 2 below using the ground truth of actual metastasis or prostate cancer specific mortality events experienced by the patients in the trials from which the data is extracted. There were 1,133 distant metastasis events and 931 prostate cancer specific mortality events in the dataset used to train the model. Additional information about training dataset is presented in Table 2 below:
Page 7
Table 2. Characteristics of Training Dataset
[Large detailed table showing study characteristics across multiple clinical trials with variables including treatment protocols, patient demographics, tumor stages, Gleason grades, and follow-up data]
Page 8
[Continuation of Table 2 with additional data rows and study characteristics]
D. Software and Cybersecurity
ArteraAI Prostate software documentation and software verification and validation testing demonstrate that the device followed all recommendations for basic documentation level as outlined in the FDA guidance document, "Content of Premarket Submissions for Device Software Functions," issued on June 14, 2023. A description of the testing protocols, including pass/fail criteria, and report of results was provided for the verification and validation activities and all testing results met design specifications and passed the acceptance criteria.
ArteraAI Prostate cybersecurity documentation demonstrated that the device met the cybersecurity requirements as outlined in Section 524B of Federal Food, Drug, and Cosmetic Act (FD&C Act). This includes a threat model, software bill of materials, data security training, validation and mitigation of cybersecurity risks, cyber risk management, labeling, cyber testing, and post market cyber vulnerabilities and other information for safeguarding the algorithms.
Page 9
V Standards/Guidance Documents Referenced:
- Guidance for the Content of Premarket Submissions for Device Software Functions; June 2023
- CLSI document EP12-Ed3: Evaluation of Qualitative, Binary Output Examination Performance; March 2023
- Cybersecurity in Medical Devices: Quality System Considerations and Content of Premarket Submissions; September 2023
- The 510(k) Program: Evaluating Substantial Equivalence in Premarket Notifications [510(k)]; July 2014
- Guidance for Industry and FDA Staff: De Novo Classification Process (Evaluation of Automatic Class III Designation); October 2021
- Acceptance of Clinical Data to Support Medical Device Applications and Submissions Frequently Asked Questions; February 2018
- Guidance for Industry and Food and Drug Administration Staff - Factors to Consider When Making Benefit-Risk Determinations in Medical Device Premarket Approval and De Novo Classifications; August 2019
- Guidance for Off-the-Shelf Software Use in Medical Devices; August 2023
- ISO 14971 Third Edition 2019-12 Medical devices - Application of risk management to medical devices
- IEC 62304 Edition 1.1 2015-06 (2015). Medical device software – Software life cycle processes
- IEC 62366-1 Edition 1.1 2020-06 CONSOLIDATED VERSION – Medical devices – Part 1: Application of usability engineering to medical devices
VI Performance Characteristics:
A. Analytical Performance:
The precision of ArteraAI device was evaluated in a between-site reproducibility study which was performed at three laboratory sites in the United States. At each site, slides were scanned by a single operator on a Philips Ultra Fast scanner at 40x objective, with one run per day and five replicates per run, over five non-consecutive days (total number=15). Fifty-two samples (including 6 borderline samples based on ArteraAI Prostate raw score cut-offs) were included in the between-site reproducibility study and these samples were selected from patients with an age at biopsy from 55 years and above, Gleason score 6 to 10, clinical stage T1 to T3, and spanning the low-, intermediate-, and high-risk categories of the device output. The sample characteristics are provided in Table 3 below.
Page 10
Table 3. Characteristics of Samples Used in Analytical Studies
| Characteristic | N = 52 |
|---|---|
| Age (year), Median, (Min, Max) | 66, (55, 86) |
| PSA (ng/mL), Median, (Min, Max) | 6.95, (1.14, 577.42) |
| Tumor Stage, n (%) | |
| T1 | 35.0 (67.3%) |
| T2 | 15.0 (28.8%) |
| T3 | 2.0 (3.8%) |
| Gleason Grade Group, n (%) | |
| GG 1 | 14.0 (26.9%) |
| GG 2 | 17.0 (32.7%) |
| GG 3 | 11.0 (21.2%) |
| GG 4 | 5.0 (9.6%) |
| GG 5 | 5.0 (9.6%) |
| NCCN Risk Category, n (%) | |
| Very Low/Low | 11.0 (21.2%) |
| Intermediate | 31.0 (59.6%) |
| High/Very High | 10.0 (19.2%) |
| ArteraAI Risk Group (Case-Level Mode) n (%) | |
| Low Risk | 17.0 (32.7%) |
| Intermediate Risk | 20.0 (38.5%) |
| High Risk | 15.0 (28.8%) |
| Borderline Group (Case-Level Mean Within Borderline Threshold), n (%) | |
| Borderline | 6.0 (11.5%) |
| Non-Borderline | 46.0 (88.5%) |
n (%). Note that some percentages may not add up to a hundred percent due to rounding
Summary of Analytical Validation Study Results:
a. Analysis of numeric values of the raw score was performed according to CLSI EP05-A3: Evaluation of Precision of Quantitative Measurement Procedures, 3rd Edition. Within-laboratory, between-site and reproducibility were calculated; in addition, a qualitative analysis (percent of each ArteraAI categories among 15 replicates) was performed and results of these analyses are presented in Table 4 below.
b. Analysis of 10-year DM values for cases with Low- and Intermediate- risk categories was also performed according to the CLSI EP05-A3. Within-laboratory, between-site and reproducibility were calculated; in addition, a qualitative analysis (percent of each ArteraI categories among 15 replicates) was performed and results of these analyses are presented in Table 5.
c. For ArteraAI raw scores, the %CV for the within-site precision (the same scanner on different days) ranged from 0.1% to 2.8%; the %CV for the between-site precision ranged from 0.0% to 6.0% and %CV for reproducibility ranged from 0.3% to 6.1%.
Page 11
d. For ArteraAI DM scores, the %CV for the within-site precision (the same scanner on different days) ranged from 0.5% to 5.7%; the %CV for the between-site precision ranged from 0.0% to 12.3% and %CV for reproducibility ranged from 1.0% to 12.3%.
Table 4. Within-Site Precision and Reproducibility of ArteraAI Raw Score
[Large detailed table showing precision measurements across 52 samples with columns for Sample, Mean Raw score, ArteraAI Risk Group, Borderline Cases, Within-Site measurements, Between-Site measurements, Reproducibility measurements, and Percent Category Agreement Results across three sites]
Page 12
[Continuation of Table 4 with samples 29-52]
Page 13
Table 5. Within-Site Precision and Reproducibility of ArteraAI Prostate DM Risk
[Large detailed table showing DM risk precision measurements across 37 samples with similar structure to Table 4 but focused on DM risk categories]
Page 14
[Continuation of Table 5 with samples 32-37]
B Clinical Performance:
The clinical performance of the ArteraAI Prostate device was evaluated in a retrospective clinical study which included a total of 886 patients across three sites in the US. The dataset for pivotal clinical performance study included patients with non-metastatic prostate cancer diagnosed since 2005 without clinically or pathologically defined metastases. Patients across 3 US sites were considered eligible if age at date of biopsy was 55 years of age and older with clinical T-stage T1-T4 (T1a, T1b, T1c, T1, T2a, T2b, T2c, T2, T3a, T3b, T3c, T4a, T4b, T4c, T4), baseline median PSA value closest to the biopsy were 6.2 ng/mL, and Gleason score at diagnosis was 6-10. The intended patient should also have been a candidate for curative intent management (surgery, radiation therapy with or without systemic therapy), or active surveillance. Patients were required to have non-metastatic prostate cancer and at least one H&E slide containing at least one FFPE biopsy core with the highest Gleason grade tumor as diagnosed by the pathologist. The slides were scanned to a digital image format using the Philips Ultra Fast Scanner. Patients with prior or concurrent malignancy (except non-melanoma skin cancer) within the 5 years prior to prostate cancer diagnosis, recurring cancer, metastatic disease at diagnosis or patients who received only palliative care were excluded from the study resulting in pivotal clinical performance cohort of N=886.
The summary of patient characteristics for the pivotal clinical performance study is presented in Table 6 below.
Page 15
Table 6. Summary of Clinical Validation Patient Cohort Characteristics
| Variables | Overall N = 886¹ |
|---|---|
| Sites, n(%) | |
| Site 1 | 290 (33%) |
| Site 2 | 444 (50%) |
| Site 3 | 152 (17%) |
| Treatment Per Protocol, n(%) | |
| Active Surveillance | 314 (36%) |
| Radiation Therapy (With or without Androgen Deprivation Therapy) | 203 (23%) |
| Radical Prostatectomy | 354 (41%) |
| Missing | 15 |
| Age at time of biopsy | |
| Median (Q1 - Q3) | 65 (61 - 70) |
| Min - Max | 55 - 98 |
| Race, n(%) | |
| Black | 72 (8.1%) |
| White | 675 (76%) |
| Other | 133 (15%) |
| Unknown | 6 (0.7%) |
| PSA (ng/mL) at time of biopsy | |
| Median (Q1 - Q3) | 6.2 (4.6 - 9.6) |
| Clinical Tumor Stage, n(%) | |
| T1a | 3 (0.3%) |
| T1b | 1 (0.1%) |
| T1c | 579 (65%) |
| T2 | 2 (0.2%) |
| T2a | 178 (20%) |
| T2b | 48 (5.4%) |
| T2c | 46 (5.2%) |
| T3a | 20 (2.3%) |
| T3b | 6 (0.7%) |
| T4 | 3 (0.3%) |
Page 16
| Variables | Overall N = 886¹ |
|---|---|
| Gleason Grade Group at time of biopsy, n(%) | |
| 1 | 372 (42%) |
| 2 | 220 (25%) |
| 3 | 132 (15%) |
| 4 | 97 (11%) |
| 5 | 64 (7.2%) |
| Missing | 1 |
| NCCN risk group (3-level), n(%) | |
| Low | 313 (35%) |
| Intermediate | 358 (40%) |
| High | 206 (23%) |
| N1-5² | 7 (0.8%) |
| Missing | 2 |
| Follow-up time of the censored (year) | |
| Median (Q1 - Q3) | 8.2 (6.2 - 11.2) |
| Min - Max | 0.1 - 18.7 |
¹n (%). Note that some percentages may not add up to a 100% due to rounding
²Clinically node positive patients, not applicable for NCCN risk grouping
Summary of Clinical Validation Results:
a. 10-Year Risk of DM for ArteraAI Prostate Risk Categories (High, Intermediate, Low)
The prognostic ability of the ArteraAI Prostate was evaluated for 10-year risk of DM. The estimates of 10-year risks of DM for ArteraAI Prostate Risk categories along with two-sided 95%CI are presented in Table 7 and Figure 2 below.
The results of the pivotal clinical performance study support that:
i. 10-year risk of DM for ArteraAI Prostate Risk category High (28.1%) is statistically significantly higher than the overall risk (8.1%) and this difference (20.0%) is clinically significant.
ii. 10-year risk of DM for ArteraAI Prostate Risk category Low (3.3%), is statistically significantly lower than the overall risk (8.1%) and this difference (4.8%) is clinically significant.
Page 17
Table 7. 10-Year Risks of DM for Artera AI Prostate Risk Categories
| ArteraAI Prostate Risk Category | Total Number | Number of DM for 10 years | Estimated 10-year Risk of DM (95% CI) * | Percentage of Patients with the Risk Category (Total/886) |
|---|---|---|---|---|
| High | 144 | 30 | 28.1% (19.4%-37.5%) | 16.3% |
| Intermediate | 214 | 12 | 6.6% (3.6%-10.8%) | 24.2% |
| Low | 528 | 13 | 3.3% (1.8%-5.6%) | 59.6% |
| Total | 886 | 55 | Estimated overall risk (95% CI): 8.1% (6.1%-10.4%) |
- The estimated 10-year risk of DM and 95% CI were calculated by Kaplan- Meier survival analysis.
Figure 2. Kaplan-Meier curves for 10-Year Risk of DM for ArteraAI Prostate Risk Categories (High, Intermediate, Low)
[Kaplan-Meier survival curve chart showing three risk categories over 15 years, with ArteraAI High showing highest risk, ArteraAI Intermediate showing moderate risk, and ArteraAI Low showing lowest risk]
Page 18
b. 10-Year Risk of PCSM for ArteraAI Prostate Risk Categories (High, Intermediate, Low)
The prognostic ability of the ArteraAI Prostate was evaluated for 10-year risk of PCSM. Estimates of 10-year risks of PCSM for ArteraAI Prostate Risk categories along with two-sided 95%CI are presented in Table 8 and Figure 3.
The results of the pivotal clinical performance study support that:
i. 10-year risk of PCSM for ArteraAI Prostate Risk category High (10.2%), is statistically significantly higher than the overall risk (2.3%) and this difference (7.9%) is clinically significant.
ii. 10-year risk of PCSM for ArteraAI Prostate Risk category Low (0.6%), is statistically significantly lower than the overall risk (2.3%) and this difference (1.7%) is clinically significant.
Table 8. 10-year Risk for PCSM for ArteraAI Prostate Risk Categories
| ArteraAI Prostate Risk Category | Total Number | Number of PCSM for 10 years | Estimated 10-year Risk of PCSM (95% CI) * | Percentage of Patients with the Risk Category (Total/886) |
|---|---|---|---|---|
| High | 144 | 9 | 10.2% (4.7% - 18.2%) | 16.3% |
| Intermediate | 214 | 2 | 1.1% (0.2% - 3.7%) | 24.2% |
| Low | 528 | 2 | 0.6% (0.1% - 2.0%) | 59.6% |
| Total | 886 | 13 | Estimated overall risk (95% CI): 2.3% (1.2% - 3.8%)) |
- The estimated 10-year risk of DM and 95% CI were calculated by Kaplan- Meier survival analysis.
Page 19
Figure 3. Kaplan-Meier curves for 10-Year Risk of PCSM for ArteraAI Prostate Risk Categories (High, Intermediate, Low)
[Kaplan-Meier survival curve chart showing three risk categories over 15 years for PCSM]
c. Subgroup Analysis for 10-Year Risk of DM for ArteraAI Prostate Risk Categories (Low, Intermediate, High)
i. African American Vs Non-African American
This subgroup analysis shows that the ArteraAI Prostate risk categories for 10-year risk of distant metastasis outputs are validated between African American and Non-African American patients. A higher 10-year DM risk estimates for African American patients vs non-African American patients for ArteraAI categories High (35.6% vs 27.4%) and Low (9.0% vs 2.9%,) and overall risk (13.5% vs 7.7%) was observed (Table 9). The number of patients from African American patient group was limited (72) and this should be taken in consideration when using the risk estimates provided by ArteraAI Prostate for African American patients.
Page 20
Table 9. 10-year Risk of DM for African American Patients
| ArteraAI Prostate Risk Category | African American Patients (N=72) | |||
|---|---|---|---|---|
| Total Number | Number of DM for 10 Years | Estimated 10-year Risk of DM, (95%CI) | Percentage of Patients with the Risk Category | |
| High | 10 | 2 | 35.6% (1.6%-77.2%) | 13.9% |
| Intermediate | 26 | 2 | 8.7% (1.4%-24.8%) | 36.1% |
| Low | 36 | 2 | 9.0% (1.3%-26.3%) | 50.0% |
| Total | 72 | 6 | Estimated overall 10-year DM risk, 95%CI: 13.5% (5.1%-26.1%) |
Table 10. 10-year risk for DM for Non-African American Patients
| ArteraAI Prostate Risk Category | Non-African American Patients (N=814) | |||
|---|---|---|---|---|
| Total Number | Number of DM for 10 years | Estimated 10-year Risk of DM, (95%CI) | Percentage of Patients with the Risk Category | |
| High | 134 | 28 | 27.4% (18.6%-36.9%) | 16.5% |
| Intermediate | 188 | 10 | 6.3% (3.2%-10.8%) | 23.1% |
| Low | 492 | 11 | 2.9% (1.5%-5.2%) | 60.4% |
| Total | 814 | 49 | Estimated overall 10-year DM risk, 95%CI: 7.7% (5.7%-10.0%) |
d. Different Treatment Groups
This subgroup analysis shows that the ArteraAI Prostate risk categories for 10-year risk of distant metastasis outputs are validated across patients treated with all different treatment regimens related to nonmetastatic prostate cancer (Table 11). This subgroup analysis stratified by different types of treatment [Active surveillance (n=314), Radiation therapy (n=203) and radical prostatectomy (n=354)] was performed and ArteraAI Prostate risk estimates were acceptable for each treatment group.
Page 21
Table 11. 10-year risk of DM for patients with different treatments
| Treatment Subgroup (N=871*) (all patients with known treatment types) | ArteraAI Prostate Risk Category (N) | Number of DM for 10 Years | Estimated 10-year Risk of DM (95% CI) | Percentage of Patients with the Risk Category (N=871) |
|---|---|---|---|---|
| Active Surveillance (N=314) | High (N=24) | 5 | 23.1% (8.0%-42.8%) | 2.8% |
| Intermediate (N=56) | 1 | 2.1% (0.2%-9.9%) | 6.4% | |
| Low (N=234) | 3 | 2.4% (0.6%-6.7%) | 26.9% | |
| Radiation Therapy (N=203) | High (N=64) | 16 | 33.4% (19.6%-47.8%) | 7.3% |
| Intermediate (N=47) | 5 | 13.6% (4.8%-26.8%) | 5.4% | |
| Low (N=92) | 3 | 3.5% (0.9%-9.0%) | 10.6% | |
| Radical Prostatectomy (N=354) | High (N=53) | 8 | 22.6% (9.8%-38.6%) | 6.1% |
| Intermediate (N=107) | 6 | 6.3% (2.6%-12.6%) | 12.3% | |
| Low (N=194) | 6 | 3.8% (1.5%-7.8%) | 22.3% |
- For 15 out 886 patients, treatment type information was not available.
e. Additional study: Samples with more than one highest Gleason Grade slides
In addition, a study was conducted for cases with multiple slides containing the highest Gleason grade, 15 cases including 14 cases with 2 slides and 1 case with 3 slides which had the same highest Gleason grade. One out of 15 cases (6.7%) had different ArteraAI Prostate risk categories. In real-life settings, all slides with same highest Gleason grade should be analyzed by the ArteraAI Prostate device and the highest risk category is provided in the patient ArteraAI report.
Page 22
VII Pre-Determined Change Control Plan
The ArteraAI Prostate includes a pre-determined change control plan (PCCP) approved by the US Food and Drug Administration (FDA). The PCCP provides an overview of the planned modifications which is to add additional FDA cleared WSI scanners as intended use components. As outlined in the PCCP, each modification is designed to address specific differences in device input, ensuring consistent performance and prognostic accuracy. Verification and validation testing will ensure that software updates made to add interoperability with additional FDA cleared scanners will not have an impact on existing interoperable scanners or other functionality. The verification/validation process for each additional scanner is same as the validation process used to show interoperability with the Philips Ultra Fast Scanner that is authorized as part of this De Novo submission.
Specific validation study protocols and acceptance criteria are also detailed in the PCCP to ensure that device maintains the following performance characteristics for the stated modification:
- Addition of additional FDA cleared whole slide image (WSI) scanners as intended use components (Interoperability to an additional WSI scanner)
Per ArteraAI's change control procedure, a change request for the following changes will be created:
i. Update the User Interface to include an additional interoperable scanner in the file upload workflow.
ii. Update the Back End to verify image metadata from files from the new interoperable scanner.
iii. If necessary: Update the Image Converter component to convert compatible files from the new scanner to the expected format for the AI Engine.
Upon successful validation, labeling will be updated in accordance with the authorized PCCP to provide users with current information regarding the device's interoperable scanner.
VIII Proposed Labeling:
The labeling supports the decision to grant the De Novo request for this device.
IX Identified Risks and Mitigations:
| Risks to Health | Mitigation Measures |
|---|---|
| Risk of false positive, false negative, or failure to provide a result. | Certain design verification and validation activities, including certain analytical and clinical studies.Certain labeling information, including certain performance information and limitations. |
| Incorrect interpretation of test results by the user. | Certain design verification and validation activities.Certain labeling information, including certain performance information and limitations. |
Page 23
X Benefit/Risk Assessment:
A Summary of the Assessment of Benefit:
ArteraAI Prostate device provides 10-year categorical risk (High, Intermediate, Low) for DM and PCSM. The device also provides a 10-year individual risk estimate of DM for Low and Intermediate risk groups. These risk estimates in the IU population are intended to help physicians make more informed treatment decisions. The device may help in reducing under or over treatment of patients by estimating the risk of DM.
B Summary of the Assessment of Risk:
The probable risks associated with the use of this device are mainly due to erroneous results and incorrect use and interpretation of test results by the healthcare providers. Incorrect test results may be due the prognostic ArteraAI Prostate 10-year categorical risk (High, Intermediate, Low) for DM and PCSM being reported as higher or lower than true risk and the individual risk estimate of DM for Low and Intermediate risk groups being reported as higher or lower than true risk. In both scenarios above, there is probable risk of mismanagement of patient care in accordance with professional guidelines, based on false test results from this test, or incorrect interpretation of test results.
C Patient Perspectives:
This submission did not include specific information on patient perspectives for this device.
D Summary of the Assessment of Benefit-Risk:
The probable benefit of this device was demonstrated by analytical and clinical validation studies (refer to Section VI Performance Characteristics for details). The clinical performance of ArteraAI device was evaluated in a clinical study which included a total of 886 patients across three sites in the US. The pivotal clinical performance study showed that the 10-year risk of DM for ArteraAI Prostate risk category High (28.1%) is statistically significantly higher than the overall risk (8.1%) and this difference (20.0%) is clinically significant. The 10-year risk of DM for ArteraAI Prostate category Low (3.3%) is statistically significantly lower than the overall risk (8.1%) and this difference (4.8%) is clinically significant.
False test results from this test, or incorrect interpretation of test results, could result in improper medical management of patients. The probable risks associated with false test results includes prognostic ArteraAI Prostate 10-year categorical risk (High, intermediate, Low) for DM and PCSM and prognostic ArteraAI 10-year individual risk estimate of DM for Low and Intermediate risk groups being reported as higher or lower than the true risk. These risks are mitigated by adequate analytical and clinical performance of the device. The probable risks associated with incorrect interpretation of test results are mitigated by inclusion of adequate instructions in the labeling on proper use of the device within the clinical workflow. Further, the
Page 24
test results are unlikely to be the only factor considered while making clinical decisions. These results may support risk-based decisions within recommended guidelines.
While general controls are insufficient to ensure the safety and effectiveness of the device, in light of the mitigations provided by the special controls, the probable benefits outweigh the probable risks for the use of the ArteraAI Prostate device.
XI Conclusion:
The De Novo request is granted, and the device is classified under the following and subject to the special controls identified in the letter granting the De Novo request:
Product Code(s): SFH
Device Type: Software algorithm device analyzing digital images for cancer prognosis
Class: II
Regulation: 21 CFR 864.3755
N/A