K Number
K173940
Manufacturer
Date Cleared
2018-05-15

(140 days)

Product Code
Regulation Number
892.5050
Reference & Predicate Devices
N/A
Predicate For
N/A
AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
Intended Use

The Astroid Planning App is an interactive end user application for proton treatment planning for the intended use and primary purpose of enabling radiotherapy professionals to efficiently design and analyze proton radiotherapy treatment plans. This Astroid Planning App leverages the existing .decimal Astroid Dosimetry App [FDA 510(k) K150547), which is a library of treatment planning functions accessed through the Thinknode® cloud services framework, for device creation, dose calculation, optimization, and all other dosimetry and processing calculations. Since the Astroid Dosimetry App is responsible for performing the calculations, the scope of this Astroid Planning App is to be the user interface for end users to input treatment planning data and review the results. Typical indications for the treatment of persons with cancer, over a wide range of potential disease locations. In the most common use case of the software, users will import patient data from existing imaging software programs, manage physician prescription and intent information, develop a proton treatment plan, and analyze the plan to determine how well it meets the physician's goals. Since the critical treatment planning functions are handled outside this software application, by a software of known quality and pedigree, the primary and most frequently used functions of this software are the record keeping service (for patient data storage), user interface controls, and visualization tools.

Furthermore, since the accuracy of information computed and displayed by an application such as this is very important to the proper treatment of patients, it is critical that users have the appropriate educational and clinical experience backgrounds to adequately understand and use the product. Additionally, since each radiotherapy treatment machine produces a unique beam of radiation, there is much responsibility on the end users to adequately commission and test this software over the full range of expected treatment conditions before the system is utilized for patient treatment.

Device Description

The primary purpose of the Astroid Planning App device is for facilitating the planning and analysis of proton radiation therapy treatments. The Astroid Planning App device is an interactive end user application in which the user interacts with the interface to perform proton treatment planning tasks. The data constructed in the Astroid Planning App device will be used as inputs to the Astroid Dosimetry App device [FDA 510(k) K150547], which is the foundational proton dosimetry calculation library that contains all algorithms and calculation processing for the proton treatment planning. The Astroid Planning App device composes and otherwise constructs the calculation requests required for the development of the proton treatment plan, leveraging the functions externally located in the Astroid Dosimetry App to then perform the requested calculations.

AI/ML Overview

The Astroid Planning App is an interactive end-user application for proton treatment planning. It leverages the existing .decimal Astroid Dosimetry App (K150547) for device creation, dose calculation, and optimization. The Planning App's scope is to provide a user interface for inputting treatment planning data and reviewing results, while the critical treatment planning functions are handled by the Dosimetry App.

1. Table of acceptance criteria and the reported device performance:

The provided text does not contain a specific table of quantitative acceptance criteria. However, it states that the device was evaluated against predicate devices and through validation tests. The overall reported performance is that the Astroid Planning App "performed as well as the predicate devices and that the Astroid Planning App is deemed safe and effective for clinical use when properly commissioned for a proton treatment machine."

2. Sample size used for the test set and the data provenance:

The document states: "Validation tests comparing results of proton dose calculations, with the inclusion of all applicable treatment delivery devices, to experimental and analytical datasets were performed." It does not specify the exact sample size or the provenance of the experimental and analytical datasets used for comparison. It does not indicate if the data was retrospective or prospective or its country of origin.

3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts:

This information is not explicitly provided in the document.

4. Adjudication method for the test set:

The document does not describe a formal adjudication method (e.g., 2+1, 3+1). It states that "Clinically oriented validation test cases were written and executed by .decimal personnel and hospital-based testing partners." This suggests internal validation and potentially collaboration with clinical partners, but not a formal adjudication process for establishing ground truth as might be expected in a clinical study.

5. If a multi-reader multi-case (MRMC) comparative effectiveness study was done, and if so, what was the effect size of how much human readers improve with AI vs without AI assistance:

A multi-reader multi-case study comparing human readers with and without AI assistance was not explicitly mentioned. The testing focused on the performance of the Astroid Planning App itself, comparing it to predicate devices. The device serves as a planning tool, not a diagnostic aid that would typically involve human reader performance changes.

6. If a standalone (i.e., algorithm only without human-in-the-loop performance) was done:

The document states that "the primary and most frequently used functions of this software are the record keeping service (for patient data storage), user interface controls, and visualization tools." The critical treatment planning functions and calculations are handled by the separate Astroid Dosimetry App. Therefore, the Astroid Planning App, as described, is inherently a "human-in-the-loop" interface for the Astroid Dosimetry App, and a standalone algorithm-only performance assessment of the Planning App itself (without considering the Dosimetry App) would not be applicable to its stated function. However, the underlying Astroid Dosimetry App (K150547) would have undergone its own standalone performance evaluation. This document focuses on the Planning App's role as an interface.

7. The type of ground truth used (expert consensus, pathology, outcomes data, etc.):

The ground truth for the dose calculation comparisons was based on "experimental and analytical datasets." This implies physical measurements and/or established theoretical models for proton dose calculations. For other functions, the "performance as well as the predicate devices" suggests the predicate devices' established accuracy served as a benchmark for comparison.

8. The sample size for the training set:

Information regarding a specific training set size is not provided. As this is a planning application, rather than a machine learning model that would typically have a distinct training phase, the concept of a "training set" might not directly apply in the same way. The development and verification process likely involved extensive iterative testing and refinement.

9. How the ground truth for the training set was established:

Since a distinct training set (in the machine learning sense) is not described, the method for establishing its ground truth is not mentioned. The validation process, however, involved comparison to "experimental and analytical datasets," which would serve as the reference for accuracy.

Summary of the Study:

The study was a non-clinical testing effort focused on demonstrating that the Astroid Planning App performs comparably to predicate devices and is safe and effective when properly commissioned.

  • Tests performed:
    • Validation tests comparing proton dose calculations to experimental and analytical datasets.
    • Verification and validation tests for all other externally available functions.
    • Usability testing, including analysis of all system displays and user options.
    • Plan quality studies and full end-to-end testing of the entire planning process as compared to the predicate devices.
  • Personnel involved: .decimal personnel and hospital-based testing partners.
  • Comparison: The device was compared to predicate devices (Eclipse Treatment Planning System K172163 and RayStation 4.0.2 K140187) in terms of technology, intended uses, and end-user profiles.
  • Conclusion: The tests showed that the Astroid Planning App performed as well as the predicate devices.

{0}------------------------------------------------

Image /page/0/Picture/0 description: The image shows the logos of the Department of Health and Human Services and the Food and Drug Administration (FDA). The Department of Health and Human Services logo is on the left, and the FDA logo is on the right. The FDA logo includes the letters "FDA" in a blue square, followed by the words "U.S. Food & Drug Administration" in blue text.

.decimal, LLC. % Kevin Erhart, Ph.D. Chief Technology Officer 121 Central Park Place SANFORD FL 32771

May 15, 2018

Re: K173940

Trade/Device Name: Astroid Planning App Regulation Number: 21 CFR 892.5050 Regulation Name: Medical charged-particle radiation therapy system Regulatory Class: II Product Code: MUJ Dated: April 18, 2018 Received: April 19, 2018

Dear Dr. Erhart:

We have reviewed vour Section 510(k) premarket notification of intent to market the device referenced above and have determined the device is substantially equivalent (for the indications for use stated in the enclosure) to legally marketed predicate devices marketed in interstate commerce prior to May 28, 1976, the enactment date of the Medical Device Amendments, or to devices that have been reclassified in accordance with the provisions of the Federal Food. Drug, and Cosmetic Act (Act) that do not require approval of a premarket approval application (PMA). You may, therefore, market the device, subject to the general controls provisions of the Act. The general controls provisions of the Act include requirements for annual registration, listing of devices, good manufacturing practice, labeling, and prohibitions against misbranding and adulteration. Please note: CDRH does not evaluate information related to contract liability warranties. We remind you, however, that device labeling must be truthful and not misleading.

If your device is classified (see above) into either class II (Special Controls) or class III (PMA), it may be subject to additional controls. Existing major regulations affecting your device can be found in the Code of Federal Regulations, Title 21, Parts 800 to 898. In addition, FDA may publish further announcements concerning your device in the Federal Register.

Please be advised that FDA's issuance of a substantial equivalence determination does not mean that FDA has made a determination that your device complies with other requirements of the Act or any Federal statutes and regulations administered by other Federal agencies. You must comply with all the Act's requirements, including, but not limited to: registration and listing (21 CFR Part 807); labeling (21 CFR Part 801); medical device reporting of medical device-related adverse events) (21 CFR 803); good manufacturing practice requirements as set forth in the quality systems (QS) regulation (21 CFR Part 820); and if applicable, the electronic product radiation control provisions (Sections 531-542 of the Act); 21 CFR 1000-1050.

{1}------------------------------------------------

Also, please note the regulation entitled, "Misbranding by reference to premarket notification" (21 CFR Part 807.97). For questions regarding the reporting of adverse events under the MDR regulation (21 CFR Part 803), please go to http://www.fda.gov/MedicalDevices/Safety/ReportaProblem/default.htm for the CDRH's Office of Surveillance and Biometrics/Division of Postmarket Surveillance.

For comprehensive regulatory information about medical devices and radiation-emitting products, including information about labeling regulations, please see Device Advice (https://www.fda.gov/MedicalDevices/DeviceRegulationandGuidance/) and CDRH Learn (http://www.fda.gov/Training/CDRHLearn). Additionally, you may contact the Division of Industry and Consumer Education (DICE) to ask a question about a specific regulatory topic. See the DICE website

(http://www.fda.gov/DICE) for more information or contact DICE by email (DICE@fda.hhs.gov) or phone (1-800-638-2041 or 301-796-7100).

Sincerely,

Michael D. O'Hara

Robert Ochs, Ph.D. Director Division of Radiological Health Office of In Vitro Diagnostics and Radiological Health Center for Devices and Radiological Health

Enclosure

{2}------------------------------------------------

Indications for Use

510(k) Number (if known) K173940

Device Name Astroid Planning App

Indications for Use (Describe)

The Astroid Planning App is an interactive end user application for proton treatment planning for the intended use and primary purpose of enabling radiotherapy professionals to efficiently design and analyze proton radiotherapy treatment plans. This Astroid Planning App leverages the existing .decimal Astroid Dosimetry App [FDA 510(k) K150547), which is a library of treatment planning functions accessed through the Thinknode® cloud services framework, for device creation, dose calculation, optimization, and all other dosimetry and processing calculations. Since the Astroid Dosimetry App is responsible for performing the calculations, the scope of this Astroid Planning App is to be the user interface for end users to input treatment planning data and review the results. Typical indications for the treatment of persons with cancer, over a wide range of potential disease locations. In the most common use case of the software, users will import patient data from existing imaging software programs, manage physician prescription and intent information, develop a proton treatment plan, and analyze the plan to determine how well it meets the physician's goals. Since the critical treatment planning functions are handled outside this software application, by a software of known quality and pedigree, the primary and most frequently used functions of this software are the record keeping service (for patient data storage), user interface controls, and visualization tools.

Furthermore, since the accuracy of information computed and displayed by an application such as this is very important to the proper treatment of patients, it is critical that users have the appropriate educational and clinical experience backgrounds to adequately understand and use the product. Additionally, since each radiotherapy treatment machine produces a unique beam of radiation, there is much responsibility on the end users to adequately commission and test this software over the full range of expected treatment conditions before the system is utilized for patient treatment.

Type of Use (Select one or both, as applicable)

☑ Prescription Use (Part 21 CFR 801 Subpart D) ☐ Over-The-Counter Use (21 CFR 801 Subpart C)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

CONTINUE ON A SEPARATE PAGE IF NEEDED.

This section applies only to requirements of the Paperwork Reduction Act of 1995.

DO NOT SEND YOUR COMPLETED FORM TO THE PRA STAFF EMAIL ADDRESS BELOW.

The burden time for this collection of information is estimated to average 79 hours per response, including the time to review instructions, search existing data sources, gather and maintain the data needed and complete and review the collection of information. Send comments regarding this burden estimate or any other aspect of this information collection, including suggestions for reducing this burden, to:

Department of Health and Human Services Food and Drug Administration Office of Chief Information Officer Paperwork Reduction Act (PRA) Staff PRAStaff@fda.hhs.gov

"An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB number."

{3}------------------------------------------------

Image /page/3/Picture/0 description: The image shows the word "decimal" in a stylized font, with the ".d" in blue and the rest of the word in gray. Above the word "al" is a small circled R symbol. Below the word "decimal" is the phrase "The benchmark for custom radiation therapy" in a smaller font.

Section 5 510(k) Summary

Section 807.87 (h) A 510(k) Summary as described in Section 807.92

Premarket Notification [510(k)] Summary as required by 21 CFR 807.92

Date summary was prepared:

November 2, 2017

Submitter's Name:

.decimal, LLC. 121 Central Park PL Sanford, Florida 32771

Contact Person:

Kevin Erhart Chief Technology Officer Phone: 407-330-3300 407-322-7546 Fax: Email:kerhart@dotdecimal.com

Device Name:

Astroid Planning App

Classification Name:

MUJ 21 CFR 892.5050 Medical charged-particle radiation therapy systems Class II

{4}------------------------------------------------

Image /page/4/Picture/0 description: The image shows the logo for ".decimal". The text "decimal" is in a sans-serif font, with the "." and "dec" in blue and the "imal" in gray. Below the logo is the text "The benchmark for custom radiation therapy" in a smaller, sans-serif font.

Device Description:

The primary purpose of the Astroid Planning App device is for facilitating the planning and analysis of proton radiation therapy treatments. The Astroid Planning App device is an interactive end user application in which the user interacts with the interface to perform proton treatment planning tasks. The data constructed in the Astroid Planning App device will be used as inputs to the Astroid Dosimetry App device [FDA 510(k) K150547], which is the foundational proton dosimetry calculation library that contains all algorithms and calculation processing for the proton treatment planning. The Astroid Planning App device composes and otherwise constructs the calculation requests required for the development of the proton treatment plan, leveraging the functions externally located in the Astroid Dosimetry App to then perform the requested calculations.

Predicate Device(s):

Eclipse Treatment Planning System K172163 RayStation 4.0.2 K140187

Intended Use:

The Astroid Planning App is an interactive end user application that leverages the existing .decimal Astroid Dosimetry App library [FDA 510(k) K150547] of functions (accessed through the Thinknode® cloud services framework) for device creation, dose calculation, optimization, and many other purposes, for the intended use and primary purpose of enabling radiotherapy professionals to efficiently design and analyze proton radiotherapy treatment plans.

Indications for Use:

Typical indications for use are for the treatment of persons with cancer, over a wide range of potential disease locations. In the most common use case of the software, users will import patient data from existing imaging and contouring software programs, manage physician prescription and intent information, develop a proton treatment plan, and analyze the plan to determine how well it meets the physician's goals. Since the critical treatment planning functions and calculations are handled outside this software application, by a software of known quality and pedigree, the primary and most frequently used functions of this software are the record keeping service (for patient data storage via Thinknode), user interface controls, and visualization tools.

Furthermore, since the accuracy of information computed and displayed by an application such as this is very important to the proper treatment of patients, it is critical that users have the appropriate educational and clinical experience backgrounds to adequately understand and use the product. Additionally, since each radiotherapy treatment machine produces a unique beam of radiation, there is much responsibility on the end users to adequately commission and test this software over the full range of expected treatment conditions, as per industry standards and regulatory requirements, before the system is utilized for patient treatment.

{5}------------------------------------------------

Image /page/5/Picture/0 description: The image shows the logo for ".decimal" with the tagline "The benchmark for custom radiation therapy" underneath. The word "decimal" is in gray, except for the "." which is in blue. A registered trademark symbol is to the right of the word "decimal".

Summary of Technological Characteristics:

The Astroid Planning App technology is substantially equivalent to both the listed predicate devices. The Astroid Planning App. Eclipse TPS, and RayStation 4.0.2 all provide users with tools to calculate, analyze, and otherwise compare potential treatment plans for proton radiation therapy courses. All three systems include display windows for visualizing patient images, contoured structures, dose calculation results, and dose summary statistics. Unlike the other two predicate systems, the Astroid Planning App leverages a separate library for dose calculation and other radiotherapy calculations [Astroid Dosimetry App, FDA 510(k) K150547], however, this does not detract from the point that the proton treatment planning features contained within all three systems are substantially equivalent in terms of technology, intended uses, and end user profiles.

Summary of Non-Clinical Testing:

Clinical testing was not performed as part of the development of this product. Clinical testing is not advantageous in demonstrating substantial equivalence or safety and effectiveness of the device since testing can be performed such that no human subjects are exposed to risk. Clinically oriented validation test cases were written and executed by .decimal personnel and hospital-based testing partners. Validation tests comparing results of proton dose calculations, with the inclusion of all applicable treatment delivery devices, to experimental and analytical datasets were performed. Additional verification and validation tests were also performed for all other functions available for external use through the system. Usability testing, including analysis of all system displays and user options were also completed. Plan quality studies and full end-to-end testing of the entire planning process as compared to the predicate devices was also completed. These tests show that the Astroid Planning App performed as well as the predicate devices and that the Astroid Planning App is deemed safe and effective for clinical use when properly commissioned for a proton treatment machine.

§ 892.5050 Medical charged-particle radiation therapy system.

(a)
Identification. A medical charged-particle radiation therapy system is a device that produces by acceleration high energy charged particles (e.g., electrons and protons) intended for use in radiation therapy. This generic type of device may include signal analysis and display equipment, patient and equipment supports, treatment planning computer programs, component parts, and accessories.(b)
Classification. Class II. When intended for use as a quality control system, the film dosimetry system (film scanning system) included as an accessory to the device described in paragraph (a) of this section, is exempt from the premarket notification procedures in subpart E of part 807 of this chapter subject to the limitations in § 892.9.