K Number
K032886
Manufacturer
Date Cleared
2004-01-09

(115 days)

Product Code
Regulation Number
892.5050
Reference & Predicate Devices
Predicate For
AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
Intended Use

The intended purpose of the Diamond Edition of Setup 2000 Version 3.0 software is to provide an accurate and convenient method of independently checking, on a point dose basis, the treatment planning calculations of the primary radiation treatment-planning (RTP) computer. The primary RTP computer is capable of importing CT images of the patient, identifying target volumes, superimposing the treatment beams and optimizing the weighting and modulation of the beam to produce an acceptable radiation distribution within the patient. The Diamond Edition of Setup 2000 Version 3.0 calculates point doses under specified conditions communicated to the software through operator interaction (keyboard and mouse) or through file import.

Device Description

The Diamond Edition of Setup 2000 Version 3.0 software program is designed to operate in a Microsoft Windows environment either on a sinqle PC or on a workstation with the treatment machine and patient data shared on a server. This software does not control any device that delivers radiation to the patient. This software does not communicate directly with the treatment machine, the primary treatment planning (RTP) computer or the record and verify system. This software does have the ability to transfer treatment data files in a standardized format (e.g. RTP Connectivity Protocol by IMPAC) from the primary treatment planning computer or R&V system to facilitate the entry of the data to the software and the transfer of data to the R&V system for electronic charting. The software calculates the treatment machine monitor units (MU or time as appropriate) or dose to validate the values calculated by the RTP computer or to provide the settings for simple treatments not requiring the RTP plan prescribed by the physician. The software provides these calculations using methods and models published in the professional literature, the specific treatment information provided by the user and the values in a treatment machine database of measured physical parameters entered and validated by the medical physicist. The results of calculations are documented in printed or electronic reports to be placed in the patient's chart.

AI/ML Overview

This document does not contain explicit acceptance criteria tables or detailed study results proving the device meets specific performance metrics in the way a typical medical device validation study report would. Instead, it relies on historical performance, comparison to predicate devices, and internal testing processes.

However, based on the provided text, we can infer some aspects of intended performance and the general approach to demonstrating safety and effectiveness.

Here's an attempt to structure the information based on the prompt's requirements, with explicit statements where information is present and noting where it's absent:


Acceptance Criteria and Device Performance Study for K&S Associates, Inc. Diamond Edition of Setup 2000 Version 3.0

1. Table of Acceptance Criteria and Reported Device Performance:

Acceptance Criteria (Inferred from Text)Reported Device Performance (Inferred/Stated)
Accuracy of MU/Dose Calculation"The software calculates the treatment machine monitor units (MU or time as appropriate) or dose to validate the values calculated by the RTP computer or to provide the settings for simple treatments.""Diamond produces more accurate IMRT dose results through the application of more recent and more sophisticated calculation models.""The intended purpose of the Diamond Edition of Setup 2000 Version 3.0 software is to provide an accurate and convenient method of independently checking, on a point dose basis, the treatment planning calculations of the primary radiation treatment-planning (RTP) computer.""We require this software to be accurate..."No specific quantifiable accuracy metric (e.g., % deviation) is provided in this document.
Reliability/Dependability"a simple, reliable design""We require this software to be accurate, reliable, dependable and efficient...""The DOS Setup program has been in use by hundreds of highly qualified professionals across the US since 1984 without a single reported incidence of calculation error." (Referencing an earlier version, implying similar reliability for the current version).
Safety - Mitigation of Hazards"Risk and hazard analysis provided in this submission demonstrate the traceability... that every conceivable hazard to the patient and the integrity of the data files has been mitigated to the fullest extent possible.""a substantial system of internal validation checks and pre-calculation validation provide a substantial Error Avoidance System (EAS)."
Effectiveness - Quality Assurance Tool"powerful and effective quality assurance tool for the analysis and verification of radiation therapy treatment plans...""promotes better patient care by bridging the ever increasing gap between the sophisticated calculation capability of the modern treatment planning computers and the otherwise limited calculational resources..."
Substantial Equivalence to Predicate DevicesNumerous points listed in "Intended use and Substantial Equivalence" section (e.g., allows MU/dose calculation, uses similar calculation methods, uses treatment machine database, stores calculations, generates reports).
Error Avoidance"reduces operator errors through the use of active internal validation of user inputs and other machine limitations""Diamond provides a substantial Error Avoidance System (EAS) to minimize operator errors."
Compatibility with Modern RT Features (Asymmetric jaws, Dynamic wedging, MLC, IMRT)"Have the ability to perform calculations with modern treatment machine options such collimators with asymmetric jaws, dynamic wedging and multi-leaf collimators (MLC).""Have the ability to import treatment information files for intensity modulated radiation therapy (IMRT) having multiple segments with MLC settings and calculate the point dose at specified points of interest."

2. Sample Size Used for the Test Set and Data Provenance:

  • Sample Size: Not explicitly stated as a number of cases or patients.
  • Data Provenance: The document mentions "a complex clinical environment at institutions such as the MD Anderson Cancer Center" for testing, implying real-world patient data (or simulated clinical scenarios based on real complexity). It also refers to "a network of selected knowledgeable and qualified users" testing the software. It is prospective for these specific tests as they were done during development, but the data itself could be retrospective patient data used for simulation/testing, or prospective phantom measurements.

3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications:

  • Number of Experts: Unspecified, but refers to "a network of selected knowledgeable and qualified users" and "qualified health professionals" (e.g., medical physicists).
  • Qualifications: "knowledgeable and qualified users," "medical physicist and other qualified health professionals." For earlier versions, it mentions "hundreds of highly qualified professionals across the US," and their own staff consisting of "medical physics consulting organization" members. No specific years of experience are listed.

4. Adjudication Method for the Test Set:

  • Adjudication Method: Not explicitly stated. The testing process involved "alpha tested (System Tests and Validation Tests) at the K&S facility" and then "a network of selected knowledgeable and qualified users" and "QED consultants and institutions such as the MD Anderson Cancer Center test the software." This implies independent testing and review, but a formal adjudication process (e.g., 2+1, 3+1 consensus) is not detailed.

5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study:

  • No, an MRMC comparative effectiveness study was not explicitly described. The document focuses on the software's standalone capability to assist human users (medical physicists) in quality assurance by providing independent checks, rather than comparing human performance with and without the AI assistance in a formal MRMC study. The "effect size of how much human readers improve with AI vs without AI assistance" is therefore not reported.

6. Standalone (Algorithm Only Without Human-in-the-Loop) Performance:

  • Yes, a standalone performance assessment was done implicitly. The software calculates MU or dose to "validate the values calculated by the RTP computer" or to "provide the settings for simple treatments." This implies the algorithm's direct output (calculated dose/MU) is compared against other calculations or established benchmarks. The "System Tests and Validation Tests" as well as the independent testing by external users would have evaluated the raw computational accuracy of the software itself.

7. Type of Ground Truth Used:

  • Ground Truth: The ground truth for dose/MU calculations would be derived from:
    • Published methods and models in professional literature: The software explicitly states it "provides these calculations using methods and models published in the professional literature."
    • Measured physical parameters in a treatment machine database: "values in a treatment machine database of measured physical parameters entered and validated by the medical physicist."
    • Comparison to primary RTP computer calculations: The software's purpose is to "independently checking, on a point dose basis, the treatment planning calculations of the primary radiation treatment-planning (RTP) computer."
    • Diode/TLD measurements: The software has the "ability to calculate and report Diode/TLD measurements," and "there is an additional requirement to perform measurements with ion chambers, TLD, film or other appropriate devices" for IMRT, suggesting these physical measurements serve as ground truth or validation.

8. Sample Size for the Training Set:

  • Not applicable / Not explicitly stated. This is a calculation software based on physics models and measured machine data, not a machine learning model that requires a "training set" in the conventional sense. Its "training" or configuration involves entering and validating the physics parameters for specific treatment machines by a medical physicist.

9. How the Ground Truth for the Training Set Was Established:

  • Not applicable. As above, it's not a machine learning model with a training set. The accuracy of its underlying models and machine parameters are "validated by the medical physicist" using established measurement protocols and published literature.

{0}------------------------------------------------

K&S Associates, Inc. Diamond Edition of Setup 2000 Version 3.0 Summary of Safety and Effectiveness:

K032881 P1A3

Introduction

This software is designed specifically for the purpose of providing the medical physicist and other qualified health professionals a powerful and effective quality assurance tool for the analysis and verification of radiation therapy treatment plans generate by modern treatment planning computer systems. While this document describes the efforts to make this software safe and effective for it's intended use, it should be understood that the proper use of this device promotes better patient care by bridging the ever increasing gap between the sophisticated calculation capability of the modern treatment planning computers and the otherwise limited calculational resources normally available to the individuals responsible for independent verification. The use of this software also reduces operator errors through the use of active internal validation of user inputs and other machine limitations prior to performing a calculation.

Description

The Diamond Edition of Setup 2000 Version 3.0 software program is designed to operate in a Microsoft Windows environment either on a sinqle PC or on a workstation with the treatment machine and patient data shared on a server. This software does not control any device that delivers radiation to the patient. This software does not communicate directly with the treatment machine, the primary treatment planning (RTP) computer or the record and verify system. This software does have the ability to transfer treatment data files in a standardized format (e.g. RTP Connectivity Protocol by IMPAC) from the primary treatment planning computer or R&V system to facilitate the entry of the data to the software and the transfer of data to the R&V system for electronic charting. The software calculates the treatment machine monitor units (MU or time as appropriate) or dose to validate the values calculated by the RTP computer or to provide the settings for simple treatments not requiring the RTP plan prescribed by the physician. The software provides these calculations using methods and models published in the professional literature, the specific treatment information provided by the user and the values in a treatment machine database of measured physical parameters entered and validated by the medical physicist. The results of calculations are documented in printed or electronic reports to be placed in the patient's chart.

Intended use and Substantial Equivalence

The intended use of Diamond Edition of Setup 2000 Version 3.0 is the same as the named predicated devices. The Diamond Edition of Setup 2000 Version 3.0 and the predicated devices are equivalent in the following ways:

    1. Allow the calculation of MU or dose under user specified parameters.
    1. Use similar calculation methods based in the literature.
    1. Use a treatment machine database for look up, interpolation and calculation of results.

{1}------------------------------------------------

K&S Associates, Inc. Diamond Edition of Setup 2000 Version 3.0 Summary of Safety and Effectiveness:

Kozzrrl Pr 49

    1. Provide a means of storing the calculations in a manner that maintains the relation to the specific patient.
    1. Have reports that document the calculation parameters and results.
    1. Use terminology that is commonly used in the profession.
    1. Have user interfaces that allow the user to communicate with the software.
    1. Have ability to transfer information from the primary treatment planning computer or record and verify systems.
    1. Have the ability to perform calculations with modern treatment machine options such collimators with asymmetric jaws, dynamic wedging and multi-leaf collimators (MLC).
    1. Have the ability to import treatment information files for intensity modulated radiation therapy (IMRT) having multiple segments with MLC settings and calculate the point dose at specified points of interest.
    1. Have some capability to operate on a server with multiple users.
    1. Have the ability to calculate and report Diode/TLD measurements.

The differences between Diamond and the predicated devices relate to the ease of use and security as follows:

    1. Diamond has fewer screens and provides more information within each screen.
    1. Diamond has a machine wizard to assist the medical physicist in treatment machine data entry.
    1. Diamond is much faster when operating on a server with binary patient and machine files.
    1. Diamond provides the features to manage the calculations of active patients (patients on treatment) and inactive patients.
    1. Diamond uses a more accurate collimator scatter function through a points-eye-view of the flattening filter, the primary jaws and the MLC components to produce more accurate results.
    1. Diamond provides a higher level of security of machine files with an archiving previous data files and a check-in/check-out feature to prevent multiple medical physicists on a networked system from changing data in the same machine file.
    1. Diamond has the ability to store the Diode/TLD data in the patient file.
    1. Diamond produces more accurate IMRT dose results through the application of more recent and more sophisticated calculation models.
    1. Diamond provides a substantial Error Avoidance System (EAS) to minimize operator errors.

Technological characteristics

Diamond provides similar capabilities and functions for the basic static field treatment calculations but has many technically superior features that are based on recent advances in collimator scatter modeling and MLC simulation for IMRT.

Risk & Hazard Analysis Summary

The risk and hazard analysis provided in this submission demonstrate the traceability from the Design Controls, Software Requirements Specifications

{2}------------------------------------------------

K&S Associates, Inc. Diamond Edition of Setup 2000 Version 3.0 Summary of Safety and Effectiveness:

K032886 P343

through to the System Test Plan and the Test and Validation Logs and user documentation that every conceivable hazard to the patient and the integrity of the data files has been mitigated to the fullest extent possible. Additionally, a substantial system of internal validation checks and precalculation validation provide a substantial Error Avoidance System (EAS).

Summary of Safety and Effectiveness

K& S has a long history with dose calculation software beginning in 1978 with a first release to the public in 1984. This history is based on fulfilling the needs of a medical physics consulting organization by designing software to not only perform the required task but also to assist in the ongoing need to reduce errors in calculations and to help standardize the calculation methods of all members of the radiation oncology team including the medical physicist, the dosimetrist, the therapist and the radiation oncology physician. Quality patient care is achieve only when all members of the medical team participate in and are part of a coordinated quality system. The Diamond Edition of Setup 2000 Version 3.0 helps achieve this goal through a simple, reliable design that is easy to understand and easy for the operator to use. Significant effort has been expended to design, specify, code, test and produce a software product that is as safe and effective as reasonably possible under the usual conditions of cost versus benefit. This document describes this effort. After the software version has been alpha tested (System Tests and Validation Tests) at the K&S facility, a network of selected knowledgeable and qualified users. others under the supervision of K&S and QED consultants and institutions such as the MD Anderson Cancer Center test the software in a complex clinical environment to identify any needed changes. A confidential copy of their report on an earlier version of Setup 2000 is included. It is important to understand that K&S is both the customer and the developer and our professional medical physics practice depends on a reliable software product. K&S has a software quality program that includes audits of tests and records and a staff accustomed to satisfying quality issues as evidenced by three accreditations for the calibration services provided for nearly 20 years. We require this software to be accurate, reliable, dependable and efficient to serve our consulting needs and these requirements ensure that the software is thoroughly tested before release. The DOS Setup program has been in use by hundreds of highly qualified professionals across the US since 1984 without a single reported incidence of calculation error. The Windows software has been in clinical use since 2001 and has been in continuous refinement and development. It has been a slow process because we have required each incremental change to be thoroughly mastered before the next change.

In summary, we consider the Diamond Edition of Setup 2000 Version 3.0 Dose Calculation Management software to be safe and effective for its intended use.

{3}------------------------------------------------

Image /page/3/Picture/1 description: The image shows the logo for the U.S. Department of Health & Human Services. The logo consists of a stylized eagle with three tail feathers, representing the department's commitment to health, human services, and well-being. The words "DEPARTMENT OF HEALTH & HUMAN SERVICES • USA" are arranged in a circular fashion around the eagle.

Food and Drug Administration 9200 Corporate Boulevard Rockville MD 20850

JAN - 9 2004

Ms. Vivian Denton Quality Manager K & S Associates 1926 Elm Tree Drive NASHVILLE TN 37210-3718 Re: K032886 Trade/Device Name: Diamond Setup 2000 Regulation Number: 21 CFR 892.5050 Regulation Name: Medical charged-particle radiation therapy system Regulatory Class: II Product Code: 90 LHN Dated: December 17, 2003 Received: December 19, 2003

Dear Ms. Denton:

We have reviewed your Section 510(k) premarket notification of intent to market the device referenced above and have determined the device is substantially equivalent (for the indications for use stated in the enclosure) to legally marketed predicate devices marketed in interstate commerce prior to May 28, 1976, the enactment date of the Medical Device Amendments, or to devices that have been reclassified in accordance with the provisions of the Federal Food, Drug, and Cosmetic Act (Act) that do not require approval of a premarket approval application (PMA). You may, therefore, market the device, subject to the general controls provisions of the Act. The general controls provisions of the Act include requirements for annual registration, listing of devices, good manufacturing practice, labeling, and prohibitions against misbranding and adulteration.

If your device is classified (see above) into either class II (Special Controls) or class III (PMA), it may be subject to such additional controls. Existing major regulations affecting your device can be found in the Code of Federal Regulations, Title 21, Parts 800 to 898. In addition, FDA may publish further announcements concerning your device in the Federal Register.

Please be advised that FDA's issuance of a substantial equivalence determination does not mean that FDA has made a determination that your device complies with other requirements of the Act or any Federal statutes and regulations administered by other Federal agencies. You must comply with all the Act's requirements, including, but not limited to: registration and listing (21 CFR Part 807); labeling (21 CFR Part 801); good manufacturing practice requirements as set forth in the quality systems (QS) regulation (21 CFR Part 820); and if applicable, the electronic product radiation control provisions (Sections 531-542 of the Act); 21 CFR 1000-1050.

{4}------------------------------------------------

This letter will allow you to begin marketing your device as described in your Section 510(k) I his letter will and in you ve organ finding of substantial equivalence of your device to a legally premaince notineation: " cresults in a classification for your device and thus, permits your device to proceed to the market.

If you desire specific advice for your device on our labeling regulation (21 CFR Part 801), please It you dosn't spoolite at one of the following numbers, based on the regulation number at the top of the letter:

8xx.1xxx(301) 594-4591
876.2xxx, 3xxx, 4xxx, 5xxx(301) 594-4616
884.2xxx, 3xxx, 4xxx, 5xxx, 6xxx(301) 594-4616
892.2xxx, 3xxx, 4xxx, 5xxx(301) 594-4654
Other(301) 594-4692

Additionally, for questions on the promotion and advertising of your device, please contact the Office of Compliance at (301) 594-4639. Also, please note the regulation entitled, "Misbranding by reference to premarket notification" (21CFR Part 807.97) you may obtain. Other general of reference to premainted the Act may be obtained from the Division of Small Manufacturers, International and Consumer Assistance at its toll-free number (800) 638-2041 or (301) 443-6597 or at its Internet address http://www.fda.gov/cdrh/dsma/dsmamain.html.

Sincerely yours,

Nancy C. Bryden.

Nancy C. Brogdon Director, Division of Reproductive, Abdominal and Radiological Devices Office of Device Evaluation Center for Devices and Radiological Health

Enclosure

{5}------------------------------------------------

K&S Associates, Inc.

Indications for Use

K 032886 510(k) Number (if known):_____________________________________________________________________________________________________________________________________________________

Device Name: Diamond Edition of Setup 2000 Version 3.0

Indications For Use:

The current standard of care (AAPM, ACMP, ACR, etc.) in radiation oncology requires that the calculation results of each computer generated treatment plan be checked by some independent method. In the case of IMRT there is an additional requirement to perform measurements with ion chambers, TLD, film or other appropriate devices to ensure the accurate setup and delivery of the prescribed dose to the target organ and the limitation of dose to nearby sensitive organs. The medical physicist has the primary responsibility for these quality assurance checks and independent calculations. The intended purpose of the Diamond Edition of Setup 2000 Version 3.0 software is to provide an accurate and convenient method of independently checking, on a point dose basis, the treatment planning calculations of the primary radiation treatment-planning (RTP) computer. The primary RTP computer is capable of importing CT images of the patient, identifying target volumes, superimposing the treatment beams and optimizing the weighting and modulation of the beam to produce an acceptable radiation distribution within the patient. The Diamond Edition of Setup 2000 Version 3.0 calculates point doses under specified conditions communicated to the software through operator interaction (keyboard and mouse) or through file import.

American Association of Physicists in Medicine (AAPM) American College of Medical Physics (ACMP) American College of Radiology (ACR)

AND/OR Prescription Use (Part 21 CFR 801 Subpart D) ·

Over-The-Counter Use _ (21 CFR 807 Subpart C)

(PLEASE DO NOT WRITE BELOW THIS LINE-CONTINUE ON ANOTHER PAGE IF NEEDED)

Concurrence of CDRH, Office of Device Evaluation (ODE)

David the Signer

Page 9

(Division Sign-Off) (Division Sign-On)
Division of Reproductive, Abdominal,

§ 892.5050 Medical charged-particle radiation therapy system.

(a)
Identification. A medical charged-particle radiation therapy system is a device that produces by acceleration high energy charged particles (e.g., electrons and protons) intended for use in radiation therapy. This generic type of device may include signal analysis and display equipment, patient and equipment supports, treatment planning computer programs, component parts, and accessories.(b)
Classification. Class II. When intended for use as a quality control system, the film dosimetry system (film scanning system) included as an accessory to the device described in paragraph (a) of this section, is exempt from the premarket notification procedures in subpart E of part 807 of this chapter subject to the limitations in § 892.9.