Search Results
Found 10 results
510(k) Data Aggregation
(30 days)
Capintec, Inc.
The CRC PC Smart Chamber K1 is intended to be used by qualified nuclear medicine technologists, nuclear medicine physicians, and radiopharmacists to measure radiopharmaceuticals, including high energy beta and gamma emitters for diagnostic applications. The CRC PC Smart Chamber K1 is intended to be used only with the TEMA Karls 100 radiopharmaceutical dose administration system.
The Capintec CRC PC Smart Family of dose calibrators are sealed, pressurized reentrant well style ionization chambers which use a networked PC as the user interface. The CRC PC Smart Chamber K1 is modified CRC PC Smart Chamber, which has been shortened in height to fit into the Karl 100 Dose Administration System, which is manufactured by TEMA.
This document describes the CRC PC Smart Chamber K1, a radionuclide dose calibrator. The information provided heavily relies on a comparison to a predicate device and states that safety and effectiveness were confirmed through "verification and validation testing." However, it does not provide details about a specific study designed to prove the device meets defined acceptance criteria in the way a clinical study for an AI/CADe device would.
Instead, the submission focuses on demonstrating substantial equivalence by highlighting design similarities with a previously cleared device (CRC-PC Smart Chamber, K141413) and confirming compliance with relevant electrical and safety standards.
Therefore, I cannot populate most of the requested fields as they pertain to a detailed performance study with defined acceptance criteria and human expert evaluation, which is not described in this document.
Here's how I can address the specific points based on the provided text:
1. A table of acceptance criteria and the reported device performance
The document does not explicitly state quantitative acceptance criteria or detailed performance metrics from a dedicated study. It generally mentions:
- "Risk assessment confirms that all identified risks were either mitigated or are within acceptable limits."
- "Verification and validation testing confirmed the CRC-PC Smart Chamber K1 meets all stated specifications and functions as expected."
2. Sample sized used for the test set and the data provenance (e.g. country of origin of the data, retrospective or prospective)
Not applicable. No specific test set data is described. The device is a physical instrument, and its performance is likely evaluated through engineering verification and validation against technical specifications, not typically through a "test set" of patient data in the way an AI algorithm might be.
3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g. radiologist with 10 years of experience)
Not applicable. No ground truth establishment by experts for a test set is described.
4. Adjudication method (e.g. 2+1, 3+1, none) for the test set
Not applicable. No adjudication method is described.
5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance
Not applicable. This is not an AI/CADe device that assists human readers. It's a dose calibrator for radiopharmaceuticals.
6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done
Not applicable. This is not an algorithm, but a physical device. Its "standalone" performance would be its accuracy and precision in measuring radioactivity, which is stated to meet "all stated specifications."
7. The type of ground truth used (expert concensus, pathology, outcomes data, etc)
Not applicable directly in the context of clinical "ground truth." For a dose calibrator, "ground truth" would be established by reference standards or highly accurate laboratory measurements of radioactivity, which are typically used during calibration and verification processes.
8. The sample size for the training set
Not applicable. This is not a machine learning device that requires a training set.
9. How the ground truth for the training set was established
Not applicable.
Ask a specific question about this device
(194 days)
Capintec, Inc.
The CRC-77tHR is intended to be used by qualified radiochemists, radiation physicists, or other appropriately trained personnel in isotope production sites to measure a wide range of measure a wide range of high activity radiopharmaceuticals and radioactive materials, including high energy beta and gamma emitters. The device is not intended for use with brachytherapy sources. This device is also used in numerous research applications for measurement of high activity levels of radioactive materials.
The Capintec CRC-77tHR is dose calibrator which uses a touch screen user interface and sealed reentrant well chamber as the detector. The gas fill pressure has been lowered in order to extend the maximum activity range for isotope manufacturing and radiopharmaceutical production environments.
The provided document pertains to the FDA 510(k) clearance for the Capintec CRC-77tHR radionuclide dose calibrator. The information details the device's technical specifications and performance data, but it does not describe a study involving AI assistance, human readers, or image-based diagnostics with associated ground truth and expert adjudication methods.
The document outlines a traditional medical device clearance process for a dose calibrator, focusing on:
- Substantial equivalence to a predicate device (CRC-55t Dose Calibrator series).
- Technical specifications, including measurement range, resolution, energy range, electrometer accuracy, linearity, and reproducibility.
- Compliance with electrical safety, electromagnetic compatibility (EMC), and usability standards (e.g., IEC 60601-1, IEC 62304 for software).
- Software verification and validation testing, with a "moderate" level of concern.
- Evaluation at an isotope production site.
Therefore, many of the requested points regarding AI, human-in-the-loop performance, multi-reader multi-case studies, and specific ground truth methodologies for image-based diagnostics are not applicable to this device's clearance information.
However, I can extract and present the acceptance criteria and reported device performance related to the dose calibrator's technical specifications from the provided text.
Acceptance Criteria and Reported Device Performance (CRC-77tHR Radionuclide Dose Calibrator)
The acceptance criteria for this device are primarily tied to its technical specifications and its performance metrics, which demonstrate substantial equivalence to its predicate device (CRC-55t) while operating at a higher activity range.
1. Table of Acceptance Criteria and Reported Device Performance:
Performance Metric | Acceptance Criteria (Stated or Implied) | Reported Device Performance |
---|---|---|
Measurement Range | Must be able to measure a wide range of high activity radiopharmaceuticals and radioactive materials, including high energy beta and gamma emitters. | Maximum activity for Tc-99m: approximately 400 Curies |
Maximum activity for F-18: approximately 130 Curies | ||
Resolution | Not explicitly stated as acceptance criteria, but a key performance metric. | 0.01 mCi (10 µCi) |
Minimum Activity Range | Must be suitable for levels > 100 µCi (implies that less than 100 µCi is not an intended use). | Minimum activity range > 100 µCi |
Energy Range | Not explicitly stated as acceptance criteria, but a key performance metric. | 15 keV to 3 MeV |
Electrometer Accuracy | Not explicitly stated as acceptance criteria, but a key performance metric. | ± 2% |
Electrometer Linearity |
Ask a specific question about this device
(29 days)
CAPINTEC, INC.
The CRC PC Smart Chamber series is intended to be used by qualified nuclear medicine technologists, nuclear medicine physicians, and radiopharmacists to measure a wide range of radiopharmaceuticals and radioactive materials, including high energy befa and gamma emitters for diagnostic and therapeutic applications. It is also designed for use by trained medical physicists for diagnostic and therapeutic applications including measurement of the output of most radioactive brachytherapy sources, including LDR, HDR, and IVBT sources. All brachytherapy sources must be measured in the appropriate source holder. This device is also used in numerous research applications for measurement of radioactive materials.
Capintec's CRC PC Smart Chamber series dose calibrators are designed for measurement of radioactive materials used in nuclear medicine, therapy, and research applications. The unit is intended for use by trained nuclear medicine technologists, nuclear medicine physicians, radiopharmacists, or medical physicists for diagnostic and therapeutic applications. The CRC PC series has the same principles of operation, same basic functionality, and same detector technology as the predicate device, CRC 55t series. The basic detection, measurement process, design concepts, calculations, and response remain the same as the predicate device. There are no differences in intended use or effectiveness. The CPC PC Smart Chamber replaces the touchscreen user interface of the predicate device with a laptop or network PC.
The provided text does not contain information about acceptance criteria or a study proving the device meets those criteria. The document is a 510(k) summary for a medical device (Capintec CRC PC with Smart Chamber Series dose calibrators). It focuses on:
- Substantial Equivalence: Comparing the new device to a predicate device (CRC 55t series) to demonstrate similar principles of operation, functionality, detector technology, intended use, and effectiveness.
- Safety and Effectiveness: Stating that the predicate devices have a long history of safe, reliable, and effective use, and that the new device enhances safety and effectiveness through an improved user interface.
- Compliance with Standards: Listing compliance with various IEC and AAMI standards related to electromagnetic compatibility, general safety, and usability.
- Indications for Use: Defining who can use the device and for what applications (measurement of radiopharmaceuticals, radioactive materials, and brachytherapy sources for diagnostic, therapeutic, and research applications).
- FDA Correspondence: Official FDA letter regarding the 510(k) clearance.
There is no mention of:
- Specific performance acceptance criteria (e.g., accuracy, precision targets).
- A study design or results demonstrating that the device meets such criteria.
- Information about sample sizes, data provenance, expert panels, adjudication, MRMC studies, standalone performance, ground truth establishment, or training sets.
Therefore, I cannot provide the requested table or answer the specific questions about the study design as the information is not present in the provided text.
Ask a specific question about this device
(76 days)
CAPINTEC, INC.
The CRC 55t series, which includes the standard 55tR dose calibrator, reduced pressure chamber (CRC 55tPET) and well counter (CRC55tW), is intended to be used by qualified nuclear medicine technologists, nuclear medicine physicians, and radiopharmacists to measure a wide range of radiopharmaceuticals and radioactive materials, including high energy beta and gamma emitters for diagnostic, therapeutic, or in vitro laboratory tests. It is also designed for use by trained medical physicists to measure the output of most radioactive brachytherapy sources, including LDR, HDR, and IVBT sources. All brachytherapy sources must be measured in the appropriate source holder. The well counter is designed for measurement of low activity radioactive sources or solutions in vitro laboratory test applications. This device is also used in numerous research applications for measurement of radioactive materials.
Capintec's CRC 55t series dose calibrators are designed for measurement of radioactive materials used in nuclear medicine, therapy, laboratory tests, and research applications. The unit is intended for use by trained nuclear medicine technologists, nuclear medicine physicians, radiopharmacists, or medical physicists for diagnostic, in vitro, and therapeutic applications. The CRC 55t series uses the same principles of operation, same basic electronic circuitry, and same detector technology as the predicated device, CRC 25 series. The basic detection, measurement process, design concepts, functionality, calculations, algorithms, and response remain the same as the predicate device. There are no differences in intended use or effectiveness. The 55t replaces the traditional keypad interface with a larger color touch screen display. The CRC 55t provides enhanced user interface features associated with newer touch screen technology. In addition, the CRC 55t provides an expanded MCA for isotope identification. The predicate device contains 6 fixed channels which provides only preliminary information. The CRC 55t includes a 256 channel MCA which permits spectral identification.
The provided text describes a Capintec CRC 55t series dose calibrator, focusing on its features, intended use, and substantial equivalence to a predicate device. However, it does not contain information about specific acceptance criteria for device performance or a study demonstrating that the device meets such criteria in terms of quantitative performance metrics (e.g., accuracy, precision for dose calibration).
The document is a summary of safety and effectiveness information for a 510(k) premarket notification and an FDA clearance letter. It highlights the device's adherence to various EMC and electrical safety standards, but these are related to electrical and operational safety, not directly to the accuracy or performance of the dose measurement function in a clinical context that would require a ground truth study or human reader evaluations.
Therefore, I cannot provide the requested information. The document focuses on:
- Device Description: The CRC 55t series dose calibrators measure radioactive materials in nuclear medicine, therapy, laboratory tests, and research.
- Technological Equivalence: The 55t series uses the same principles, circuitry, and detector technology as the predicate CRC 25 series.
- Key Differences: The 55t introduces a larger color touchscreen and an expanded 256-channel MCA for isotope identification, replacing the 6 fixed channels of the predicate device.
- Intended Use: For trained nuclear medicine technologists, physicians, radiopharmacists, and medical physicists in diagnostic, in vitro, and therapeutic applications, as well as research.
- Safety and Effectiveness Justification: Enhanced user interface and improved MCA are cited as features that enhance safety and effectiveness.
- Compliance: The device has been tested and approved to various IEC, UL, and CAN/CSA electrical and safety standards for laboratory equipment.
There is no data presented in the document regarding:
- A table of acceptance criteria and reported device performance (quantitative measurements).
- Sample sizes for test sets or data provenance for performance evaluation.
- Number of experts or their qualifications for establishing ground truth.
- Adjudication methods.
- Multi-reader multi-case (MRMC) comparative effectiveness studies.
- Standalone algorithm performance studies.
- Type of ground truth used (e.g., pathology, outcomes data).
- Sample size or methods for establishing ground truth for a training set (as this device is not an AI/ML-based diagnostic algorithm in the way a computer-aided detection system would be).
The FDA's substantial equivalence determination is based on the new device being as safe and effective as a legally marketed predicate device, primarily through technological similarity and adherence to safety standards, rather than a clinical performance study with defined ground truth and statistical endpoints for diagnostic accuracy.
Ask a specific question about this device
(38 days)
CAPINTEC, INC.
The CRC 25R dose calibrator, which includes optional well counter (CRC 25W) or reduced pressure chamber (CRC 25PET), is intended to be used by qualified nuclear medicine technologists to measure a wide range radiopharmaceuticals, including high energy beta and gamma emitters. It is also designed for use by trained medical physicists to measure the output of most radioactive brachytherapy sources, including HDR. LDR and IVBT sources. All brachytherapy sources must be measured in the appropriate source holder. The well counter is designed for measurement of low activity radioactive sources or solutions, including laboratory test applications. This device is used in numerous research applications for measurement of radioactive materials.
The Capintec CRC 25 series is a reduced feature version of the CRC 15Ultra. The CRC 25 series uses the same basic hardware, and same detectors as the CRC 15 Ultra, but does not provide the ability to use multiple chambers, nor does the CRC 25 support the addition of a beta counter. The basic detection, measurement process, design concepts, functionality, calculations, algorithms, and response remain the same as the predicate device.
This document is a 510(k) premarket notification for the Capintec CRC 25 series radionuclide dose calibrator. It details the device's substantial equivalence to a predicate device (CRC 15Ultra) and its compliance with safety standards, but it does not contain any information regarding acceptance criteria or the results of a study designed to prove the device meets those criteria.
Therefore, I cannot provide the requested information. The document focuses on regulatory approval and substantial equivalence based on existing hardware and concepts, rather than presenting a performance study with detailed acceptance criteria and results.
Ask a specific question about this device
(48 days)
CAPINTEC, INC.
The CRC 15Ultra multiple chamber dose calibrator, which includes optional beta counter and well counter, is intended to be used by qualified nuclear medicine technologists to measure a wide range radiopharmaceuticals, including high mergy beta and gamma emitters. It is also designed for use by trained medical physicists to measure the output of most radioactive brachytherapy sources, including HDR, LDR and IVBT sources. All brachytherapy sources must be measured in the appropriate source holder. The well counter is designed for measurement of low activity radioactive sources or solutions, including laboratory test applications. This device is used in numerous research applications for measurement of radioactive materials.
The Capintec CRC 15Ultra is a multiple detector system, which may include up to eight sealed pressurized re-entrant well chambers, plus a high energy beta counter, and a well counter. The CRC 15Ultra combines the features of several well established Capintec models: CRC 35R, CRC 15R, Beta Counter, and Caprac R Counter into one unit with flexible configurations which are field upgradeable. The 15Ultra incorporates enhanced electronic circuitry and faster microprocessor capabilities, which extends it capability to network eight ionization chambers, as did the CRC 35R. However, the CRC 15Ultra can also add the detector assembly from the Beta C Counter, or the detector assembly from the Caprac R Well Counter, to the same universal readout. The basic design concepts, functionality, calculations, algorithms, and response are the same.
This document is a 510(k) summary for the Capintec CRC 15Ultra. It does not contain information about the acceptance criteria and a study proving the device meets those criteria. The document is primarily focused on demonstrating substantial equivalence to predicate devices and lists applicable safety standards.
Therefore, I cannot fulfill your request for information on acceptance criteria and studies demonstrating device performance based on the provided text.
Ask a specific question about this device
(90 days)
CAPINTEC, INC.
The 2 Basic is intended to be used by trained medical physicist to measure the radiation output from radiation therapy machines for verification of patient treatment plan, quality assurance, or beam characteristics. It is not intended to function as a primary calibration device. The 2 Basic can be used in direct surface contact with patients or in a phantom material.
The 2 Basic is a solid state diode detector system coupled with a precision electrometer and PC for radiation measurement, data storage and display. It is intended to be used by trained medical physicists for the measurement of radiation output from radiation therapy treatment machines. The 2 Basic can be used with direct patient contact for entrance skin measurements, or in air, water, or other suitable phantoms materials for beam output measurements.
Measurement data is used to verify and document the beam characteristics of radiation therapy treatment machines for quality assurance programs and to very therapeutic doses delivered to patients during treatments.
The Capintec 2 Basic system consists of 2 diode detectors permanently attached to a precision electrometer and application software. The detectors are solid state silicon diodes with a hemispherical shape optimized for direct patient contact. They provide high sensitivity, excellent linearity, and uniform output vs. gantry angle. The diodes are completely water resistant and enclosed in biocompatible molded epoxy. The high precision electrometer measures the current from the detector and converts the value into a displayed dose and provides automatic zero compensation. Application software controls the system and stores measurement data for each detector, and associated beam parameters such as energy, MU, and patient demographic data. Data can be stored on the PC or printed for hard copy record. Customer must supply a UL recognized PC to be used with application software.
This document is a 510(k) premarket notification for the Capintec 2 Basic device. It primarily focuses on the device's substantial equivalence to predicate devices and its intended use, rather than detailed performance study results against specific acceptance criteria. Therefore, most of the requested information regarding acceptance criteria and study data is not present in the provided text.
Based on the provided text, here's what can be extracted:
Acceptance Criteria and Reported Device Performance:
The document broadly states that "The risk analysis, safety testing and verification and validation testing has addressed patient contact hazards, software hazards, and operator hazards and concluded that the unit is safe and fully meets the intended use and stated specifications of the product." However, specific numerical acceptance criteria for performance metrics (e.g., accuracy, precision) and their corresponding reported device performance values are not provided in this summary.
The document lists the following relevant standards, which would typically contain performance requirements that the device aims to meet:
- Medical Electrical Equipment, Part 1 General Requirements - UL2601-1:2nd
- Medical Electrical Equipment, Part 1 General Requirements - IEC60601-1:
- Collateral standard: Electromagnetic Compatibility-IEC 60601-1-2
- Medical Electrical Equipment, Part 1 General Requirements for Safety
- Medical Electrical Equipment, Part 1 General Requirements-Can/CSA C22.2 No.606101-M90
- Medical Electrical Systems-IEC 606601-1-1:1993+A1
- IEC 60601-2-9 Patient Contact Dosimeters Used in Radiation Therapy with Electrically Connected Radiation Detectors.
Sample sizes used for the test set and data provenance:
This information is not provided in the document. The document refers to "verification and validation testing" but does not detail the specifics of such testing, including sample size or data provenance.
Number of experts used to establish the ground truth for the test set and their qualifications:
This information is not provided in the document.
Adjudication method for the test set:
This information is not provided in the document.
If a multi-reader multi-case (MRMC) comparative effectiveness study was done:
This information is not provided in the document. The device is a measurement system, not typically one that involves human readers interpreting diagnostic images for which an MRMC study would be conducted.
If a standalone study (i.e. algorithm only without human-in-the-loop performance) was done:
The document refers to "verification and validation testing," which would imply standalone performance testing of the device. However, the details of such a study (e.g., specific metrics, results, sample size) are not provided. The device consists of "2 diode detectors permanently attached to a precision electrometer and application software" and measures current to convert it into a displayed dose. This is an automated measurement system, so its performance is inherently "standalone."
The type of ground truth used (expert consensus, pathology, outcomes data, etc.):
Given the device's function to "measure the radiation output from radiation therapy machines," the ground truth would typically be established by highly accurate primary calibration standards or reference dosimetry systems. However, the specific type of ground truth used in their testing is not explicitly stated in the provided text.
The sample size for the training set:
This information is not provided in the document. The term "training set" is usually associated with machine learning models. While the device includes "application software," the document does not suggest an AI or machine learning component that would require a distinct "training set" in the conventional sense.
How the ground truth for the training set was established:
As the existence of a "training set" for an AI model is not indicated, this information is not applicable or not provided.
Ask a specific question about this device
(198 days)
CAPINTEC, INC.
The CRC 15BT dose calibrator is intended to be used by trained medical physicists, or qualified technologists to measure the activity or output of radioactive brachytherapy sources, including HDR, LDR and IVBT sources.
The CRC 15BT dose calibrator is a well type ionization chamber specifically designed to accurately and rapidly measure all types of brachytherapy sources with appropriate calibration and source positioning device. The ionization chamber is connected to a readout, which converts measured current into a displayed value in units of either Ci (activity) or U (air kerma strength). The unit is sealed and pressurized with UPC Argon. which improves sensitivity and eliminates the need for temperature and pressure corrections.
Based on the provided text, the device in question is the Capintec CRC 15BT calibrator, a radionuclide dose calibrator. The document is a 510(k) submission review with an acceptance letter from the FDA. This type of document typically focuses on establishing "substantial equivalence" to a predicate device rather than detailing specific acceptance criteria and performance studies in the way a clinical trial might for a new drug or an AI-powered diagnostic device.
Therefore, much of the requested information (related to AI algorithms, test sets, ground truth establishment, expert adjudication, MRMC studies, and standalone performance) is not applicable to this device and this type of regulatory submission. The CRC 15BT is a physical medical device for measuring radioactive sources, not a software-based diagnostic tool with AI components.
However, I can extract the relevant information regarding the device's validation and "acceptance criteria" as described in the document, framed within the context of a 510(k) submission for a physical device.
Here's the breakdown of what can be synthesized from the text:
1. Table of Acceptance Criteria and Reported Device Performance
Acceptance Criteria Category | Specific Criteria (as implied by text) | Reported Device Performance (as stated in text) |
---|---|---|
Intended Use Suitability | Suitable for all clinically available gamma and high-energy beta brachytherapy sources, including HDR, LDR, and IVBT in any number of configurations (seeds, ribbons, source trains). | "evaluated by the University of Wisconsin ADCL, and found to be a suitable instrument for all clinically available gamma and high-energy beta brachytherapy sources, including HDR, LDR, and IVBT in any number of configurations including, seeds, ribbons, and source trains with appropriate source holders." |
Accuracy/Measurement | Accurately and rapidly measure activity or output of radioactive brachytherapy sources. | Converts measured current into a displayed value in units of Ci (activity) or U (air kerma strength). The core design is a minor modification of the CRC 15R, which has an "excellent reputation for long term stability, reliability, safety and effectiveness." The 15BT is expected to "maintain the same excellent quality as the CRC 15R." |
Activity Range | Accommodate higher activity range required for HDR sources. | Modifications to the 15BT include "reduced fill gas pressure and an increased bias voltage to accommodate a higher activity range required for HDR sources." |
Stability, Reliability, Safety, Effectiveness | Maintain high standards comparable to the predicate device (CRC 15R). | Expected to maintain "excellent quality... same level of safety and effectiveness and long term reliability" as the CRC 15R, which has been commercially available for over 10 years with an "excellent reputation." |
Compliance with Safety Standards | Adherence to relevant medical electrical equipment safety standards. | "tested and approved to the following safety standards for medical equipment: EN60601-1:1990+A1+A2, IEC60601-1:1998+A1+A2, EN60601-1-2, IEC60601-1-4:1996, Can/CSA C22.2 No.606101-M90, IEC 606601-1-1:1993+A1." |
2. Sample size used for the test set and the data provenance
- Sample Size: Not explicitly stated in terms of a specific number of brachytherapy sources tested. The evaluation was done by the University of Wisconsin ADCL, implying a testing protocol was followed, but the "sample size" of sources is not quantified.
- Data Provenance: The testing was carried out by the University of Wisconsin ADCL (Accredited Dosimetry Calibration Laboratory), an independent, accredited laboratory. This indicates an objective, third-party evaluation. The data would be prospective testing data, specifically for the CRC 15BT.
3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts
- Not Applicable in the AI/Diagnostic Sense. For a dose calibrator, "ground truth" is typically established by physical standards and reference measurements, often against primary standards maintained by national metrology institutes or through cross-calibration with other precisely calibrated instruments. The University of Wisconsin ADCL is accredited for dosimetry calibration, indicating they possess the expertise and equipment to establish accurate reference measurements for brachytherapy sources. The text doesn't mention "experts" in the context of subjective interpretation like radiologists, but rather a specialized laboratory performing objective measurements.
4. Adjudication method for the test set
- Not Applicable. This concept is for subjective interpretations/diagnoses (e.g., by human readers in an AI study). For a physical measurement device like a dose calibrator, the "adjudication" is the verification of the calibration and measurement accuracy against established physical standards by the ADCL.
5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance
- Not Applicable. This is a physical device, not an AI software requiring human reader interaction or augmentation.
6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done
- Not Applicable / Interpreted Differently. The device is standalone in its operation of measuring radiation. It's a sensor system that performs its function without human interpretation of its core measurement (though humans operate it and use its output). There is no "algorithm" in the AI sense.
7. The type of ground truth used (expert consensus, pathology, outcomes data, etc.)
- For the CRC 15BT, the "ground truth" for its performance would be physical measurement standards and reference sources with known activities or air kerma strengths, established and traceable to national or international primary standards. The University of Wisconsin ADCL's role is to ensure the calibrator accurately measures these known quantities.
8. The sample size for the training set
- Not Applicable. This is not an AI/machine learning device that requires a "training set."
9. How the ground truth for the training set was established
- Not Applicable. As there is no training set for this type of device, this question is irrelevant.
Ask a specific question about this device
(331 days)
CAPINTEC, INC.
The MedSet Cardiolight system is intended to be used by trained ECG technicians with analysis and interpretation by cardiologists for the measurement and analysis of electrocardiogram signals on ambulatory patients as an aid to the diagnosis of heart disease.
The MedSet Cardiolight System is a real time ambulatory ECG recording and analysis system for a recording period of up to 24 hours. The stored data is transferred to a PC for graphical display of the results as an aid to the medical diagnosis of heart disease by a trained cardiologist.
Here's an analysis of the acceptance criteria and the study proving the device meets them, based on the provided text:
1. Table of Acceptance Criteria and Reported Device Performance
Metric | Acceptance Criteria (Implied) | Reported Device Performance |
---|---|---|
Sensitivity (Normal) | N/A (Compared to AHA) | 99% |
Specificity (Normal) | N/A (Compared to AHA) | 99% |
Pos. Predictive Acc. (Normal) | N/A (Compared to AHA) | 92% |
Sensitivity (VES) | N/A (Compared to AHA) | 91% |
Specificity (VES) | N/A (Compared to AHA) | 95% |
Pos. Predictive Acc. (VES) | N/A (Compared to AHA) | 99% |
Overall Quality | Comparable to other commercial long-term ECG devices | "the quality of the automatic analysis of the Cardiolight system corresponds to those of other commercial long term ECG devices." |
Note on Acceptance Criteria: The document does not explicitly state numerical acceptance criteria for Sensitivity, Specificity, and Positive Predictive Accuracy. Instead, it reports the device's performance against "standard data of the American Hearts Association (AHA)" as a benchmark. The overall qualitative acceptance criterion appears to be that its performance is equivalent to, or better than, other commercial long-term ECG devices, as stated in the conclusion of the validation study.
2. Sample Size Used for the Test Set and Data Provenance
- Test Set: "150 000 events" for the automatic ECG analysis (derived from "many recorded and manually edited ECG data sets," including the AHA standard data).
- Clinical Validation (Patients): 150 patients.
- Data Provenance:
- Automatic ECG Analysis: "standard data of the American Hearts Association (AHA)" and "many recorded and manually edited ECG data sets." The nationality of the "many recorded and manually edited ECG data sets" is not specified but given the company location (Germany) and the use of AHA data, it's likely a mix. This appears to be retrospective data.
- Clinical Validation: Performed at the University of Ulm Medical Clinic, which is in Germany. This was likely a prospective study on 150 patients.
- Commercial Use: "in commercial use in Europe for several years" implies retrospective real-world data collection.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of those Experts
- Automatic ECG Analysis: The ground truth for the "150 000 events" was established using "AHA-annotations" and "manually edited ECG data sets."
- For the AHA data, the ground truth would have been established by experts associated with the American Heart Association. Their specific number and qualifications are not detailed in this document but are generally understood to be highly qualified cardiologists/electrophysiologists.
- For the "manually edited ECG data sets," the number and specific qualifications of the experts who performed the manual editing are not specified, but the context implies trained professionals.
- Clinical Validation: The analysis and interpretation are intended "by cardiologists." For the clinical validation protocol, it's implied that cardiologists assessed the results to make the comparison, but the exact number or qualifications of those involved in establishing the ground truth for this specific study are not given.
4. Adjudication Method for the Test Set
The document does not explicitly describe an adjudication method (e.g., 2+1, 3+1). For the "manually edited ECG data sets" and "AHA-annotations," it's generally understood that a consensus or expert review process would have been used to establish the ground truth, but the specifics are not provided.
5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance
No, a multi-reader multi-case (MRMC) comparative effectiveness study evaluating human readers with and without AI assistance was not reported. The study focused on the performance of the algorithm itself (standalone) and then a clinical validation where the system served as an "aid to the medical diagnosis," implying a human-in-the-loop, but not a direct comparative effectiveness study on reader improvement.
6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done
Yes, a standalone performance evaluation of the algorithm was done. The "Test Results" section directly compares the "automatic analysis" results (Sensitivity, Specificity, Positive Predictive Accuracy for Normal and VES events) to "AHA-annotations" and manually edited data.
7. The type of ground truth used (expert consensus, pathology, outcomes data, etc.)
The ground truth used was:
- Expert Consensus/Annotation: "AHA-annotations" and "manually edited ECG data sets." This implies a form of expert consensus or highly trained expert review of ECG waveforms.
8. The Sample Size for the Training Set
The document does not specify the sample size for the training set. The provided performance metrics (Sensitivity, Specificity, PPP) relate to the test results of the algorithm.
9. How the Ground Truth for the Training Set was Established
The document does not specify how the ground truth for the training set was established, as it doesn't describe the training process or data.
Ask a specific question about this device
(81 days)
CAPINTEC, INC.
THE CAPINTEC 292 ELECTROMETER IS INTENDED TO BE USED BY TRAINED MEDICAL PHYSICISTS OR QUALIFIED RADIATION THERAPY TECHNOLOGISTS TO PERFORM QUALITY ASSURANCE CHECKS AND MEASUREMENTS ON THE OUTPUT FROM THERAPEUTIC X-RAY MACHINES OR TELETHERAPY UNITS. WITH THE ADDITION OF AN OPTIONAL CAPINTEC CRC DOSE CALIBRATOR CHAMBER, THE 292 MAY ALSO BE USED BY TRAINED MEDICAL PAYSICISTS OR QUALIFIED TECHNOLOGISTS TO MEASURE RADIOACTIVE SOURCES USED FOR THERAPEUTIC OR DIAGNOSTIC TREATMENT.
The 292 is a precise and accurate software controlled low impedance electrometer with four measurement ranges, adjustable + bias voltage which can act as a dose or dose rate meter.
Here's an analysis of the provided text, focusing on acceptance criteria and the study proving device performance:
Acceptance Criteria and Device Performance Study for Capintec Model 292 Electrometer
1. Table of Acceptance Criteria and Reported Device Performance
Acceptance Criteria | Reported Device Performance |
---|---|
100% success in function and intended use | Excellent agreement between 292 and 192 electrometers when measuring x-ray machines (to the limits of reproducibility of individual x-ray machines). |
100% agreement between software algorithms and manual calculations. | |
Agreed to within 1% between 292 (with CRC dose calibrator chamber) and CRC 15R dose calibrator when measuring NIST radioactive sources. | |
Evaluation of suggestions for improvement in software/hardware from "beta test sites" | Suggestions were received and would be evaluated, tested, and incorporated if appropriate. |
Correction of any problems discovered during beta testing | Problems would be corrected prior to release to production. |
2. Sample Size Used for the Test Set and Data Provenance
The document does not explicitly state a numerical "sample size" in terms of number of devices or number of measurements for the primary comparison. Instead, it describes:
- Test Set Description: "The same NIST calibrated ionization chamber was used with both the 192 and 292 electrometers, and measurements were made under a variety of accelerator and orthovoltage machine settings."
- Data Provenance: The measurements were likely conducted internally by Capintec or in collaboration with a National Institute of Standards and Technology (NIST) certified facility, given the use of "NIST calibrated ionization chamber" and "NIST radioactive sources." The "beta test sites," which contributed to identifying issues and suggestions, were described as "selected radiation oncology facilities." The data is likely prospective as it involves new testing of the 292 electrometer.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts
The document does not specify a distinct set of "experts" to establish a ground truth for the test set. Instead, the ground truth is established by:
- Reference Devices: The predicate devices (Capintec Model 192 electrometer and CRC 15R dose calibrator) served as the de-facto "ground truth" for comparison. These are established, pre-amendment devices or existing devices with proven performance.
- NIST Calibration: The use of "NIST calibrated ionization chamber" and "NIST radioactive sources" implies that the accuracy of the measurements and the reference values are traceable to national standards, which can be considered the highest form of metrological "ground truth."
- Implicit Expertise: While not explicitly stated as "experts," the "trained medical physicists or qualified radiation therapy technologists" who performed the measurements using the 192, 292, and CRC 15R would have the necessary qualifications to conduct these tests and interpret the results.
4. Adjudication Method for the Test Set
No explicit adjudication method (e.g., 2+1, 3+1) is described. The comparison relies on:
- Direct Measurement Comparison: Results from the 292 were directly compared to those from the predicate 192 electrometer and the CRC 15R dose calibrator.
- Software Verification: Software algorithms were verified against "manual calculations," suggesting a direct comparison without a complex multi-person adjudication process.
5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done
No, a Multi-Reader Multi-Case (MRMC) comparative effectiveness study was not done. This type of study is typically used for diagnostic imaging devices where different human readers interpret cases with and without AI assistance. The Capintec Model 292 Electrometer is a measurement device, not an interpretive diagnostic tool, so such a study would not be applicable.
6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) Study Was Done
Yes, a standalone performance evaluation of the algorithm (software) was explicitly done: "In addition, the software algorithms were verified against manual calculations and agreement was 100%." This verifies the internal logic and calculations performed by the device's software without direct human interpretation being part of the performance metric.
7. The Type of Ground Truth Used
The ground truth used was a combination of:
- Reference Device Performance: The established, pre-amendment Capintec Model 192 electrometer and the CRC 15R dose calibrator served as the primary reference for performance comparison.
- NIST Traceability: The use of "NIST calibrated ionization chamber" and "NIST radioactive sources" indicates that the ground truth for the physical measurements is traceable to national metrological standards.
- Manual Calculation Verification: For the software, "manual calculations" served as the ground truth.
8. The Sample Size for the Training Set
The document does not specify a sample size for a "training set." The 292 electrometer is a microprocessor-based measurement device, not an AI/machine learning model that typically requires a distinct training set. The development process would involve traditional engineering, calibration, and testing, rather than machine learning training.
9. How the Ground Truth for the Training Set Was Established
As there is no explicit mention of a "training set" in the context of machine learning, the question of how its ground truth was established is not directly applicable. The device's functionality is based on established physics principles and precision measurement, with performance verified against existing, validated devices and NIST standards.
Ask a specific question about this device
Page 1 of 1