Search Results
Found 11 results
510(k) Data Aggregation
(92 days)
JIN
The KetoSens BT Blood ß-Ketone Monitoring System is intended for the quantitative measurement of 0-Ketone (betahydroxybutyrate) level in capillary whole blood drawn from the fingertip. The KetoSens BT Blood β-Ketone Monitoring System is intended for self-testing outside the body (in vitro) by people with diabetes at home as an aid to monitor the effectiveness of ketoacidosis control. The system is not intended for use in the diagnosis of or screening for ketoacidosis and is not intended for use on neonates. This system is intended to be used by a single person and should not be shared.
The KetoSens Blood 0-Ketone Test Strips work with the KetoSens BT Blood 0-Ketone Meter to quantitatively measure Blood ß-Ketone in capillary whole blood samples drawn from the finger.
Not Found
I am sorry, but the provided text does not contain any information about acceptance criteria, device performance, validation studies, sample sizes, ground truth establishment, or expert involvement. The document primarily consists of an FDA 510(k) clearance letter for the KetoSens BT Blood $\beta$ -Ketone Monitoring System, outlining its indications for use and regulatory compliance. Therefore, I cannot fulfill your request to describe the acceptance criteria and the study that proves the device meets them based on the given information.
Ask a specific question about this device
(228 days)
JIN
VivaChek™ Blood Glucose and ß-Ketone Monitoring System is comprised of the VivaChek™ Blood Glucose and β-Ketone Meter (VGM200), the VivaChek™ Ino Blood Glucose Test Strips (VGS01) and the VivaChek™ Blood β-Ketone Test Strips (VKS01).
The VivaChek™ Blood Glucose and ß-Ketone Monitoring System is intended to quantitatively measure the glucose concentration and/or (beta-hydroxybutyrate) concentration in fresh capillary whole blood samples drawn from the fingertips. It is intended for use by persons with diabetes at home as an aid to monitor the effectiveness of diabetes control. It is not intended for neonatal use or for the diagnosis of or screening for diabetes. This system is intended for self-testing outside the body (in vitro diagnostic use), and should only be used by a single person and should not be shared.
VivaChek™ Blood Glucose and β-Ketone Monitoring System (Model: VGM200) is designed to quantitatively measure the glucose and/or ß-ketone concentration respectively in fresh capillary whole blood samples drawn from the fingertips.
The test principle of the ß-ketone is based on the amperometric detection of ß-hydroxybutyrate (also known as 3-hydroxybutyrate) in whole blood. β-hydroxybutyrate is converted by the enzyme ß-hydroxybutyrate dehydrogenase to acetoacetate. The magnitude of electrical current resulting from this enzymatic reaction is proportional to the amount of ß-hydroxybutyrate present in the sample.
VivaChek™ Blood Glucose and ß-Ketone Monitoring System (Model: VGM200) contains Bluetooth Low Energy (BLE), it complies with US federal quidelines, Part 15 of the FCC Rules for devices with RF capability.
Here's a breakdown of the acceptance criteria and study information for the VivaChek™ Blood Glucose and ß-Ketone Monitoring System, based on the provided FDA 510(k) summary:
1. Table of Acceptance Criteria and Reported Device Performance
The document doesn't explicitly list acceptance criteria values for most studies, but rather states that the studies "Pass" or "were acceptable." For the performance characteristics, it focuses on demonstrating equivalence to the predicate device. For the clinical study, the acceptance criteria were based on participants' ability to obtain readings and satisfaction with ease of operation and overall performance.
For the B-Ketone performance studies, generally, the acceptance criteria for a blood ketone monitoring system would align with ISO 15197 or similar guidelines, requiring a certain percentage of results to fall within defined accuracy ranges when compared to a reference method (e.g., laboratory analyzer). While not explicitly stated with numerical targets, the "Pass" conclusion for studies like Linearity, Precision, and Interfering Agents implies adherence to such generally accepted analytical performance standards.
Study Type | Acceptance Criteria (Implied/General) | Reported Device Performance (as per document) |
---|---|---|
B-Ketone Analytical Performance | ||
Linearity Study | Demonstrate consistent and accurate measurements across the entire measuring range (0.1 - 8.0 mmol/L) | Pass |
Within-Run Precision Study | Low variability in results when testing the same sample multiple times within a single run | Pass |
Intermediate Precision Study | Low variability in results over time, different operators, and different test strips/reagents | Pass |
Hematocrit Effect Study | Accurate measurements across the specified hematocrit range (20-65%) | Pass |
Sample Volume Study | Accurate measurements with the specified sample volume (0.8 µL) | Pass |
Altitude Effect Evaluation | Accurate measurements across relevant altitude variations | Pass |
Operating Conditions Evaluation | Accurate measurements within specified operating temperature (45.5-113°F) and RH (10-90%) | Pass |
Interference Agents Study | Accurate measurements in the presence of common interfering substances | Pass |
Stability Studies | ||
Accelerated Closed Vial Test Strip Stability Study | Maintain performance specifications under accelerated aging conditions | Pass |
Accelerated Closed Control Stability Study | Maintain performance specifications under accelerated aging conditions | Pass |
Accelerated Open Vial Test Strip Stability Study | Maintain performance specifications under accelerated aging conditions | Pass |
Real Time Open Vial Test Strip Stability Study | Maintain performance specifications over the stated shelf-life under real-time conditions | Pass |
System and Usability | ||
User Evaluation | Non-professional, inexperienced lay persons able to obtain ß-ketone readings; satisfactory ease of operation and overall performance. | Study results indicated that non-professional, inexperienced lay persons were able to obtain ß-ketone readings. Participants were satisfied with ease of operation and overall performance. |
Error Codes Test | Proper functioning and accurate display of error codes | Pass |
Meter Environmental Temperature Test | Meter functions correctly and accurately within specified environmental temperatures | Pass |
Meter Robustness Study | Meter withstands specified physical stresses without performance degradation | Pass |
Shipping Study (Ketone Strip & Control) | Maintain performance specifications after shipping simulation | Pass |
Meter Software Documentation | Software meets specified requirements and documentation is complete | Pass |
Testing with Used Test Strips | Prevention of reuse of test strips or proper error indication | Pass |
2. Sample Size Used for the Test Set and Data Provenance
The document does not explicitly state the sample sizes for the individual non-clinical (laboratory) studies. For the User Evaluation (clinical study), it refers to "participated lay persons" without specifying the exact number.
The provenance of the data is not mentioned in terms of country of origin. The studies are described as "non-clinical (laboratory) studies" and a "clinical (user evaluation) study," indicating they are likely prospective experiments conducted specifically for this submission.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications
This information is not provided in the document. For analytical devices like this, ground truth for accuracy studies (e.g., Linearity, Precision) would typically be established by a reference laboratory method using highly accurate and calibrated instruments, not necessarily by experts in the sense of human interpretation.
4. Adjudication Method for the Test Set
The document does not describe any adjudication method. Given the nature of a quantitative measurement device, the comparison would typically be against a reference method, rather than requiring expert adjudication.
5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was done, and its effect size
No, an MRMC comparative effectiveness study was not done. This type of study is more relevant for diagnostic devices that involve human interpretation of images or other subjective data, which is not the case for a blood ketone and glucose monitoring system.
6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) was done
Yes, the analytical and performance studies listed (e.g., Linearity, Precision, Hematocrit Effect, Interference) represent standalone (algorithm only) performance of the device without human-in-the-loop interpretation beyond operating the device. The device provides a quantitative numerical output directly. The "User Evaluation" did involve humans, but primarily to assess their ability to use the device and obtain a reading, not to interpret the reading itself.
7. The Type of Ground Truth Used
For the analytical performance studies (e.g., Linearity, Precision, Hematocrit, Interference), the ground truth would typically be established by a reference laboratory method or highly accurate comparative instrument. The document refers to "corresponding study protocols," which would detail these reference methods, but the specific methods are not described in this summary.
8. The Sample Size for the Training Set
The document does not mention a training set or its sample size. This device is not described as using machine learning or AI that would require a distinct training set in the conventional sense. Its performance is based on established electrochemical principles.
9. How the Ground Truth for the Training Set was Established
As no training set is mentioned or implied for an AI/ML context, this information is not applicable.
Ask a specific question about this device
(89 days)
JIN
KET-1 System: The KET-1 Blood Ketone Monitoring System is intended to quantitatively measure $\beta$ -hydroxybutyrate ( $\beta$ -ketone) in fresh capillary whole blood from fingertips. It should only be used by a single patient and it should not be shared. Testing is done outside the body (In Vitro diagnostic use). It is intended for self-testing by people with diabetes at home as an aid to monitoring the effectiveness of diabetes control programs. It is not to be used for diagnosis or screening of diabetes, or for neonatal use. The KET-1 Blood Ketone Monitoring System is comprised of the KET-1 Blood Ketone Meter and KET-1 Blood Ketone Test Strip.
The KET-1 Blood Ketone Monitoring System consists of the KET-1 Blood Ketone Meter, KET-1 Blood Ketone Test Strips, and KET-1 Ketone Control Solutions (Level 1 and Level 2). The system is for self-testing of blood ketone. The KET-1 Blood Ketone Test Strips and KET-1 Ketone Control Solutions are purchased separately.
This document describes the regulatory approval of the KET-1 Blood Ketone Monitoring System. The provided text is a 510(k) summary, which outlines the device, its intended use, and the studies conducted to demonstrate its substantial equivalence to a legally marketed predicate device.
Here's an analysis of the acceptance criteria and study proving the device meets them, based on the provided text:
1. A table of acceptance criteria and the reported device performance
The document does not explicitly present a table of numerical acceptance criteria with corresponding performance metrics. Instead, it describes general categories of testing and concludes that the device demonstrates substantial equivalence. For quantitative tests like accuracy, it states that "results demonstrate substantial equivalence to the predicate system" without providing specific numbers or ranges for the acceptance criteria.
2. Sample size used for the test set and the data provenance
- Sample Size for Test Set: The document mentions an "accuracy study" conducted with "home users using finger capillary whole blood." However, it does not specify the sample size (number of participants or samples) used for this accuracy study or any other mentioned tests (e.g., precision, repeatability, linearity).
- Data Provenance: The device manufacturer is Apex Biotechnology Corp. located in Hsinchu, Taiwan. The location of the clinical study (accuracy study) is not explicitly stated, but it is reasonable to infer it would be in Taiwan or a region where the manufacturer operates or has a testing facility. The data provenance is retrospective in the sense that the studies were completed before the 510(k) submission for regulatory review. However, the accuracy study itself was likely conducted prospectively (data collected specifically for the study) from the home users.
3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts
This information is not provided in the document. For a blood ketone monitoring system, ground truth would typically be established by a reference laboratory method (e.g., gas chromatography-mass spectrometry or a highly accurate clinical chemistry analyzer) rather than expert human interpretation of images. The document does not specify details of the ground truth method or the personnel involved.
4. Adjudication method for the test set
This information is not applicable in the context of a blood ketone monitoring system, as it measures a quantitative analyte. Adjudication methods (e.g., 2+1, 3+1) are typically used for qualitative or diagnostic imaging studies where human experts interpret results and disagreements need to be resolved. For a quantitative measurement, the "ground truth" (reference method result) is directly compared to the device's measurement.
5. If a multi-reader multi-case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance
An MRMC study is not applicable to this device. This type of study is relevant for AI-powered diagnostic imaging devices where human readers (e.g., radiologists) interpret images with and without AI assistance. The KET-1 Blood Ketone Monitoring System is a quantitative point-of-care device that measures a chemical analyte and does not involve human interpretation of complex images or AI assistance for human readers.
6. If a standalone (i.e. algorithm only without human-in-the loop performance) was done
The KET-1 Blood Ketone Monitoring System is a standalone device in the sense that it provides a direct quantitative measurement of β-ketone. Its "performance" is its accuracy and precision in measuring blood ketone levels compared to a reference method, rather than a diagnostic algorithm that processes complex data for human review. The documented testing (accuracy, precision, linearity) essentially assesses the standalone performance of the device.
7. The type of ground truth used (expert consensus, pathology, outcomes data, etc.)
The document implies that the ground truth for the accuracy study was established by a reference method, as is standard for quantitative diagnostic devices. While not explicitly stated, clinical chemistry analyzers or other highly accurate laboratory methods would be used to obtain the "true" β-ketone values against which the KET-1 system's results are compared. It is not expert consensus, pathology, or outcomes data.
8. The sample size for the training set
The document does not provide any information about a training set. This is likely because the KET-1 Blood Ketone Monitoring System is a pre-calibrated electrochemical device, not an AI/machine learning model that typically requires a large training dataset. The "training" of such a device usually refers to the internal calibration and manufacturing processes, not the statistical training of a data-driven model.
9. How the ground truth for the training set was established
As there is no mention of a training set in the context of an AI/ML model, the establishment of ground truth for a training set is not applicable or described. The device's calibration and internal algorithms would be developed and validated through rigorous engineering and internal testing, using precisely known, manufactured control solutions and spiked samples, rather than a labeled training dataset in the AI sense.
Ask a specific question about this device
(192 days)
JIN
The TD-4140 Smart Dongle Blood Glucose plus [-ketone Monitoring System consists of the Smart Dongle blood glucose test strips, Smart Dongle {}-ketone test strips, and the Procheck mobile application as the display component of the system. This system is intended to be used for the quantitative measurement of glucose (sugar) and fketone in fresh capillary whole blood from the finger.
This system is intended for self-testing outside the body (in vitro diagnostic use) by people with diabetes at home as an aid to monitor the effectiveness of diabetes control. It is intended to be used by a single person and should not be shared. This system should not be used for the diagnosis of or screening for diabetes, nor for use on neonates.
The TD-4140 Smart Dongle Blood Glucose plus ß-ketone Monitoring System consists of the Smart Dongle meter, Smart Dongle blood glucose test strips, Smart Dongle 0-ketone test strips, and the Procheck mobile application as the display component of the system.
This system is compatible to iPhone series, including iPhone 4/4s, 5/5s, 6/6 plus, and iPod touch 5. These products have been designed, tested, and proven to work together as a system to produce accurate test results. The Smart Dongle meter should only be used with the Smart Dongle Blood Glucose test strips and the Smart Dongle ß-ketone test strips.
The provided text describes the TD-4140 Smart Dongle Blood Glucose plus ß-ketone Monitoring System, but only offers limited information on specific acceptance criteria for blood glucose and ß-ketone measurements. It reports accuracy and precision performance. The study described is a submission for 510(k) clearance, which typically involves demonstrating substantial equivalence to a predicate device through various performance characteristics, not necessarily a comparative effectiveness study with human readers.
Here's a breakdown of the available information:
1. Table of Acceptance Criteria and Reported Device Performance
Note: The document does not explicitly state "acceptance criteria" but rather presents performance results against implicit standards for glucose and ß-ketone meters. The ranges below are derived from the reported accuracy tables for blood glucose and ß-ketone.
Measurement Parameter | Acceptance Criteria (Implied from Performance Tables) | Reported Device Performance |
---|---|---|
Blood Glucose | ||
Accuracy: | For glucose |
Ask a specific question about this device
(422 days)
JIN
KetoSens Blood ß-Ketone Monitoring System is intended to be used for the quantitative measurement of f-Ketone (beta-hydroxybutyrate) level in capillary whole blood samples drawn from the fingertip. The KetoSens Blood B-Ketone Monitoring Systems are for self-testing outside the body (for in vitro diagnostic use) in the home as an aid to monitor the effectiveness of diabetes control program. The system is not in the diagnosis of or screening for diabetes mellitus and is not intended for use on neonates. This system is intended to be used by a single person and should not be shared.
The KetoSens Blood ß-Ketone Test Strips work with the KetoSens Blood ß-Ketone Meter to quantitatively measure Blood ß-Ketone in capillary whole blood samples drawn from the fingertip.
KetoSens Multi Blood p-Ketone Monitoring System is intended to be used for the quantitative measurement of f-Ketone (beta-hydroxybutyrate) level in capillary whole blood from the fingertip and venous EDTA whole blood. KetoSens Multi Blood ß-Ketone Monitoring System is intended for in vitro diagnostic use and is intended for multiple-patient use in professional healthcare settings as an aid to monitor the effectiveness of diabetes control program. The system is not intended for use in the diagnosis of or screening for diabetes mellitus and is not intended for use on neonates. This system should only be used with single-use, auto-disabling lancing devices.
The KetoSens Multi Blood p-Ketone Test Strips work with Blood ß-Ketone Meter to quantitatively measure Blood B-Ketone in capillary whole blood samples drawn from the fingertip and venous whole blood drawn in professional healthcare settings.
The KetoSens Blood ß-Ketone Monitoring System/KetoSens Multi Blood ß-Ketone Monitoring System consists of a meter, single use test strips, and control solutions with two different B-Ketone concentrations ("Control A" and "Control B" ranges).
The KetoSens Blood ß-Ketone Monitoring System/KetoSens Multi Blood ß-Ketone Monitoring System is based on an electrochemical biosensor technology (electrochemical). The System measures the Blood ß-Ketone level in whole blood samples using a small electrical current generated in the test strips.
This document focuses on the KetoSens Blood β-Ketone Monitoring System and its validation studies. It describes various performance tests conducted to ensure the device meets specified criteria, primarily focusing on accuracy, precision, and usability.
Here's an organized breakdown of the acceptance criteria and study details based on the provided text:
1. Table of Acceptance Criteria and Reported Device Performance
The document does not explicitly present a single table labeled "Acceptance Criteria." However, acceptance criteria are implicitly stated within the "System Accuracy Test" and "Consumer Study" results, and "Repeatability Test" and "Intermediate Precision Test" conclusions.
Test Type | Acceptance Criteria (Stated or Implied) | Reported Device Performance |
---|---|---|
Repeatability (Precision) | Pooled SD of concentrations 1, 2 should be 0.95). | Passed. Total r² = 0.9985 across 3 strip lots. |
System Accuracy (Capillary Blood) | At ketone At ketone At ketone ≥ 1.5 mmol/L: 33/33 (100%) within ± 20 %. | |
All 204 samples (100%) fell within specified ranges. | ||
System Accuracy (Venous Blood) | At ketone At ketone At ketone ≥ 1.5 mmol/L: 35/35 (100%) within ± 20 %. | |
All 204 samples (100%) fell within specified ranges. | ||
Consumer Study (Accuracy) | Capillary blood accuracy to satisfy system accuracy requirements (as defined above). | Passed. |
General user tests: 185/185 (100%) within ± 0.3 mmol/L (for ketone Trained user tests: 185/185 (100%) within ± 0.3 mmol/L (for ketone Capillary: 124/124 (100%) within ± 0.3 mmol/L for Venous: 121/123 (98.4%) within ± 0.3 mmol/L for
Ask a specific question about this device
(128 days)
JIN
The Healthy Me™ Ketone Reagent Strips for Urinalysis are intended for the qualitative and semi-quantitative detection of Ketone (Acetoacetic acid) in urine. The identification of ketones is used in the diagnosis of acidosis (a condition characterized by abnormally high acidity of body fluids) or ketosis (a condition characterized by increased production of ketone bodies such as acetone) and for monitoring patients on ketogenic diets.
The Healthy Me™ Ketone Reagent strips are intended for Over the Counter use by lay people with Diabetes and/or people on low carb diets at home to check for the ketones in urine. This product is not intended for the management of diabetes.
The On Call Ketone Reagent Strips for Urinalysis are intended for the qualitative and semi-quantitative detection of Ketone (Acetoacetic acid) in urine. The identification of ketones is used in the diagnosis of acidosis (a condition characterized by abnormally high acidity of body fluids) or ketosis (a condition characterized by increased production of ketone bodies such as acetone) and for monitoring patients on ketogenic diets.
The On Call Ketone Reagent strips are intended for Over the Counter use by lay people with Diabetes and/or people on low carb diets at home to check for the ketones in urine. This product is not intended for the management of diabetes.
On Call® & Healthy Me" Ketone Reagent Strips for Urinalysis consists of a Plastic Strip to which a regent pad is affixed. The reagent pad reacts with the urine and provides a visible color reaction. On Call® & Healthy Me™ Ketone Reagent Strips for Urinalysis are packaged along with a drying agent in a Canister bottle. Each strip is stable and ready to use upon removal from the Canister. The entire reagent strip is disposable. Results are obtained by direct comparison to the test strip with a color blocks printed on the bottle label. Accurate timing is essential to provide optimal results. No calculations or laboratory instruments are needed.
Here's an analysis of the provided text regarding the acceptance criteria and study for the On Call/Healthy Me Ketone Reagent Strips for Urinalysis:
Introduction to the Device
The device, On Call® & Healthy Me™ Ketone Reagent Strips for Urinalysis, is intended for the qualitative and semi-quantitative detection of acetoacetic acid (ketones) in urine. It's designed for over-the-counter use by laypersons, including those with diabetes or on low-carb diets, to monitor for ketones at home. The test is based on a color change reaction with nitroprusside and acetoacetic acid, ranging from light pink (negative) to darker pink/purple (positive).
Acceptance Criteria and Device Performance
Acceptance Criteria Category | Specific Criteria (if stated or inferred) | Reported Device Performance |
---|---|---|
Method Comparison Agreement | Accuracy against Predicate Device (Technician read) using Solution Concentrations: |
- Same block agreement: High agreement across all color blocks.
- Agreement within +/- one block: Very high agreement across all color blocks. | 1. Results of ACON Ketone by Layperson vs Bayer Ketostix by Technician at 3 Sites with solution concentrations matching color blocks:
- Same block agreement: 99.4% (ranging from 55/56 for 15 mg/dL to 60/60 for Neg, 5mg/dL, 40mg/dL, and 61/61 for 160mg/dL, and 60/61 for 80mg/dL).
- Agreement within +/- one block: 100.0%. |
| User Performance Agreement | Accuracy against Predicate Device (Technician read) using Participant Midstream Urine: - Same block agreement: High agreement across all color blocks where predicate showed results.
- Agreement within +/- one block: Very high agreement across all color blocks where predicate showed results. | 2. Participants' Midstream Urine with ACON Ketone Reagent Strips by Layperson vs Urine Collected in Cup with Bayer Ketostix by Technician at 2 sites:
- Same block agreement: 100% for observable results where data is provided (Neg, 5 mg/dL, 15 mg/dL, 40 mg/dL). Note: No results reported for 80 mg/dL or 160 mg/dL when read by layperson with ACON, while technician with Bayer showed 0 for these too. This suggests either these levels were not present in midstream urine or were not detected by either device/method. |
| Substantial Equivalence | Demonstrate substantial equivalence to the predicate device (Bayer Ketostix reagent strips K801270) in terms of intended use, principle, reagents, specimen, methodology, and performance. | The conclusion explicitly states: "The above mentioned results demonstrate that the On Call and Healthy Me Ketone reagent strips for urinalysis are substantially equivalent to legally marketed predicate device currently sold on the U.S. market." |
| Analytical Performance | Reference to prior 510(k) (K061559) for ACON Urinalysis Reagent Strips. | "The performance of Ketone reagent strips has been evaluated and present in 510k- K061559-ACON Urinalysis Reagent Strips." (The specific acceptance criteria from K061559 are not detailed here, but the statement implies they were met). |
| Clinical Sensitivity/Specificity | Not applicable; assumed to be covered by the method comparison and substantial equivalence to a predicate for which these were established. | Not Applicable. |
Study Details
-
Sample Size used for the test set and the data provenance:
- Study 1 (Solutions): 347 samples. These were solution concentrations designed to match the color blocks. The provenance is not explicitly stated beyond being conducted at "3 Sites." It's likely a controlled laboratory study rather than patient samples.
- Study 2 (Midstream Urine): 71 samples. These were "Participants' Midstream Urine." The provenance is not explicitly stated beyond being conducted at "2 sites." It's likely prospective collection for the purpose of the study.
-
Number of experts used to establish the ground truth for the test set and the qualifications of those experts:
- Ground truth was established by a "Technician" reading the predicate device (Bayer Ketostix).
- The number of technicians is not specified.
- Their qualifications are not specified (e.g., years of experience, specific certifications), other than being identified as "Technician."
-
Adjudication method for the test set:
- The document implies that the technician's reading of the predicate device was taken as the reference standard (ground truth). There is no mention of a
multi-reader adjudication method (e.g., 2+1, 3+1) for establishing this ground truth.
- The document implies that the technician's reading of the predicate device was taken as the reference standard (ground truth). There is no mention of a
-
If a multi-reader multi-case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:
- This was not an MRMC study comparing human readers with and without AI assistance. This study compared a layperson reading the investigational device against a technician reading a predicate device.
- Therefore, no effect size related to AI assistance for human readers is applicable or provided.
-
If a standalone (i.e., algorithm only without human-in-the-loop performance) was done:
- No, this device is a manual reagent strip read by a human (layperson). It does not involve an algorithm or AI.
-
The type of ground truth used (expert consensus, pathology, outcomes data, etc.):
- The ground truth was established by a "Technician" reading the predicate device (Bayer Ketostix) and comparing the color change to the color blocks. This is a form of reference standard comparison to a legally marketed predicate device, where the predicate read by a trained professional serves as the benchmark. For the first study, it was confirmed against known solution concentrations.
-
The sample size for the training set:
- The document does not explicitly state a separate "training set" for the current device. The performance evaluation presented is for the validation/test set. It mentions that "The performance of Ketone reagent strips has been evaluated and present in 510k- K061559-ACON Urinalysis Reagent Strips," implying a prior validation for a professional version of the device, which would have had its own training/test data.
-
How the ground truth for the training set was established:
- Since a training set for this specific submission is not specified, how its ground truth was established is not detailed in this document. For the predicate device (Bayer Ketostix) and the previously cleared professional device (K061559), the ground truth would have likely been established through reference laboratory methods (e.g., spectrophotometry, enzymatic assays) for quantitative ketone levels, which are then correlated with the semi-quantitative color scale.
Ask a specific question about this device
JIN
The Precision Xtra / Optium Blood ß-Ketone Test Strips are intended to quantitatively measure blood ß-Ketone (Beta-Hydroxybutyrate) in fresh capillary whole blood from the fingertip. The test strips are for use outside the body (in vitro diagnostic use) and are for self-testing or healthcare professional use. Healthcare professionals may also use venous whole blood samples, provided the samples are used within 30 minutes of collection. The test strip is to be used for ketone concentrations in persons with diabetes and other conditions.
The Precision® Xtra™ Diabetes Monitoring System utilizes amperometric biosensor technology to generate a current. The size of the current is proportional to the amount of ß-hydroxybutyrate (ß-ketone) present in the sample, providing a quantitative measure of ß-ketone in whole blood and control solutions.
The Abbott Precision Xtra Blood ß-Ketone Test Strips and Optium Blood ß-Ketone Test Strips are intended for the quantitative measurement of ß-ketone (Beta-Hydroxybutyrate) in fresh capillary whole blood and, for healthcare professionals, in venous whole blood samples within 30 minutes of collection. The device is for in vitro diagnostic use, for self-testing or professional use by individuals with diabetes and other conditions requiring ketone monitoring.
A study was conducted to demonstrate the substantial equivalence of the Precision Xtra Blood ß-Ketone Test Strips/Optium Blood ß-Ketone Test Strips to predicate devices (Precision Xtra Blood ß-Ketone Test Strips K983504 and Optium Blood ß-Ketone Test Strips K040814/K050814).
1. Table of Acceptance Criteria and Reported Device Performance:
The document mentions that various performance aspects were tested and passed, indicating they met established acceptance criteria, but it does not specify the numerical criteria themselves or the exact reported performance values. The performance studies verified the device through "non clinical testing in the laboratory."
Performance Characteristic | Acceptance Criteria (Implied: Passed) | Reported Device Performance (Implied: Acceptable/Comparable) |
---|---|---|
Altitude | Met predefined specifications | Verified as acceptable |
Dynamic Range | Met predefined specifications | Verified as acceptable |
Precision | Met predefined specifications | Verified as acceptable |
Linearity | Met predefined specifications | Verified as acceptable |
Accuracy | Met predefined specifications | Verified as acceptable |
Sample Volume | Met predefined specifications | Verified as acceptable |
Interference | Met predefined specifications | Verified as acceptable |
Sensor Movement | Met predefined specifications | Verified as acceptable |
Oxygen Sensitivity | Met predefined specifications | Verified as acceptable |
Sample Application (end/top fill) | Met predefined specifications | Verified as acceptable |
Environmental (e.g., temperature/humidity) | Met predefined specifications | Verified as acceptable |
Hematocrit | Met predefined specifications | Verified as acceptable |
pH | Met predefined specifications | Verified as acceptable |
Shipping | Met predefined specifications | Verified as acceptable |
2. Sample Size Used for the Test Set and Data Provenance:
The document does not explicitly state the sample sizes used for the non-clinical laboratory testing. The data provenance is stated as "non clinical testing in the laboratory," implying controlled laboratory conditions rather than patient data from a specific country. It is not specified whether the data was retrospective or prospective.
3. Number of Experts Used to Establish Ground Truth for the Test Set and Qualifications:
This information is not provided in the document. Given that the testing was "non clinical" and involved laboratory studies, it is unlikely that human experts were involved in establishing ground truth in the way described for clinical studies (e.g., radiologists interpreting images). Ground truth for these types of devices is typically established using a reference method or calibrated laboratory equipment.
4. Adjudication Method for the Test Set:
Not applicable, as this was non-clinical laboratory testing, not a clinical study involving human interpretation.
5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done:
No, an MRMC comparative effectiveness study was not done. The performance studies were non-clinical laboratory tests comparing the device to its predicate devices, not evaluating human reader improvement with or without AI assistance.
6. If a Standalone (Algorithm Only Without Human-in-the-Loop Performance) Was Done:
Yes, a standalone performance assessment was effectively done. The performance studies described are for the device (test strips) itself, evaluating its accuracy, precision, and other analytical characteristics in a laboratory setting, without direct human intervention in the result generation process beyond using the device as intended. The "algorithm" here would be the electrochemical reaction and measurement system of the biosensor technology.
7. The Type of Ground Truth Used:
The document does not explicitly state the type of ground truth. However, for "non clinical testing in the laboratory" of a quantitative measurement device, the ground truth would typically be established using:
- Reference methods: Highly accurate and precise laboratory methods (e.g., enzymatic reference methods for ß-ketone).
- Calibrated standards: Solutions with known, precise concentrations of ß-ketone.
8. The Sample Size for the Training Set:
The document does not contain information about a "training set." The mentioned studies are performance verification for the device, implying that the device's design and underlying technology were already established. For this type of in vitro diagnostic device, "training sets" are not typically used in the same manner as for machine learning algorithms.
9. How the Ground Truth for the Training Set Was Established:
Not applicable, as no training set is mentioned or implied for this non-clinical performance verification.
Ask a specific question about this device
(209 days)
JIN
The Neo Diagnostics KetoChecks is intended for the identification of ketones in urine and can be used in the diagnosis of acidosis (a condition characterized by abnormally high acidity of body fluids) or ketosis (a condition characterized by increased production of ketone bodies such as Acetoacetic acid) and for monitoring patients on ketogenic diets and patients with diabetes. The test is indicated for use by professionals and for Over the Counter use by lay people.
KetoChecks for Urinalysis is firm plastic strips to which a reagent area is affixed. Depending on the product being used, KetoChecks provides a test for Ketone (Acetoacetic acid) in Urine. Test results may provide information regarding the status of carbohydrate metabolism. Please refer to the outside box and bottle label for the specific test parameters of the product you are using.
KetoChecks is packaged along with a drying agent in a plastic bottle with a twist-off cap. Each strip is stable and ready to use upon removal from the bottle. The entire reagent strip is disposable. The directions must be followed exactly. Results are obtained by direct comparison of the test strip with the color blocks printed on the bottle label. Accurate timing is essential to provide optimal results. To obtain optimal results, it is necessary to use fresh, well-mixed, and uncentrifuged urine. No calculations or laboratory instruments are needed.
Here's an analysis of the acceptance criteria and the study proving the device meets them, based on the provided text for K033114:
Acceptance Criteria and Device Performance
The provided document defines accuracy based on the comparison of the KetoChecks strips to a color chart, which is itself determined by the color blocks on the bottle label. The closest thing to explicit "acceptance criteria" for performance is within the clinical correlation study, where the device (KetoChecks) is compared against a legally marketed predicate device (Bayer Ketostix).
Table of Acceptance Criteria and Reported Device Performance
Performance Metric | Acceptance Criteria (Implied by Predicate Equivalence) | Reported Device Performance (KetoChecks Lot 1 vs. Bayer Ketostix Lot 3A04A) |
---|---|---|
Agreement with predicate (Same Color Block) | High agreement with predicate device | 97.2% (212/218) |
Agreement with predicate (Within 1 Color Block) | Very high agreement with predicate device | 99.5% (217/218) |
Internal Consistency (Same Color Block for different lots) | High consistency between different lots | 97.1% (134/138) |
Internal Consistency (Within 1 Color Block for different lots) | Very high consistency between different lots | 99.3% (137/138) |
Note: The document explicitly states: "For visually read strips, accuracy is a function of the manner in which the color blocks on the bottle label are determined and the discrimination of the human eye in reading the test. Precision is difficult to assess in a test of this type because of the variability of the human eye. It is for this reason that users are encouraged to develop their own standards of performance." This implies that the primary acceptance criteria revolve around the device's ability to produce consistent results with its own color chart and to perform comparably to a well-established predicate device.
Study Details
The study presented focuses on establishing substantial equivalence to the Bayer Ketostix reagent strips.
-
Sample Size Used for the Test Set and Data Provenance:
- Test Set Sample Size:
- For the comparison of KetoChecks Lot 1 vs. Bayer Ketostix Lot 3A04A: 218 unknown urine samples were used.
- For the comparison of KetoChecks Lot 1 vs. KetoChecks Lot 2 (internal consistency): 138 unknown urine samples were used.
- Data Provenance: The document does not specify the country of origin. It indicates that "clinical tests" were performed, suggesting prospective collection of urine samples for the purpose of this evaluation. However, details on ethical approvals or patient demographics are not provided.
- Test Set Sample Size:
-
Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts:
- The document implies that the ground truth for the comparison was based on the visual readings of the KetoChecks strips and the Bayer Ketostix strips themselves. It does not mention an independent "ground truth" established by a panel of experts in the traditional sense, such as pathology or a gold standard instrument.
- For visually read strips, the document states, "Comparison to the color chart is dependent on the interpretation of the individual. It is, therefore, recommended that all laboratory personnel interpreting the results of these strips be tested for color blindness." This suggests that the "experts" are the "laboratory personnel" performing the visual comparisons, but their number and specific qualifications (e.g., years of experience as a lab technician) are not detailed.
-
Adjudication Method for the Test Set:
- No explicit adjudication method (like 2+1 or 3+1) is described. The results are presented as direct comparisons (e.g., "Same Color Block," "Within 1 Color Block"). It appears that the reading itself is the primary data point, and there's no mention of a process to resolve discrepancies between multiple readers, if multiple readers were used.
-
Multi Reader Multi Case (MRMC) Comparative Effectiveness Study:
- No, a formal MRMC comparative effectiveness study, as typically understood in the context of advanced AI devices, was not performed. The study is a comparison of two visual dipstick products, focused on agreement between the new device and the predicate device, not on how human readers' performance with or without AI-assistance improves clinical outcomes or accuracy compared to a true gold standard.
-
Standalone Performance:
- Yes, a standalone performance evaluation was done in the sense that the KetoChecks device was read visually by an individual and compared against the color chart provided with the device and also against the results obtained from the predicate device. It represents the inherent performance of the device and a human reader in tandem, without assistance from an AI algorithm. The device itself is solely a visual reagent test strip, so its "standalone" performance is its direct visual interpretability.
-
Type of Ground Truth Used:
- The primary "ground truth" for evaluating the KetoChecks' performance relative to the predicate was agreement with the Bayer Ketostix results. For internal consistency, the ground truth was the visual reading of the KetoChecks strip itself by the "individual" (presumably lab personnel). There is no mention of pathology, advanced laboratory instrumentation, or long-term clinical outcomes data being used as ground truth. This is typical for equivalence claims for simple diagnostic strips.
-
Sample Size for the Training Set:
- This question is not applicable in the context of this device and study. The KetoChecks is a chemical reagent strip for visual interpretation, not a machine learning or AI-based device that requires a "training set" of data in the computational sense. The "training" for such a device would involve optimizing the chemical reagents and color chart design.
-
How the Ground Truth for the Training Set Was Established:
- This question is not applicable for the same reasons as point 7. The "ground truth" for the development of such a strip would involve precise chemical formulations and calibration against known concentrations of ketones to ensure proper color development at specific thresholds, but this is not a "training set" in the AI sense.
Ask a specific question about this device
(121 days)
JIN
Ask a specific question about this device
(312 days)
JIN
Ask a specific question about this device
Page 1 of 2