Search Results
Found 4 results
510(k) Data Aggregation
(35 days)
HiChem Cholesterol Reagent is intended for the quantitative determination of total cholesterol in serum and plasma for the diagnosis and treatment of disorders involving excess cholesterol in the blood and lipid and lipoprotein metabolism disorders.
The HiChem Cholesterol Reagent determines cholesterol through the enzymatic action of cholesterol esterase, cholesterol oxidase and peroxidase. The resulting increase in absorbance at one of interested estable concessed on concentration in the sample.
Here's an analysis of the acceptance criteria and the studies performed for the HiChem Cholesterol Reagent, based on the provided text.
1. Table of Acceptance Criteria and Reported Device Performance
The document describes two scenarios: the HiChem Cholesterol Reagent as a manual procedure and the HiChem Cholesterol Reagent used as a secondary reagent on Beckman® SYNCHRON CX® Systems. The acceptance criteria are largely implied by the reported performance figures, as specific pre-defined thresholds aren't explicitly stated as "acceptance criteria." However, the comparisons to the predicate device and specified ranges (e.g., linearity) serve as the de facto criteria.
Scenario 1: HiChem Cholesterol Reagent (Manual Procedure)
| Metric | Acceptance Criteria (Implied) | Reported Device Performance |
|---|---|---|
| Linearity | Performance should be linear from 5 mg/dL to 750 mg/dL. | Linear from 5 mg/dL to 750 mg/dL. Regression: (HiChem Recoveries) = 3.7 mg/dL + 0.975 × (Standard Factors), r² = 1.000 Sv.x = 4.11 mg/dL. df = 11 |
| Precision (Within-run) | Not explicitly stated, but expected to be low for control sera. | Serum control 1 (109 mg/dL): 0.85 mg/dL Serum control 2 (226 mg/dL): 1.46 mg/dL Serum control 3 (501 mg/dL): 3.12 mg/dL |
| Precision (Total) | Not explicitly stated, but expected to be low for control sera. | Serum control 1 (109 mg/dL): 0.92 mg/dL Serum control 2 (226 mg/dL): 1.90 mg/dL Serum control 3 (501 mg/dL): 4.47 mg/dL |
| Method Comparison | Results should be equivalent to the Beckman® Cholesterol Reagent. | (HiChem Results) = 12 mg/dL + 0.957 × (Beckman® Results) r² = 0.966 S(y.x) = 8.1 |
| Anticoagulant Interference | Bias due to additives should be minimal. | Bias < 2.5 mg/dL cholesterol. |
| Detection Limit | Claimed limit of 5 mg/dL should be met or exceeded. | Observed detection limit: 3.2 mg/dL (below claimed 5 mg/dL). |
Scenario 2: HiChem Cholesterol Reagent on Beckman® SYNCHRON CX® Systems
| Metric | Acceptance Criteria (Implied) | Reported Device Performance |
|---|---|---|
| Linearity | Performance should be linear from 5 mg/dL to 750 mg/dL. | Linear from 5 mg/dL to 750 mg/dL. Regression: (HiChem Recoveries) = -1.0 mg/dL + 0.964 × (Standard Factors), sv.x = 8.9 ma/dL. df = 11 |
| Precision (Within-run) | Not explicitly stated, but expected to be low for control sera. | Serum control 1 (105 mg/dL): 1.8 mg/dL Serum control 2 (217 mg/dL): 1.2 mg/dL Serum control 3 (504 mg/dL): 2.8 mg/dL |
| Precision (Total) | Not explicitly stated, but expected to be low for control sera. | Serum control 1 (105 mg/dL): 1.4 mg/dL Serum control 2 (217 mg/dL): 2.5 mg/dL Serum control 3 (504 mg/dL): 2.5 mg/dL |
| Method Comparison | Results should be equivalent to the Beckman® CHOL Reagents. | (HiChem Results) = -3.6 mg/dL + 0.993 x (Beckman® Results) r² = 0.983 S(y.x) = 6.1 |
| Anticoagulant Interference | Bias due to additives should be minimal. | Bias < 1 mg/dL cholesterol and statistically insignificant. |
| Detection Limit | Claimed limit of 5 mg/dL should be met or exceeded. | Observed detection limit: 2.7 mg/dL (below claimed 5 mg/dL). |
| Calibration Stability | Changes in recoveries over 14 days < 2.6% (and < 3% manufacturer's precision claim). | Changes < 2.6% over 14 days. |
| Reagent Stability | Changes in recoveries over 30 days < 2.6% (and < 3% manufacturer's precision claim). | Changes < 2.6% over 30 days. |
2. Sample Size Used for the Test Set and Data Provenance
-
Manual Procedure Test Set:
- Linearity Standards: 12 points (df=11, representing n=12 measurements or independent standards).
- Precision Control Sera:
- Serum control 1: n = 29 replicates
- Serum control 2: n = 30 replicates
- Serum control 3: n = 30 replicates
- Method Comparison (Serum/Plasma): 113 mixed serum and plasma specimens.
- Anticoagulant Interference: Spiked and unspiked serum pools (number not specified).
- Detection Limit: Repetitive assay of a cholesterol standard (number of replicates not specified, but sufficient to calculate 3 standard deviations).
-
Beckman® SYNCHRON CX® Systems Test Set:
- Linearity Standards: 12 points (df=11, representing n=12 measurements or independent standards).
- Precision Control Sera:
- Serum control 1: n = 60 replicates
- Serum control 2: n = 60 replicates
- Serum control 3: n = 60 replicates
- Method Comparison (Serum/Plasma): 154 mixed serum and plasma specimens.
- Anticoagulant Interference: Spiked and unspiked serum pools (number not specified).
- Detection Limit: 30 replicate study of a cholesterol standard.
- Stability Studies: Serum controls assayed over claimed periods (number of controls and frequency not specified).
-
Data Provenance: Not explicitly stated (e.g., country of origin). The studies appear to be prospective as they are designed experiments to test the performance of the HiChem reagent under controlled conditions, rather than analysis of pre-existing clinical data.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts
This type of information is not applicable to this device. The HiChem Cholesterol Reagent is an in vitro diagnostic (IVD) reagent intended for quantitative determination of a chemical analyte (cholesterol). The "ground truth" for linearity, precision, and agreement with a predicate device is established through:
- Controlled standards with known concentrations.
- Reference methods or predicate devices (Beckman® SYNCHRON® Systems Cholesterol Reagent).
- Statistical analysis of repeated measurements.
There are no human experts "establishing ground truth" in the way one might for image analysis or disease diagnosis.
4. Adjudication Method for the Test Set
Not applicable. As noted above, the assessment involves comparing numerical results to established standards or a predicate device, not subjective interpretation requiring adjudication among experts.
5. If a Multi Reader Multi Case (MRMC) Comparative Effectiveness Study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance
Not applicable. This device is an IVD reagent, not an AI-assisted diagnostic tool that would involve human readers interpreting results.
6. If a standalone (i.e., algorithm only without human-in-the-loop performance) was done
The studies conducted for the HiChem Cholesterol Reagent can be considered standalone in the sense that they evaluate the performance of the reagent (and the associated analytical system) without human interpretation of the results to establish a diagnosis. The "human-in-the-loop" aspect here is the laboratory technician performing the test or operating the analyzer, but their role is instrumental, not interpretive in establishing the final quantitative value. The performance metrics (linearity, precision, correlation) are direct outputs of the device system.
7. The Type of Ground Truth Used
The ground truth used in these studies consists of:
- Known concentrations of linearity standards: For linearity studies.
- Reference measurements from the predicate device (Beckman® SYNCHRON® Systems Cholesterol Reagent): For method comparison studies.
- Expected values of commercially available control sera: For precision and stability studies.
- Spiked samples with known additive concentrations: For anticoagulant interference studies.
- Statistical determination from repeated measurements: For detection limit.
8. The Sample Size for the Training Set
Not applicable. This device is a chemical reagent and an enzymatic assay, not a machine learning model. Therefore, there is no "training set" in the context of AI or algorithm development. The performance characteristics are inherent to the chemical reactions and analytical methods.
9. How the Ground Truth for the Training Set Was Established
Not applicable (as it's not an AI/ML device). If considering the development and optimization of the reagent itself, the "ground truth" for developing the formulation would have been established through iterative biochemical testing and optimization against known cholesterol standards and samples, similar to how the performance is validated.
Ask a specific question about this device
(41 days)
HiChem Phosphorus Reagent is intended for the quantitative determination of inorganic phosphorus in serum, plasma and urine for the diagnosis and treatment of various disorders including parathyroid gland and kidney diseases, and vitamin D imbalance.
The HiChem Phosphorus Reagent determines phosphorus by its reaction with molybdate in an acidic solution to form a phosphomolybdate complex. The resulting increase in absorbance at 340 nm is proportional to the phosphorus concentration in the sample.
The HiChem Phosphorus Reagent is an adaptation of the method first described by Simonsen and is intended for use with manual spectrophotometers or clinical analyzers which can automate the required manipulations.
Here's a breakdown of the HiChem Phosphorus Reagent device's acceptance criteria and the study information as detailed in the provided document:
This document describes a diagnostic reagent, not an AI/ML powered device, therefore some of the requested information (like MRMC studies, number of experts for ground truth, adjudication methods) is not applicable. I will provide the information that is applicable based on the provided text.
1. Table of Acceptance Criteria and Reported Device Performance
| Performance Metric | Acceptance Criteria (Manual Procedure) | Reported Device Performance (Manual Procedure) | Acceptance Criteria (SYNCHRON CX® Systems) | Reported Device Performance (SYNCHRON CX® Systems) |
|---|---|---|---|---|
| Linearity Range | 0.1 - 15 mgP/dL | 0.1 - 15 mgP/dL (Linear) | 1.0 - 12.0 mgP/dL | At least 1.0 - 12.0 mgP/dL (Linear) |
| r² (Correlation) | Implied high correlation | 1.000 (Manual) | Implied high correlation | 1.000 (SYNCHRON CX®) |
| Sensitivity | 0.1 mgP/dL (Claimed) | 0.05 mgP/dL (Observed, < 0.1 mgP/dL) | 0.1 mgP/dL (Claimed) | 0.3 mgP/dL (Observed, > 0.1 mgP/dL, but sensitivity claim is 1.0 mgP/dL. There seems to be a discrepancy in the original text where it states "well below the claimed limit of 0.1 mgP/dL" after stating the sensitivity claim is 1.0 mgP/dL. I will assume the 1.0 mgP/dL is the correct claim for the SYNCHRON CX® system and 0.3 mgP/dL is well below that.) |
| Precision (Within-run SD) | Implied low variation | 0.02 - 0.07 mgP/dL (Serum) 0.00 - 0.06 mgP/dL (Urine) | Implied low variation | 0.08 - 0.11 mgP/dL (Serum) 0.08 - 0.11 mgP/dL (Urine) |
| Precision (Total SD) | Implied low variation | 0.03 - 0.08 mgP/dL (Serum) 0.00 - 0.07 mgP/dL (Urine) | Implied low variation | 0.09 - 0.13 mgP/dL (Serum) 0.11 - 0.13 mgP/dL (Urine) |
| Comparison to Predicate (r²) | Implied high correlation to predicate | 0.985 (Serum/Plasma), 0.999 (Urine) | Implied high correlation to predicate | 0.972 (Serum/Plasma), 0.996 (Urine) |
| Chemical Additive Bias | < 0.1 mgP/dL | < 0.1 mgP/dL | < 0.15 mgP/dL | < 0.15 mgP/dL |
| Calibration/Reagent Stability | Not explicitly stated in criteria for manual, but demonstrated. | Documented via assay of controls/pools | Implied stable results over claimed periods | Imprecision < 0.3 mgP/dL or 3% (manufacturer's claim) |
2. Sample Sizes Used for the Test Set and Data Provenance
- Linearity Standards:
- Manual procedure: Data from "linearity standards" (number not explicitly stated, but regression done with df = 23, suggesting 24 data points or more).
- SYNCHRON CX® Systems: 6 linearity standards were used.
- Precision Studies:
- Manual procedure: 30 replicates for each of 2 serum controls and 2 urine pools.
- SYNCHRON CX® Systems: 60 replicates for each of 3 serum controls and 2 urine pools.
- Sensitivity determination: 30 replicates of a diluted serum control.
- Comparison to Predicate Device:
- Manual procedure: 95 mixed serum and plasma specimens, and 44 urine specimens.
- SYNCHRON CX® Systems: 153 mixed serum and plasma specimens.
- Chemical Additives: Spiked and unspiked serum pools (number not specified).
- Calibration/Reagent Stability (SYNCHRON CX® Systems): Serum controls and urine pools were assayed over claimed periods (number of samples/pools not specified).
Data Provenance: Not explicitly stated (e.g., country of origin, retrospective/prospective). However, such studies for in vitro diagnostics are typically conducted in a laboratory setting under controlled conditions. The studies are prospective in the sense that they are specifically designed to test the performance of the new reagent.
3. Number of Experts Used to Establish Ground Truth for the Test Set and Their Qualifications
Not applicable. This is a chemical reagent, and the "ground truth" for phosphorus concentration is established by the reference method (predicate device, or the actual concentration of spiked standards), not by expert consensus or interpretation.
4. Adjudication Method for the Test Set
Not applicable. The comparisons are quantitative measurements against either known standards or a legally marketed predicate device, not subjective interpretations requiring adjudication.
5. If a Multi Reader Multi Case (MRMC) Comparative Effectiveness Study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance
Not applicable. This device is an in vitro diagnostic reagent, not an AI-powered diagnostic imaging or interpretation tool. There are no human readers involved in the "interpretation" of the phosphorus concentration in the same way there would be for an AI-assisted diagnostic.
6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) was done
Yes, in essence, the entire study is "standalone" performance. The HiChem Phosphorus Reagent, once integrated with a spectrophotometer or clinical analyzer, performs its function (quantifying phosphorus) without human intervention in the measurement process itself. The performance data presented (linearity, precision, correlation to predicate) is the standalone performance of the reagent.
7. The Type of Ground Truth Used
The ground truth for this device is established by:
- Known concentrations: For linearity standards and sensitivity studies, the ground truth is the known, pre-determined concentration of phosphorus in the prepared standards.
- Reference method/device: For comparison studies, the "ground truth" (or reference) is the measurements obtained from the legally marketed predicate devices (BMD® Phosphorus Reagent on the Hitachi® 704 and Beckman® SYNCHRON® Systems Phosphorus Reagent on the SYNCHRON CX® Systems). The comparison aims to show substantial equivalence to these established methods.
8. The Sample Size for the Training Set
Not applicable. This is a chemical reagent and does not involve AI/Machine Learning models that require training sets in the computational sense. The "training" in developing such a reagent would be chemical formulation and optimization, not data-driven model training.
9. How the Ground Truth for the Training Set was Established
Not applicable, as there is no "training set" in the context of AI/ML for this device.
Ask a specific question about this device
(65 days)
HiChem CK/NAC Reagent (product no. 70003) is intended for the quantitation of creatine kinase in serum and n homent of had not headly no room, seevated serum creatine kinase are diseases of the heart and skeletal muscle.
The HiChem CK/NAC Reagent determines creatine kinase by enzymation of adenosine diphosphate in the The rionoment of creatine the sphosphate. The rate of this reaction, and the activity of creatine kinase in the sociment is determined through the measurement of NADH which is formed through a series of linked enzymatic reactions.
The HiChern CK/NAC Reagent is intended to be used either as a manual procedure or on clinical analyzers which can THE HONEY ON WO Treagon IS The reagent is supplied as two liquit-stable components which are combined, ether adomails no roquined manyalance "The reason is to to series CK/NAC Reagent Buffer. The CK/NAC Bubstrate can also be used as a start reagent and combined with the Reagent Buffer following sample addition.
Here's an analysis of the provided text, focusing on the acceptance criteria and the study that proves the device meets them:
Device: HiChem CK/NAC Reagent (product no. 70003)
Intended Use: Quantitation of creatine kinase in serum. Elevated serum creatine kinase levels indicate diseases of the heart and skeletal muscle.
1. Table of Acceptance Criteria and Reported Device Performance
The document describes several performance characteristics for both manual and automated (Hitachi 704) procedures. The acceptance criteria are implicitly derived from the reported performance, as the document states these demonstrate the effectiveness of the reagent. For linearity and precision, the reported values often serve as the acceptance criteria themselves within the context of demonstrating "effectiveness." For comparison studies and stability, the acceptance criteria are explicitly stated as biases/shifts being below certain thresholds or strong correlation coefficients.
| Performance Metric | Acceptance Criteria (Implicit/Explicit) | Reported Device Performance (Manual Procedure) | Reported Device Performance (Automated Hitachi 704) |
|---|---|---|---|
| Linearity | Recovery of linearity standards should span the claimed linear range with strong correlation (high r²) and low standard error (s_yx). For 30°C: linear to at least 2000 U/L. For 37°C: linear to at least 2000 U/L. | 30°C: Linear to at least 2000 U/L. (Recoveries at 30°C) = 6.1 U/L + 0.9918 x (Standard Activity), r² = 0.9998, s_yx = 8.1 U/L. 37°C: Linear to at least 2000 U/L. (Recoveries at 37°C) = 2.5 U/L + 0.9867 x (Standard Activity), r² = 0.9998, s_yx = 10.7 U/L. | Linear to at least 2,400 U/L. (HiChem Recoveries) = -0.2 U/L + 1.0013 x (Activity), r² = 1.0000, s_yx = 3.4 U/L. |
| Precision (Within-run SD & Total SD) | Implied acceptable precision for different concentration levels. | Serum control 1 (50 U/L): Within-run SD = 1.5 U/L, Total SD = 1.6 U/L. Serum control 2 (378 U/L): Within-run SD = 5.3 U/L, Total SD = 7.8 U/L. Serum control 3 (1048 U/L): Within-run SD = 10.3 U/L, Total SD = 18.6 U/L. | Serum control 1 (53 U/L): Within-run SD = 0.9 U/L, Total SD = 1.2 U/L. Serum control 2 (415 U/L): Within-run SD = 1.4 U/L, Total SD = 3.0 U/L. Serum control 3 (1183 U/L): Within-run SD = 3.4 U/L, Total SD = 6.9 U/L. |
| Method Comparison (Reference Reagent) | Strong correlation (high r²) and low standard error (s_yx) when compared to a legally marketed predicate device, with an acceptable slope and intercept close to 1 and 0, respectively. | Compared to Sigma Reagent: (HiChem Results) = 0.6 U/L + 0.990 x (Sigma Results), s_yx = 8.5 U/L, r² = 0.991. | Compared to BMD Reagent: (HiChem Results) = 0.0 U/L + 1.048 x (BMD Results), r = 0.9994, s_yx = 3.05 U/L. |
| Chemical Additives (Heparin, EDTA) | Biases observed should be less than 2% and statistically insignificant at the 95% confidence level compared to unspiked pools. | Biases less than 2% and statistically insignificant at the 95% confidence level. | Not applicable (not mentioned for automated procedure specifically). |
| Reagent Stability (Combined Working Reagent) | Observed shifts in standard recovery should be less than the greater of 4 U/L or 5% (for 2 weeks at 2-8°C and 1 day at 18-25°C). | Observed shifts in standard recovery were less than the greater of 4 U/L or 5%. (Tested over 2 weeks at 2-8°C and 1 day at 18-25°C with control sera from 50 to 1200 U/L CK at 37°C). | Not applicable (not mentioned for automated procedure specifically, but general stability is addressed below). |
| Calibration Stability | Observed shifts in recoveries over 24 hours without calibration should be less than the greater of 1 U/L or 0.25%. | Not applicable (specific to automated procedure). | Observed shifts in recoveries over 24 hours without calibration were less than the greater of 1 U/L or 0.25%. (Tested with control sera spanning 50 to 1,200 U/L CK). |
| On-Board Stability | Observed shifts in recoveries over the 21-day stability claim should be no greater than 3.5%. | Not applicable (specific to automated procedure). | Observed shifts in recoveries over the 21-day stability claim were no greater than 3.5%. (Tested with the same serum controls). |
Study that Proves the Device Meets the Acceptance Criteria:
The document itself constitutes the summary of the studies performed to demonstrate safety and effectiveness, and ultimately, substantial equivalence to predicate devices. It describes a series of experiments and analyses for both manual and automated use of the HiChem CK/NAC Reagent.
2. Sample Sizes Used for the Test Set and Data Provenance
-
Linearity (Manual): "linearity standards" (number not specified explicitly, but implies multiple points across the range).
-
Precision (Manual): 30 replicates per serum control level (3 levels tested).
-
Method Comparison (Manual): 90 mixed serum and plasma specimens.
-
Chemical Additives (Manual): "spiked and unspiked serum pools" (number of pools/samples not specified, but implies comparative testing).
-
Reagent Stability (Manual): "serum controls" (number of controls/data points not specified explicitly, but ranges from 50 to 1200 U/L CK).
-
Linearity (Automated): "eleven linearity standards."
-
Precision (Automated): 60 replicates per serum control level (3 levels tested).
-
Method Comparison (Automated): 126 mixed serum and plasma specimens.
-
Calibration Stability (Automated): "serum controls" spanning approximately 50 to 1,200 U/L CK (number of controls/data points not specified explicitly).
-
On-board Stability (Automated): "the same serum controls" as for calibration stability (number of controls/data points not specified explicitly).
Data Provenance: Not explicitly stated (e.g., country of origin, retrospective or prospective). Given the nature of laboratory reagent testing for product submission, it is typically understood that these are prospective studies conducted in a controlled lab environment.
3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts
This type of study does not involve "experts" establishing ground truth in the traditional sense of medical image interpretation (e.g., radiologists). Instead, the "ground truth" for the test set is established by:
- Reference materials: Known concentration "linearity standards" for linearity testing, "commercially available control sera" with known target values for precision testing.
- Predicate devices: The legally marketed Sigma Diagnostics Creatine Kinase (CK) Reagent and BMD CK/NAC Reagent serve as the reference standard (the "ground truth" or comparative standard) for method comparison studies.
Therefore, the concept of "number of experts" and their "qualifications" is not applicable here.
4. Adjudication Method for the Test Set
Not applicable. This is not a study requiring adjudication of interpretations (e.g., by multiple readers). The results are quantitative measurements compared against known values or established predicate methods.
5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was done
No, an MRMC comparative effectiveness study was not done. This type of study is relevant for diagnostic devices that involve human interpretation of images or other subjective data, which is not the case for a quantitative chemical reagent.
6. If a Standalone (i.e. algorithm only without human-in-the-loop performance) was done
This is essentially a standalone (algorithm/reagent only) performance study. The reagent itself, combined with either manual pipetting and spectrophotometry or an automated analyzer, generates the results. There isn't a "human-in-the-loop" component in the interpretation of the result from the device, only in the operation of the manual procedure. The automated procedure is even less human-in-the-loop for the measurement process.
7. The Type of Ground Truth Used
The ground truth used several forms:
- Reference Standards/Materials: For linearity, commercially prepared "linearity standards" with known, accurate creatine kinase concentrations are used. For precision, "commercially available control sera" with established target values are used.
- Predicate Device Measurements: For method comparison, the measurements obtained from legally marketed predicate devices (BMD CK/NAC Reagent and Sigma Diagnostics Creatine Kinase (CK) Reagent) on the same patient specimens serve as the comparative ground truth.
8. The Sample Size for the Training Set
Not applicable. This is a chemical reagent, not a machine learning algorithm that requires a "training set." The performance characteristics are derived from direct experimental measurements. The phrase "training set" is generally used in the context of AI/ML model development.
9. How the Ground Truth for the Training Set was Established
Not applicable, as there is no training set for this type of device.
Ask a specific question about this device
(78 days)
HiChem BUN/Urea Reagent (product no. 70006) is for the quantitative determination of urea nitrogen in serum. plasma and urine. Plasma urea levels are affected by a wide variety of factors including diet, increased protein catabolism and mild dehydration as well as many renal diseases. The major value of plasma urea measurement is in distinguishing between renal and non-renal related causes.
The HiChem BUN/Urea Reagent determines urea nitrogen through enzymatic hydrolysis by urease. The rate of this reaction, and the quantity of urea nitrogen in the specimen is monitored through the measurement of the resulting ammonia which oxidizes NADH to NAD in the presence of ox-keto-glutarate and glutamate dehydrogenase. The reagent is supplied as two liquid-stable reagent components which are intended to be combined, either before or during use, in the approximate ratio of 1 part BUN/Urea Enzyme Reagent and 5 parts BUN/Urea Buffer. The BUN/Urea Enzyme Reagent can also be used as a start reagent and combined with the reagent buffer after sample addition.
This document describes the performance of the HiChem BUN/Urea Reagent and compares it to existing reagents, rather than an AI-powered device. Therefore, many of the requested elements for an AI device study (e.g., sample size for AI test set, number of experts for ground truth, adjudication method, MRMC study, standalone performance, training set details) are not applicable.
However, I can extract the acceptance criteria and reported performance based on the provided text for the HiChem BUN/Urea Reagent.
1. Table of Acceptance Criteria and Reported Device Performance
The document doesn't explicitly state "acceptance criteria" with numerical thresholds for all evaluated aspects. Instead, it presents performance metrics and makes claims about substantial equivalence to predicate devices, linearity, and stability. I will infer acceptance criteria where possible from the claims made (e.g., linearity to at least 150 mgN/dL, shifts less than specified values for stability). For comparative studies, the acceptance is implied if the regression statistics (r², Sy.x) demonstrate strong agreement with the predicate device.
Manual Procedure:
| Performance Characteristic | Acceptance Criteria (Inferred) | Reported Device Performance (HiChem BUN/Urea Reagent) |
|---|---|---|
| Precision | Demonstrated by replicate assay | Low serum control (n=30): Mean 8.7 mgN/dL, within run SD 0.48 mgN/dL, total SD 0.58 mgN/dL Mid. serum control (n=30): Mean 25.7 mgN/dL, within run SD 0.73 mgN/dL, total SD 0.70 mgN/dL High serum control (n=30): Mean 52.1 mgN/dL, within run SD 0.93 mgN/dL, total SD 1.02 mgN/dL Low urine pool (n=30): Mean 15.4 mgN/dL, within run SD 0.71 mgN/dL, total SD 0.90 mgN/dL High urine pool (n=30): Mean 53.3 mgN/dL, within run SD 1.20 mgN/dL, total SD 1.54 mgN/dL |
| Linearity | Linear to at least 150 mgN/dL | Regression: (HiChem Results) = 0.1 mgN/dL + 0.986 × (Standard Value), r² = 1.000, Sy.x = 0.5 mgN/dL. (Spans claimed linear range) |
| Method Comparison (Serum/Plasma vs. Sigma) | Demonstrates substantial equivalence and produces equivalent results with clinical purpose. Implied strong correlation (high r²) and low bias (Sy.x). | 80 mixed serum and plasma specimens: (HiChem Results) = 0.7 mgN/dL + 0.977 × (Sigma Results) r² = 0.996, Sy.x = 1.00 mgN/dL |
| Method Comparison (Urine vs. BMD) | Demonstrates substantial equivalence and produces equivalent results with clinical purpose. Implied strong correlation (high r²) and low bias (Sy.x). | 39 urine specimens: (HiChem Results) = 1.9 mgN/dL + 0.966 × (BMD Results) r² = 0.990, Sy.x = 1.82 mgN/dL |
| Interfering Substances (Additives) | Observed differences less than 1% and statistically insignificant | Use of sodium and lithium heparin, EDTA, citrate, and iodoacetate are acceptable. Observed differences < 1% and statistically insignificant in comparison of spiked and unspiked serum pools. |
| Reagent Stability (Combined Working Reagent) | Shifts in standard recovery less than the greater of 3 mgN/dL or 3% | Over 1 month at 2-8°C and 4 days at 18-25°C. In all cases, shifts in standard recovery were less than the greater of 3 mgN/dL or 3%. |
Automated Hitachi 704 Procedure:
| Performance Characteristic | Acceptance Criteria (Inferred) | Reported Device Performance (HiChem BUN/Urea Reagent on Hitachi 704) |
|---|---|---|
| Precision | Demonstrated by replicate assay | Low serum control (n=60): Mean 13.9 mgN/dL, within run SD 0.59 mgN/dL, total SD 0.81 mgN/dL Mid. serum control (n=60): Mean 52.7 mgN/dL, within run SD 0.60 mgN/dL, total SD 0.77 mgN/dL High serum control (n=60): Mean 78.8 mgN/dL, within run SD 0.70 mgN/dL, total SD 1.09 mgN/dL Low urine pool (n=60): Mean 21.9 mgN/dL, within run SD 0.54 mgN/dL, total SD 0.52 mgN/dL High urine pool (n=60): Mean 75.3 mgN/dL, within run SD 0.85 mgN/dL, total SD 2.91 mgN/dL |
| Linearity (vs. BMD standards) | Equivalent between HiChem and BMD BUN Reagents, spanning 0-150 mgN/dL | Regression: (HiChem Results) = 0.0 mgN/dL + 1.005 x (BMD Results), r² = 1.000, Sy.x = 0.6 mgN/dL. (Spans claimed linear range of 0 to 150 mgN/dL) |
| Method Comparison (Serum/Plasma vs. BMD) | Demonstrates substantial equivalence and produces equivalent results with clinical purpose. Implied strong correlation (high r²) and low bias (Sy.x). | 190 mixed serum and plasma specimens: (HiChem Results) = 0.0 mgN/dL + 1.009 × (BMD Results) r² = 0.999, Sy.x = 0.6 mgN/dL |
| Method Comparison (Urine vs. BMD) | Demonstrates substantial equivalence and produces equivalent results with clinical purpose. Implied strong correlation (high r²) and low bias (Sy.x). | Not explicitly stated count, assumed part of 190 mixed specimens or similar: (HiChem Results) = 0.1 mgN/dL + 1.027 × (BMD Results) r² = 0.999, Sy.x = 0.7 mgN/dL |
| Calibration Stability | Observed shifts in recoveries less than the greater of 2 mgN/dL or 2% over 48 hours | Serum controls spanning 8 to 132 mgN/dL urea nitrogen. In all cases, shifts in recoveries over the calibration period were less than the greater of 2 mgN/dL or 2% over 48 hours. |
2. Sample size used for the test set and the data provenance (e.g. country of origin of the data, retrospective or prospective)
-
Test Set Sample Sizes:
- Precision (Manual):
- Low, Mid, High serum controls: n = 30 for each
- Low, High urine pools: n = 30 for each
- Method Comparison (Manual):
- Serum and plasma specimens vs. Sigma: n = 80
- Urine specimens vs. BMD: n = 39 (diluted with normal saline)
- Interfering Substances: "Spiked and unspiked serum pools" (number not specified)
- Precision (Automated Hitachi 704):
- Low, Mid, High serum controls: n = 60 for each
- Low, High urine pools: n = 60 for each
- Method Comparison (Automated Hitachi 704):
- Mixed serum and plasma specimens vs. BMD: n = 190 (diluted with normal saline)
- Urine comparison: (assumed to be part of or similar to the 190 specimens, not explicitly stated as a separate count)
- Calibration Stability: Serum controls spanning 8 to 132 mgNdL (number not specified, but tested over time)
- Precision (Manual):
-
Data Provenance: The document does not specify the country of origin for the samples or whether the study was retrospective or prospective. Given the nature of a 510(k) submission for a diagnostic reagent in the USA, it is likely that the studies were conducted in the USA using samples that would be representative of a general patient population. The studies appear to be prospective experimental evaluations of the reagent's performance.
3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g. radiologist with 10 years of experience)
- Not Applicable. This is a chemical reagent study, not an imaging or diagnostic AI study requiring expert adjudication of ground truth in the traditional sense. The "ground truth" for method comparisons is established by the results obtained from the predicate/comparable reagents (Sigma BUN (Rate) Reagent and BMD BUN Reagent), which are themselves established and validated clinical chemistry methods. For linearity and precision studies, the "ground truth" is based on known concentrations of standards and controls.
4. Adjudication method (e.g. 2+1, 3+1, none) for the test set
- Not Applicable. As mentioned above, this is not an AI diagnostic study involving human interpretation that would require an adjudication method.
5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance
- Not Applicable. This is a performance study for a chemical reagent, not an AI-assisted diagnostic device that would involve human readers.
6. If a standalone (i.e. algorithm only without human-in-the loop performance) was done
- Yes, this is essentially a standalone performance study. The HiChem BUN/Urea Reagent, both manually and on the Hitachi 704, operates as a standalone chemical test. Its performance is evaluated independently and then compared to predicate devices. There is no "human-in-the-loop" component in the direct measurement process of the reagent itself, beyond standard laboratory procedures for sample handling and instrument operation.
7. The type of ground truth used (expert consensus, pathology, outcomes data, etc)
- The "ground truth" for this study is multifactorial:
- Known concentrations: For linearity and precision studies, commercially available control sera and urine pools, as well as linearity standards, are used, which have established, known concentrations of urea nitrogen.
- Reference Method/Predicate Device Results: For method comparison studies, the results from the predicate devices (Sigma BUN (Rate) Reagent and BMD BUN Reagent) are used as the reference "truth" against which the HiChem reagent's performance is compared. These are established and accepted clinical chemistry methods.
8. The sample size for the training set
- Not Applicable. This is a chemical reagent, not a machine learning model, so there is no "training set."
9. How the ground truth for the training set was established
- Not Applicable. As there is no training set for a chemical reagent, this question is irrelevant.
Ask a specific question about this device
Page 1 of 1