Search Results

The UC-1800 Automatic Urine Analyzer is automated instrument which is intended for professional, in vitro diagnostic use only.

Depending on the reagent strips being used, the instruments perform semi-quantitative detection of the following analytes in urine: ascorbic acid, microalbumin, leukocytes, creatinine, ketone, urobilinogen, bilirubin, glucose, protein, specific gravity, blood and pH in urine and for qualitative determination of nitrite in urine hydrometer (optional) can determine the color and turbidity of urine. Test results may provide information regarding the status of carbohydrate metabolism, kidney and liver function, acid-base balance and bacteriuria.

The URIT 11FA urine reagent strips provide semi-quantitative tests for ascorbic acid, leukocytes, setone, urobilinogen, bilirubin, glucose, protein, specific gravity, blood and pH in urine and for qualitative determination of nitrite in urine. The URIT 11FA urine reagent strips are for use with the UC-1800 Automatic Urine Analyzer and are for professional, in vitro diagnostic use only. Test results may provide information regarding the status of carbohydrate metabolism, kidney and liver function, acid-base balance and bacteriuria.

The URIT 12FA urine reagent strips provide semi-quantitative tests for microalbumin, leukocytes, creatinine, ketone, urobilinogen, bilirubin, glucose, protein, specific gravity, blood and pH in urine and for qualitative determination of nitrite in urine. The URIT 12FA urine reagent strips are for use with the UC-1800 Automatic Urine Analyzer and are for professional, in vitro diagnostic use only. Test results may provide information regarding the status of carbohydrate metabolism, kidney and liver function, acid-base balance and bacteriuria.

UC-1800 Automatic Urine Analyzer is characterized by fully automated and simple operation. All you need to do is to set test strips and samples, press the START key, and the rest of operations are fully automated with UC-1800, which can measure samples continuously. For each measurement, the instrument automatically performs a series of operation: sample transmitting, sample aspirating, sample dropping, rinsing strip feeding and color identifying, etc. The instrument is used in conjunction with a serial of URIT urine test strips for measuring 15 parameters. Measure results are printed through either built-in printer or external printer.

Urine Reagent Strips is used to determine the components to be measured in urine by dry chemistry method together with urine analyzer. Various components to be tested in the urine can result in changes to the colors of corresponding reagent blocks on the Urine Reagent Strips. The depth of reaction color is proportional to the corresponding component to be tested in the urine. Qualitative and semi-quantitative detection can be conducted to the contents of the corresponding detected components. As a reagent for the determination of multiple components in human urine and the most basic test item for clinical urine routine test), it is suitable for the screening test or auxiliary diagnosis for clinical diagnosis, without the specificity for diseases or indications, and urine dry chemistry test is a screening test and cannot be used as a single diagnostic method.

The provided document describes the URIT UC-1800 Automatic Urine Analyzer and its associated reagent strips (URIT 11FA and 12FA Urine Reagent Strips). The information below summarizes the acceptance criteria and the studies performed to demonstrate the device meets these criteria.

1. Table of Acceptance Criteria and Reported Device Performance

The document presents the performance in terms of "Exact agreement" and "± 1 color block" agreement with expected values or between the proposed device and predicate devices. For most analytes, the criteria seem to be high exact agreement and 100% agreement within ±1 color block. Specific thresholds for acceptance were not explicitly stated as global criteria but are implied by the "Qualified" conclusions for individual tests. The comparison to predicates also uses agreement rates.

Below is a summary of the reported device performance from the "Precision / Reproducibility" section (Tables 8, 9, 10, 11) for repeatability and "Comparison Studies" section (Tables a.1, a.2, a.3) for agreement with predicate devices. Given the extensive number of analytes and concentration levels, key representative results are presented.

a. Repeatability (Within-Run Precision)
Reported as "Exact agreement" and "± 1 color block". All tests for all expected values show 100% agreement for "± 1 color block". Exact agreement varies slightly, but most are 100% or very close.

b. Reproducibility (Between-Run Precision)
Reported as "Exact agreement" and "± 1 color block". All tests for all expected values show 100% agreement for "± 1 color block". Exact agreement varies slightly, but most are 100% or very close.

c. Comparison with Predicate Devices

2. Sample Sizes Used for the Test Set and Data Provenance

• Repeatability (within-run) & Reproducibility (between-run):

  • Sample Size:
    • Repeatability: 60 measurements per concentration level per analyte (20 replicates x 3 instruments).
    • Reproducibility: 120 measurements per concentration level per analyte (20 days x 2 runs/day x 1 time/run in 3 sites, with 1 instrument/site, 3 operators).
  • Data Provenance: The document does not explicitly state the country of origin or if the data was retrospective or prospective. It refers to "negative urines and spiked urines of known concentrations." This suggests controlled laboratory-prepared samples rather than direct patient samples.

• Linearity/Assay Reportable Range:

  • Sample Size: 63 measurements per concentration level per analyte (reference solutions tested 21 times on 3 UC-1800 machines with 3 lots of reagent strips).
  • Data Provenance: Laboratory-prepared reference solutions, not clinical samples.

• Analytical Sensitivity: No sample sizes mentioned, values are stated directly.

• Critical Value: No sample sizes mentioned, values are stated directly.

• Analytical Specificity (Interference, pH, Color, Specific Gravity):

  • Sample Size: For interference studies, samples were tested 5 times on 2 UC-1800 machines with 2 batch numbers of 11FA and 12FA reagent strips. This totals 20 measurements per condition (5 tests x 2 machines x 2 strips).
  • Data Provenance: Laboratory-prepared urine samples (negative samples prepared and spiked with interfering substances or adjusted for pH/color/SG).

• Comparison Studies with Predicate Devices (Clinical Samples):

  • Uritest-500B (K082811): 1000 clinical urine samples.
  • Mission® U120 Ultra Urine Analyzer (K142391): 979 clinical urine samples.
  • AUTION MAX AX-4030 Urinalysis System (K093098):
    • Color: 1365 clinical urine samples.
    • Turbidity: 1000 clinical urine samples.
  • Data Provenance: The document explicitly states "clinical urine samples were collected." The country of origin is not specified but given the submitter's address (China), it is highly likely that these clinical samples were collected in China and were retrospective as the study compares against existing predicate devices.

3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts

The document does not mention the use of experts to establish a "ground truth" for the test set in the traditional sense of medical image interpretation or clinical diagnosis. For chemical analyzers, the "ground truth" (or reference standard) is typically established by:

• Known concentrations: For repeatability, reproducibility, linearity, and analytical sensitivity, samples are prepared with known concentrations of the analytes.
• Reference methods: For the analytical specificity and comparison studies, the predicate devices themselves or established reference methods (e.g., 2,6-Dichlorophenolindophenol Titration Method for Ascorbic Acid, Lange method for Ketone, etc. as specified in Table 35 "Traceability") serve as the reference for comparison.

Therefore, the concept of "number of experts" and their "qualifications" for ground truth establishment, as typically applied in AI/ML performance evaluation (e.g., for image interpretation), is not directly applicable here. The ground truth is analytical and based on laboratory standards and established measurement techniques.

4. Adjudication Method for the Test Set

Not applicable in the context of this analytical device. As explained above, the "ground truth" refers to known concentrations or results from predicate/reference methods. There isn't a subjective interpretation by multiple experts that would require an adjudication method like 2+1 or 3+1.

5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

Not applicable. This device is an automated urine analyzer, not an AI/ML-driven diagnostic aid for human readers. It performs measurements to provide semi-quantitative results for various urine analytes. Therefore, there is no human-in-the-loop performance or comparison of human reader improvement with or without AI assistance.

6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) was done

Yes, the studies presented are all standalone performance evaluations of the device (UC-1800 Automatic Urine Analyzer with URIT 11FA/12FA Urine Reagent Strips) without human intervention in the measurement process. The device operates automatically to detect and report analyte levels. The comparison studies demonstrate its performance against existing predicate (standalone) analyzers.

7. The Type of Ground Truth Used

The ground truth used in the studies includes:

• Known Concentrations: For analytical performance studies such as precision (repeatability and reproducibility), linearity, analytical sensitivity, and analytical specificity (interference testing), samples were prepared with known, precisely measured concentrations of the target analytes or interfering substances.
• Predicate Device Measurements: For method comparison studies, the results obtained from the established predicate devices (Uritest-500B Urine Analyzer, Mission® U120 Ultra Urine Analyzer, and AUTION MAX AX-4030 Urinalysis System) served as the reference standard for comparison. These predicate devices also operate based on defined analytical principles.
• Reference Methods: Table 35 details the "Reference Method" used for traceability for each analyte (e.g., 2,6-Dichlorophenolindophenol Titration Method for Ascorbic Acid, Glucose Oxidase Method for Glucose, Acidometer measurement for pH, etc.). This indicates fundamental analytical standards are the basis for the stated detection ranges and performance.

8. The Sample Size for the Training Set

The document does not explicitly mention a "training set" in the context of machine learning. The UC-1800 Automatic Urine Analyzer uses reflectance photometry and other physical principles (refractometer for specific gravity, light-scattering for turbidity, light-transmission for color) to generate results, not an AI algorithm that learns from a dataset in the conventional sense. The "training" of such a system typically involves calibrating optical sensors and algorithms to known standards, which is part of the engineering design and quality control processes.

If interpretation of "training set" refers to the data used for the initial development and calibration of the device's measurement algorithms:

• No specific sample size for a "training set" for an AI model is reported because the device does not employ machine learning that requires a distinct "training set" and "test set" in the typical AI/ML development lifecycle.
• The system is calibrated using URIT urine control materials and calibration test strips (Table 9, "Calibration").

9. How the Ground Truth for the Training Set Was Established

As noted above, the device does not use an AI/ML model with a "training set" in the common understanding. The system's operational parameters and calibration are established using:

• Reference materials and calibrators: The device is calibrated using "URIT urine control materials and calibration test strips" (Table 9, "Calibration"). These control materials and calibration strips would have their values established using highly accurate reference methods or certified reference materials, ensuring traceability to scientific standards (as indicated in Table 35 "Traceability").
• Chemical principles: The underlying "ground truth" for the device's internal algorithms (i.e., how they convert optical signals to analyte concentrations) is based on established chemical reactions and physical measurement principles (e.g., reflectance photometry, refractometry, light scattering, dye-binding, enzymatic reactions). The "ground truth" for developing and fine-tuning these algorithms would be derived from rigorous scientific validation against these known chemical and physical properties.

Ask a specific question about this device

The DIP | U.S. Urine Analysis Test System consists of a smartphone application, a proprietary Color-Board, and Urinalysis Reagent Strips. It is intended for the semi-quantitative detection of the following analytes in urine: Glucose. Specific Gravity, Blood, pH and Protein, as well as the qualitative detection of Nitrite,

The DIP | U.S. Urine Analysis Test System is intended for prescription home-use only, with results provided directly to the physician. The results can be used to guide patient management and care, and aid in the diagnosis and monitoring of metabolic or systemic diseases that affect kidney function and endocrine disorders. Physician interpretation of the results should be made in conjunction with the patient's other clinical information to determine if further confirmatory tests or consultations are necessary. Patients do not have access to the results at any point in the process.

The DIP | U.S. Urine Analysis Test System consists of a smartphone application, a proprietary Color-Board, and Urinalysis Reagent Strips. It is intended for the semi-quantitative detection of the following analytes in urine: Glucose, Specific Gravity, Blood, pH and Protein, as well as the qualitative detection of Nitrite.

The DIP | U.S. Urine Analysis Test System is intended for prescription home-use only, with results provided directly to the physician. The results can be used to guide patient management and care, and aid in the diagnosis and monitoring of metabolic or systemic diseases that affect kidney function and endocrine disorders. Physician interpretation of the results should be made in conjunction with the patient's other clinical information to determine if further confirmatory tests or consultations are necessary. Patients do not have access to the results at any point in the process.

The device is provided as a kit that comprises a urine receptacle, an FDA-cleared urine test strip (ACON Mission Urinalysis Reagent Strips, 510K number K061559), a Color-Board, and a User Manual. The DIP | U.S. Urine Analysis Test System also consists of a smartphone application for use with a LG Nexus 5 device (running operating system Lollipop 5.0), and an image recognition algorithm running on the back-end.

The software component of the DIP | U.S. Urine Analysis Test System consists of both an application and a back-end server. The App instructs the patient how to accurately administer the test and conducts a number of algorithm processes. Once analyzed, the DIP | U.S. Urine Analysis Test System's software securely transmits the clinical results directly to the patient's Electronic Medical Records for review by the physician. As stated above, the patients do not have access to the results at any point during the testing process.

The provided text describes the acceptance criteria and study proving the device meets those criteria for the Healthy.io DIP | U.S. Urine Analysis Test System.

Here's a breakdown of the requested information:

1. Table of Acceptance Criteria and Reported Device Performance

The acceptance criteria are primarily defined by the "percent exact match" and "±1 color block match" compared to the predicate device (ACON Mission U500 Urinalysis System). The exact numerical acceptance thresholds are not explicitly stated as strict percentages for all analytes, but the narrative implies "high-levels of accuracy" and specific target ranges are mentioned for certain analytes.

Additional Performance Metrics (from Analytical Performance Testing):

• Repeatability: 99.3% exact match
• Reproducibility: 98.5% exact match
• Linearity: At least 89.4% exact match and 100% ±1 color block accuracy.
• Illumination Study: 99.5% exact match
• Boundary Study: 99.5% exact match

2. Sample Sizes Used for the Test Set and Data Provenance

Two method comparison studies were conducted for the test set:

• Study 1:

  • Sample Size: 429 subjects, 500 total samples (including spiked samples). Only 284 results from LG Nexus 5 smartphones were used for performance data.
  • Data Provenance: Two U.S. clinical sites. The studies involved lay-users in a simulated home-use environment. This indicates prospective data collection for the purpose of this validation.

• Study 2:

  • Sample Size: 250 subjects, 289 total samples (including spiked samples).
  • Data Provenance: One U.S.-based clinic. Similar to Study 1, this appears to be prospective data collection in a simulated home-use setting.

3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications

The ground truth for the comparison studies was established by "a laboratory professional using the predicate (ACON Mission U500 Urinalysis System)" measuring aliquots of the same samples. The specific number of laboratory professionals or their detailed qualifications (e.g., years of experience, specific certifications) are not explicitly stated in the provided text.

4. Adjudication Method for the Test Set

The text describes comparing the DIP system's results to those from a laboratory professional using the predicate device. It does not mention any formal adjudication method (e.g., 2+1, 3+1 consensus) for discrepancies between the device and the predicate. The predicate device's readings appear to be treated as the reference standard (ground truth).

5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done, and the Effect Size of How Much Human Readers Improve with AI vs. Without AI Assistance

This was not a MRMC comparative effectiveness study in the typical sense of evaluating human reader improvement with AI assistance. The study evaluates the performance of the device itself as used by a lay-user, compared to a predicate device operated by a laboratory professional. There is no mention of human readers interpreting images with and without AI assistance to measure improvement.

6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) Was Done

The performance data presented, particularly the "Method Comparison Study," represents the device's performance with a human-in-the-loop (lay-user) interacting with the smartphone application and Color-Board. The device itself (including its image recognition algorithm on the back-end) performs the analysis of the test strip after the user interacts with it. The usability results (e.g., 99% success rate for lay users completing the test) address the human-in-the-loop aspect.

However, the "Analytical Performance Testing" (Precision, Interference, Limit of Detection, Linearity, Illumination, Boundary Studies) implicitly evaluates the algorithm's performance under controlled conditions with pre-determined reagent values or spiked samples, which can be seen as a form of standalone evaluation of the core analytical capability. For example, the Illumination Study and Boundary Study evaluate the device's (and thus the algorithm's) ability to measure accurately under varying external conditions. In these studies, the device measured against "predetermined reagent values," which serves as the ground truth for evaluating the algorithm's accuracy under those specific conditions.

7. The Type of Ground Truth Used

The primary ground truth used for the method comparison studies (clinical validation) was the readings obtained from the predicate device (ACON Mission U500 Urinalysis System) by a laboratory professional.

For the analytical performance studies (Precision, Interference, Limit of Detection, Linearity, Illumination, Boundary), the ground truth was based on validated spiked urine solutions at known concentrations or predetermined reagent values.

8. The Sample Size for the Training Set

The provided text does not explicitly state the sample size used for the training set for the image recognition algorithm. It focuses on the validation studies.

9. How the Ground Truth for the Training Set Was Established

The text does not describe how the ground truth for the training set was established. It only mentions that the device includes an "image recognition algorithm running on the back-end." It is standard practice for such algorithms to be trained on large datasets with established ground truth, but the details of this process are not provided in this specific document.

Ask a specific question about this device

This device is intended for the in vitro measurement of the following in urine: Leukocyte, Nitrite, Urobilinogen, Protein, pH, Blood, Specific gravity, Ketone, Bilirubin, Glucose. These strips are intended for prescription, in vitro diagnostic use only and they are visually read.

DUS 2GP reagent strips provide qualitative and semiquantitative measurements for protein, and glucose in urine specimens. Test results may provide information regarding the status of carbohydrate metabolism and kidney function.

DUS 5 reagent strips provide qualitative and semiquantitative measurements for leukocytes, nitrite, blood , protein, and glucose in urine specimens. These measurements are used to aid in the diagnosis of metabolic disorders, kidney function anomalies and urinary tract infections.

DUS 10 reagent strips provide qualitative and semiquantitative measurements for specific gravity, pH, leukocytes, nitrite, protein, glucose, ketone, urobilinogen, bilirubin and blood in urine speciments are used to aid in the diagnosis of metabolic disorders, kidney function anomalies, urinary tract infections and liver function.

The DUS Series are urine test strips with different reagent pads for the determination of specific gravity, pH, leukocytes, nitrite, protein, glucose, ketone, urobilinogen, bilirubin and blood affixed onto plastic strips. of which leukocyte, nitrite, urobilinogen, protein, pH, blood, specific gravity, ketone, bilirubin and glucose reagent pads are affixed onto the plastic strips. The reagent pads react with analytes in the urine giving a visible color. Results are confirmed by comparison of the test strip with the color chart on the container. For each color result for each analyte, a semiquantitative value is available on the box label (e.g. bilirubin results include negative, 1, 2, and 4 mg/dL) and the associated qualitative result (e.g. bilirubin results include negative. +. ++, +++).

Here's an analysis of the provided document, outlining the acceptance criteria and study details for the DUS Reagent Strips:

Acceptance Criteria and Device Performance

The provided document does not explicitly state pre-defined acceptance criteria for the "Exact Agreement" or "Agreement within +/- one block (%)" in the method comparison study. However, the study results, which consistently show high percentages (generally in the high 90s and 100%) for both metrics across all analytes, implicitly represent the device meeting an expected high level of agreement with the predicate device.

For the linearity/assay reportable range, the acceptance criteria are implied by the reported "% Exact match." A high percentage (generally 97.7% to 100%) indicates acceptance.

For the detection limit study, the acceptance criteria are stated as "Sensitivity was defined as the cutoff for which ≥95% of the contrived pooled measurements were trace or the first positive result."

The interference study implicitly accepts the device if interference is either not observed at clinically relevant concentrations or if observed interferences are adequately addressed in the labeling.

Here's a table summarizing the reported device performance, where the values themselves act as the demonstration that the implied or stated acceptance criteria (high agreement, 95% detection, or non-interference/labeling for interference) were met.

Table of Reported Device Performance

Study Details

1. Sample size used for the test set and the data provenance:

   • Method Comparison Study: Total of 867 samples.
     • Provenance: Fresh urine samples obtained at three medical facilities. The country of origin is not explicitly stated but implied to be South Korea, given the submitter's address. The data is prospective as samples were "processed within 4 hours."
   • Precision/Reproducibility: Two levels of commercially available urine-based control solutions.
     • Sample Size: 90 replicates for within-run (10 tests from 3 lots at 3 sites) and 90 replicates for within-day (1 test a day from 3 lots, at 3 sites for 10 days) for each level.
     • Provenance: Commercially available control solutions.
   • Linearity/Assay Reportable Range:
     • Sample Size: 90 replicates per concentration level (10 replicates with each of 3 lots of test strips).
     • Provenance: Samples created by spiking known concentrations of standard materials or by serial dilution of a high concentration urine sample with negative urine.
   • Detection Limit:
     • Sample Size: 90 replicates for each concentration (each sample concentration analyzed 30 times using 3 reagent strip lots).
     • Provenance: Negative urine spiked with standard materials.
   • Analytical Specificity:
     • Sample Size: 3 replicates using 3 lots of DUS 10 test strips for each concentration level of interfering substance.
     • Provenance: Urine sample pools prepared at 3 analyte concentrations (negative, low, high positive) spiked with potential interfering substances.

2. Number of experts used to establish the ground truth for the test set and the qualifications of those experts:

   • Precision, Linearity, Detection Limit, Analytical Specificity: Ground truth was established by the known concentrations of control solutions or spiked samples. Testing was performed by 3 medical technicians as reported in the linearity study and precision study, but their specific qualifications (e.g., years of experience) are not stated beyond being "medical technicians."
   • Method Comparison Study: The ground truth for the method comparison study was established by comparing the DUS 10 test strips results against a predicate device (Multistix 10SG). The testing was performed by three medical technicians at each of the clinical sites. Similar to above, their specific qualifications are not detailed beyond "medical technicians."

3. Adjudication method (e.g., 2+1, 3+1, none) for the test set:

   • The document does not describe an explicit adjudication method (like 2+1 or 3+1) involving multiple human readers or experts resolving discrepancies for the test set in the traditional sense of image-based AI studies.
   • The method comparison study compares the new device's readings to the predicate device's readings, and the percentage agreement is calculated. The process for resolving discrepancies between the new device and the predicate device is not detailed, nor is there a mention of an expert panel reviewing cases.
   • For other studies (precision, linearity, detection limit), the ground truth is analytically determined by control concentrations.

4. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:

   • No, a multi-reader, multi-case (MRMC) comparative effectiveness study as typically understood for AI-assisted diagnostic tools (i.e., human readers with and without AI assistance) was not explicitly performed or described in this document.
   • The studies focus on the performance characteristics of the device itself (the reagent strips) and its comparison to a predicate device, which is also a reagent strip for visual reading. The device's use is "visually read" by operators, but the study design is not one of AI assistance to human readers.

5. If a standalone (i.e., algorithm only without human-in-the-loop performance) was done:

   • This device is a reagent strip that is visually read. It is not an AI algorithm. Therefore, the concept of "standalone (algorithm only without human-in-the-loop performance)" does not directly apply in the context of an AI device. The performance data presented (precision, linearity, detection limits, analytical specificity, method comparison) are essentially standalone performance characteristics of the physical reagent strip, with human visual interpretation being the intended mode of operation for reading the results. The method comparison specifically assesses this human-read performance against a predicate device.

6. The type of ground truth used (expert consensus, pathology, outcomes data, etc.):

   • Method Comparison Study: The ground truth for comparative analysis was the results obtained from the predicate device (Multistix 10SG).
   • Precision, Linearity, Detection Limit, Analytical Specificity: The ground truth was analytically determined concentrations derived from commercial control solutions or spiked urine samples with known analyte levels.

7. The sample size for the training set:

   • This document is for a traditional in-vitro diagnostic (IVD) reagent strip that is visually read, not an AI/ML device. Therefore, there is no "training set" in the context of machine learning model development. The assays are based on chemical reactions, and the performance is inherent to the chemical formulation and strip manufacturing.

8. How the ground truth for the training set was established:

   • As there is no AI/ML component or "training set" in the context of an algorithm, this question is not applicable. The chemical reactions on the strips are designed to react to specific analytes, and their performance is validated through the studies described.

Ask a specific question about this device

The DUS R-50S System provides a qualitative measurements for specific gravity, pH, leukocytes, nitrite, protein, glucose, ketone, urobilinogen, bilirubin, blood, microalbumin and creatinine in urine specimens. These measurements are used to aid in the diagnosis of metabolic disorders, kidney function anomalies, urinary tract infections and liver function. The system is intended for prescription, in vitro diagnostic use only.

The DUS R-50S (Urine Chemistry system) is a portable analyzer. It is designed to read only DUS Series for urinalysis. This analyzer reports semi-quantitatively assays for 12 urine analytes [Leukocyte, Nitrite, Urobilinogen, Protein, pH, Blood, Specific gravity, Ketone, Bilirubin, Glucose, Microalbumin, Creatinine]. Reagent strip results are automatically displayed on the screen. The DUS R-50S is intended for in vitro diagnostic use only

The DUS R-50S (Urine Chemistry system) device is intended for qualitative and semi-quantitative measurements of various analytes in urine specimens to aid in diagnosing metabolic disorders, kidney function anomalies, urinary tract infections, and liver function.

Here's an analysis of the acceptance criteria and the study that proves the device meets them:

1. Table of Acceptance Criteria and Reported Device Performance

The acceptance criteria are generally implied by the requirement for "very high concordance of between 90-100%" with the predicate device and the "majority of analysis display 90-100 % concordance over all blocks." The detailed "Exact agreement (%)" and "Within one block (%)" values for each analyte serve as the reported device performance against these implicit acceptance criteria.

2. Sample Size Used for the Test Set and Data Provenance

The method comparison study was conducted with a total of 867 samples. The data provenance is described as being collected at three clinical sites. The document does not specify the country of origin of the data, but the submitter information lists DFI Co., Ltd. in Korea. The study appears to be retrospective, as it compares the new device results against a legally marketed predicate device using collected samples.

3. Number of Experts Used to Establish the Ground Truth for the Test Set and their Qualifications

The document does not explicitly mention the use of experts to establish ground truth for the test set. Instead, the performance is evaluated by "method comparison" against a predicate device (Siemens Clinitek Status + urine chemistry instrument). The predicate device's results are considered the reference for comparison.

4. Adjudication Method for the Test Set

There is no mention of an adjudication method involving human experts for the test set. The comparison is directly between the new device and the predicate device.

5. Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study

A multi-reader multi-case (MRMC) comparative effectiveness study was not conducted as per the provided information. The study focuses on comparing the new device's analytical performance against a predicate device, not on human reader performance with or without AI assistance.

6. Standalone Performance Study

Yes, a standalone performance study was done in the form of a method comparison study where the DUS R-50S (DUS R-50S instrument, DUS10 and DUS2AC reagent strips) was compared to the predicate device (Siemens Clinitek Status + urine chemistry instrument using Multistix 10SG and CLINITEK Microalbumin 2 test strips). This evaluates the algorithm and device's performance directly.

7. Type of Ground Truth Used

The "ground truth" for the test set was the results obtained from the predicate device, specifically the Siemens Clinitek Status + urine chemistry instrument using Multistix 10SG and CLINITEK Microalbumin 2 test strips.

8. Sample Size for the Training Set

The document does not explicitly specify a separate sample size for a "training set." The performance evaluation focuses on the method comparison study using 867 samples. For a 510(k) submission for an in vitro diagnostic device, the manufacturer typically performs internal validation and verification studies during development, but the detailed breakdown of training data vs. test data for algorithm development is not typically part of the regulatory submission summary provided.

9. How the Ground Truth for the Training Set Was Established

Since a "training set" is not explicitly mentioned or detailed, the method for establishing its ground truth is not provided. If an algorithm was developed using machine learning, the ground truth for training would generally be established by laboratory reference methods or expert interpretation of the results from traditional methods, similar to how the predicate device results are used for the test set.

Ask a specific question about this device

The iChem® VELOCITY™ automated urine chemistry system is an in vitro diagnostic device used to automate the urine chemistry analysis profile using iChem® VELOCITY ™ Urine Chemistry Strips. The iChemVELOCITY can be used as a stand-alone system, as well as in an iQ®200 Series system, a configuration given the proprietary name iRICELL™ as it is designed to be hardware and software compatible with iQ200 Series systems. It produces quantitative results for specific gravity; semi-quantitative results for glucose, blood, leukocyte esterase, bilirubin, urobilingen, pH, protein, ketones and ascorbic acid; and qualitative results for nitrites, color and clarity.

iChemVELOCITY strips are intended for use only with the iChem Velocity analyzer. In particular, they are not intended for visual reading. The iChemVELOCITY is not intended to be used as a Point of Care (POC) analyzer.

These measurements are used to aid in the diagnosis of metabolic disorders, kidney function anomalies, urinary tract infections, and liver function. Tests performed using the iChemVELOCITY are intended for clinical laboratory and in vitro diagnostic use only.

The iChemVELOCITY is an automated urine chemistry system performing measurements of defined physical and chemical constituents in urine. The system utilizes iChemVELOCITY urine chemistry test strips which are read in the Strip Reader Module (SRM) by measuring light reflectance, in addition the iChemVELOCITY measures color and clarity using light transmittance through Color/Clarity Module (CCM) and specific gravity using refractive index through Specific Gravity Module (SGM).

The subject of this submission is a design change to the Color/Clarity Module (CCM) of the Color/Clarity/Specific Gravity Module (CGM) subassembly of the iChemVELOCITY. The CCM measures the color and clarity of a urine sample using transmitted and scattered light, incident on a color sensor. An algorithm then converts the output of the different channels of the sensor into semi-quantitative colors. The CCM is being changed to replace end-of-life components (color sensor and scatter light source) and update the color detection algorithm.

Here's a breakdown of the acceptance criteria and the study that proves the device meets them, based on the provided text:

Device: iChem®VELOCITY™ Automated Urine Chemistry System with redesigned Color/Clarity Module (CCM)

1. A table of acceptance criteria and the reported device performance

The document doesn't explicitly state "acceptance criteria" with numerical targets for the redesigned CCM. Instead, it aims to demonstrate substantial equivalence to the predicate device (iChemVELOCITY with the original CCM). Therefore, the reported performance is compared to the predicate's expected performance, with the implicit criterion being that the redesigned CCM performs at least as well as, or is in agreement with, the predicate.

Here's an interpretation of the performance data in the context of implied acceptance:

Detailed Performance Tables from the Document:

Method Comparison Results Summary (Page 8):

Precision Results Summary (Page 9):

2. Sample size used for the test set and the data provenance

• Sample Size: The "Precision Results Summary" table on page 9 indicates that for each color and clarity level category, 240 samples were tested.
• Data Provenance: The document does not specify the country of origin of the data or whether it was retrospective or prospective. It only states that "Performance testing of the iChemVELOCITY with the redesigned CCM was conducted."

3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts

The document does not specify the number of experts used or their qualifications for establishing ground truth. The "Method Comparison" results compare the "Redesigned CCM" to a "Comparator." Given the context of a design change to an existing device, the "Comparator" likely refers to the predicate iChemVELOCITY device with the original CCM. The ground truth, in this case, would be the results generated by the predicate device, not necessarily external human experts.

4. Adjudication method (e.g. 2+1, 3+1, none) for the test set

The document does not mention any adjudication method, as the comparison is primarily machine-to-machine (redesigned CCM vs. predicate CCM).

5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

No, a multi-reader multi-case (MRMC) comparative effectiveness study was not done. This device is an automated urine chemistry system, and the study focuses on the performance of the redesigned CCM against its predicate, not on human reader performance or AI assistance.

6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done

Yes, a standalone performance study was done. The entire study focuses on the performance of the automated iChemVELOCITY system with the redesigned CCM. There is no mention of human-in-the-loop performance evaluation for the color and clarity measurements. The device is intended "for clinical laboratory and in vitro diagnostic use only" and "is not intended for visual reading."

7. The type of ground truth used (expert consensus, pathology, outcomes data, etc.)

The primary ground truth for the performance study is the predicate device's performance. The study aims to show that the redesigned CCM produces results equivalent to the iChemVELOCITY with the original CCM, which was previously cleared.

8. The sample size for the training set

The document does not specify a separate training set size. The study describes a design change to existing hardware/software components, including an updated algorithm. It's possible that the "new firmware has been written and installed on the CCM's microprocessor... to update the CCM algorithm" implies some form of development/training, but the specifics and size are not provided in this regulatory summary.

9. How the ground truth for the training set was established

Since no specific training set and its size are explicitly mentioned, the method for establishing its ground truth is also not described. If algorithm development involved training, the ground truth would likely have been established using reference methods during the design phase of the original or updated algorithm, but this is not detailed in the provided text. The document focuses on the verification that the redesigned component performs equivalently to the existing, cleared device.

Ask a specific question about this device

The AUTION ELEVEN Semi-Automated Urinalysis System provides a qualitative and semi-quantitative measurements for glucose, protein, bilirubin, urobilinogen, pH, blood, ketones, nitrites, leukocytes, specific gravity and color tone in urine specimens. The system is intended for in vitro diagnostic use in screening patient populations found in clinical laboratories.

The AUTION ELEVEN Semi-Automated Urinalysis System consists of the following:

• · AUTION ELEVEN model AE-4022 Urine Analyzer (device component)
• · AUTION Sticks 10EA Test Strips (reagent component)

The AUTION ELEVEN Semi-Automated Urinalysis System provides a qualitative and semi-quantitative measurement for glucose, protein, bilirubin, urobilinogen, pH, blood, ketones, nitrites, leukocytes, specific gravity and color tone. The system is intended for in vitro diagnostic use in screening patient populations found in clinical laboratories. The AUTION ELEVEN Semi-Automated Urinalysis System consists of AUTION ELEVEN model AE-4022 urine analyzer and AUTION Sticks 10EA test strips.

The AUTION sticks 10EA consist of a plastic strip containing 10 pads impregnated with chemicals specific for the determination of a particular analyte. The chemical reaction with the urine results in a color change which is measured by the AUTION ELEVEN AE-4022 device, resulting in a display and print out indicating analyte concentration. The AUTION ELEVEN technology provides fast results that can be used along with other diagnostic information to rule out certain disease states and to determine if microscopic analysis is needed.

The semi-automated nature of the device requires the user to dip an AUTION Stick 10EA test strip into a patient urine specimen and place it on the instrument. The instrument processes the test strip, allowing 60 seconds for the chemical reactions to occur on the test strip reagent pads. After 60 seconds, the device measures the amount of reflectance generated from each reagent pad and converts the reflectance measurements to qualitative and semi-quantitative results for physician use.

Here's a breakdown of the acceptance criteria and study information for the AUTION ELEVEN Semi-Automated Urinalysis System, extracted from the provided text:

Acceptance Criteria and Device Performance

Precision Results

Note: The document states that "results from bench testing met pre-determined acceptance criteria and support a determination of substantial equivalence." However, the specific numerical acceptance criteria for "Exact match %" and "+/- 1 Color Block %" were not explicitly listed in the tables provided for precision. The reported device performance values are the results obtained from the study.

Method Comparison Results (Accuracy)

Note: Similar to precision, the document states "The overall conclusion from the clinical evaluation is that the results are acceptable and support a determination of substantial equivalence," implying the reported accuracy rates met their internal acceptance criteria. However, the specific numerical acceptance thresholds were not provided in these tables.

Detection Limits/Sensitivity Results

The acceptance criteria here are that the "Actual Concentration" for a given semi-quantitative rank should result in the device reporting that rank (or a higher rank) at a certain "Percent in Rank." These are implicitly the acceptance criteria for sensitivity. The table shows the "Actual Concentration" and the "Percent in Rank" achieved. For instance, for Glucose, the acceptance criterion for the 4+ rank might be that at 750 mg/dL, it should be in the 4+ rank at least 50% of the time (reported 87%).

Interfering Substances

The acceptance criteria are implicitly that the identified interferents cause a specific shift in color blocks as described (e.g., False negative (-2 to -3 color block change) for Glucose with Ascorbic acid). The study identifies what interference occurs and its magnitude, implying these findings were deemed acceptable within the context of device labeling.

Study Details

1. Sample size used for the test set and the data provenance:

   • Precision Study:
     • Sample Size: Not a direct patient sample size. Three (3) levels of quality controls were used for each analyte.
     • Data Provenance: Not specified, but likely controlled laboratory conditions given the use of commercial controls and specified dilutions/spiking.
   • Method Comparison Study (Accuracy):
     • Sample Size: 8395 tests of individual analytes. The number of unique patient samples is not explicitly stated, but the note mentions "Each site collected urine patient samples from their clinical laboratory or obtained them from nearby hospitals."
     • Data Provenance: Clinical patient samples, collected and refrigerated within 2 hours of collection for up to 24 hours prior to testing. Country of origin is not specified, but the clinical sites suggest real-world data collection. The study is prospective in the sense that samples were collected for the purpose of this study.

2. Number of experts used to establish the ground truth for the test set and the qualifications of those experts:

   • Precision Study: Not applicable. Ground truth was established by the known concentrations of the quality control materials.
   • Method Comparison Study: Ground truth was established by comparison against "2 commercially available urinalysis predicates, 1 semi-automated urine analyzer was used for specific gravity comparison and one fully-automated urine analyzer was used to compare all the rest of the analytes." No human experts were explicitly mentioned for ground truth establishment for this comparison. The predicate devices served as the reference standard.

3. Adjudication method (e.g., 2+1, 3+1, none) for the test set:

   • Not applicable for either the precision or method comparison studies as ground truth was established either by known control concentrations or by predicate device performance, not by human expert consensus requiring adjudication.

4. If a multi-reader multi-case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:

   • No, a multi-reader multi-case (MRMC) comparative effectiveness study was not conducted. This device is an automated and semi-automated urinalysis system, and the studies focused on its analytical performance against predicate devices and known controls, not on human reader performance or AI assistance.

5. If a standalone (i.e. algorithm only without human-in-the loop performance) was done:

   • Yes, the performance characteristics studies (Precision, Method Comparison, Detection Limits, Interfering Substances) represent standalone (algorithm only) performance of the AUTION ELEVEN Semi-Automated Urinalysis System. While a human dips the strip, the measurement and interpretation of the color change are performed by the automated device's optical unit and algorithms. The system then provides qualitative and semi-quantitative results automatically.

6. The type of ground truth used (expert consensus, pathology, outcomes data, etc.):

   • Precision Study: Known concentrations of quality control materials.
   • Method Comparison Study: Comparison against established predicate urinalysis devices for each analyte.

7. The sample size for the training set:

   • No information about a "training set" is provided in the document. This type of device (urinalysis analyzer) is typically developed and validated using analytical samples (spiked, diluted, known concentrations) and clinical samples, rather than a machine learning "training set" in the conventional sense. The "Performance Characteristics" section details the validation of the device's measurement accuracy and precision.

8. How the ground truth for the training set was established:

   • Not applicable, as no training set was explicitly mentioned or described for this type of device validation.

Ask a specific question about this device

The Uritek TC-201 Urine Chemistry Test System consists of the Uritek TC-201 Urine Chemistry Analyzer and the Teco Diagnostics Urine Reagent (URS-10) Strips. The Uritek TC-201 urine analyzer is an automated, bench top instrument which is intended for point-of-care, in vitro diagnostic use only and is intended to be used together with the Teco Diagnostics Urine Reagent (URS-10) Strips as a system for semi-quantitative detection of Glucose, Bilirubin, Ketone, Specific Gravity, Blood, pH, Protein, Urobilinogen, Nitrite and Leukocytes in urine. These measurements are used to aid in the diagnosis of metabolic disorders, kidney function anomalies, urinary tract infections and liver function.

The Uritek TC-201 Urine Analyzer (TC-201) is a portable easy to use instrument which reads Teco Diagnostics' Urine Reagent (URS-10) Strips for testing in the clinical laboratory. The analyzer can determine the intensity of different colors on the reagent strip test area. It does this by irradiating the test area with light and detecting the reflectance of different wavelengths using photodiode. Results are calculated by a reflection rate which is a percentage of the total reflectance of the testing wavelength and are printed automatically. The Uritek TC-201 Urine Analyzer reports semi-quantitative assays for Glucose, Bilirubin, Ketone, Specific Gravity, Blood, pH, Protein, Urobilinogen, Nitrite and Leukocytes in urine. The analyzer features a display, internal printer, a serial computer interface and an electrical outlet. Communication between the operator and the analyzer is made through the display using the user interface touch screen on the front surface of the instrument. Reagent strip results are automatically displayed on the screen in one minute. A printed hardcopy can also be created either from the results screen or recalled from memory. The Urine Reagent Strips (URS-10) for Urinalysis are firm plastic strips to which ten different reagent pads are affixed. The reagent pad areas are bibulous material saturated with chemically active substances, then dried and affixed to the plastic strip with double-sided adhesive. The Teco Urine Reagent (URS-10) Strips provide tests for the semi-quantitative determination of Glucose, Bilirubin, Ketone, Specific Gravity, Blood, pH, Protein, Urobilinogen, Nitrite, and Leukocytes in urine.

Here's a breakdown of the acceptance criteria and the study results for the Uritek TC-201 Urine Chemistry Test System, based on the provided document:

Acceptance Criteria and Reported Device Performance

The acceptance criterion for most analytes in the precision studies (both in-house and Point-of-Care) was 100% agreement within ±1 color block. For the comparative studies, the acceptance criteria were also based on agreement within and outside of specified color blocks. For Specific Gravity, the acceptance criteria was +/- 0.005.

Here's a summary table combining the reported performance from various studies:

Note: "L1", "L2", "L3" refer to Level I (High), Level II (Low), and Level III (Negative/Trace) control solutions, respectively. "N" indicates the number of tests performed.

Additional Information:

2. Sample size used for the test set and the data provenance:

• Precision Studies (In-house):
  • Within-Run: 180 strips per control level (20 strips x 3 strip lots x 1 day x 3operators/analyzers).
  • Run-to-Run: 120 strips per control level (3 strips x 2 runs x 10 days x 2 operators/analyzers/strip lots).
  • Data Provenance: In-house studies using commercially available urine control solutions. The country of origin of the data is not explicitly stated but implied to be from the manufacturer's facility.
• Precision Studies (Point-of-Care):
  • Sample Size: 40 tests per sample (duplicates per run, two runs per day for 10 days). Combined across 3 POC sites, the total for each control level (L1, L2, L3) was 120 (40 tests x 3 sites).
  • Data Provenance: Prospective, from three Point-of-Care (POC) sites: Clinica Medica Del Sagrado Corazon (Anaheim, CA), Clinica Medica San Miquel (Santa Ana, CA), and Artritis & Osteoporosis Center (Edinburg, TX). This data is from the USA.
• Method Comparison Study:
  • Sample Size: A total of 509 urine specimens. This comprised:
    • At least 115 unaltered patient samples per site from 3 POC sites (total > 345).
    • Additional contrived samples (10% of total samples).
    • 91 clinical samples from POC Site I and Site II.
    • A separate study at Site I with 26 patient urine samples prescreened at pH ≥ 8.0.
  • Data Provenance: Prospective, from three Point-of-Care (POC) sites in the USA. Samples were a mix of unaltered patient samples and contrived samples.

3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts:

• Precision Studies: Ground truth was established by the expected ranges of commercially available urine control solutions (HYCOR Biomedical), which have known target analyte concentrations confirmed by their package inserts and certificates of analysis. No external human experts are explicitly mentioned for these studies beyond the internal operators.
• Method Comparison Study: The ground truth for the method comparison study was established by the predicate device, the Siemens Clinitek Status+ Urine Analyzer (using Clinitek Multistix 10 SG Strips). This is a comparison between two devices, not a comparison against a clinical expert consensus or pathology.
• Linearity/Assay Reportable Range: For pH, a pH meter was used to confirm results. For specific gravity, a clinical, handheld refractometer was used. These serve as the "ground truth" or reference methods for these specific parameters. Three operators performed these measurements.

4. Adjudication method (e.g. 2+1, 3+1, none) for the test set:

• Adjudication Method: Not explicitly described in the provided text for most studies. The precision studies rely on the expected values of control solutions. The method comparison study compares the Uritek TC-201 directly against the predicate device; discrepancies are noted but a formal multi-expert adjudication process is not detailed. For the precision studies, results were considered "within the expected results +/- one color block"; however, the process for resolving disagreements or establishing a definitive ground truth in cases of initial disagreement is not specified beyond relying on the control solution's stated values.

5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:

• This document describes a clinical chemistry test system for urine analysis, which is an automated instrument reading reagent strips. It is not an AI-assisted diagnostic imaging or human-in-the-loop system. Therefore, an MRMC comparative effectiveness study involving human readers and AI assistance is not applicable and was not performed.

6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done:

• The Uritek TC-201 Urine Analyzer is described as an automated, bench top instrument that "reads Teco Diagnostics' Urine Reagent (URS-10) Strips". It operates by "irradiating the test area with light and detecting the reflectance of different wavelengths using photodiode" and "Results are calculated by a reflection rate... and are printed automatically." This indicates that the device operates in a standalone (algorithm only) manner for interpreting the reagent strips. Human involvement is primarily in sample preparation and loading, and interpreting the printed results.

7. The type of ground truth used (expert consensus, pathology, outcomes data, etc.):

• Precision Studies: Ground truth was established by the expected ranges of commercially available urine control solutions with confirmed analyte concentrations.
• Linearity/Assay Reportable Range Study: For pH, a pH meter was the ground truth. For Specific Gravity, a clinical, handheld refractometer was the ground truth.
• Method Comparison Study: The ground truth was the predicate device's measurements (Siemens Clinitek Status+ Urine Analyzer).

8. The sample size for the training set:

• The document describes performance testing for a diagnostic device, not the development or training of a machine learning model. Therefore, a "training set" in the context of AI/ML is not applicable here. The studies described are for verification and validation of the device's analytical performance against established standards and a predicate device.

9. How the ground truth for the training set was established:

• As mentioned above, there is no "training set" in the context of AI/ML for this device. The ground truth for the various performance studies (precision, linearity, method comparison) was established using commercially available control solutions with known values, reference instruments (pH meter, refractometer), and comparison to a legally marketed predicate device.

Ask a specific question about this device

The TC-Thunderbolt Automated Urine Analyzer System is an in vitto diagnostic device used to automate the urine chemistry analysis using TC-Thunderbolt URS-10 strips. It produces semi-quantitative results of glucose, protein, pH, bilirubin, blood, ketone, urobilinogen, nitrite, specific gravity and leukocytes in urine. TC-Thunderbolt URS-10 strips are intended for use only with TC-Thunderbolt Automated Urine Analyzer System, they are not intended for manual visual reading. This device is for clinical laboratory use only. This device is not for Point of Care Use. These measurements are used to aid in the diagnosis of metabolic disorders, kidney function anomalies, urinary tract infections and liver function.

The proposed device is an automated urine chemistry analyzer system intended for use only with TC-Thunderbolt URS-10 strips for the measurement of ten urine chemistry analytes from the chemistry strip. The system consists of the TC-Thunderbolt Automated Urine Analyzer and the TC-Thunderbolt URS-10 strips.

This document describes the performance of the TC-Thunderbolt Automated Urine Analyzer System, an in vitro diagnostic device for semi-quantitative analysis of urine chemistry. The studies presented focus on the analytical performance of the device and its associated test strips (TC-Thunderbolt URS-10 strips) rather than human-in-the-loop performance with an AI. Therefore, sections related to human reader improvement with AI assistance (MRMC studies) and expert consensus in the typical sense for AI model ground truth are not directly applicable to this type of device submission.

Here's a breakdown of the requested information based on the provided text, focusing on the device's analytical performance:

1. Table of Acceptance Criteria and Reported Device Performance

The acceptance criteria for this device are implied by the results of the precision and method comparison studies, generally aiming for high agreement with either the expected control values or a predicate device. The tables below summarize the reported device performance for selected analytes from the precision (within-run and run-to-run) and method comparison studies.

Precision Study Acceptance Criteria & Performance (Within-Run & Run-to-Run for Urine Controls):

The acceptance criteria for precision studies are generally for high exact match agreement and 100% agreement within +/- one color block.

Method Comparison Study Acceptance Criteria & Performance (vs. Predicate Device):

The acceptance criteria for method comparison studies are generally for high overall agreement, with a specific note for SG.

2. Sample Size Used for the Test Set and Data Provenance

Precision Study (Test Set):
For Within Run precision: 60 strips per control level (20 replicates x 1 day x 3 operators/strip lots) were tested. There were 3 control levels (I, II, III).
For Run to Run precision: 60 strips per control level (2 replicates x 2 runs x 5 days x 3 operators/strip lots) were tested. There were 3 control levels (I, II, III).
Data Provenance: Not explicitly stated for all samples, but the "Method Comparison Study Summary" states: "This comparison study testing was performed at Teco Diagnostics, Anaheim CA in United States." It also mentions "The urine samples for analysis in these method comparison studies were provided by external clinical sites." This implies a prospective data collection for the method comparison, and likely also for the precision studies, as real-time control solutions were used.

Method Comparison Study (Test Set):
A total of 487 urine samples were used for the method comparison study.
Data Provenance: The study was performed at Teco Diagnostics, Anaheim, CA, United States. Samples were collected from external clinical sites. These could be considered a mix of retrospective and prospective, as some samples might have been collected specifically for the study (prospective), and others could have been existing samples (retrospective), but the description implies a prospective approach to sample collection and testing for the study. Spiked samples were also prepared.

Sensitivity/Cutoff Point Determination Study & Linearity Study (Test Set):
For Sensitivity: 21 data points for each level (7 strips x 3 operators/strip lots). This study used spiked urine samples.
For Linearity: 21 measurements for every sample tested (7 strips x 3 operators/strip lots). This study used negative urine and spiked negative urine.
Data Provenance: Performed at Teco Diagnostics, Anaheim, CA, United States. Samples were negative urine, with many spiked to achieve various concentrations.

3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts

For this type of in vitro diagnostic device, "ground truth" is typically established by:

• Reference materials/control solutions: For precision studies, commercially available urine control solutions with confirmed target analyte concentrations were used.
• Comparative method (Predicate Device or Reference Method): For method comparison, the predicate device (Uritek-720+ Urine Analyzer) served as the comparative method against which the new device's performance was evaluated.
• Known concentrations: For sensitivity and linearity studies, samples were prepared by spiking known concentrations of analytes into negative urine. For pH, a pH meter confirmed results, and for Specific Gravity, a clinical, handheld refractometer confirmed values.

Therefore, the ground truth is established by analytical reference methods and known chemical concentrations, rather than human expert reads of images. There is no mention of human experts establishing ground truth in the context of image interpretation or reading. The studies mentioned involve operators performing tests, but their role is to execute the protocol and collect data, not to adjudicate ground truth. The number of operators (3) is mentioned for precision and sensitivity/linearity studies, indicating consistency checks across different users of the device.

4. Adjudication Method for the Test Set

Adjudication as typically understood in the context of human reader disagreement for AI models is not directly applicable here. The "ground truth" for these analytical tests is based on the known concentrations of controls, the results from a predicate device, or measurements by reference instruments (pH meter, refractometer). Discrepancies in device readings are analyzed as agreement percentages (exact match and +/- color block) against these pre-established analytical references, rather than being arbitrated by human experts.

5. If a Multi Reader Multi Case (MRMC) Comparative Effectiveness Study was done

No, a Multi Reader Multi Case (MRMC) comparative effectiveness study was not performed. This submission is for an automated in vitro diagnostic device (urine analyzer) that produces semi-quantitative results by measuring chemical reactions on test strips. It is not an AI-assisted diagnostic imaging device that involves human readers interpreting images. Therefore, the concept of human readers improving with or without AI assistance is not relevant to this submission.

6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) was done

Yes, the studies are essentially standalone performance evaluations of the automated device (TC-Thunderbolt Automated Urine Analyzer System). While operators conduct the tests, the output is generated by the instrument's sensing and processing of the chemical reactions on the strips. The tables presented show the performance of the device itself (e.g., % agreement with controls or predicate device), representing its standalone analytical capability.

7. The Type of Ground Truth Used

The types of ground truth used are:

• Defined Control Solutions/Reference Materials: For precision studies, commercially available urine control solutions with certified analyte concentrations were used.
• Predicate Device Gold Standard: For method comparison, the Uritek-720+ Urine Analyzer (the predicate device) served as the reference against which the new device was compared.
• Known Chemical Concentrations: For sensitivity/cutoff point determination and linearity studies, samples were prepared by spiking urine with precise, known concentrations of analytes.
• Reference Instruments: For pH, a pH meter was used as the ground truth. For specific gravity, a clinical, handheld refractometer was used as the ground truth.

8. The Sample Size for the Training Set

This document only describes analytical performance studies for a medical device submitted for 510(k) clearance, which demonstrates substantial equivalence to a predicate device. It does not provide information about a "training set" in the context of machine learning. The device's operation is based on established chemical principles and optical measurement, not on a machine learning model that requires a "training set."

9. How the Ground Truth for the Training Set Was Established

Since there is no mention of a machine learning model or a "training set" in the context of AI development, this question is not applicable. The device relies on chemical reactions and optical measurement, for which the underlying scientific principles and performance are validated through the analytical studies described.

Ask a specific question about this device

The Mission® U120 Ultra Urine Analyzer is intended for use in conjunction with the Mission® Urinalysis Reagent Strips for the semi-quantitative detection of the following analytes in urine: Glucose, Bilirubin, Ketone (Acetoacetic Acid), Specific Gravity, pH, Blood, Protein, Urobilinogen, Leukocytes and Ascorbic Acid as well as the qualitative detection of Nitrite.

The instrument is intended for point-of-care, in vitro diagnostic use only. The measurement can be used in general evaluation of health, and aids in the diagnosis and monitoring of metabolic or systemic diseases that affect kidney function, endocrine disorders and diseases or disorders of the urinary tract. It is intended for professional use only.

The Mission® Liquid Urine Controls Liquid Diptube Urine Controls are assayed urine controls, intended for use in validating the precision of analyzer reading of urinalysis for one or more of the following analytes: Ascorbic acid, Glucose, Bilirubin, Ketone (Acetoacetic acid), Specific Gravity, Blood, pH, Protein, Urobilinogen, Nitrite and Leukocytes. It is intended for professional in vitro diagnostic use only.

The Mission® U120 Ultra Urine Analyzer is a reflectance photometer that analyzes the intensity and color of light reflected from the reagent areas of a urinalysis reagent strip. Without a urine analyzer, users must visually compare the reagent areas of the strip to a color chart using the naked eye. Mission® U120 Ultra Urine Analyzer also features data management and report generation capabilities.

Acceptance Criteria and Device Performance Study for Mission® U120 Ultra Urine Analyzer

This report summarizes the acceptance criteria and the study proving the device meets these criteria for the Mission® U120 Ultra Urine Analyzer, as derived from the provided 510(k) summary (K142543).

1. Table of Acceptance Criteria and Reported Device Performance

The acceptance criteria for the Mission® U120 Ultra Urine Analyzer were established through comparison with a predicate device (ACON U120 Urine Analyzer, K070929) and through various performance studies, including sensitivity, precision, interference, and environmental stability. The primary acceptance criteria for clinical performance were based on the agreement levels with the predicate device.

Note: The exact acceptance criteria were not explicitly stated as numerical thresholds for each analyte in the provided document beyond the general statement of "demonstrated that the intended user can follow the product instruction and obtain comparable instrument read results when using the Mission®U120 Ultra Urine Analyzer and a predicate Analyzer." The reported performance statistics (exact and within one level agreement) implicitly serve as the achieved acceptance. For Sensitivity, the achievement of specific low and high end ranges, as listed in the document, constitutes the acceptance. For Precision, 100% within +/- one block agreement was explicitly stated.

2. Sample Size Used for the Test Set and Data Provenance

The primary clinical test set involved approximately 468 patient urine specimens for each analyte (sample sizes varied slightly for some analytes, e.g., 451 for Nitrite, 450 for Bilirubin, etc.). This number includes both patient-collected specimens and "few contrived urine specimens" to ensure coverage of the measuring range.

The data provenance is prospective, as it involved "patient urine specimens randomly collected from patients at each of 3 clinical sites" and "Additional study was carried out at 2 sites in US," indicating a planned data collection process for the study. The country of origin for the clinical data is the United States (2 sites in US mentioned).

3. Number of Experts Used to Establish the Ground Truth for the Test Set and Qualifications of Those Experts

The ground truth for the clinical test set was established by comparing the results from the Mission® U120 Ultra Urine Analyzer with those from a predicate device, the ACON U120 Urine Analyzer (K070929), rather than human experts.

The testing was performed by 9 intended users in total across 3 clinical sites (3 users at each site). Their qualifications are described as "intended users," implying they are professionals who would typically operate such devices in a point-of-care setting, but specific expert qualifications (e.g., radiologist with 10 years of experience) are not provided.

4. Adjudication Method for the Test Set

The adjudication method used seems to be a direct comparison between the results obtained from the candidate device (Mission® U120 Ultra Urine Analyzer) and the predicate device (ACON U120 Urine Analyzer). The agreement percentages (exact and within one level) are reported, indicating that the predicate device's readings served as the reference for comparison. There is no mention of an independent adjudication panel or a consensus method among multiple experts for the test set's ground truth beyond the comparison to the predicate.

5. Multi Reader Multi Case (MRMC) Comparative Effectiveness Study

An MRMC comparative effectiveness study, in the traditional sense of evaluating human reader performance with and without AI assistance, was not performed. The study compared the new automated analyzer (Mission® U120 Ultra Urine Analyzer) against a predicate automated analyzer (ACON U120 Urine Analyzer), with "intended users" operating the devices. The study objective was to evaluate the performance of the new analyzer compared to the predicate and to observe operational issues. It did not focus on the effect size of how much human readers improve with AI vs. without AI assistance, as the "AI" (automated analyzer) is the primary testing modality being evaluated for its standalone performance relative to a predicate.

6. Standalone (i.e. algorithm only without human-in-the-loop performance) Study

Yes, a standalone study was performed. The core of the clinical study involved comparing the "Mission® U120 Ultra Urine Analyzer" reading "Mission® Urinalysis Reagent Strips" against the "ACON U120 Urine Analyzer" reading "Mission® Urinalysis Reagent Strips." This evaluates the algorithm-driven output of the Mission® U120 Ultra Urine Analyzer as a standalone device against a legally marketed predicate device. The precision, sensitivity, interference, and environmental studies also evaluate the device's performance in a standalone capacity under various conditions.

7. The Type of Ground Truth Used

For the clinical study, the reference standard (ground truth) was the performance of the legally marketed predicate device, the ACON U120 Urine Analyzer (K070929), when reading the same Mission® Urinalysis Reagent Strips. The study directly compared the results from the new device against those of the predicate. Some "contrived urine specimens" were also used, implying that these had pre-defined or known concentrations of analytes, which would also serve as a form of ground truth.

For the precision study, the "target concentration of the analyte in each control solution was confirmed with Siemens reagent strips read by Clinitek Status urine analyzer and Mission® Urinalysis Reagent Strip read by ACON U120 urine analyzer," indicating a combination of predicate devices and validated controls as ground truth.

For the sensitivity study, the "low and high end range of sensitivity" for the reagent strips were determined, which likely relied on precisely prepared samples with known analyte concentrations as the ground truth.

8. The Sample Size for the Training Set

The document does not explicitly state a separate "training set" sample size for the Mission® U120 Ultra Urine Analyzer, as it is primarily a reflectance photometer analyzing color changes rather than a complex machine learning model that typically requires a distinct training phase. The device's operation is based on pre-programmed algorithms for color interpretation.

The clinical study and other performance studies described serve as validation of the device's accuracy and functionality. If any internal calibration or parameter tuning occurred, the data used for that is not detailed in this section.

9. How the Ground Truth for the Training Set Was Established

As mentioned above, the document does not describe a distinct training set for a machine learning algorithm. The device is an optical reader with established "tests principles" based on reflectance photometry and CMOS image sensing. The "ground truth" for its development and programming would implicitly derive from the chemical reactions on the reagent strips and the expected colorimetric responses at different analyte concentrations. These foundational principles are well-established in urinalysis technology. The sensitivity study, for instance, establishes the "low and high end range of sensitivity" for the device, which reflects its ability to correctly interpret known concentrations.

Ask a specific question about this device

The CLINITEK Novus® Automated Urine Chemistry Analyzer is a fully automated urinalysis instrument. The CLINITEK Novus analyzer is intended to read Siemens Healthcare Diagnostics CLINITEK Novus Cassettes, as well as determine urine specific gravity and urine clarity. The CLINITEK Novus 10 Urinalysis Cassette is intended for the seniquantitative measurement of the following parameters in urine: bilirubin, blood (occult), glucose, ketone (acetoacetic acid), leukocytes, nitrite (qualitative), pH, protein, color, and urobilinogen.

These measurements are used to assist diagnosis in the following areas:

• · Carbohydrate metabolism (such as diabetes mellitus)
• · Kidney function
• · Liver function
• · Metabolic disorders
• · Urinary tract infection

For in vitro diagnostic use.

The CLINITEK Novus® Calibration Kit is intended to be used with the CLINITEK Novus Urinalysis Cassette to calibrate the CLINITEK Novus Automated Urine Chemistry analyzer. This product is for professional in vitro diagnostic use.

The CLINITEK Novus® system is a fully automated urine chemistry analyzer that is designed for use with the CLINITEK Novus® 10 Urinalysis Cassette. The analyzer automates the process of urine strip testing by dispensing urine samples onto a test pad, and then by reading the color and intensity of light reflected from the reacted test pads, converts the results into clinically meaningful units.

Test results from the test pads are qualitative and semi-quantitative; specific gravity is measured by a refractometer assembly.

Here's an analysis of the acceptance criteria and study detailed in the provided document:

1. Table of Acceptance Criteria and Reported Device Performance

The document does not explicitly state pre-defined acceptance criteria (e.g., "The device must achieve X% agreement"). However, it does present the results of comparison studies against a predicate device and states that "The results for overall percent agreement and within one level agreement met acceptance criteria." This implies that acceptable thresholds were achieved. Based on the presented data, we can infer the achieved performance. For specific analytes, the values vary, but they consistently show high exact match and very high agreement within +/- 1 block.

2. Sample Size Used for the Test Set and Data Provenance

• Sample Size:
  • For the method comparison study (comparing CLINITEK Novus to the predicate CLINITEK Atlas), up to 2773 specimens were tested across 3 sites for most analytes.
  • For Urobilinogen, an additional fourth site was involved due to a high number of contrived samples in the initial three sites. This fourth site tested 261 samples (187 negative, and then 48, 10, 12, 4 for various positive levels).
• Data Provenance: The document does not explicitly state the country of origin. The study was conducted "across 3 sites" (and later a fourth), implying a multi-center study within the scope of the device manufacturer's operations/clinical trials. It is a prospective comparison study as it compared the new device (CLINITEK Novus) against an existing predicate device (CLINITEK Atlas) using actual patient specimens.

3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications

The context of this device being an automated urine chemistry analyzer comparing its readings to a predicate automated urine chemistry analyzer suggests that the "ground truth" for the test set was established by the results from the predicate device (CLINITEK Atlas), not human experts. Therefore, the concept of a number of experts and their qualifications for establishing ground truth is not directly applicable in this context. The predicate device's established performance serves as the reference.

4. Adjudication Method for the Test Set

Since the comparison is primarily between two automated devices, and the "ground truth" is derived from the predicate device's readings, a typical adjudication method involving human readers (like 2+1 or 3+1 consensus) is not applicable. The data presented is a direct comparison of the readings obtained from the CLINITEK Novus analyzer against the readings obtained from the CLINITEK Atlas analyzer.

5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance?

No, a Multi-Reader Multi-Case (MRMC) comparative effectiveness study involving human readers and AI assistance was not performed. This device is an automated in vitro diagnostic (IVD) analyzer, not an AI-powered image analysis tool meant to assist human readers. Its primary function is to automatically measure chemical parameters in urine.

6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) was done?

Yes, the performance reported is a standalone performance of the CLINITEK Novus Automated Urine Chemistry Analyzer. It assesses the device's ability to accurately measure urine parameters independently, by comparing its results directly to those of a predicate automated device. There is no human-in-the-loop component in the reported performance evaluation.

7. The Type of Ground Truth Used

The primary "ground truth" used for the method comparison study was the results obtained from the predicate device, the CLINITEK Atlas Automated Urine Chemistry Analyzer. For the detection limit study, "ground truth" was established by spiking negative pooled human urine with known quantities of analytes.

8. The Sample Size for the Training Set

The document describes studies comparing the new device to a predicate device and analytical performance characteristics. It does not explicitly mention a "training set" or a machine learning/AI model training process for this IVD device. The description focuses on demonstrating substantial equivalence to a predicate device through analytical and method comparison studies. If the device uses algorithms derived from prior data, that information is not detailed in this summary.

9. How the Ground Truth for the Training Set Was Established

Since a "training set" is not explicitly mentioned in the context of machine learning/AI for this device, the method for establishing its ground truth is not applicable/not provided in this document. The device's operation appears to be based on established reflectance photometry and refractive index principles for chemical analysis, rather than a learned model from a training set.

Ask a specific question about this device