(85 days)
Yes
The document explicitly states that the device incorporates "SW functions NerveTrack and UterineAssist based on AI technology" and mentions a "deep learning based segmentation algorithm".
No
The device is described as a "diagnostic ultrasound system" intended for "clinical diagnosis of patients," which indicates it is used for identifying medical conditions rather than treating them.
Yes
The "Intended Use / Indications for Use" section explicitly states, "The diagnostic ultrasound system and probes are designed to obtain ultrasound images and analyze body fluids." and "It can be used... for clinical diagnosis of patients." The "Device Description" also refers to it as a "general purpose, mobile, software controlled, diagnostic ultrasound system."
No
The device is described as a "diagnostic ultrasound system" and its function is to "acquire ultrasound data". This indicates it includes hardware components (probes, system) to generate and receive ultrasound waves, not just software for processing data.
Based on the provided information, this device is not an IVD (In Vitro Diagnostic).
Here's why:
- Intended Use: The primary intended use is to "obtain ultrasound images and analyze body fluids." While it mentions analyzing body fluids, the core function and the detailed description focus on generating and analyzing ultrasound images of anatomical structures within the body.
- Device Description: The description clearly states it's a "diagnostic ultrasound system." It details the various ultrasound modes and analysis packages used to measure anatomical structures and provide information for clinical diagnosis.
- Lack of IVD Characteristics: An IVD device is typically used to examine specimens (like blood, urine, or tissue) outside the body to obtain information about a person's health. This device operates by transmitting and receiving ultrasound waves into the body.
- Focus on Imaging: The entire document heavily emphasizes the imaging capabilities, modes of operation related to imaging, and the anatomical sites being imaged.
- AI Features: The AI features mentioned (NerveTrack and UterineAssist) are also focused on analyzing the ultrasound images themselves (segmentation, feature point extraction, measurement) rather than analyzing a biological specimen.
While the device mentions "analyze body fluids," this is likely in the context of using ultrasound to visualize and potentially measure fluid collections within the body (e.g., ascites, pleural effusions), which is a function of diagnostic imaging, not in vitro analysis of a collected sample.
Therefore, based on the provided text, the device is a diagnostic ultrasound system and does not meet the definition of an In Vitro Diagnostic device.
No
The letter explicitly states "Control Plan Authorized (PCCP) and relevant text: Not Found", indicating no PCCP was cleared or approved for this device.
Intended Use / Indications for Use
The diagnostic ultrasound system and probes are designed to obtain ultrasound images and analyze body fluids.
The clinical applications include: Fetal/Obstetrics, Abdominal, Gynecology, Pediatric, Small Organ, Neonatal Cephalic, Adult Cephalic, Trans-rectal, Muscular-Skeletal (Conventional, Superficial), Urology, Cardiac Adult, Cardiac Pediatric, Trans-esophageal (Cardiac), Peripheral vessel, Lung and Dermatology.
It is intended for use by, or by the order of, and under the supervision of, an appropriately trained healthcare professional who is qualified for direct use of medical devices. It can be used in hospitals (includes emergency room), private practices, clinics and similar care environment for clinical diagnosis of patients.
Modes of Operation: 2D mode, Color Doppler mode, Power Doppler (PD) mode, M mode, Pulsed Wave (PW) Doppler mode, Continuous Wave (CW) Doppler mode, Tissue Doppler Imaging (TDI) mode, Tissue Doppler Wave (TDW) mode, ElastoScan Mode, Combined modes, Multi-Image mode(Dual, Quad), 3D/4D mode.
Product codes
IYN, IYO, ITX
Device Description
The HM70 EVO is a general purpose, mobile, software controlled, diagnostic ultrasound system. Its function is to acquire ultrasound data and to display the data as 2D mode. M mode, Color Doppler imaging, Power Doppler imaging (including Directional Power Doppler mode; S-Flow), PW Spectral Doppler mode, CW Spectral Doppler mode, Harmonic imaging(S-Harmonic), Tissue Doppler imaging, Tissue Doppler Wave, Panoramic Imaging, Freehand 3D, 3D imaging mode (real-time 4D imaging mode), Elastoscan Mode or as a combination of these modes. The HM70 EVO also gives the operator the ability to measure anatomical structures and offers analysis packages that provide information that is used to make a diagnosis by competent health care professionals. The HM70 EVO has real time acoustic output display with two basic indices, a mechanical index and a thermal index. which are both automatically displayed.
Mentions image processing
Yes
Mentions AI, DNN, or ML
Yes
Input Imaging Modality
Ultrasound
Anatomical Site
Fetal/Obstetrics, Abdominal, Gynecology, Pediatric, Small Organ, Neonatal Cephalic, Adult Cephalic, Trans-rectal, Muscular-Skeletal (Conventional, Superficial), Urology, Cardiac Adult, Cardiac Pediatric, Trans-esophageal (Cardiac), Peripheral vessel, Lung and Dermatology.
Indicated Patient Age Range
Not Found
Intended User / Care Setting
It is intended for use by, or by the order of, and under the supervision of, an appropriately trained healthcare professional who is qualified for direct use of medical devices. It can be used in hospitals (includes emergency room), private practices, clinics and similar care environment for clinical diagnosis of patients.
Description of the training set, sample size, data source, and annotation protocol
The training data used for the training of the NerveTrack algorithm are independent of the data used to test the NerveTrack algorithm.
Description of the test set, sample size, data source, and annotation protocol
UterineAssist:
- 450 sagittal uterus images and 150 transverse uterus images collected at three hospitals for segmentation validation.
- 45 sagittal and 41 transverse plane images of uterus collected at three hospitals for feature points extraction and size measurement.
- Demographic distribution: Gender: Female, Age: Reproductive age, Ethnicity/Country: All Koreans.
- Images collected with 4 SAMSUNG MEDISON's ultrasound systems and probes. Mix of data from retrospective and prospective data collection in clinical practice.
- Segmentation of the ground truth was generated by three participating OB/GYN experts with more than 10 years' experience. The set of images (uterus and endometrium) were divided into 3 subsets and the three participating OB/GYN experts each drew the ground truths for one of the subsets. The ground truths drawn by an expert were cross-checked by the other two experts. Any images that do not meet the inclusion/exclusion criteria were excluded from the set of images.
- Data used for test/training validation purpose are completely separated from the ones during training process and there is no overlap between the two.
NerveTrack:
- Number of Subjects: 18 (13 Females, 5 Males)
- Number of Images: 2,146 (1,168 Females, 978 Males)
- Age range: 22
68 (Females: 3268, Males: 22~50) - Average age: 42.7 (Females: 45.7, Males: 35.0)
- BMI range: 16
31.5 (Females: 1627.1, Males: 31.5) - Average BMI: 21.5 (Females: 20.5, Males: 31.5)
- Ethnicity: All Koreans
- When collecting scan data, the speed of the probe varies from about 1cm to 5cm per second. The orientation of the probe was short-axis imaging and perpendicular to the skin, obtained by sliding the probe in both the proximal and distal directions.
- Ten anesthesiologists and five sonographers with more than 10 years of experience participated to establish the ground truth (GT) for the location of 10 different kinds of nerves. One anesthesiologist who scanned the ultrasound directly drew the GT of nerve location, and two or more other anesthesiologists and sonographers reviewed and confirmed that it was correct. If there was any mistake during the review, it was revised again.
- The training data used for the training of the NerveTrack algorithm are independent of the data used to test the NerveTrack algorithm.
Summary of Performance Studies (study type, sample size, AUC, MRMC, standalone performance, key results)
UterineAssist Summary Test Statistics:
- Test Type: Image segmentation validation.
- Sample Size: 450 sagittal uterus images and 150 transverse uterus images.
- Key Results: The average dice-score of uterus is 96%; The average dice-score of endometrium is 92%.
- Test Type: Feature points extraction validation.
- Sample Size: 45 sagittal and 41 transverse plane images of uterus.
- Key Results: The errors of uterus feature points are 5.8 mm or less; The errors of endometrium feature points are 4.3 mm or less.
- Test Type: Size measurement validation.
- Sample Size: Same data set as Feature points extraction test.
- Key Results: The errors of Measurements performance are 2.0 mm or less.
- Clinical subgroups and confounders: Sagittal uterus images divided into 4 phases (early proliferative, peri-ovulatory, secretory, and post-menopause). Differentiation made between good image quality and challenging image quality data set.
NerveTrack Validation:
- Validation Type: Accuracy (%), Speed (FPS)
- Acceptance Criteria: Accuracy ≥ 80%, Speed ≥ 2 FPS
- Summary Performance Data:
- Accuracy (%): Average 91.50, Standard Deviation 5.08, 95% CI 88.35 to 94.65
- Speed (FPS): Average 3.71, Standard Deviation 0.06, 95% CI 3.65 to 3.78
- Standalone Performance: Evaluated for BMI (Body Mass Index) subgroups (underweight, healthy weight, overweight, obesity) as potential subject and image confounder. Very good generalizability observed for BMI, as average accuracy of all subgroups are included within the confidence interval of the accuracy for the full dataset.
- Key Results: The maximum depth of the detected nerve was 3.31 cm from skin. Low correlation between BMI and maximum depth of nerves, and no significant difference of NerveTrack performance according to the patient's BMI information, indicating robustness of the model across various BMI.
Key Metrics (Sensitivity, Specificity, PPV, NPV, etc.)
UterineAssist:
- Average dice-score of uterus: 96%
- Average dice-score of endometrium: 92%
- Errors of uterus feature points: 5.8 mm or less
- Errors of endometrium feature points: 4.3 mm or less
- Errors of Measurements performance: 2.0 mm or less
NerveTrack:
- Accuracy (%): Average 91.50 (95% CI 88.35 to 94.65)
- Speed (FPS): Average 3.71 (95% CI 3.65 to 3.78)
Predicate Device(s)
HM70 EVO Diagnostic Ultrasound System (K220269), V8 Diagnostic Ultrasound System (K223387), FUJIFILM SonoSite Vevo MD Imaging System (K190476)
Reference Device(s)
Not Found
Predetermined Change Control Plan (PCCP) - All Relevant Information
Not Found
§ 892.1550 Ultrasonic pulsed doppler imaging system.
(a)
Identification. An ultrasonic pulsed doppler imaging system is a device that combines the features of continuous wave doppler-effect technology with pulsed-echo effect technology and is intended to determine stationary body tissue characteristics, such as depth or location of tissue interfaces or dynamic tissue characteristics such as velocity of blood or tissue motion. This generic type of device may include signal analysis and display equipment, patient and equipment supports, component parts, and accessories.(b)
Classification. Class II.
0
December 21, 2023
Image /page/0/Picture/1 description: The image shows the logo of the U.S. Food and Drug Administration (FDA). The logo consists of two parts: the Department of Health & Human Services logo on the left and the FDA acronym with the full name of the agency on the right. The FDA part of the logo is in blue, with the acronym in a larger font size than the full name. The full name of the agency is "U.S. Food & Drug Administration".
Samsung Medison CO., LTD. % So-Yeon Jang Regulatory Affairs Specialist 3366. Hanseo-ro. Nam-myeon Hongcheon-gun, Gangwon-do 25108 SOUTH KOREA
Re: K233112
Trade/Device Name: HM70 EVO Diagnostic Ultrasound System Regulation Number: 21 CFR 892.1550 Regulation Name: Ultrasonic Pulsed Doppler Imaging System Regulatory Class: Class II Product Code: IYN, IYO, ITX Dated: September 27, 2023 Received: September 27, 2023
Dear So-Yeon Jang:
We have reviewed your section 510(k) premarket notification of intent to market the device referenced above and have determined the device is substantially equivalent (for the indications for use stated in the enclosure) to legally marketed predicate devices marketed in interstate commerce prior to May 28, 1976, the enactment date of the Medical Device Amendments, or to devices that have been reclassified in accordance with the provisions of the Federal Food, Drug, and Cosmetic Act (the Act) that do not require approval of a premarket approval application (PMA). You may, therefore, market the device, subject to the general controls provisions of the Act. Although this letter refers to your product as a device, please be aware that some cleared products may instead be combination products. The 510(k) Premarket Notification Database available at https://www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfpmn/pmn.cfm identifies combination product submissions. The general controls provisions of the Act include requirements for annual registration, listing of devices, good manufacturing practice, labeling, and prohibitions against misbranding and adulteration. Please note: CDRH does not evaluate information related to contract liability warranties. We remind you, however, that device labeling must be truthful and not misleading.
If your device is classified (see above) into either class II (Special Controls) or class III (PMA), it may be subject to additional controls. Existing major regulations affecting your device can be found in the Code of Federal Regulations, Title 21, Parts 800 to 898. In addition, FDA may publish further announcements concerning your device in the Federal Register.
Additional information about changes that may require a new premarket notification are provided in the FDA guidance documents entitled "Deciding When to Submit a 510(k) for a Change to an Existing Device" (https://www.fda.gov/media/99812/download) and "Deciding When to Submit a 510(k) for a Software Change to an Existing Device" (https://www.fda.gov/media/99785/download).
1
Your device is also subject to, among other requirements, the Quality System (QS) regulation (21 CFR Part 820), which includes, but is not limited to, 21 CFR 820.30, Design controls; 21 CFR 820.90, Nonconforming product; and 21 CFR 820.100, Corrective and preventive action. Please note that regardless of whether a change requires premarket review, the QS regulation requires device manufacturers to review and approve changes to device design and production (21 CFR 820.30 and 21 CFR 820.70) and document changes and approvals in the device master record (21 CFR 820.181).
Please be advised that FDA's issuance of a substantial equivalence determination does not mean that FDA has made a determination that your device complies with other requirements of the Act or any Federal statutes and regulations administered by other Federal agencies. You must comply with all the Act's requirements, including, but not limited to: registration and listing (21 CFR Part 807); labeling (21 CFR Part 801); medical device reporting of medical device-related adverse events) (21 CFR Part 803) for devices or postmarketing safety reporting (21 CFR Part 4, Subpart B) for combination products (see https://www.fda.gov/combination-products/guidance-regulatory-information/postmarketing-safety-reportingcombination-products); good manufacturing practice requirements as set forth in the quality systems (QS) regulation (21 CFR Part 820) for devices or current good manufacturing practices (21 CFR Part 4, Subpart A) for combination products; and, if applicable, the electronic product radiation control provisions (Sections 531-542 of the Act); 21 CFR Parts 1000-1050.
Also, please note the regulation entitled, "Misbranding by reference to premarket notification" (21 CFR 807.97). For questions regarding the reporting of adverse events under the MDR regulation (21 CFR Part 803), please go to https://www.fda.gov/medical-device-safety/medical-device-reportingmdr-how-report-medical-device-problems.
For comprehensive regulatory information about mediation-emitting products, including information about labeling regulations, please see Device Advice (https://www.fda.gov/medicaldevices/device-advice-comprehensive-regulatory-assistance) and CDRH Learn (https://www.fda.gov/training-and-continuing-education/cdrh-learn). Additionally, you may contact the Division of Industry and Consumer Education (DICE) to ask a question about a specific regulatory topic. See the DICE website (https://www.fda.gov/medical-device-advice-comprehensive-regulatoryassistance/contact-us-division-industry-and-consumer-education-dice) for more information or contact DICE by email (DICE@fda.hhs.gov) or phone (1-800-638-2041 or 301-796-7100).
Sincerely,
Yanna S. Kang -S
Yanna Kang, Ph.D. Assistant Director Mammography and Ultrasound Team DHT8C: Division of Radiological Imaging and Radiation Therapy Devices OHT8: Office of Radiological Health Office of Product Evaluation and Quality Center for Devices and Radiological Health
2
Indications for Use
510(k) Number (if known) K233112
Device Name
HM70 EVO Diagnostic Ultrasound System
Indications for Use (Describe)
The diagnostic ultrasound system and probes are designed to obtain ultrasound images and analyze body fluids.
The clinical applications include: Fetal/Obstetrics, Abdominal, Gynecology, Pediatric, Small Organ, Neonatal Cephalic, Adult Cephalic, Trans-rectal, Muscular-Skeletal (Conventional, Superficial), Urology, Cardiac Adult, Cardiac Pediatric, Trans-esophageal (Cardiac), Peripheral vessel, Lung and Dermatology.
It is intended for use by, or by the order of, and under the supervision of, an appropriately trained healthcare professional who is qualified for direct use of medical devices. It can be used in hospitals (includes emergency room), private practices, clinics and similar care environment for clinical diagnosis of patients.
Modes of Operation: 2D mode, Color Doppler mode, Power Doppler (PD) mode, M mode, Pulsed Wave (PW) Doppler mode, Continuous Wave (CW) Doppler mode, Tissue Doppler Imaging (TDI) mode, Tissue Doppler Wave (TDW) mode, ElastoScan Mode, Combined modes, Multi-Image mode(Dual, Quad), 3D/4D mode.
Type of Use (Select one or both, as applicable)
| Prescription Use (Part 21 CFR 801 Subpart D) | Over-The-Counter Use (21 CFR 801 Subpart C) |
|---|---|
| ------------------------------------------------------------------------------------------------------------------------------------------ | -------------------------------------------------------------------------------------------------------------------------- |
CONTINUE ON A SEPARATE PAGE IF NEEDED.
This section applies only to requirements of the Paperwork Reduction Act of 1995.
DO NOT SEND YOUR COMPLETED FORM TO THE PRA STAFF EMAIL ADDRESS BELOW.
The burden time for this collection of information is estimated to average 79 hours per response, including the time to review instructions, search existing data sources, gather and maintain the data needed and complete and review the collection of information. Send comments regarding this burden estimate or any other aspect of this information collection, including suggestions for reducing this burden, to:
Department of Health and Human Services Food and Drug Administration Office of Chief Information Officer Paperwork Reduction Act (PRA) Staff PRAStaff(@fda.hhs.gov
"An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB number."
3
510(k) Premarket Notification - Traditional
K233112
510(k) Summary
In accordance with 21 CFR 807.92 the following summary of information is provided:
- Date Prepared September 27, 2023 1.
-
- Manufacturer SAMSUNG MEDISON CO., LTD. 3366, Hanseo-ro, Nam-myeon, Hongcheon-gun, Gangwon-do 25108, REPUBLIC OF KOREA
- Primary Contact Person 3. So-Yeon Jang Regulatory Affairs Specialist Phone: +82.2.2194.0875 Fax: +82.2.2194.0278 Email: sy24.jang(@samsungmedison.com
- Secondary Contact Person 4. Ninad Gujar Vice President Phone: +1.978.564.8632 Fax: +1.978.564.8677 Email: ngujar@neurologica.com
-
- Proposed Device
- Proprietary Name: HM70 EVO Diagnostic Ultrasound System
- Common Name: System, Imaging, Pulsed Doppler, Ultrasonic System, Imaging, Pulsed Echo, Ultrasonic Transducer, Ultrasonic, Diagnostic
- Classification: 21 CFR 892.1550 Ultrasonic pulsed doppler imaging system 21 CFR 892.1560 Ultrasonic pulsed echo imaging system 21 CFR 892.1570 Diagnostic ultrasonic transducer
- Product Code(s): IYN, IYO, ITX
- Predicate Device 6.
-
- Device Description
The HM70 EVO is a general purpose, mobile, software controlled, diagnostic ultrasound system. Its function is to acquire ultrasound data and to display the data as 2D mode. M mode, Color Doppler imaging, Power Doppler imaging (including Directional Power Doppler mode; S-Flow), PW Spectral Doppler mode, CW Spectral Doppler mode, Harmonic imaging(S-Harmonic), Tissue Doppler imaging, Tissue Doppler Wave, Panoramic Imaging,
4
510(k) Premarket Notification - Traditional
Freehand 3D, 3D imaging mode (real-time 4D imaging mode), Elastoscan Mode or as a combination of these modes. The HM70 EVO also gives the operator the ability to measure anatomical structures and offers analysis packages that provide information that is used to make a diagnosis by competent health care professionals. The HM70 EVO has real time acoustic output display with two basic indices, a mechanical index and a thermal index. which are both automatically displayed.
-
- Indications for Use
The diagnostic ultrasound system and probes are designed to obtain ultrasound images and analyze body fluids.
- Indications for Use
The clinical applications include: Fetal/Obstetrics, Abdominal, Gynecology, Pediatric, Small Organ, Neonatal Cephalic, Adult Cephalic, Trans-vaginal, Muscular-Skeletal (Conventional, Superficial), Urology, Cardiac Adult, Cardiac Pediatric, Transesophageal (Cardiac), Peripheral vessel, Lung and Dermatology.
It is intended for use by, or by the order of, and under the supervision of, an appropriately trained healthcare professional who is qualified for direct use of medical devices. It can be used in hospitals (includes emergency room), private practices, clinics and similar care environment for clinical diagnosis of patients.
Modes of Operation: 2D mode, Color Doppler mode, Power Doppler (PD) mode, M mode, Pulsed Wave (PW) Doppler mode, Continuous Wave (CW) Doppler mode, Tissue Doppler Imaging (TDI) mode, Tissue Doppler Wave (TDW) mode, ElastoScan Mode, Combined modes, Multi-Image mode(Dual, Quad), 3D/4D mode.
-
- Technology
The HM70 EVO employs the same fundamental scientific technology as its predicate devices.
- Technology
-
- Determination of Substantial Equivalence
Comparison to Predicates: The HM70 EVO is substantially equivalent to the predicate devices with regard to intended use, imaging capabilities, technological characteristics and safety and effectiveness.
- Determination of Substantial Equivalence
-
. The systems are all intended for diagnostic ultrasound imaging and fluid flow analysis
-
. The proposed HM70 EVO and the predicates HM70 EVO (K220269), V8 (K223387) and VEVO MD Imaging system (K190476) have the same intended use.
-
. The proposed HM70 EVO has added a clinical application for dermatology.
-
The proposed HM70 EVO has added a new transducer L3-22, and another transducer . LA3-22AI migrated from the predicate V8 (K223387). Biocompatibility test has been conducted for the new transducer, and image performance tests have been conducted for both.
5
510(k) Premarket Notification - Traditional
- . The proposed HM70 EVO has added SW functions NerveTrack and UterineAssist based on AI technology, previously cleared in V8 (K223387).
- The proposed HM70 EVO has added a MEPP (Minimal Extended Power Pack) as an ● additional portable power supply.
- . The proposed HM70 EVO has added a new type of Gel Warmer as an accessory.
- The system is manufactured with materials which have been evaluated and found to . be safe for the intended use of the device.
- . The system has acoustic power levels which are below the applicable FDA limits.
- The proposed HM70 EVO and the predicates HM70 EVO (K220269), V8 (K223387) ● and VEVO MD Imaging system (K190476) have similar capability in terms of performing measurements, capturing digital images, reviewing and reporting studies.
- The proposed HM70 EVO and predicates have been designed in compliance with . approved electrical and physical safety standards.
11. Summary of Non-Clinical Test
The device has been evaluated for acoustic output, biocompatibility, software function, cleaning and disinfection effectiveness as well as thermal, electrical, electromagnetic and mechanical safety, and has been found to conform with applicable FDA guidance and medical device safety standards. The HM70 EVO and its applications comply with the following FDA-recognized standards.
| Reference No. | Title |
|---|---|
| IEC 60601-1 | ANSI AAMI ES60601-1:2005/(R)2012 and A1:2012, |
| C1:2009/(R)2012 and A2:2010 /(R)2012 Medical Electrical | |
| Equipment - Part 1: General Requirements for basic safety and | |
| essential performance. | |
| IEC 60601-1-2 | IEC60601-1-2: 2020(4.1 Edition), Medical electrical equipment - |
| Part 1-2: General requirements for basic safety and essential | |
| performance - EMC | |
| IEC 60601-2-18 | IEC 60601-2-18: Edition 3.0 2009-08 |
| Medical electrical equipment - Part 2-18: Particular requirements for | |
| the basic safety and essential performance of endoscopic equipment | |
| IEC 60601-2-37 | IEC60601-2-37:2007 + A1:2015, Particular requirements for the |
| safety of ultrasonic medical diagnostic and monitoring equipment | |
| ISO10993-1 | ISO 10993-1:2018, Biological evaluation of medical devices -- Part |
| 1: Evaluation and testing within a risk management process. | |
| ISO14971 | ISO 14971:2019, Medical devices - Application of risk management |
| to medical devices | |
| NEMA UD 2-2004 | NEMA UD 2-2004 (R2009) |
| Acoustic Output Measurement Standard for Diagnostic Ultrasound | |
| Equipment Revision 3 |
6
510(k) Premarket Notification - Traditional
| IEC 62304 | ANSI AAMI IEC 62304:2006/A1:2016 |
|---|---|
| Medical device software - Software life cycle processes [Including | |
| Amendment 1 (2016)] |
[ The Summary of Testing for UterineAssist]
-
Summary test statistics or other test results including acceptance criteria or other information supporting the appropriateness of the characterized performance.
We tested on three areas : image segmentation, feature points extraction and size measurement. -
□ Segmentation test
-
் A deep learning based segmentation algorithm was validated using 450 sagittal uterus images and 150 transverse uterus images collected at three hospitals.
-
் The average dice-score of uterus is 96%
-
· The average dice-score of endometrium is 92%
-
□ Feature points extraction test
-
· We acquired, in addition, 45 sagittal and 41 transverse plane images of uterus collected at three hospitals.
-
· The errors of uterus feature points are 5.8 mm or less
-
· The errors of endometrium feature points are 4.3 mm or less
-
□ Size measurement test
-
· We use same data set of Feature points extraction test
-
· The errors of Measurements performance are 2.0 mm or less
-
Demographic distribution:
- □ Gender : Female
- □ Age : Reproductive age, specific age not collected
- □ Ethnicity/Country : All Koreans
-
Information about clinical subgroups and confounders present in the dataset:
- | | We divided the sagittal uterus images, depending on the shape of the endometrium, into 4 phases : early proliferative, peri-ovulatory, secretory, and post-menopause.
- | | During testing, a differentiation is made between good image quality and challenging image quality data set.
7
510(k) Premarket Notification - Traditional
■ Information about equipment and protocols used to collect images
- | | We acquired the data set with 4 SAMSUNG MEDISON's ultrasound systems and probes in order to secure diversity of the data set: Mix of data from retrospective data collection and prospective data collection in clinical practice
- Information about how the reference standard was derived from the dataset (i.e. the "truthing" process) :
- □ Segmentation of the ground truth was generated by three participating OB/GYN experts with more than 10 years' experience.
- □ The set of images (uterus and endometrium) were divided into 3 subsets and the three participating OB/GYN experts each drew the ground truths for one of the subsets.
- □ The ground truths drawn by an expert were cross-checked by the other two experts. Any images that do not meet the inclusion/exclusion criteria were excluded from the set of images.
- Description of how the independence of test data from training data was ensured:
- Data used for test/training validation purpose are completely separated from the ones during training process and there is no overlap between the two.
[ The validation for expansion of the detection nerve of NerveTrack based on AI ]
These are the details on validation of the AI algorithm used for all the new and improved AI-based features that includes expansion of the use of NerveTrack feature and the information about the dataset the device was tested on.
| Validation Type | Definition | Acceptance Criteria |
|---|---|---|
| Accuracy (%) | $\frac{\text{Number of correctly detected frames}}{\text{Total number of frames with nerve}} \times 100$ | ≥ 80% |
| Speed (FPS) | $\frac{1000}{\text{Average latency time of each frame (msec)}}$ | ≥ 2 FPS |
Acceptance Criteria:
Summary Performance data, Standard Deviations & Confidence Intervals:
| Validation Type | Average | Standard Deviation | 95% CI |
|---|---|---|---|
| Accuracy (%) | 91.50 | 5.08 | 88.35 to 94.65 |
| Speed (FPS) | 3.71 | 0.06 | 3.65 to 3.78 |
8
510(k) Premarket Notification - Traditional
The standalone performance of NerveTrack was evaluated for BMI (Body Mass Index) subgroups, which are potential subject and image confounder. For subgroup analysis, we divided BMI values into four groups according to the CDC (Centers for Disease Control and Prevention) definition for adult overweight & obesity. They are underweight (BMI