AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
Intended Use

The ThinkingNet is a Medical Image Management and Review System, commonly known as PACS. ThinkingNet made by Thinking Systems Corporation, Florida, USA, is indicated for acceptance, transmission, storage, archival, reading, interpretation, clinical review, analysis, annotation, distribution, printing, editing and processing of digital images and data acquired from DICOM compatible diagnostic device, by healthcare professionals, including radiologists, cardiologists, physicians, technologists and clinicians.

  • With a ThinkingWeb option it can be used to access diagnostic information remotely with all workstation functionality or to collaborate with other users. The client device is cross platform for all but the thick-client ThinkingNet.Net option.
  • With the molecular imaging option it can be used for processing and interpreting nuclear medicine and other molecular imaging studies.
  • With image co-registration and fusion option it can be used for processing and interpreting PET-CT, PET-MRI, SPECT-CT and other hybrid imaging studies.
  • With the Mammography option it can be used for screening and diagnosis (with -MG, "For presentation" images only) from FDA approved modalities in softcopy (using FDA cleared displays for mammography) and printed formats.
  • With the cardiology option it can be used for reading, interpreting and reporting cardiac studies, such as nuclear cardiac, PET cardiac, echocardiographic, X-ray angiographic and CTA studies.
  • With the Orthopedic option it can be used to perform common orthopedic measurements of the hip, knee, spine, etc.
    OR
  • With the 3D/MPR option it can be used to volumetric image data visualization: -MIP, MPR, VR and triangulation.
  • With the Quality Assurance option it can be used by PACS administrators or clinicians to perform quality control activities related to patient and images data.
Device Description

ThinkingNet is a multi-modality PACS/RIS with applications optimized for each individual imaging modality. The image data and applications can be accessed locally or remotely. ThinkingNet workstation software is designed as diagnostic reading and processing software packages, which may be marketed as software only, as well as packaged with standard off-the-shelf computer hardware.
The base functions include receiving, transmission, storage, archival, display images from all imaging modalities. When enabled, the system allows remote access of image data and applications over a local or wide area network, using a Web browser, thick-client, thin-client or cloud-based remote application deployment method.
Options allow for additional capability, including modality specific applications, quantitative postprocessing, modality specific measurements, multi-planar reformatting and 3D visualization.
ThinkingNet Molecular Imaging modules offer the image processing functionality, through MDStation and ThinkingWeb, that have the same indication as the predicate modality workstations. It delivers image processing and review tools for applications used in functional imaging modalities, such as nuclear medicine, PET, PET/CT, SPECT/CT and PET/MRI.
ThinkingNet Mammo module is a diagnostic softcopy breast imaging workstation with diagnostic print capability.

  • It displays and prints regionally approved DICOM DR Digital Mammography Images (MG . SOP class) with a default or user defined mammography hanging protocol.
  • . It displays and prints regionally approved DICOM CR Digital Mammography Images (CR SOP class) a default or user defined mammography hanging protocol.
  • It displays adjunct breast imaging modality studies (i.e. Breast MR, Breast . PET and Breast gamma camera) for comparison.
    ThinkingWeb modules offer comprehensive remote image and application access methods to allow clinicians to review and process images remotely. It has the following modules.
  • . ThinkingWebLite: Clientless image distribution via simple Web browser (see NuWEB in K010271). It is primarily a referral physician's portal, not intended for primary reading.
  • . ThinkingNet.Net: A thick-client implementation using an existing image review module (NuFILM) with a proprietary image streaming mechanism.
  • . ThinkingWeb: Cross-platform thin-client remote application access based the existing MDStation software and off-the-shelf remote computing technology.
  • . ThinkingWeb Extreme: A cloud-based remote application deployment implementation based the existing MDStation software and off-the-shelf cloud computing technologies.
    Besides ThinkingNet.Net, all ThinkingWeb products support cross-platform client computer devices. Thinking Net uses Windows-based client computer.
AI/ML Overview

The provided 510(k) summary for "ThinkingNet Modality Applications and Web Extensions" does not contain specific acceptance criteria or performance study results in the typical format of a clinical or technical validation study.

Instead, the submission primarily focuses on demonstrating substantial equivalence to predicate devices. This means that, for this type of submission, the manufacturer asserts that their device is as safe and effective as existing legally marketed devices, rather than needing to prove new performance metrics against predefined acceptance criteria. The "Performance testing" mentioned refers to internal verification and validation activities to ensure the new features (like Web options and modality-specific modules) still perform as expected and maintain equivalence to the predicate devices.

Therefore, many of the requested details about acceptance criteria, specific performance numbers, sample sizes for test sets, expert qualifications, and ground truth methodologies for a new performance claim are not present in the provided document.

Here's an analysis of the available information:

1. A table of acceptance criteria and the reported device performance

  • Acceptance Criteria: Not explicitly stated as quantifiable metrics for a new claim. The "acceptance criteria" here are implicitly linked to demonstrating substantial equivalence with the listed predicate devices. This means the device must function similarly in terms of image management, communication, archiving, and processing capabilities.
  • Reported Device Performance: No specific numerical performance metrics (e.g., sensitivity, specificity, accuracy) are reported for the device in the context of a clinical study designed to establish new performance claims. The document states that "Performance testing was conducted to show that ThinkingNet is safe and effective," but does not provide details of these tests or their results.

2. Sample size used for the test set and the data provenance (e.g. country of origin of the data, retrospective or prospective)

  • Sample Size: Not specified.
  • Data Provenance: Not specified.

3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts (e.g. radiologist with 10 years of experience)

  • Number of Experts: Not specified.
  • Qualifications of Experts: Not specified.

4. Adjudication method (e.g. 2+1, 3+1, none) for the test set

  • Adjudication Method: Not specified.

5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

  • MRMC Study: No MRMC study is mentioned. This device is a PACS/image management system, not an AI-assisted diagnostic tool for which such studies are typically conducted.
  • Effect Size: Not applicable as no MRMC study was performed.

6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done

  • Standalone Performance: Not applicable/not specified. The device is an image management and review system, inherently designed for human interaction.

7. The type of ground truth used (expert consensus, pathology, outcomes data, etc.)

  • Type of Ground Truth: Not specified. For a PACS, the "ground truth" would generally relate to the accurate display, storage, and retrieval of medical images and data, ensuring data integrity and functionality mirroring predicate devices.

8. The sample size for the training set

  • Sample Size for Training Set: Not applicable/not specified. This is a PACS system, not a machine learning model that typically requires a discrete training set.

9. How the ground truth for the training set was established

  • Ground Truth for Training Set: Not applicable.

Summary of available information regarding the "study" (internal V&V) and acceptance criteria:

The "study" referenced in the document is the internal verification and validation (V&V) process conducted by Thinking Systems, following their ISO 13485 and FDA 21 CFR Part 820 compliant Quality System.

  • Acceptance Criteria (Implicit): The primary acceptance criterion is that the "ThinkingNet with its Web options and modality specific modules to be as safe, as effective, and performance is substantially equivalent to the predicate device(s)." This means the device must meet the functional and performance characteristics established by the legally marketed predicate devices.
  • Proof of Meeting Criteria:
    • Performance Testing: "Performance testing was conducted to show that ThinkingNet is safe and effective." This would have involved internal tests to ensure the system's various functions (receiving, transmission, storage, display, advanced processing, remote access) operate correctly and reliably. These tests would validate that the device's features, especially the new Web options and modality-specific applications, perform comparably to or within the established safety and effectiveness parameters of the predicate devices.
    • Quality Assurance Measures: The document lists several QA measures applied to the development, including Requirements Specification, Design Specification, Hazard and Risk Analysis, Modular Testing, Verification Testing, Validation Testing, and Integration Testing. These processes ensure that the device was designed and built to meet its intended purpose and functions properly.
    • Substantial Equivalence Argument: The core of the submission is the detailed argument for substantial equivalence, comparing ThinkingNet's intended use, indications, target populations, and technical characteristics with multiple predicate devices across various modalities (PACS, molecular imaging, mammography, cardiology, RECIST, echocardiography). The differences identified (e.g., more built-in modality-specific applications, server-side processing for Web clients, cross-platform support) are then argued not to affect safety and effectiveness, supported by the internal performance testing.

In essence, for this 510(k) submission, the "acceptance criteria" were met by demonstrating that the device functions comparably to existing cleared devices, and the "study" was the manufacturer's well-documented internal verification and validation process designed to ensure this equivalence and the device's safety and effectiveness. No independent clinical efficacy study with specific numerical performance targets was required or presented for this type of device and submission pathway.

§ 892.2050 Medical image management and processing system.

(a)
Identification. A medical image management and processing system is a device that provides one or more capabilities relating to the review and digital processing of medical images for the purposes of interpretation by a trained practitioner of disease detection, diagnosis, or patient management. The software components may provide advanced or complex image processing functions for image manipulation, enhancement, or quantification that are intended for use in the interpretation and analysis of medical images. Advanced image manipulation functions may include image segmentation, multimodality image registration, or 3D visualization. Complex quantitative functions may include semi-automated measurements or time-series measurements.(b)
Classification. Class II (special controls; voluntary standards—Digital Imaging and Communications in Medicine (DICOM) Std., Joint Photographic Experts Group (JPEG) Std., Society of Motion Picture and Television Engineers (SMPTE) Test Pattern).