(303 days)
The ANAM® Test System: Military, Military Expanded, Core, and Sports Batteries are intended for use as computerbased neurocognitive test batteries to aid in the assessment of mild traumatic brain injury. The ANAM Test System: Military, Military Expanded, Core, and Sports Batteries are neurocognitive test batteries that provide healthcare professionals with objective measure of neurocognitive functioning as assessment aids and in the management of mild traumatic brain injury in individuals ages 13-65.
The ANAM Test System should only be used as an adjunctive tool for evaluating cognitive function.
The ANAM Test System is a software only device that provides clinicians with objective measurements of cognitive performance in populations, to aid in the assessment and management of concussion. ANAM measures various aspects of neurocognitive functioning including reaction time, memory, attention, and spatial processing speed. It also records symptoms of concussion in the test taker.
The software is downloaded from the Vista LifeSciences website and is for use on Dell Inspiron 15 3000 Series or similar Windows PC model or Android Samsung Galaxy tablet or similar Android device. The hardware is not provided as part of the device but is purchased separately by the user. Each ANAM battery consists of a collection of pre-selected modules that are administered in a sequential manner.
Specific modules included in the ANAM Test System:
-
- Questionnaires
-
- Demographics
-
- Mood Scale
-
- Neurobehavioral Symptom Inventory (NSI)
-
- PTSD Checklist (PCL)
-
- Sleepiness Scale
-
- Symptoms Checklist
-
- TBI Questionnaire
Performance Tests
-
- Code Substitution Learning
-
- Code Substitution Delayed
-
- Go/No-Go"
-
- Matching to Sample*
-
- Mathematical Processing
-
- Memory Search
-
- Procedural Reaction Time
-
- Simple Reaction Time*
-
- Spatial Processing*
- *Available for tablet platform.
The tests and questionnaires can be combined into custom batteries or users can choose from pre-configured standardized batteries. The standardized batteries include ANAM Core, ANAM Sports. ANAM Military, and ANAM Military-Expanded. These standardized batteries have fixed test settings and parameters to ensure standardized presentation and enable comparison to normative data.
Here's a breakdown of the requested information regarding the acceptance criteria and the study that proves the device meets them, based on the provided FDA 510(k) summary for the ANAM Test System.
Please note: The provided document is a 510(k) summary, which focuses on demonstrating substantial equivalence to a predicate device rather than detailing specific acceptance criteria and the full study methodology in the way a clinical study report would. Therefore, some information, particularly regarding specific acceptance criteria values, sample sizes for test and training sets, number and qualification of experts, adjudication methods, and MRMC study specifics, is not explicitly stated in this document. The document primarily highlights the "numerous studies" that have examined concurrent validity.
Acceptance Criteria and Reported Device Performance
Given the nature of the 510(k) submission, the "acceptance criteria" are implicitly tied to demonstrating substantially equivalent performance to the predicate device, ImPACT, in providing an objective measure of neurocognitive functioning to aid in the assessment and management of mild traumatic brain injury (mTBI).
| Acceptance Criteria (Inferred from Substantial Equivalence) | Reported Device Performance (Summary from Document) |
|---|---|
| Intended Use Equivalence: Aid in assessment and management of mTBI by providing objective measures of neurocognitive functioning. | The ANAM Test System's intended use is identical to the predicate device: "intended for use as computer-based neurocognitive test batteries to aid in the assessment and management of mild traumatic brain injury." (p. 5) The ANAM Test System measures various aspects of neurocognitive functioning, including reaction time, memory, attention, and spatial processing speed, similar to the predicate's measurement of verbal and visual memory, visual motor speed, impulse control, and reaction time. |
| Safety and Effectiveness Equivalence: Reliable measure of cognitive function comparable to the predicate device. | The 510(k) submission states, "The 510(k) submission includes the results of numerous studies that have examined the concurrent validity of ANAM as a clinical tool by documenting correlations with traditional neuropsychological tests with both normal and concussed populations. The results of these studies demonstrate that ANAM provides a reliable measure of cognitive function for use as an assessment aid and in the management of concussion and is therefore substantially equivalent to the predicate device." (p. 5) |
| Patient Population Equivalence: Individuals aged 13-65. | The ANAM Test System is indicated for individuals aged 13-65, which is largely similar to the predicate device's age range of 12-59 years. |
| Fundamental Neurocognitive Functions Measured: Assess core cognitive domains relevant to mTBI. | ANAM measures "response speed, attention/concentration, immediate and delayed memory, spatial processing, inhibition, and decision processing speed and efficiency." This aligns with the types of functions measured by the predicate device (verbal and visual memory, visual motor speed, impulse control, and reaction time). (p. 5) |
| Reporting and Interpretation Features: Provide meaningful data for clinical interpretation, including comparison to normative data and reliable change indices. | ANAM provides raw scores, standard scores (from a normative database), and Reliable Change Indices (RCI) for individual tests and an ANAM Composite Score (ACS). This is comparable to the predicate device's provision of composite scores, percentile scores, and RCIs. (p. 5) |
Study Proving Device Meets Acceptance Criteria
The document states that the substantial equivalence determination is based on "numerous studies" that have examined the concurrent validity of ANAM.
-
Sample sizes used for the test set and the data provenance:
- Sample Size: Not explicitly stated for specific test sets within this summary. It mentions "numerous studies" with "normal and concussed populations."
- Data Provenance: Not specified (e.g., country of origin). The document implies the studies are part of the broader clinical evidence for the device. The studies examined "concurrent validity" by correlating ANAM with "traditional neuropsychological tests." This suggests retrospective or prospective clinical data involving real patient populations.
-
Number of experts used to establish the ground truth for the test set and the qualifications of those experts:
- Not specified within the 510(k) summary. The ground truth for "concurrent validity" studies would typically involve the results from the "traditional neuropsychological tests" administered by qualified neuropsychologists or clinicians.
-
Adjudication method (e.g. 2+1, 3+1, none) for the test set:
- Not specified. The studies focused on "concurrent validity" which suggests a comparison to established, validated neuropsychological tests rather than an adjudication process between human readers for diagnostic consensus.
-
If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance:
- Not applicable/Not mentioned. The ANAM Test System is described as a "computer-based neurocognitive test battery" and a "software only device." It functions as an adjunctive tool to aid healthcare professionals in assessment and management. This type of device typically provides quantitative measures of cognitive function directly, rather than assisting human 'readers' in interpreting medical images or complex data in an MRMC study setup. The studies focus on the validity of the test itself in measuring cognitive function.
-
If a standalone (i.e. algorithm only without human-in-the-loop performance) was done:
- Yes, implicitly. The "performance data" section (p. 5) discusses the results of studies examining the "concurrent validity of ANAM as a clinical tool by documenting correlations with traditional neuropsychological tests." This refers to the standalone performance of the ANAM test in measuring cognitive function and its correlation with established measures, without direct human-in-the-loop assistance for interpreting the ANAM results, though a human clinician ultimately uses the results in their assessment.
-
The type of ground truth used (expert consensus, pathology, outcomes data, etc):
- The ground truth relies on the scores and results derived from "traditional neuropsychological tests" administered to "normal and concussed populations." This implies that expert diagnosis of concussion and the established measurements from these traditional gold-standard tests served as the reference for determining concurrent validity.
-
The sample size for the training set:
- Not specified in the 510(k) summary. Given that it's a "computer-based neurocognitive test battery" and not a typical AI/ML algorithm that requires a discrete training dataset in the same way, any "training" would likely refer to the iterative development and validation of the test components and norming data based on large population studies, rather than a separate "training set" for an explicit AI model. The document mentions "normative data" and a "normative database."
-
How the ground truth for the training set was established:
- For the establishment of "normative data" (which would serve a similar function to a training set for a traditional AI model), the ground truth would be established through the collection of ANAM test performance data from large, healthy populations across different demographics, age groups, and potentially educational levels. This process involves statistical analysis to define "normal" ranges and establish a reliable baseline against which individual performance can be compared. The summary mentions "standard scores (calculated with the normative database)" and "the summed T-score of a normative control group."
{0}------------------------------------------------
Image /page/0/Picture/0 description: The image shows the logo of the U.S. Food and Drug Administration (FDA). On the left is the seal of the Department of Health & Human Services. To the right of the seal is the FDA logo, which consists of the letters "FDA" in a blue square, followed by the words "U.S. FOOD & DRUG" in blue, and the word "ADMINISTRATION" in a smaller font size below.
March 25, 2021
Vista LifeSciences, Inc. Margaret Molloy President and CEO 7375 S. Peoria St. Suite 210 Englewood, Colorado 80112
Re: K201376
Trade/Device Name: ANAM Test System Regulation Number: 21 CFR 882.1471 Regulation Name: Computerized Cognitive Assessment Aid for Concussion Regulatory Class: Class II Product Code: POM Dated: February 11, 2021 Received: February 19, 2021
Dear Margaret Molloy:
We have reviewed your Section 510(k) premarket notification of intent to market the device referenced above and have determined the device is substantially equivalent (for the indications for use stated in the enclosure) to legally marketed predicate devices marketed in interstate commerce prior to May 28, 1976, the enactment date of the Medical Device Amendments, or to devices that have been reclassified in accordance with the provisions of the Federal Food, Drug, and Cosmetic Act (Act) that do not require approval of a premarket approval application (PMA). You may, therefore, market the device, subject to the general controls provisions of the Act. Although this letter refers to your product as a device, please be aware that some cleared products may instead be combination products. The 510(k) Premarket Notification Database located at https://www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfpmn/pmn.cfm identifies combination product submissions. The general controls provisions of the Act include requirements for annual registration, listing of devices, good manufacturing practice, labeling, and prohibitions against misbranding and adulteration. Please note: CDRH does not evaluate information related to contract liability warranties. We remind you, however, that device labeling must be truthful and not misleading.
If your device is classified (see above) into either class II (Special Controls) or class III (PMA), it may be subject to additional controls. Existing major regulations affecting your device can be found in the Code of Federal Regulations, Title 21, Parts 800 to 898. In addition, FDA may publish further announcements concerning your device in the Federal Register.
Please be advised that FDA's issuance of a substantial equivalence determination does not mean that FDA has made a determination that your device complies with other requirements of the Act or any Federal statutes and regulations administered by other Federal agencies. You must comply with all the Act's requirements, including, but not limited to: registration and listing (21 CFR Part 807); labeling (21 CFR Part
{1}------------------------------------------------
801); medical device reporting of medical device-related adverse events) (21 CFR 803) for devices or postmarketing safety reporting (21 CFR 4, Subpart B) for combination products (see https://www.fda.gov/combination-products/guidance-regulatory-information/postmarketing-safety-reportingcombination-products); good manufacturing practice requirements as set forth in the quality systems (QS) regulation (21 CFR Part 820) for devices or current good manufacturing practices (21 CFR 4. Subpart A) for combination products; and, if applicable, the electronic product radiation control provisions (Sections 531-542 of the Act); 21 CFR 1000-1050.
Also, please note the regulation entitled, "Misbranding by reference to premarket notification" (21 CFR Part 807.97). For questions regarding the reporting of adverse events under the MDR regulation (21 CFR Part 803), please go to https://www.fda.gov/medical-device-safety/medical-device-reportingmdr-how-report-medical-device-problems.
For comprehensive regulatory information about medical devices and radiation-emitting products, including information about labeling regulations, please see Device Advice (https://www.fda.gov/medicaldevices/device-advice-comprehensive-regulatory-assistance) and CDRH Learn (https://www.fda.gov/training-and-continuing-education/cdrh-learn). Additionally, you may contact the Division of Industry and Consumer Education (DICE) to ask a question about a specific regulatory topic. See the DICE website (https://www.fda.gov/medical-device-advice-comprehensive-regulatoryassistance/contact-us-division-industry-and-consumer-education-dice) for more information or contact DICE by email (DICE@fda.hhs.gov) or phone (1-800-638-2041 or 301-796-7100).
Sincerely,
Jay Gupta Assistant Director DHT5A: Division of Neurosurgical, Neurointerventional and Neurodiagnostic Devices OHT5: Office of Neurological and Physical Medicine Devices Office of Product Evaluation and Quality Center for Devices and Radiological Health
Enclosure
{2}------------------------------------------------
Indications for Use
510(k) Number (if known) K201376
Device Name ANAM Test System
Indications for Use (Describe)
The ANAM® Test System: Military, Military Expanded, Core, and Sports Batteries are intended for use as computerbased neurocognitive test batteries to aid in the assessment of mild traumatic brain injury. The ANAM Test System: Military, Military Expanded, Core, and Sports Batteries are neurocognitive test batteries that provide healthcare professionals with objective measure of neurocognitive functioning as assessment aids and in the management of mild traumatic brain injury in individuals ages 13-65.
The ANAM Test System should only be used as an adjunctive tool for evaluating cognitive function.
| Type of Use (Select one or both, as applicable) | |
|---|---|
| Prescription Use (Part 21 CFR 801 Subpart D) | Over-The-Counter Use (21 CFR 801 Subpart C) |
CONTINUE ON A SEPARATE PAGE IF NEEDED.
This section applies only to requirements of the Paperwork Reduction Act of 1995.
DO NOT SEND YOUR COMPLETED FORM TO THE PRA STAFF EMAIL ADDRESS BELOW.
The burden time for this collection of information is estimated to average 79 hours per response, including the time to review instructions, search existing data sources, gather and maintain the data needed and complete and review the collection of information. Send comments regarding this burden estimate or any other aspect of this information collection, including suggestions for reducing this burden, to:
Department of Health and Human Services Food and Drug Administration Office of Chief Information Officer Paperwork Reduction Act (PRA) Staff PRAStaff(@fda.hhs.gov
"An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB number."
{3}------------------------------------------------
5. 510(K) SUMMARY
In accordance with 21 CFR 807.87(h) and (21 CFR 807.92) the 510(k) Summary for the ANAM Test System is provided below.
| Device Common Name: | Computerized Cognitive Test |
|---|---|
| Device Proprietary Name: | ANAM Test System |
| Applicant: | Vista LifeSciences, Inc.PO Box 4670Parker CO 80134Phone: 888.733.8804 Ext. 1www.vistalifesciences.com |
| Contact: | Margaret E. MolloyCEO and PresidentVista LifeSciences, Inc.PO Box 4670Parker CO 80134Phone: 888.733.8804 Ext. 4Email: memolloy@vistapartners.com |
| Prepared by: | Lori WhiteQuality Systems Program ManagerVista LifeSciences, Inc.PO Box 4670Parker CO 80134Phone: 888.733.8804 Ext. 1Email: lori.white@vistalifesciences.com |
| Date Prepared: | March 22, 2021 |
| Classification Regulation: | 882.1471 Computerized Cognitive Assessment Aid forConcussion |
| Panel: | Neurology |
| Product Code: | POM |
| Predicate Device: | DEN150037, ImPACT |
{4}------------------------------------------------
Indication for Use:
The ANAM® Test System: Military, Military Expanded, Core, and Sports Batteries are intended for use as computer-based neurocognitive test batteries to aid in the assessment and management of mild traumatic brain injury. The ANAM Test System: Military Expanded, Core, and Sports Batteries are neurocognitive test batteries that provide healthcare professionals with objective measure of neurocognitive functioning as assessment aids and in the management of mild traumatic brain injury in individuals ages 13-65.
The ANAM Test System should only be used as an adjunctive tool for evaluating cognitive function.
Device Description:
The ANAM Test System is a software only device that provides clinicians with objective measurements of cognitive performance in populations, to aid in the assessment and management of concussion. ANAM measures various aspects of neurocognitive functioning including reaction time, memory, attention, and spatial processing speed. It also records symptoms of concussion in the test taker.
The software is downloaded from the Vista LifeSciences website and is for use on Dell Inspiron 15 3000 Series or similar Windows PC model or Android Samsung Galaxy tablet or similar Android device. The hardware is not provided as part of the device but is purchased separately by the user. Each ANAM battery consists of a collection of pre-selected modules that are administered in a sequential manner.
Specific modules included in the ANAM Test System:
-
- Questionnaires
-
- Demographics
-
- Mood Scale
-
- Neurobehavioral Symptom Inventory (NSI)
-
- PTSD Checklist (PCL)
-
- Sleepiness Scale
-
- Symptoms Checklist
-
- TBI Questionnaire
Performance Tests
-
- Code Substitution Learning
-
- Code Substitution Delayed
-
- Go/No-Go"
-
- Matching to Sample*
-
- Mathematical Processing
-
- Memory Search
-
- Procedural Reaction Time
-
- Simple Reaction Time*
-
- Spatial Processing*
- *Available for tablet platform.
{5}------------------------------------------------
The tests and questionnaires can be combined into custom batteries or users can choose from pre-configured standardized batteries. The standardized batteries include ANAM Core, ANAM Sports. ANAM Military, and ANAM Military-Expanded. These standardized batteries have fixed test settings and parameters to ensure standardized presentation and enable comparison to normative data.
This 510(k) submission provides evidence demonstrating that the ANAM Test System is substantially equivalent to a POM predicate device and is therefore safe and effective to use following concussion. The ANAM Core, Sports, Military, and Military-Expanded batteries as well as the individual tests comprising these batteries have demonstrated sensitivity to the cognitive effects of concussion and, thus, will serve as the focus of the materials provided herein. In some cases descriptions and features of the entire ANAM Test System have been provided to better facilitate the understanding of the complete system and its many features as a computerized cognitive assessment aid.
Performance Data:
The 510(k) includes the results of numerous studies that have examined the concurrent validity of ANAM as a clinical tool by documenting correlations with traditional neuropsychological tests with both normal and concussed populations. The results of these studies demonstrate that ANAM provides a reliable measure of cognitive function for use as an assessment aid and in the management of concussion and is therefore substantially equivalent to the predicate device.
Substantial Equivalence:
Both the predicate device and ANAM "provide healthcare professionals with objective measure of neurocognitive functioning as an assessment aid and in the management of concussion". The predicate device does this by measuring verbal and visual memory, visual motor speed, impulse control, and reaction time. ANAM also measures fundamental neurocognitive functions including response speed, attention/concentration, immediate and delayed memory, spatial processing, inhibition, and decision processing speed and efficiency.
The intended use of ANAM is the same as that of the predicate device, namely for use as a computer-based neurocognitive test battery to aid in the assessment and management of concussion.
| Proposed Device | Predicate Device | |
|---|---|---|
| 510(k) Number | TBD | DEN 150037 |
| Device Name | ANAM Test System | ImPACT |
| Submitter | Vista LifeSciences, Inc. | ImPACT Applications, Inc. |
| Classification Regulation | Class II | Class II |
| Product Code | POM | POM |
| Proposed Device | Predicate Device | |
| Indication | The ANAM® Test System:Military, Military Expanded,Core, and Sports Batteries areintended for use as computer-based neurocognitive testbatteries to aid in the assessmentand management of mildtraumatic brain injury. TheANAM Test System: Military,Military Expanded, Core, andSports Batteries areneurocognitive test batteries thatprovide healthcare professionalswith objective measure ofneurocognitive functioning asassessment aids and in themanagement of mild traumaticbrain injury in individuals ages13-65.The ANAM Test System shouldonly be used as an adjunctivetool for evaluating cognitivefunction. | ImPACT is intended for use as acomputer-based neurocognitivetest battery to aid in theassessment and management ofconcussion.ImPACT is a neurocognitive testbattery that provides healthcareprofessionals with objectivemeasure of neurocognitivefunctioning as an assessment aidand in the management ofconcussion in individuals ages12-59. |
| Platform | PC: Dell Inspiron 15 3000 Seriesor similar Windows laptopcomputer, Windows 10 operatingsystem.Tablet: Samsung Galaxy Tab Atablet or similar Android device,Android 7.1 – 8.1 operatingsystems. | Internet browser. |
| Use Cases | Measures change over timeand/or compares performancewith normative data. | Measures change over timeand/or compares performancewith normative data. |
| Patient Population | Individuals | Individuals |
| Age of Users | 13-65 years | 12-59 |
| How Provided | Software only, downloaded | Internet browser |
| Proposed Device | Predicate Device | |
| Reporting features | ANAM Performance Report(APR) provides raw scores andstandard scores (calculated withthe normative database) for eachtest within the battery. APR alsoyields the ANAM CompositeScore (ACS) summarizingperformance across the testbattery. The ACS is a summed T-score that is computed relative tothe summed T-score of anormative control group. TheACS is reported in standarddeviation units. Reliable ChangeIndices (RCI) are calculated anddisplayed for each individual testto capture change in performancebetween a specified test sessionand a previous test session (e.g.baseline). | ImPACT Clinical Reportprovides composite scores fortests in the battery includingVerbal Memory Composite,Visual Memory Composite,Visual Motor Speed Composite,Reaction Time Composite,Impulse Control Composite,Total Symptom Score, andCognitive Efficiency Index(CEI). Reliable Change Indices(RCI) are calculated anddisplayed to capture change inperformance between a specifiedtest session and a previous testsession (e.g. baseline). |
| Results Interpretation | Clinical interpretation of theresults includes comparison withthe normative database and/orprevious test sessions. ANAMprovides raw scores, standardscores, and reliable changeindices for each test.Performance on sub-tests areevaluated individually as well aswithin the context of the entiretest battery. | Clinical interpretation of theresults includes comparison withthe normative database and/orprevious test sessions. ImPACTprovides raw scores andpercentile scores. Performanceon sub-tests are evaluatedindividually and presented ascomposite scores. |
A technological comparison is provided in the table below.
{6}------------------------------------------------
{7}------------------------------------------------
Summary / Conclusion of Substantial Equivalence Rationale
Although there are some differences in the modules between ANAM and the predicate device, the performance testing demonstrates that ANAM provides a reliable measure of neurocognitive functioning to aid in the assessment and management of concussion and is therefore substantially equivalent to the predicate device.
§ 882.1471 Computerized cognitive assessment aid for concussion.
(a)
Identification. The computerized cognitive assessment aid for concussion is a prescription device that uses an individual's score(s) on a battery of cognitive tasks to provide an indication of the current level of cognitive function in response to concussion. The computerized cognitive assessment aid for concussion is used only as an assessment aid in the management of concussion to determine cognitive function for patients after a potential concussive event where other diagnostic tools are available and does not identify the presence or absence of concussion. It is not intended as a stand-alone diagnostic device.(b)
Classification. Class II (special controls). The special controls for this device are:(1) Software, including any proprietary algorithm(s) used by the device to arrive at its interpretation of the patient's cognitive function, must be described in detail in the software requirements specification (SRS) and software design specification (SDS). Software verification, validation, and hazard analysis must be performed.
(2) Clinical performance data must be provided that demonstrates how the device functions as an interpretation of the current level of cognitive function in an individual that has recently received an injury that causes concern about a possible concussion. The testing must:
(i) Evaluate device output and clinical interpretation.
(ii) Evaluate device test-retest reliability of the device output.
(iii) Evaluate construct validity of the device cognitive assessments.
(iv) Describe the construction of the normative database, which includes the following:
(A) How the clinical workup was completed to establish a “normal” population, including the establishment of inclusion and exclusion criteria.
(B) Statistical methods and model assumptions used.
(3) The labeling must include:
(i) A summary of any clinical testing conducted to demonstrate how the device functions as an interpretation of the current level of cognitive function in a patient that has recently received an injury that causes concern about a possible concussion. The summary of testing must include the following:
(A) Device output and clinical interpretation.
(B) Device test-retest reliability of the device output.
(C) Construct validity of the device cognitive assessments.
(D) A description of the normative database, which includes the following:
(
1 ) How the clinical workup was completed to establish a “normal” population, including the establishment of inclusion and exclusion criteria.(
2 ) How normal values will be reported to the user.(
3 ) Representative screen shots and reports that will be generated to provide the user results and normative data.(
4 ) Statistical methods and model assumptions used.(
5 ) Whether or not the normative database was adjusted due to differences in age and gender.(ii) A warning that the device should only be used by health care professionals who are trained in concussion management.
(iii) A warning that the device does not identify the presence or absence of concussion or other clinical diagnoses.
(iv) A warning that the device is not a stand-alone diagnostic.
(v) Any instructions technicians must convey to patients regarding the administration of the test and collection of cognitive test data.