Psychometric Properties of Computerized Cognitive Tools and Standard Neuropsychological Tests Used to Assess Sport Concussion: A Systematic Review

Kristin Wilmoth, Benjamin L. Brett, Natalie A. Emmert, Carolyn M. Cook, Jeffrey Schaffert, Todd Caze, Thomas Kotsonis, Margaret Cusick, Gary Solomon, Jacob E. Resch, C. Munro Cullum, Lindsay D. Nelson, Michael McCrea

Research output: Contribution to journalReview articlepeer-review

4 Scopus citations

Abstract

Athletic programs are more frequently turning to computerized cognitive tools in order to increase efficiencies in concussion assessment. However, assessment using a traditional neuropsychological test battery may provide a more comprehensive and individualized evaluation. Our goal was to inform sport clinicians of the best practices for concussion assessment through a systematic literature review describing the psychometric properties of standard neuropsychological tests and computerized tools. We conducted our search in relevant databases including Ovid Medline, Web of Science, PsycINFO, and Scopus. Journal articles were included if they evaluated psychometric properties (e.g., reliability, sensitivity) of a cognitive assessment within pure athlete samples (up to 30 days post-injury). Searches yielded 4,758 unique results. Ultimately, 103 articles met inclusion criteria, all of which focused on adolescent or young adult participants. Test–retest reliability estimates ranged from.14 to.93 for computerized tools and.02 to.95 for standard neuropsychological tests, with strongest correlations on processing speed tasks for both modalities, although processing speed tasks were most susceptible to practice effects. Reliability was improved with a 2-factor model (processing speed and memory) and by aggregating multiple baseline exams, yet remained below acceptable limits for some studies. Sensitivity to decreased cognitive performance within 72 h of injury ranged from 45%–93% for computerized tools and 18%–80% for standard neuropsychological test batteries. The method for classifying cognitive decline (normative comparison, reliable change indices, regression-based methods) affected sensitivity estimates. Combining computerized tools and standard neuropsychological tests with the strongest psychometric performance provides the greatest value in clinical assessment. To this end, future studies should evaluate the efficacy of hybrid test batteries comprised of top-performing measures from both modalities.

Original languageEnglish (US)
Pages (from-to)675-692
Number of pages18
JournalNeuropsychology Review
Volume33
Issue number4
DOIs
StatePublished - Dec 2023

Keywords

  • Computerized neurocognitive tests
  • Neuropsychological assessment
  • Reliability
  • Sensitivity
  • Sport concussion
  • Validity

ASJC Scopus subject areas

  • Neuropsychology and Physiological Psychology

Fingerprint

Dive into the research topics of 'Psychometric Properties of Computerized Cognitive Tools and Standard Neuropsychological Tests Used to Assess Sport Concussion: A Systematic Review'. Together they form a unique fingerprint.

Cite this