test validity and reliability in assessment

was supported by the Swiss National Science Foundation (grants BSSG10_155915, 100014_178841, 32003B_166566, and PP00P1_170506/1), the Foundation for Research in Science and the Humanities at the University of Zurich (STWF-17-012), and the Baugarten Stiftung. The work is made available under the Creative Commons CC0 public domain dedication.ĭata Availability: All data and analysis files are available on the public GitHub repository.

This is an open access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose.

Received: JAccepted: JanuPublished: January 27, 2023 De La Torre, University of Cadiz: Universidad de Cadiz, SPAIN Salmon CE, Piper BJ, Pamplona GSP (2023) Evaluation of the reliability and validity of computerized tests of attention. Taken together, our results provide necessary information to help design and interpret studies involving attention assessments.Ĭitation: Langner R, Scharnowski F, Ionta S, G. We substantiate convergent and discriminant validity for several task scores using between-task correlations and provide further evidence for construct validity via associations of task scores with attentional and motivational assessments. Stability across application sites was observed for the CPT and Switcher task, but practice effects were observed for all tasks except the PVT. Across tasks, response time scores showed adequate reliability, whereas scores of performance accuracy, variability, and deterioration over time did not. For all tasks, we evaluated test-retest reliability using the intraclass correlation coefficient (ICC), as well as internal consistency through within-test correlations and split-half ICC. Here, we evaluated the reliability and validity of computerized attention tasks as provided with the PEBL package: Continuous Performance Task (CPT), Switcher task, Psychomotor Vigilance Task (PVT), Mental Rotation task, and Attentional Network Test. Aiming for a wide applicability of attentional assessments, Psychology Experiment Building Language (PEBL) is an open-source software system for designing and running computerized tasks that tax various attentional functions. Different aspects of attention can be assessed through psychological tests to identify stable individual or group differences as well as alterations after interventions.

Test validity and reliability in assessment