Abstract
The Test d2 - Revision (d2-R) is a further development of the established d2 Test of Attention. The paper-and-pencil form of the d2-R was published in 2010. The online adaption of the d2-R was recently published within the Hogrefe TestSystem 5, a modern test suite for online assessments. To preserve both the ease of use as well as the psychometrical strength of the d2-R the iterative design process to develop the digital version of d2-R was guided by a close orientation to the paper-and-pencil form.
We conducted usability testing with eye tracking to gather feedback from test users to check design decisions. The most difficult challenge was the absence of a diagnostician in the online setting. Therefore our main objectives were the evaluation of the instructional quality and the correct usage of the test administration (line-by-line working).
One finding was that a reliable testing requires a training phase more than a narrative instruction. The narrative instruction could be reduced to a minimum. Another finding was that all test users consistently worked line by line if the arrangement of items was determined by the law of proximity.
While the item difficulty generates a strong variance between regular users, very experienced users were able to solve the task with high precision over time. Deeper analysis of eye movements showed details of the faster information processing which led to the better performance.
The results show that the online adaptation of the d2-R works as reliable and valid as the paper-and-pencil version and above that, can be used in distributed settings without a diagnostician. In addition the specific implementation of the d2-R allows for a usage with modern browser applications and tablet computers. Highlight videos and results of the current standardization study will be part of the presentation.