Article,

Diagnostik von ICT-Literacy. Multiple-Choice- vs. simulationsbasierte Aufgaben

, , , , and .
Diagnostica Zeitschrift für Psychologische Diagnostik und Differentielle Psychologie, (January 2014)
DOI: 10.1026/0012-1924/a000113

Abstract

ICT literacy suggests a performance-based assessment by means of tasks presenting interactive (simulated) computer environments and requiring responses by means of mouse and/or keyboard. However, assessment procedures like self-ratings or paper-based performance measures are still commonly used. The present study compares the psychometric properties of simulation-based (SIM) tasks with parallel multiple-choice (MC) tasks that make use of screenshots of software applications. The MC tasks, developed for the National Educational Panel Study (NEPS), reflect the skill to select and retrieve digital information and to perform basic operations (access). In a random groups design, 405 grade 9 students completed the computer-based access items as MC tasks or as SIM tasks as well as the simulation-based Basic Computer Skills (BCS) test. Results show that the majority of MC tasks and SIM tasks differ in difficulty and loading. Consistent convergent validity is indicated by comparably high correlations of the two test forms with BCS.

Tags

Users

  • @neps.dc

Comments and Reviews