There has been a proliferation of learning analytics (LA) interfaces designed to support teachers, such as LA dashboards. However, although teacher dashboards have been extensively studied, there is limited understanding of the relationship between single-page or multi-page dashboard designs and the cognitive demands placed on teachers to use them. Additionally, teachers typically have varying levels of visualisation literacy (VL), which may make it easier or more difficult for them to engage with single-page versus multi-page dashboard designs. In this paper, we explore how teachers, with varying VL, use single-page and multi-page LA dashboards. We conducted a quasi-experimental study with 23 higher education teachers of varied VL inspecting single and multi-page LA dashboards. We used an eye-tracking device to measure cognitive load while teachers inspected the LA dashboards in online group work. We investigated how proxy metrics derived from eye-tracking data related to teachers' cognitive load varied depending on the type of the dashboard teacher used and the level of VL teachers have. Our findings suggest that the design of the LA dashboard had an impact on the cognitive load experienced by the teachers. Post-hoc analysis revealed that teachers with low VL had a marginally lower cognitive load when using single-page dashboards. We argue that the LA dashboard design for teachers should account for teachers' levels of VL and provide design recommendations.
Description
Single or Multi-page Learning Analytics Dashboards? Relationships Between Teachers’ Cognitive Load and Visualisation Literacy | SpringerLink
%0 Conference Paper
%1 10.1007/978-3-031-42682-7_23
%A Pozdniakov, Stanislav
%A Martinez-Maldonado, Roberto
%A Tsai, Yi-Shan
%A Srivastava, Namrata
%A Liu, Yuchen
%A Gasevic, Dragan
%B Responsive and Sustainable Educational Futures
%C Cham
%D 2023
%E Viberg, Olga
%E Jivet, Ioana
%E Muñoz-Merino, Pedro J.
%E Perifanou, Maria
%E Papathoma, Tina
%I Springer Nature Switzerland
%K dashboard ectel2023 learning-analytics
%P 339--355
%T Single or Multi-page Learning Analytics Dashboards? Relationships Between Teachers' Cognitive Load and Visualisation Literacy
%X There has been a proliferation of learning analytics (LA) interfaces designed to support teachers, such as LA dashboards. However, although teacher dashboards have been extensively studied, there is limited understanding of the relationship between single-page or multi-page dashboard designs and the cognitive demands placed on teachers to use them. Additionally, teachers typically have varying levels of visualisation literacy (VL), which may make it easier or more difficult for them to engage with single-page versus multi-page dashboard designs. In this paper, we explore how teachers, with varying VL, use single-page and multi-page LA dashboards. We conducted a quasi-experimental study with 23 higher education teachers of varied VL inspecting single and multi-page LA dashboards. We used an eye-tracking device to measure cognitive load while teachers inspected the LA dashboards in online group work. We investigated how proxy metrics derived from eye-tracking data related to teachers' cognitive load varied depending on the type of the dashboard teacher used and the level of VL teachers have. Our findings suggest that the design of the LA dashboard had an impact on the cognitive load experienced by the teachers. Post-hoc analysis revealed that teachers with low VL had a marginally lower cognitive load when using single-page dashboards. We argue that the LA dashboard design for teachers should account for teachers' levels of VL and provide design recommendations.
%@ 978-3-031-42682-7
@inproceedings{10.1007/978-3-031-42682-7_23,
abstract = {There has been a proliferation of learning analytics (LA) interfaces designed to support teachers, such as LA dashboards. However, although teacher dashboards have been extensively studied, there is limited understanding of the relationship between single-page or multi-page dashboard designs and the cognitive demands placed on teachers to use them. Additionally, teachers typically have varying levels of visualisation literacy (VL), which may make it easier or more difficult for them to engage with single-page versus multi-page dashboard designs. In this paper, we explore how teachers, with varying VL, use single-page and multi-page LA dashboards. We conducted a quasi-experimental study with 23 higher education teachers of varied VL inspecting single and multi-page LA dashboards. We used an eye-tracking device to measure cognitive load while teachers inspected the LA dashboards in online group work. We investigated how proxy metrics derived from eye-tracking data related to teachers' cognitive load varied depending on the type of the dashboard teacher used and the level of VL teachers have. Our findings suggest that the design of the LA dashboard had an impact on the cognitive load experienced by the teachers. Post-hoc analysis revealed that teachers with low VL had a marginally lower cognitive load when using single-page dashboards. We argue that the LA dashboard design for teachers should account for teachers' levels of VL and provide design recommendations.},
added-at = {2023-09-03T21:10:23.000+0200},
address = {Cham},
author = {Pozdniakov, Stanislav and Martinez-Maldonado, Roberto and Tsai, Yi-Shan and Srivastava, Namrata and Liu, Yuchen and Gasevic, Dragan},
biburl = {https://www.bibsonomy.org/bibtex/2d5816c86c3e2eeabb340f35dac55accc/brusilovsky},
booktitle = {Responsive and Sustainable Educational Futures},
description = {Single or Multi-page Learning Analytics Dashboards? Relationships Between Teachers’ Cognitive Load and Visualisation Literacy | SpringerLink},
editor = {Viberg, Olga and Jivet, Ioana and Mu{\~{n}}oz-Merino, Pedro J. and Perifanou, Maria and Papathoma, Tina},
interhash = {ce67f7e7ddc0d9755b0dd1e7faaad0e9},
intrahash = {d5816c86c3e2eeabb340f35dac55accc},
isbn = {978-3-031-42682-7},
keywords = {dashboard ectel2023 learning-analytics},
pages = {339--355},
publisher = {Springer Nature Switzerland},
timestamp = {2023-09-03T21:10:23.000+0200},
title = {Single or Multi-page Learning Analytics Dashboards? Relationships Between Teachers' Cognitive Load and Visualisation Literacy},
year = 2023
}