TY - GEN
T1 - Evaluating Learning Analytics of Adaptive Learning Systems
T2 - 6<sup>th</sup> EAI International Conference on Design, Learning, and Innovation
AU - Tretow-Fish, Tobias Alexander Bang
AU - Khalid, Md Saifuddin
N1 - Publisher Copyright:
© 2022, ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering.
PY - 2022
Y1 - 2022
N2 - There is currently no systematic overview of methods for evaluating Learning Analytics (LA) and Learning Analytics Dashboards (LAD) of Adaptive Learning Platforms (ALPs). 10 articles and 2 reviews are analyzed and synthesized. Focusing on the purposes of evaluation, methods used in the studies are grouped into five categories (C1-5): C1) evaluation of LA and LAD design and framework, C2) evaluation of performance with LA and LAD, C3) evaluation of adaptivity functions of the system, C4) evaluation of perceived value, and C5) Evaluation of pedagogical and didactic theory/context. While there is a relative high representation of evaluations in the C1-C4 categories of methods, which contribute to the design and development of the interaction and interface design features, the C5 category is not represented. The presence of pedagogical and didactical theory in the LA, LAD, and ALPs is lacking. Though traces of pedagogical theory is present none of the studies evaluates on its impact.
AB - There is currently no systematic overview of methods for evaluating Learning Analytics (LA) and Learning Analytics Dashboards (LAD) of Adaptive Learning Platforms (ALPs). 10 articles and 2 reviews are analyzed and synthesized. Focusing on the purposes of evaluation, methods used in the studies are grouped into five categories (C1-5): C1) evaluation of LA and LAD design and framework, C2) evaluation of performance with LA and LAD, C3) evaluation of adaptivity functions of the system, C4) evaluation of perceived value, and C5) Evaluation of pedagogical and didactic theory/context. While there is a relative high representation of evaluations in the C1-C4 categories of methods, which contribute to the design and development of the interaction and interface design features, the C5 category is not represented. The presence of pedagogical and didactical theory in the LA, LAD, and ALPs is lacking. Though traces of pedagogical theory is present none of the studies evaluates on its impact.
KW - Adaptive learning platforms
KW - Evaluation
KW - Learning analytics
U2 - 10.1007/978-3-031-06675-7_3
DO - 10.1007/978-3-031-06675-7_3
M3 - Article in proceedings
AN - SCOPUS:85131941380
SN - 9783031066740
T3 - Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST
SP - 37
EP - 52
BT - Proceedings of 6th EAI International Conference
A2 - Brooks, Eva
A2 - Sjöberg, Jeanette
A2 - Møller, Anders Kalsgaard
PB - Springer
Y2 - 10 December 2021 through 11 December 2021
ER -