A Real-Time Learning Analytics Dashboard for Automatic Detection of Online Learners’ Affective States

• Main Authors: Akçapınar, G. (Author), Bui, H.T.T (Author), Hasnine, M.N (Author), Nguyen, H.T (Author), Tran, T.T.T (Author), Ueda, H. (Author)
• Format: Article
• Language: English
• Published: MDPI 2023
• Subjects: Affective state; Affective state detection; affective states detection; AI in education; dashboard; Dashboard; distance learning; Education, Distance; E-learning; emotion; Emotion; Emotions; human; Humans; Laptop computers; learning; Learning; Learning analytic framework; learning analytics framework; Learning systems; Lecture video; Lecture video analyse; lecture video analysis; motivation; Motivation; Real- time; student; Students; Video analysis
• Online Access: View Fulltext in Publisher; View in Scopus

 Students’ affective states describe their engagement, concentration, attitude, motivation, happiness, sadness, frustration, off-task behavior, and confusion level in learning. In online learning, students’ affective states are determinative of the learning quality. However, measuring various affective states and what influences them is exceedingly challenging for the lecturer without having real interaction with the students. Existing studies primarily use self-reported data to understand students’ affective states, while this paper presents a novel learning analytics system called MOEMO (Motion and Emotion) that could measure online learners’ affective states of engagement and concentration using emotion data. Therefore, the novelty of this research is to visualize online learners’ affective states on lecturers’ screens in real-time using an automated emotion detection process. In real-time and offline, the system extracts emotion data by analyzing facial features from the lecture videos captured by the typical built-in web camera of a laptop computer. The system determines online learners’ five types of engagement (“strong engagement”, “high engagement”, “medium engagement”, “low engagement”, and “disengagement”) and two types of concentration levels (“focused” and “distracted”). Furthermore, the dashboard is designed to provide insight into students’ emotional states, the clusters of engaged and disengaged students’, assistance with intervention, create an after-class summary report, and configure the automation parameters to adapt to the study environment. © 2023 by the authors.