Towards Emotionally Aware AI Smart Classroom: Current Issues and Directions for Engineering and Education
Future smart classrooms that we envision will significantly enhance learning experience and seamless communication among students and teachers using real-time sensing and machine intelligence. Existing developments in engineering have brought the state-of-the-art to an inflection point, where they c...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2018-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/8253436/ |
id |
doaj-a8bf69623325416bb9854efbbe1c23aa |
---|---|
record_format |
Article |
spelling |
doaj-a8bf69623325416bb9854efbbe1c23aa2021-03-29T20:29:23ZengIEEEIEEE Access2169-35362018-01-0165308533110.1109/ACCESS.2018.27918618253436Towards Emotionally Aware AI Smart Classroom: Current Issues and Directions for Engineering and EducationYelin Kim0Tolga Soyata1https://orcid.org/0000-0003-1506-8641Reza Feyzi Behnagh2Department of Electrical and Computer Engineering, State University of New York at Albany, Albany, NY, USADepartment of Electrical and Computer Engineering, State University of New York at Albany, Albany, NY, USADepartment of Educational Theory and Practice, State University of New York at Albany, Albany, NY, USAFuture smart classrooms that we envision will significantly enhance learning experience and seamless communication among students and teachers using real-time sensing and machine intelligence. Existing developments in engineering have brought the state-of-the-art to an inflection point, where they can be utilized as components of a smart classroom. In this paper, we propose a smart classroom system that consists of these components. Our proposed system is capable of making real-time suggestions to an in-class presenter to improve the quality and memorability of their presentation by allowing the presenter to make real-time adjustments/corrections to their non-verbal behavior, such as hand gestures, facial expressions, and body language. We base our suggested system components on existing research in affect sensing, deep learning-based emotion recognition, and real-time mobile-cloud computing. We provide a comprehensive study of these technologies and determine the computational requirements of a system that incorporates these technologies. Based on these requirements, we provide a feasibility study of the system. Although the state-of-the-art research in most of the components we propose in our system are advanced enough to realize the system, the main challenge lies in: 1) the integration of these technologies into a holistic system design; 2) their algorithmic adaptation to allow real-time execution; and 3) quantification of valid educational variables for use in algorithms. In this paper, we discuss current issues and provide future directions in engineering and education disciplines to deploy the proposed system.https://ieeexplore.ieee.org/document/8253436/Educational technologyemotion recognitionsmart classroomdeep learningreal-time computingmobile-cloud computing |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Yelin Kim Tolga Soyata Reza Feyzi Behnagh |
spellingShingle |
Yelin Kim Tolga Soyata Reza Feyzi Behnagh Towards Emotionally Aware AI Smart Classroom: Current Issues and Directions for Engineering and Education IEEE Access Educational technology emotion recognition smart classroom deep learning real-time computing mobile-cloud computing |
author_facet |
Yelin Kim Tolga Soyata Reza Feyzi Behnagh |
author_sort |
Yelin Kim |
title |
Towards Emotionally Aware AI Smart Classroom: Current Issues and Directions for Engineering and Education |
title_short |
Towards Emotionally Aware AI Smart Classroom: Current Issues and Directions for Engineering and Education |
title_full |
Towards Emotionally Aware AI Smart Classroom: Current Issues and Directions for Engineering and Education |
title_fullStr |
Towards Emotionally Aware AI Smart Classroom: Current Issues and Directions for Engineering and Education |
title_full_unstemmed |
Towards Emotionally Aware AI Smart Classroom: Current Issues and Directions for Engineering and Education |
title_sort |
towards emotionally aware ai smart classroom: current issues and directions for engineering and education |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2018-01-01 |
description |
Future smart classrooms that we envision will significantly enhance learning experience and seamless communication among students and teachers using real-time sensing and machine intelligence. Existing developments in engineering have brought the state-of-the-art to an inflection point, where they can be utilized as components of a smart classroom. In this paper, we propose a smart classroom system that consists of these components. Our proposed system is capable of making real-time suggestions to an in-class presenter to improve the quality and memorability of their presentation by allowing the presenter to make real-time adjustments/corrections to their non-verbal behavior, such as hand gestures, facial expressions, and body language. We base our suggested system components on existing research in affect sensing, deep learning-based emotion recognition, and real-time mobile-cloud computing. We provide a comprehensive study of these technologies and determine the computational requirements of a system that incorporates these technologies. Based on these requirements, we provide a feasibility study of the system. Although the state-of-the-art research in most of the components we propose in our system are advanced enough to realize the system, the main challenge lies in: 1) the integration of these technologies into a holistic system design; 2) their algorithmic adaptation to allow real-time execution; and 3) quantification of valid educational variables for use in algorithms. In this paper, we discuss current issues and provide future directions in engineering and education disciplines to deploy the proposed system. |
topic |
Educational technology emotion recognition smart classroom deep learning real-time computing mobile-cloud computing |
url |
https://ieeexplore.ieee.org/document/8253436/ |
work_keys_str_mv |
AT yelinkim towardsemotionallyawareaismartclassroomcurrentissuesanddirectionsforengineeringandeducation AT tolgasoyata towardsemotionallyawareaismartclassroomcurrentissuesanddirectionsforengineeringandeducation AT rezafeyzibehnagh towardsemotionallyawareaismartclassroomcurrentissuesanddirectionsforengineeringandeducation |
_version_ |
1724194743614701568 |