TY - GEN
T1 - Engagement detection in e-learning environments using convolutional neural networks
AU - Murshed, Mahbub
AU - Dewan, M. Ali Akber
AU - Lin, Fuhua
AU - Wen, Dunwei
N1 - Publisher Copyright:
© 2019 IEEE.
PY - 2019/8
Y1 - 2019/8
N2 - Learning institutions are responsible for ensuring effective learning environments for online learners. An effective learning environment engages learners in educational activities. In this paper, we investigate the suitability of using three different popular models and a proposed model of convolutional neural network (CNN) for the engagement detection of online learners in their educational activities. By using the models, engagement detection has been done in a scalable and accessible manner by using facial expressions. The three models include all convolutional network (All-CNN), network-in-network (NiN-CNN), and very deep convolutional network (VD-CNN). These models are popular as they have simple network architectures and these have shown efficiency in different pattern classification applications. Each model has some unique features that made it different from the traditional as well as the other architectures. The All-CNN model replaces the max-pooling layer by a convolutional layer with increased stride. The NiN-CNN model replaces the linear convolutional layer with a multilayer perceptron and the fully connected layer by the same number of activation maps of the target classes. The VD-CNN model increases the depth by using small (3×3) convolutional filters. In the proposed model, we accumulate a number of advantageous features from the above three base models and achieved promising improvement. In the proposed model, the linear convolutional layer is replaced with a multilayer perceptron, the depth of the network is increased by using small (3×3) convolutional filters, and some max-pooling layers are replaced by convolutional layer with an increased stride. The three base models and the proposed model are applied on Dataset for the Affective States in E-Environments (DAiSEE) and analyzed their performances in a learner's engagement detection, where the proposed model outperforms the others.
AB - Learning institutions are responsible for ensuring effective learning environments for online learners. An effective learning environment engages learners in educational activities. In this paper, we investigate the suitability of using three different popular models and a proposed model of convolutional neural network (CNN) for the engagement detection of online learners in their educational activities. By using the models, engagement detection has been done in a scalable and accessible manner by using facial expressions. The three models include all convolutional network (All-CNN), network-in-network (NiN-CNN), and very deep convolutional network (VD-CNN). These models are popular as they have simple network architectures and these have shown efficiency in different pattern classification applications. Each model has some unique features that made it different from the traditional as well as the other architectures. The All-CNN model replaces the max-pooling layer by a convolutional layer with increased stride. The NiN-CNN model replaces the linear convolutional layer with a multilayer perceptron and the fully connected layer by the same number of activation maps of the target classes. The VD-CNN model increases the depth by using small (3×3) convolutional filters. In the proposed model, we accumulate a number of advantageous features from the above three base models and achieved promising improvement. In the proposed model, the linear convolutional layer is replaced with a multilayer perceptron, the depth of the network is increased by using small (3×3) convolutional filters, and some max-pooling layers are replaced by convolutional layer with an increased stride. The three base models and the proposed model are applied on Dataset for the Affective States in E-Environments (DAiSEE) and analyzed their performances in a learner's engagement detection, where the proposed model outperforms the others.
KW - Convolutional neural network
KW - Deep learning
KW - Engagement detection
KW - Facial expressions
KW - Online learning environment
UR - http://www.scopus.com/inward/record.url?scp=85075149134&partnerID=8YFLogxK
U2 - 10.1109/DASC/PiCom/CBDCom/CyberSciTech.2019.00028
DO - 10.1109/DASC/PiCom/CBDCom/CyberSciTech.2019.00028
M3 - Published Conference contribution
AN - SCOPUS:85075149134
T3 - Proceedings - IEEE 17th International Conference on Dependable, Autonomic and Secure Computing, IEEE 17th International Conference on Pervasive Intelligence and Computing, IEEE 5th International Conference on Cloud and Big Data Computing, 4th Cyber Science and Technology Congress, DASC-PiCom-CBDCom-CyberSciTech 2019
SP - 80
EP - 86
BT - Proceedings - IEEE 17th International Conference on Dependable, Autonomic and Secure Computing, IEEE 17th International Conference on Pervasive Intelligence and Computing, IEEE 5th International Conference on Cloud and Big Data Computing, 4th Cyber Science and Technology Congress, DASC-PiCom-CBDCom-CyberSciTech 2019
T2 - 17th IEEE International Conference on Dependable, Autonomic and Secure Computing, IEEE 17th International Conference on Pervasive Intelligence and Computing, IEEE 5th International Conference on Cloud and Big Data Computing, 4th Cyber Science and Technology Congress, DASC-PiCom-CBDCom-CyberSciTech 2019
Y2 - 5 August 2019 through 8 August 2019
ER -