Real-Time Facial Emotion Recognition System for Smart Classrooms

Yousif, Hayder; Mishra, Ahmed

doi:10.25673/123728

Proceedings of International Conference on Applied Innovation in IT · 2026/03/31 · Vol. 14 · Issue 1 · pp. 1271–1277

Real-Time Facial Emotion Recognition System for Smart Classrooms

Hayder Abdulameer Yousif, Ahmed Hussein Ahmed and Gouri Shankar Mishra

📄 Download PDF DOI: 10.25673/123728

Abstract

The adaptive and personalized learning in the age of smart education requires real-time tracking of student interaction. Facial Emotion Recognition (FER) is a non-invasive and a high-performance tool in decoding emotional reactions of students in the classroom. This paper presents a lightweight, real-time FER system to be used in smart classroom environments, which takes advantage of deep convolutional neural networks (CNNs), which are optimized to run on the edge. The pipeline used in the system includes face detection, preprocessing, CNN-based emotion classifier, and dashboard visualization on live webcam feeds. It is tested on benchmark datasets (FER2013, RAF-DB) and on data recorded in the classroom and proved to be highly accurate on a per-class basis with low inference latency. With a mean frame rate of 25-59 FPS based on the hardware setup, the system is able to run continuously on any of the typical computing platforms. Also, analytics of emotion trends throughout the period of classes give useful feedback to teachers. The findings affirm the model to be suitable in the real time, ethical, and pedagogically effective classroom application.

Keywords

Facial Emotion Recognition Smart Classroom Real-Time FER Deep Learning Student Engagement CNN Affective Computing Dashboard Feedback.

References

S. Li, W. Deng, and J. Du, “Reliable crowdsourcing and deep locality-preserving learning for expression recognition in the wild,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2852-2861, 2017.
A. Mollahosseini, B. Hasani, and M. H. Mahoor, “AffectNet: A database for facial expression, valence, and arousal computing in the wild,” IEEE Transactions on Affective Computing, vol. 10, no. 1, pp. 18-31, 2017.
P. Tzirakis, G. Trigeorgis, M. A. Nicolaou, B. W. Schuller, and S. Zafeiriou, “End-to-end multimodal emotion recognition using deep neural networks,” IEEE Journal of Selected Topics in Signal Processing, vol. 11, no. 8, pp. 1301-1309, 2017.
P. Barros and S. Wermter, “Developing crossmodal expression recognition based on a deep neural model,” Adaptive Behavior, vol. 24, no. 5, pp. 373-396, 2016.
D. Kollias, P. Tzirakis, M. A. Nicolaou, A. Papaioannou, G. Zhao, B. Schuller, and S. Zafeiriou, “Deep affect prediction in-the-wild: Aff-Wild database and challenge, deep architectures, and beyond,” International Journal of Computer Vision, vol. 127, no. 6, pp. 907-929, 2019.
S. Suyahman and A. Hapsari, “VGG-Based Feature Extraction for Classifying Traditional Batik Motifs Using Machine Learning Models,” Preservation, Digital Technology & Culture, 2025.
L. Londoño, J. V. Hurtado, N. Hertz, P. Kellmeyer, S. Voeneky, and A. Valada, “Fairness and bias in robot learning,” Proceedings of the IEEE, vol. 112, no. 4, pp. 305-330, 2024.
X. Tang, Y. Gong, Y. Xiao, J. Xiong, and L. Bao, “Facial expression recognition for probing students’ emotional engagement in science learning,” Journal of Science Education and Technology, vol. 34, no. 1, pp. 13-30, 2025.
Y. Huang, W. Deng, and T. Xu, “A Study of Potential Applications of Student Emotion Recognition in Primary and Secondary Classrooms,” Applied Sciences, vol. 14, no. 23, 2024.
R. Pereira, C. Mendes, J. Ribeiro, R. Ribeiro, R. Miragaia, N. Rodrigues, and A. Pereira, “Systematic review of emotion detection with computer vision and deep learning,” Sensors, vol. 24, no. 11, p. 3484, 2024.
M. Shomoye and R. Zhao, “Automated emotion recognition of students in virtual reality classrooms,” Computers & Education: X Reality, vol. 5, p. 100082, 2024.
E. M. Polo, F. Iacomi, A. V. Rey, D. Ferraris, A. Paglialonga, and R. Barbieri, “Advancing emotion recognition with Virtual Reality: A multimodal approach using physiological signals and machine learning,” Computers in Biology and Medicine, vol. 193, p. 110310, 2025.
A. O. R. Vistorte, A. Deroncele-Acosta, J. L. M. Ayala, A. Barrasa, C. López-Granero, and M. Martí-González, “Integrating artificial intelligence to assess emotions in learning environments: a systematic literature review,” Frontiers in Psychology, vol. 15, p. 1387089, 2024.
M. Á. Quiroz-Martínez, S. Díaz-Fernández, K. Aguirre-Sánchez, and M. D. Gómez-Ríos, “Analysis of Students’ Emotions in Real-Time During Class Sessions Through an Emotion Recognition System,” in International Conference on Science, Technology and Innovation for Society, pp. 81-92, Springer Nature Switzerland, 2024.
O. H. Hameed, M. M. Hamzah, M. L. Saad, G. R. Abduljabbr, A. S. Barrak, and Y. W. Abduljaleel, “Thermal and Mechanical Analysis of Polyvinyl Chloride (PVC) to Polyethylene (PE) Bonding via Friction Stir Spot Welding Process,” Journal of Techniques, vol. 7, no. 2, pp. 60-66, 2025, [Online]. Available: https://doi.org/10.51173/jt.v7i2.2686.
M. Alrubay and H. Almusa, “Power Allocation in Cell Free Massive MIMO system under Pilot Contamination,” Electrical Engineering Technical Journal, vol. 2, no. 1, pp. 1-10, 2025, [Online]. Available: https://doi.org/10.51173/eetj.v2i1.12.
H. S. Ezzulddin, “Proposed Model for Credit Card Fraud Detection Model Using Machine Learning Technique,” InfoTech Spectrum: Iraqi Journal of Data Science, vol. 3, no. 1, 2025, doi: 10.51173/ijds.v3i1.50.