Hybrid Educational Environments – Using IoT to detect emotion changes during student interactions

Giacomo Nalli, Georgios Dafoulas, Ariadni Tsiakara, Bahareh Langari, Kajal Mistry, Farzad Tahmasebi Aria
pp.  39 – 52, download
(https://doi.org/10.55612/s-5002-058-001)

Abstract

The use of hybrid educational environments, especially after COVID-19 pandemic, has intensified leading to new pedagogic challenges as the integration of biometric sensors into learning processes. Instructors must adapt their methods so that teaching and its quality are not negatively affected. The aim of this study is to enhance the understanding of students’ learning experiences by analysing biometric data during different learning activities. This paper focuses on the use of an Internet of Things (IoT) device, to collect Galvanic Skin Response (GSR) and Heart rate (HR) levels, in addition to biometric data. The quantitative analysis of the collected data shows a correlation between the data extracted that allow us to detect changes on students’ emotions. Subsequently the data analysis is used by instructors to provide formative feedback to enhance student learning, benefiting learners in terms of self-directed learning and motivation which can help them to improve their performance. The paper illustrates a case study of a hybrid learning university learning activity adopted in undergraduate programmes.

Keywords: Internet of Things, hybrid learning, emotion detection

References
1. Parsons P., Ross D.: Planning a campus to support hybrid learning, in Maricopa Center for Learning and Instruction (2002).
2. Rovai A. P., Jordan H. M.: Blended learning and sense of community: A comparative analysis with traditional and fully online graduate courses, in International Review of Research in Open and Distance Learning (2004). https://doi.org/10.19173/irrodl.v5i2.192
3. Olapiriyakul K., Scher J.M.: A guide to establishing hybrid learning courses: Employing information technology to create a new learning experience and a case study, in Elsevier, pp. 287 — 301 (2006) https://doi.org/10.1016/j.iheduc.2006.08.001
4. Raes A., Detienne L., Windey I., Depaepe F.: A systematic literature review on synchronous hybrid learning: gaps identified, in Learning Environ Res, vol.23, pp. 269–290 (2020) https://doi.org/10.1007/s10984-019-09303-z
5. Verde A., Valero J.M.: Teaching and Learning Modalities in Higher Education During the Pandemic: Responses to Coronavirus Disease 2019, in Frontiers in psychology, vol.12 (2019) https://doi.org/10.3389/fpsyg.2021.648592
6. Li, P. The Role of Interest in Motivation and Learning. DEStech Transactions on Social Science, Education and Human Science (2018). https://doi.org/10.12783/dtssehs/ichss2017/19545
7. Dahl, D. W. Does motivation matter? Managerial Finance, vol 37(7), pp. 582-609 (2011) https://doi.org/10.1108/03074351111140243
8. Da Re L.: Promoting the academic success: the Formative Tutoring between research and intervention in the experience of the University of Padua, in Formazione & Insegnamento, vol. 16, pp. 183–200 (2018)
9. Figueiredo J., García-Peñalvo F.J.: Intelligent Tutoring Systems approach to Introductory Programming Courses, in Eighth International Conference on Technological Ecosystems for Enhancing Multiculturality, Association for Computing Machinery, New York, pp. 34–39 (2020) https://doi.org/10.1145/3434780.3436614
10. Abou El-Seoud M. S., Taj-Eddin I. A., Seddiek N., El-Khouly M. M., Nosseir A.: ELearning and Students’ Motivation: A Research Study on the Effect of E-Learning on Higher Education, in International Journal of Emerging Technologies in Learning (iJET), vol. 9, pp. 20–26 (2014) https://doi.org/10.3991/ijet.v9i4.3465
11. Sun, Y. T. A., Chiou, M. -J. Online Platform to Evolve and Develop Motivational Theories on Manufacturing Management Learning to Achieve Pandemic Curriculum Outcomes, International Conference on Education and Technology (ICET), pp. 224-227 (2020) https://doi.org/10.1109/ICET51153.2020.9276615
12. De Almeida, L. R. Motivating attendee’s participation in distance learning via an automatic messaging plugin for the moodle platform, IEEE Frontiers in Education Conference (FIE), pp. 1-5 (2016). https://doi.org/10.1109/FIE.2016.7757608
13. Shen L., Wang M., Shen R.: Affective e-Learning: Using “Emotional” Data to Improve Learning in Pervasive Learning Environment, in Journal of Educational Technology & Society, vol.12, pp. 176–189 (2009)
14. Mizoguchi K., Yuzurihara M., Ishige A., Sasaki H., Chui D.H., Tabira T.: Chronic stress induces impairment of spatial working memory because of prefrontal dopaminergic dysfunction, in J Neurosci, vol. 20, pp. 1568–74 (2000) https://doi.org/10.1523/JNEUROSCI.20-04-01568.2000
15. Elwess N. L., Vogt, F.D.: Heart Rate and Stress in a College Setting, in Bioscene: The Journal of College Biology Teaching, vol. 31, pp. 20–23 (2005)
16. Vemet-Maury E.: The cutaneous bio-electrical signals and their sources, in ITBM, vol. 12, pp. 98–111 (1991)
17. Joshi A., Kiran R.: Gauging the effectiveness of music and yoga for reducing stress among engineering students: An investigation based on Galvanic Skin Response, in Work, vol 65(3), pp.671 — 678. https://doi.org/10.3233/WOR-203121
18. Kim J., Youn C. H., Woo J. M., Jung S., Kim D.: Association of heart rates with stress response inventory scores in different age groups, In 29th annual international conference of the IEEE engineering in medicine and biology society, pp. 5751–5753 (2007) https://doi.org/10.1109/IEMBS.2007.4353653
19. Fernandes A., Helawar R., Lokesh R., Tari T., Shahapurkar A.V.: Determination of stress using Blood Pressure and Galvanic Skin Response, in International Conference on Communication and Network Technologies, pp. 165–168 (2014) https://doi.org/10.1109/CNT.2014.7062747
20. Nalli G., Amendola D., Smith S.: Artificial Intelligence to improve learning outcomes through online collaborative activities, in European Conference on e-Learning, Vol.21, pp.475–479(2022) https://doi.org/10.34190/ecel.21.1.661
21. Ayari, M. A., Sahbi A, Arslan A. Effects of use of technology on students’ motivation. Journal of teaching and education vol 1(2) , pp. 407-412 (2012)
22. Geer, R. Students’ Voices about Learning with Technology, Journal of Social Sciences, 8, pp. 294-303 (2012)
https://doi.org/10.3844/jssp.2012.294.303
23. McKinney, W. Python for data analysis: Data wrangling with Pandas, NumPy, and IPython. O’Reilly Media, Inc., (2012).
24. Basjaruddin N.C., Syahbarudin F., Sutjiredjeki E.: Measurement Device for Stress Level and Vital Sign Based on Sensor Fusion, in Healthcare informatics research, vol 27(1), pp. 11 — 18 (2021) https://doi.org/10.4258/hir.2021.27.1.11
25. Kotu V., Deshpande B.: Data Science (Second Edition), in Morgan Kaufmann, pp. 65–163 (2019) https://doi.org/10.1016/B978-0-12-814761-0.00004-6
26. Pulse Sensors, https://pulsesensor.com/
27. Rodic, B., Labus, A., Bogdanović, Z., Despotovic-Zrakic, M., Radenkovic, B.: Development of an IoT system for students’ stress management. Facta universitatis – series: Electronics and Energetics. 31. 329-342. (2018). https://doi.org/10.2298/FUEE1803329R

back to Table of Contents