Lessons learned from a project examining the learning outcomes and experiences in 360o videos

Emmanuel Fokides, Penelope Atsikpasi, Paraskevi Anna Arvaniti

Abstract


Advances in technologies associated with virtual reality provide interesting tools for e-learning. One such is 360° videos. Although their educational potential is supported by a number of researchers, there is limited empirical evidence backing such a claim, given that they have recently become popular. The study at hand presents the results of a project in which 360° videos were used by primary school students. Eighty-four students, aged ten to eleven, participated in the experiment. The results demonstrated that 360° videos helped them to acquire more knowledge compared to printed material. Then again, no statistically significant differences were noted when comparing 360° and regular videos. 360° videos provided a more immersive, motivational, and enjoyable learning experience. However, the low-cost HMDs used for viewing 360° videos and the applications in which they were embedded, were considered the least easy to use. Moreover, participants expressed the view that all tools fostered their learning. Overall, while the results give support to the hypothesis that 360o videos provide positive educational experiences, their actual impact on learning has to be further explored.


Full Text:

PDF

References


Akçayır, M., & Akçayır, G. (2017). Advantages and challenges associated with augmented reality for education: A systematic review of the literature. Educational Research Review, 20, 1-11. https://doi.org/10.1016/j.edurev.2016.11.002

Ardisara, A., & Fung, F. M. (2018). Integrating 360° videos in an undergraduate chemistry laboratory course. Journal of Chemical Education, 2018, 1881-1884. https://doi.org/10.1021/acs.jchemed.8b00143

Argyriou, L., Economou, D., & Bouki, V. (2020). Design methodology for 360 immersive video applications: the case study of a cultural heritage virtual tour. Personal and Ubiquitous Computing, 1-17. https://doi.org/10.1007/s00779-020-01373-8

Argyriou, L., Economou, D., Bouki, V., & Doumanis, I. (2016). Engaging immersive video consumers: Challenges regarding 360-degree gamified video applications. Proceedings of the 15th International Conference on Ubiquitous Computing and Communications and 2016 International Symposium on Cyberspace and Security (IUCC-CSS), 145-152. IEEE. https://doi.org/10.1109/IUCC-CSS.2016.028

Berns, A., Mota, J. M., Ruiz-Rube, I., & Dodero, J. M. (2018). Exploring the potential of a 360° video application for foreign language learning. Proceedings of the Sixth International Conference on Technological Ecosystems for Enhancing Multiculturality-TEEM'18, 776-780. ACM https://doi.org/10.1145/3284179.3284309

Carr‐Chellman, A., & Duchastel, P. (2000). The ideal online course. British Journal of Educational Technology, 31(3), 229-241. https://doi.org/10.1111/1467-8535.00154

Chang, C. -Y., Sung, H. -Y., Guo, J. -L., Chang, B. -Y., & Kuo, F. -R. (2019). Effects of spherical video-based virtual reality on nursing students' learning performance in childbirth education training. Interactive Learning Environments, 1-17. https://doi.org/10.1080/10494820.2019.1661854

Cohen, J. (1969) Statistical power analysis for the behavioral sciences. Academic Press.

Curcio, I. D., Dipace, A., & Norlund, A. (2016). Virtual realities and education. Research on Education and Media, 8(2), 60-68. https://doi.org/10.1515/rem-2016-0019

Dawson, H., Alami, N., Bowen, K., & Maddah, D. (2019). The use of virtual reality for public health education with reference to Syrian refugee camps. Proceedings of the Virtual and Augmented Reality to Enhance Learning and Teaching in Higher Education Conference 2018, 73-81. IM Publications Open. https://doi.org/10.1255/vrar2018.ch8

DeCarlo, L. T. (1997). On the meaning and use of kurtosis. Psychological Methods, 2(3), 292-307. https://doi.org/10.1037/1082-989X.2.3.292

Dede, C. (2009). Immersive interfaces for engagement and learning. Science, 323(5910), 66-69. https://doi.org/10.1126/science.1167311

Dede, C. J., Jacobson, J., & Richards, J. (2017). Introduction: virtual, augmented, and mixed realities in education. In Virtual, Augmented, and Mixed Realities in Education (pp. 1-16). Springer. https://doi.org/10.1007/978-981-10-5490-7_1

Diemer, J., Alpers, G. W., Peperkorn, H. M., Shiban, Y., & Mühlberger, A. (2015). The impact of perception and presence on emotional reactions: a review of research in virtual reality. Frontiers in Psychology, 6(26), 1-9. https://doi.org/10.3389/fpsyg.2015.00026

Elmezeny, A., Edenhofer, N., & Wimmer, J. (2018). Immersive storytelling in 360-degree videos: An analysis of interplay between narrative and technical immersion. Journal for Virtual Worlds Research, 11(1), 1-13. https://doi.org/10.4101/jvwr.v11i1.7298

Faul, F., Erdfelder, E., Lang, A. G., & Buchner, A. (2007). G* Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175-191. https://doi.org/10.3758/BF03193146

Field, A. (2013). Discovering statistics using SPSS (4th ed.). Sage Publications

Fokides, E., & Arvaniti, P. A. (2020). Evaluating the effectiveness of 360 videos when teaching primary school subjects related to environmental education. Journal of Pedagogical Research, 2020. https://doi.org/10.33902/JPR.2020063461

Fokides, E., Atsikpasi, P., Kaimara, P., & Deliyannis, I. (2019). Let players evaluate serious games. Design and validation of the Serious Games Evaluation Scale. International Computer Games Association Journal, 41(3), 116-137. https://doi.org/10.3233/ICG-190111

Fokides, E, & Kefalinou, M. (2020). Examining the impact of spherical videos in teaching endangered species/environmental education to primary school students. Journal of Information Technology Education: Research, 19, 427-450. https://doi.org/10.28945/4612

Fokides, E., Polydorou, E., & Mazarakis, P. (2020). Using spherical videos for teaching history to high school students. International Journal of Smart Education and Urban Society, 11(4), 18-34. https://10.4018/IJSEUS.2020100102

Fowler, C. (2015). Virtual reality and learning: Where is the pedagogy? British Journal of Educational Technology, 46(2), 412-422. https://doi.org/10.1111/bjet.12135

Fung, F. M., Choo, W. Y., Ardisara, A., Zimmermann, C. D., Watts, S., Koscielniak, T., Blanc, E., Coumoul, X., & Dumke, R. (2019). Applying a virtual reality platform in environmental chemistry education to conduct a field trip to an overseas site. Journal of Chemical Education, 96(2), 382-386. https://doi.org/10.1021/acs.jchemed.8b00728

Greenhouse, S. W., & Geisser, S. (1959). On methods in the analysis of profile data. Psychometrika, 24(2), 95-112. https://doi.org/10.1007/BF02289823

Greenwald, A. G. (1976). Within-subjects designs: To use or not to use? Psychological Bulletin, 83(2), 314. https://doi.org/10.1037/0033-2909.83.2.314

Grover, V., Jeong, S. R., & Segars, A. H. (1996). Information systems effectiveness: The construct space and patterns of application. Information and Management, 31(4), 177-191. https://doi.org/10.1016/S0378-7206(96)01079-8

Higuera-Trujillo, J. L., López-Tarruella Maldonado, J., & Llinares Millán, C. (2017). Psychological and physiological human responses to simulated and real environments: A comparison between photographs, 360° panoramas, and virtual reality. Applied Ergonomics, 65(65), 398-409. https://doi.org/10.1016/j.apergo.2017.05.006

Hodgson, P., Lee, V. W. Y., Chan, J. C. S., Fong, A., Tang, C. S. Y., Chan, L., & Wong, C. (2019). Immersive virtual reality (IVR) in higher education: Development and implementation. Augmented Reality and Virtual Reality, 161-173. https://doi.org/10.1007/978-3-030-06246-0_12

Huang, H., Hwang, G., & Chang, C. (2019). Learning to be a writer: A spherical video‐based virtual reality approach to supporting descriptive article writing in high school Chinese courses. British Journal of Educational Technology, 2019, 1-20. https://doi.org/10.1111/bjet.12893

Johnson, C. D. L. (2018). Using virtual reality and 360-degree video in the religious studies classroom: An experiment. Teaching Theology & Religion, 21(3), 228-241. https://doi.org/10.1111/teth.12446

Karageorgakis, T., & Nisiforou, E. A. (2018). Virtual reality in the EFL classroom. The Cyprus Review, 30(1), 381-396.

Keren, G. (2014). Between-or within-subjects design: A methodological dilemma. In G. Keren, & C. Lewis (Eds.), A handbook for data analysis in the behaviorial sciences (pp. 257-272). Psychology Press.

King-Thompson, J. (2017). The benefits of 360° Videos & Virtual Reality in Education. https://blend.media/blog/benefits-of-360-videos-virtual-reality-in-education

Kittel, A., Larkin, P., Elsworthy, N., Lindsay, R., & Spittle, M. (2020). Effectiveness of 360° virtual reality and match broadcast video to improve decision-making skill. Science and Medicine in Football, 2020. (in press). https://doi.org/10.1080/24733938.2020.1802506

Lackner, J. R. (2014). Motion sickness: more than nausea and vomiting. Experimental Brain Research, 232(8), 2493-2510. https://doi.org/10.1007/s00221-014-4008-8

Lee, S. H., Sergueeva, K., Catangui, M., & Kandaurova, M. (2017). Assessing Google Cardboard virtual reality as a content delivery system in business classrooms. Journal of Education for Business, 92(4), 153-160. https://doi.org/10.1080/08832323.2017.1308308

Lin, H. C. -S., Yu, S. -J., Sun, J. C. -Y., & Jong, M. S. Y. (2019). Engaging university students in a library guide through wearable spherical video-based virtual reality: Effects on situational interest and cognitive load. Interactive Learning Environments, 1-16. https://doi.org/10.1080/10494820.2019.1624579

Mauchly, J. W. (1940). Significance test for sphericity of a normal n-variate distribution. The Annals of Mathematical Statistics, 11(2), 204-209. https://doi.org/10.1214/aoms/1177731915

Meyer, J., & Land, R. (2003). Threshold concepts and troublesome knowledge: Linkages to ways of thinking and practising within the disciplines. In C. Rust (Ed.), Improving student learning-ten years on (pp. 412-424). OCSLD.

Miller, H. L., & Bugnariu, N. L. (2016). Level of immersion in virtual environments impacts the ability to assess and teach social skills in autism spectrum disorder. Cyberpsychology, Behavior, and Social Networking, 19(4), 246-256. https://doi.org/10.1089/cyber.2014.0682

Newton, R. R., & Rudestam, K. E. (2012). Your statistical consultant. Sage Publications.

Paraskevaidis, P., & Fokides, E. (2020). Using 360o videos for teaching volleyball skills to primary school students. Open Journal for Information Technology, 3(1), 21-38. https://doi.org/10.32591/coas.ojit.0301.03021p

Parmaxi, A., Stylianou, K., & Zaphiris, P. (2018). Enabling social exploration through virtual guidance in Google Expeditions: An exploratory study. Advances in Intelligent Systems and Computing, 397-408. https://doi.org/10.1007/978-3-319-75175-7_40

Pintaric, T., Neumann, U., & Rizzo, A. (2000). Immersive panoramic video. Proceedings of The Eighth ACM International Conference on Multimedia-MULTIMEDIA '00, 493-494. https://doi.org/10.1145/354384.376408

Pham, H. C., Dao, N., Pedro, A., Le, Q. T., Hussain, R., Cho, S., & Park, C. S. I. K. (2018). Virtual field trip for mobile construction safety education using 360-degree panoramic virtual reality. International Journal of Engineering Education, 34, 1174-1191.

Ritchie, H., & Newby, T. J. (1989, July). Instruction: Classroom lecture/discussion vs. Live televised instruction: A comparison of effects on student performance, attitude, and interaction. American Journal of Distance Education, 3, 36-45. https://doi.org/10.1080/08923648909526677

Ritter III, K. A., Stone, H., & Chambers, T. L. (2019). Empowering Through Knowledge: Exploring place-based environmental education in Louisiana classrooms through Virtual Reality. The ASEE Computers in Education Journal, 10(1).

Rupp, M. A., Kozachuk, J., Michaelis, J. R., Odette, K. L., Smither, J. A., & McConnell, D. S. (2016). The effects of immersiveness and future VR expectations on subjective-experiences during an educational 360 video. Proceedings of the Human Factors and Ergonomics Society Annual Meeting (Vol. 60, No. 1), 2108-2112. SAGE Publications. https://doi.org/10.1177/1541931213601477

Rupp, M. A., Odette, K. L., Kozachuk, J., Michaelis, J. R., Smither, J. A., & McConnell, D. S. (2019). Investigating learning outcomes and subjective experiences in 360-degree videos. Computers & Education, 128, 256-268. https://doi.org/10.1016/j.compedu.2018.09.015

Sankaran, N. K., Nisar, H. J., Zhang, J., Formella, K., Amos, J., Barker, L. T., Vozenilek, J. A., La-Valle, S. M., & Kesavadas, T. (2019). Efficacy study on interactive mixed reality (IMR) software with sepsis prevention medical education. Proceedings of the 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 664-670. IEEE. https://doi.org/10.1109/vr.2019.8798089

Sheridan, T. B. (2016). Recollections on presence beginnings, and some challenges for augmented and virtual reality. Presence: Teleoperators and Virtual Environments, 25(1), 75-77. https://doi.org/10.1162/PRES_e_00247

Skondras, E., Siountri, K., Michalas, A., & Vergados, D. D. (2019). Personalized real-time virtual tours in places with cultural interest. International Journal of Computational Methods in Heritage Science, 3(1), 52-68. https://doi.org/10.4018/IJCMHS.2019010104

Slater, M. (2009). Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philosophical Transactions of the Royal Society of London B: Biological Sciences, 364(1535), 3549-3557. https://doi.org/10.1098/rstb.2009.0138

Slater, M. & Sanchez-Vives, M. V. (2016). Enhancing our lives with immersive virtual reality. Frontiers in Robotics and AI, 3. https://doi.org/10.3389/frobt.2016.00074

Smith, W., Rafeek, R., Marchan, S., & Paryag, A. (2012). The use of video‐clips as a teaching aide. European Journal of Dental Education, 16(2), 91-96. https://doi.org/10.1111/j.1600-0579.2011.00724.x

Sun, F.-R., Pan, L.-F., Wan, R.-G., Li, H., & Wu, S.-J. (2018). Detecting the effect of student engagement in an SVVR school-based course on higher level competence development in elementary schools by SEM. Interactive Learning Environments, 1-14. https://doi.org/10.1080/10494820.2018.1558258

Sweller, J. (2005). Implications of cognitive load theory for multimedia learning. The Cambridge Handbook of Multimedia Learning, 3(2), 19-30. https://doi.org/10.1017/CBO9780511816819.003

Taber, K. S. (2018). The use of Cronbach's alpha when developing and reporting research instruments in science education. Research in Science Education, 48(6), 1273-1296. https://doi.org/10.1007/s11165-016-9602-2

Tiku, M. L. (1971). Power function of the F-test under non-normal situations. Journal of the American Statistical Association, 66(336), 913-916. https://doi.org/10.2307/2284254

Tüzün, H., & Özdinç, F. (2016). The effects of 3D multi-user virtual environments on freshmen university students' conceptual and spatial learning and presence in departmental orientation. Computers & Education, 94, 228-240. https://doi.org/10.1016/j.compedu.2015.12.005

Ulrich, F., Helms, N. H., Frandsen, U. P., & Rafn, A. V. (2019). Learning effectiveness of 360° video: experiences from a controlled experiment in healthcare education. Interactive Learning Environments, 1-14. https://doi.org/10.1080/10494820.2019.1579234

Violante, M. G., Vezzetti, E., & Piazzolla, P. (2019). Interactive virtual technologies in engineering education: Why not 360° videos? International Journal on Interactive Design and Manufacturing, 13(2), 729-742. https://doi.org/10.1007/s12008-019-00553-y

Whittleston, G. S., Haynes, B. J., & Mardan, A. (2018). Three applications of augmented reality technologies in structural engineering education. Institution of Structural Engineers-People and Paper Awards 2018. Retrieved from http://usir.salford.ac.uk/id/eprint/51072/1/Gareth-Whittleston-Three-applications-of-augmented-reality-technologies-in-structural-engineering-education.pdf

Wu, J., Guo, R., Wang, Z., & Zeng, R. (2019). Integrating spherical video-based virtual reality into elementary school students' scientific inquiry instruction: effects on their problem-solving performance. Interactive Learning Environments, 1-14. https://doi.org/10.1080/10494820.2019.1587469

Xie, Y., Ryder, L., & Chen, Y. (2019). Using interactive virtual reality tools in an advanced Chinese language class: a case study. TechTrends, 1-9. https://doi.org/10.1007/s11528-019-00389-z

Zhou, C., Li, Z., & Liu, Y. (2017). A measurement study of Oculus 360-degree video streaming. Proceedings of the 8th ACM on Multimedia Systems Conference, 27-37. ACM. https://doi.org/10.1145/3083187.3083190




DOI: https://doi.org/10.51383/jesma.2021.8



Journal of Educational Studies and Multidisciplinary Approaches © 2023 by Journal of Educational Studies and Multidisciplinary Approaches is licensed under CC BY 4.0