Proceedings of International Conference on Applied Innovation in IT
2025/04/26, Volume 13, Issue 1, pp.43-49

Classification of the Topicality and Relevance of Evaluation Tools for VR Applications


Caroline Schon, Rong Huang, Hanna Hessenmüller, Simon Przybyl and Johannes Tümler


Abstract: Virtual reality (VR) has emerged as one of the fastest growing technologies in recent years, offering transformative opportunities in various disciplines such as education, medicine and industry. Classifying the advantages and disadvantages of such VR simulations must be done using appropriate evaluation tools. Despite these rapid technological developments, the evaluation of VR experiences lags behind technological advances. This article examines the discrepancy between the rapid technical evolution of VR and the slow progress in the development of suitable evaluation methods. Existing evaluation approaches are analyzed and their limitations in the context of new VR applications are identified. In addition, potential solutions and future research directions will be identified to enable a more appropriate assessment of the user experience, effectiveness and impact of VR technologies. The aim is to promote an integrated evaluation framework that can keep pace with technological innovations and thus support the sustainable use of VR in different application areas.

Keywords: Virtual Reality, Evaluation, Questionnaire Analysis, User Involvement.

DOI: Under Indexing

Download: PDF

References:

  1. P. Kourtesis, S. Collina, L. A. A. Doumas, and S. E. MacPherson, "Validation of the virtual reality neuroscience questionnaire: Maximum duration of immersive virtual reality sessions without the presence of pertinent adverse symptomatology," Frontiers in Human Neuroscience, vol. 13, no. 417, pp. 1-15, Nov 2019, [Online]. Available: https://doi.org/10.3389/fnhum.2019.00417.
  2. A. Napetschnig, K. Brixius, and W. Deiters, "Development of a core set of quality criteria for virtual reality applications designed for older adults: Multistep qualitative study," Interactive Journal of Medical Research, vol. 12, pp. 1-15, Sep 2023, [Online]. Available: https://doi.org/10.2196/45433.
  3. J. Ye, S. Badiyani, V. Raja, and T. Schlegel, "Applications of Virtual Reality in Product Design Evaluation," in Human-Computer Interaction. HCI Applications and Services, J. A. Jacko, Ed., pp. 1190-1199, 2007, [Online]. Available: https://doi.org/10.1007/978-3-540-73111-5_130.
  4. S. Borsci, G. Lawson, and S. Broome, "Empirical evidence, evaluation criteria and challenges for the effectiveness of virtual and mixed reality tools for training operators of car service maintenance," Computers in Industry, vol. 67, pp. 17-26, Feb 2015, [Online]. Available: https://doi.org/10.1016/j.compind.2014.12.002.
  5. P. Antonopoulos, E. Fokides, and G. Koutromanos, "Understanding learning and learning experience in immersive virtual reality," Tech Know Learn, pp. 1-20, Aug 2024, [Online]. Available: https://doi.org/10.1007/s10758-024-09764-z.
  6. O. E. Tsivitanidou, Y. Georgiou, and A. Ioannou, "A learning experience in inquiry-based physics with immersive virtual reality: Student perceptions and an interaction effect between conceptual gains and attitudinal profiles," Journal of Science Education and Technology, vol. 30, no. 6, pp. 841-861, Dec 2021, [Online]. Available: https://doi.org/10.1007/s10956-021-09924-1.
  7. T. Kojic, D. Ali, R. Greinacher, S. Möller, and J.-N. Voigt-Antons, "User experience of reading in virtual reality - finding values for text distance, size and contrast," in 2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX), pp. 1-6, 2020, [Online]. Available: https://doi.org/10.1109/QoMEX48832.2020.9123091.
  8. C. Wienrich, N. Döllinger, S. Kock, K. Schindler, and O. Traupe, "Assessing User Experience in Virtual Reality - A Comparison of Different Measurements," in Design, User Experience, and Usability: Theory and Practice, A. Marcus and W. Wang, Eds., pp. 573-589, 2018, [Online]. Available: https://doi.org/10.1007/978-3-319-91797-9_41.
  9. N. Pares and R. Pares, "Towards a model for a virtual reality experience: The virtual subjectiveness," Presence: Teleoperators and Virtual Environments, vol. 15, no. 5, pp. 524-538, Oct 2006, [Online]. Available: https://doi.org/10.1162/pres.15.5.524.
  10. P. Grabarczyk and M. Pokropski, "Perception of affordances and experience of presence in virtual reality," AVANT. The Journal of the Philosophical-Interdisciplinary Vanguard, vol. 7, no. 2, pp. 25-44, Dec 2016, [Online]. Available: https://doi.org/10.26913/70202016.0112.0002.
  11. M. A. Mirzaei, F. Merienne, and J.-R. Chardonnet, "Influence of navigation parameters on cybersickness in virtual reality," Virtual Reality, vol. 25, no. 3, pp. 565-574, Sep 2021, [Online]. Available: https://doi.org/10.1007/s10055-020-00474-2.
  12. A. Halbig and M. E. Latoschik, "A systematic review of physiological measurements, factors, methods, and applications in virtual reality," Frontiers in Virtual Reality, vol. 2, pp. 1-20, Jul 2021, [Online]. Available: https://doi.org/10.3389/frvir.2021.694567.
  13. H. J. Yoon, J. Kim, S. W. Park, and H. Heo, "Influence of virtual reality on visual parameters: immersive versus non-immersive mode," BMC Ophthalmology, vol. 20, no. 1, pp. 1-10, Dec 2020, [Online]. Available: https://doi.org/10.1186/s12886-020-01471-4.
  14. G. Wang and A. Suh, "User adaptation to cybersickness in virtual reality: A qualitative study," in Proceedings of the 27th European Conference on Information Systems (ECIS), pp. 1-12, Jun 2019, [Online]. Available: https://aisel.aisnet.org/ecis2019_rp/191.
  15. R. Huang, J. Rödigh, A. Berger, and J. Tümler, "Ein virtuelles biotech-haus für das lehren in der biotechnologie," in Proceedings of DELFI Workshops 2022, pp. 77-85, 2022, [Online]. Available: https://doi.org/10.18420/delfi2022-ws-17.
  16. J. Tümler, M. Alptekin, K. Krylova, R. Huang, and J. Rödigh, "Weiterentwicklung des vr-biotech-house: Wein- und hefeherstellung," in Proceedings of DELFI Workshops 2024, pp. 1-10, 2024, [Online]. Available: https://doi.org/10.18420/delfi2024-ws-04.


    HOME

       - Call for Papers
       - Paper Submission
       - For Authors
       - For Reviewers
       - Important Dates
       - Conference Committee
       - Editorial Board
       - Reviewers
       - Last Proceedings


    PROCEEDINGS

       - Volume 13, Issue 1 (ICAIIT 2025)        - Volume 12, Issue 2 (ICAIIT 2024)        - Volume 12, Issue 1 (ICAIIT 2024)        - Volume 11, Issue 2 (ICAIIT 2023)
       - Volume 11, Issue 1 (ICAIIT 2023)
       - Volume 10, Issue 1 (ICAIIT 2022)
       - Volume 9, Issue 1 (ICAIIT 2021)
       - Volume 8, Issue 1 (ICAIIT 2020)
       - Volume 7, Issue 1 (ICAIIT 2019)
       - Volume 7, Issue 2 (ICAIIT 2019)
       - Volume 6, Issue 1 (ICAIIT 2018)
       - Volume 5, Issue 1 (ICAIIT 2017)
       - Volume 4, Issue 1 (ICAIIT 2016)
       - Volume 3, Issue 1 (ICAIIT 2015)
       - Volume 2, Issue 1 (ICAIIT 2014)
       - Volume 1, Issue 1 (ICAIIT 2013)


    PAST CONFERENCES

       ICAIIT 2025
         - Photos
         - Reports

       ICAIIT 2024
         - Photos
         - Reports

       ICAIIT 2023
         - Photos
         - Reports

       ICAIIT 2021
         - Photos
         - Reports

       ICAIIT 2020
         - Photos
         - Reports

       ICAIIT 2019
         - Photos
         - Reports

       ICAIIT 2018
         - Photos
         - Reports

    ETHICS IN PUBLICATIONS

    ACCOMODATION

    CONTACT US

 

        

         Proceedings of the International Conference on Applied Innovations in IT by Anhalt University of Applied Sciences is licensed under CC BY-SA 4.0


                                                   This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License


           ISSN 2199-8876
           Publisher: Edition Hochschule Anhalt
           Location: Anhalt University of Applied Sciences
           Email: leiterin.hsb@hs-anhalt.de
           Phone: +49 (0) 3496 67 5611
           Address: Building 01 - Red Building, Top floor, Room 425, Bernburger Str. 55, D-06366 Köthen, Germany

        site traffic counter

Creative Commons License
Except where otherwise noted, all works and proceedings on this site is licensed under Creative Commons Attribution-ShareAlike 4.0 International License.