Playing and learning in the blink of an eye: integrating eye-tracking technologies into game-based special needs education

1 Introduction The exponential growth of the video game industry has led to new questions in the already remarkably complex and varied field of education and skill development. This rapid evolution has caught the attention of educators, psychologists, and researchers, who have begun to explore the potential of video games as educational tools. In particular, the intersection of video game technology and pedagogy has opened new frontiers in the field of special needs education, an area that has long sought innovative approaches to meet the unique needs of students with disabilities or learning difficulties. This article aims to examine the potential of integrating video games into special needs education through the use of innovative software and hardware tools, such as eye trackers. The goal is to explore how these technologies can be leveraged to achieve better results in terms of learning outcomes and skill development for students with special needs. 2 Playing and learning through adaptive hardware and Eye tracking technologies Eye tracking technologies are emerging as promising tools for increasing the immersiveness of video games and enhancing learning processes. Chan and colleagues have highlighted how the use of Eye tracking can be conducive to skill acquisition and increased engagement of individuals with learning disabilities. These technologies offer new possibilities for monitoring and analyzing gameplay and students’ cognitive processes during game-based learning activities, providing valuable information for both educators, to optimize instructional strategies, and developers, to adopt inclusive design from the earliest stages of game design. As pointed out by Lai and colleagues [2], Eye tracking can be used to assess the visual attention and cognitive load of players and learners, allowing play and educational content to be dynamically adapted to their needs. Several companies and organizations are exploring the use of this innovative tool in video games to improve their accessibility: the Eye Asteroids project by Microsoft Research, for example, has demonstrated how Eye tracking can be implemented in a classic arcade game, providing an immersive gaming experience for players with motor disabilities. In addition, the British organization Special Effect, has developed EyeMine software, which allows gamers with motor disabilities or limited mobility to play Minecraft using eye movements alone. However, the implementation of these technologies also raises important ethical and practical issues. Privacy concerns associated with the use of Eye tracking data require careful consideration. The types of gazes and pupil dilation, for example, can be unique to each individual, and can allow identification and tracking across different games or platforms. Furthermore, this data can reveal sensitive information about gamers’ interests and preferences, which could be improperly used for creating targeted advertising or for other purposes, without the player’s explicit consent. To address these issues, it would be desirable for game designers and industry stakeholders to develop clear privacy policies and terms of service that describe how eye tracking data is collected, used, and shared. The development of innovative hardware devices, such as the Xbox Adaptive Controller and the PlayStation Access Controller, has greatly affected the accessibility of video games too. These tools, which are characterized by a modular and flexible architecture, allow for the customization of the gaming experience, adapting it to the specific needs of each user. 3 Eye-opening Gameplay: Tracking the Future of Inclusive Education Because of these considerations, we argue that eye-trackers, adaptive controllers and similar accessibility-promoting technologies could be further integrated into classrooms, specifically in game-based activities aimed at special needs students. Such experiments have been conducted, for example, by Donmez and Cagiltay, who developed education games based on eye movement for students with low vision; or by Vessoyan and colleagues, who effectively utilized eye-tracking technologies to help students affected by Rett syndrome to achieve individualized communication goals. Vickers and colleagues, meanwhile, have observed how an adaptive eyetracking interface can be leveraged to let students perform locomotion tasks in immersive computer games. The aim of this paper is to assess these existing examples through a literature review, extrapolating good practices, evaluating their pedagogical results and reflecting on the possibility of utilizing state-of the-art technologies to thrust future developments, while addressing the privacy and ethical concerns cited previously. 4 Conclusion In conclusion, the integration of eye-tracking technologies and adaptive hardware into game-based special needs education presents a promising frontier for enhancing learning outcomes and accessibility. This innovative approach offers unique opportunities to create immersive, personalized learning experiences that cater to the diverse needs of students with disabilities. Moving forward, collaborative efforts between educators, game developers, and researchers will be essential to refine these technologies and develop best practices for their implementation. Ultimately, the thoughtful integration of eye-tracking and adaptive technologies in game-based learning environments has the potential to revolutionize special needs education, fostering more inclusive, engaging, and effective learning experiences for all students.