HCC: Children's Learning Enhanced with AR and Individualized Responses (CLEARIR)

Augmented reality (AR) headsets supplement the real world by combining virtual objects with the natural environment, increasing user immersion. Children are increasingly using AR headsets, especially for education, as these devices have the potential to increase children’s learning, engagement, and motivation. However, despite this promise, little research has examined how AR headset systems can be designed to adaptively support children’s learning by providing real-time personalized feedback. There is a clear need to better understand how children’s expectations and interaction behaviors shape their experiences with AR headsets in educational contexts, and how to determine children’s reflective thinking and attention states while interacting with AR headset systems to provide personalized learning. This project addresses these concerns by investigating how AR headsets can be optimized as an adaptive learning system for children in intermediate elementary (ages 8 to 13) to enhance learning in a way that is personalized, intuitive, and effective. This project will result in AR headset learning experiences that are specifically designed for children, which will increase their learning for a range of subjects (e.g., science, mathematics) and equip young learners with essential critical thinking, spatial reasoning, and technological skills. This research project includes three phases. First, the project will develop child-centered design principles for adaptive AR headset learning systems through examining stakeholders’ (i.e., children (ages 8 to 13), teachers, and parents) perceptions and preferences of an adaptive AR headset learning system using qualitative research methods, including participatory design methods and focus groups. Second, the project will advance multimodal methods for detecting children’s reflective thinking and attention in AR headset learning systems using video and physiological signals for adaptive intervention timing. Third, the project will evaluate the principles of adaptive intervention timing (i.e., design principles and sensing-based models from the previous phases) for AR headset learning systems in a geospatial learning context with children in extended learning programs. While this project is using geospatial learning tasks as the testbed, our findings will inform adaptive AR design principles across disciplines. This research effort will result in interactive and immersive learning experiences for children that provide personalized support. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.