Many schools are now equipped with modern technologies such as VR and AR headsets and are increasingly gaining access to AI applications. However, technology alone does not automatically create educational value. What is often missing are concrete, pedagogically grounded learning scenarios that meaningfully integrate these tools into classroom practice. This is precisely where our project begins. Our goal is to leverage innovative technologies in targeted ways to address individual differences among learners, foster self-regulated learning, and make educational content more authentic and experientially rich.

Within the project, we are developing a VR/AR-based learning environment with an integrated multimodal AI dialogue partner that actively supports learners throughout the learning process. The AI incorporates contextual information from the virtual environment and responds to learners’ content-related inputs in order to engage in meaningful dialogue. It reacts individually, provides adaptive explanations, addresses questions, and supports collaborative learning processes in real time. In this way, an immersive learning environment emerges in which exploration, reflection, and dialogue are systematically interconnected.

A central component of the project is the making-education approach. Teachers and students can integrate their own 3D materials—such as 3D models, 360-degree photographs, videos, or other digital objects—into the VR/AR environment and thereby create their own immersive learning spaces. This approach helps overcome the current shortage of ready-made immersive learning applications while enabling a flexible solution that can be applied across subject domains.

Our approach combines AI, immersive technologies, and collaborative learning within a generic and scalable framework. The aim is to empower schools to independently design pedagogically meaningful VR/AR learning scenarios, supported by an intelligent dialogue-based AI system that makes learning interactive, personalized, and future-oriented.