Construction and Evaluation of a Personalized Virtual Teaching and Learning Environment Based on OKLM Digital Twin Technology

In this research, we aim to develop a new educational and learning platform using virtual technology and learning analytics.

The diagram below illustrates the concept of the virtual teaching and learning platform (“Meta-School”) that this research aims to develop.

In the face of an increasingly aging population, the education sector is expected to experience a decline in the number of students. This will likely lead to various impacts, including school mergers and closures due to depopulation, as well as challenges in teacher allocation.

The “Meta-School” being developed in this research enables the creation of an immersive and realistic teaching and learning environment by connecting classrooms and schools through a shared metaverse space.

Moreover, by using the “Meta-School,” we will develop a system for collecting and analyzing learner activity data within the virtual world.

We will also install VR cameras and directional microphones in educational settings to record on-demand VR lesson videos, and develop a system within Meta-School to deliver immersive lecture content.

The Meta-School Classroom and Its Features

① Classroom for Whole-Class Instruction

Teachers can project educational materials onto a screen in the virtual classroom and deliver lectures to multiple students.

Students can participate in the virtual classroom anytime, anywhere by connecting to the internet and wearing a head-mounted display (HMD).

This research expands the current environment to enable interactions such as dialogue and gestures (e.g., raising hands or waving) between teachers and students, as well as among students themselves—replicating the dynamics of face-to-face lectures—while also allowing the use of VR materials during lectures.

② Self-Study Classroom

Learners can watch lecture videos from whole-class sessions in the self-study classroom.

In the self-study classroom, a display is placed on the desk, allowing learners to select a video they wish to watch and begin playback by clicking the Start button in front of the display.

In addition, the eye-tracking functionality of the HMD allows for the collection of gaze data, which can be utilized for learning analytics research.

③ Group Work Classroom

The group work classroom is equipped with features that support effective collaboration.

For example, when an avatar is moved into a group area, the system limits audio so that only avatars within that area can hear each other.

Each group is also provided with a dedicated screen, which can be used to share content through screen sharing.

In addition, the system provides group work support features such as a button designed to encourage the generation of ideas during discussions, and a whiteboard where participants can write their ideas on virtual sticky notes, organize them, and group them together.

These group work features support collaborative learning among users assigned to groups through the OKLM-DT.

④ Recording on-demand VR lecture videos

We will install VR cameras and directional microphones in real-world classrooms to provide on-demand VR lecture videos with 3D visuals and audio. This will allow learners to experience lectures with a greater sense of presence compared to traditional 2D video and audio, and is expected to enhance the effectiveness of teaching and learning.

Return to Projects page