Interactive 3D Reconstruction in Virtual Reality for Training, Education and Communication

We are thrilled to announce our collaboration with Vividhata Pty Ltd on an industry-focused PhD project aimed at addressing key challenges in the Virtual Reality, Computer Graphics, 3D reconstruction, training, education, and communication sector.

Our project, titled "Interactive 3D Reconstruction in Virtual Reality for Training, Education and Communication," focuses on developing immersive and interactive VR experiences using real-world 3D scanned environments and actors. It seeks to advance the use of 3D Gaussian Splatting, 3D scanning, and Generative AI to create high-fidelity VR training simulations where participants can move freely and interact with responsive virtual actors.

It aims to make VR-based training more realistic, engaging, and accessible, particularly for applications in communication, diversity, inclusion, and social learning.

Collaborative Approach:
Leveraging the University of Technology Sydney’s renowned expertise in engineering, computer vision, immersive technologies, and advanced 3D data processing and Vividhata Pty Ltd's industry leadership in social justice, diversity, inclusion, organisational culture, and communication training, this project epitomises a collaborative approach that bridges the gap between academia and industry.

Value for Industry:
“Virtual Reality can be a game changer for DEI training and inclusion. Vividhata is delighted to support Sonain’s PhD research and advance VR that we will apply to our DEI experiences" - Highlighting the value and impact of the project from the industry partner's perspective.

Student Perspective:
 "I am excited to participate in this project because it brings together my interests in 3D reconstruction, virtual reality, and generative AI to create immersive training experiences with real social impact. The opportunity to work with UTS and Vividhata on interactive 3D Gaussian Splatting environments is especially motivating because the research can make high-fidelity VR training more accessible, engaging, and meaningful for communication, education, diversity, and inclusion."

Project Outcomes/Impact:
The expected outcomes of this project include new methods for rendering and interacting with 3D Gaussian Splatting environments in VR, frameworks for integrating scanned human actors into immersive training simulations, and Generative AI-driven approaches for realistic avatar behaviour and dialogue.

For the industry partner this means development of advanced Virtual Reality and immersion for DEI training for clients for faster learning saving time, greater confidence in learners giving better ROI.