Extending a Web-Based XR Stack for Shared Immersive Environments

Description

Recent developments in browser-based technologies – including three.js, cannon.js, WebXR, WebRTC, Node.js and WebSockets – enable real-time 3D and XR applications without installation or platform lock-in. However, compared to traditional game engines, the current lightweight WebXR ecosystem lacks a clear architectural foundation for multi-user experiences, agent-based interaction models (comparable to Actors in Unreal or GameObjects in Unity), and a structured asset/animation pipeline.

This work aims to extend an existing Web-based XR stack to support shared immersive environments, agent-based programming, and integrated asset management.

The project involves:

• Building a shared multi-user environment with real-time synchronisation (lobby/room organisation via WebSockets, high-frequency data via WebRTC)
• Integrating physics (cannon.js) and rendering (three.js) within a shared world coordinate system
• Designing and implementing an agent programming layer with a clear lifecycle (init, update, teardown), event handling (collisions, input, network messages), and optional server-side authority
• Creating an asset management workflow (based on three.js' supported asset formats)
• Developing a small but polished demonstrator (e.g., multi-user XR game or interactive sandbox

Prerequisites

• JavaScript knowledge
• Basic experience with three.js/WebGL or comparable frameworks
• Interest in XR, distributed systems, or interactive simulations
• Familiarity with networking concepts (WebSockets, WebRTC) is helpful

Supervision

• Prof. Dr. Sebastian von Mammen
• Dr. Allal Tiberkak, Medea University