• humans and virtual reality
Institut für Informatik

Principles of Interactive Systems

The Principles of Interactive Systems course provides an introduction into the requirements, concepts, and engineering art of highly interactive human-computer systems. Such systems are typically found in perceptual computing, Virtual, Augmented, Mixed Reality, computer games, and cyber-physical systems. Lately, these systems are often termed Real-Time Interac tive Systems (RIS) due to their common aspects. The course covers theoretical models derived from the requirements of the application area as well as common hands-on and novel solutions necessary to tackle and fulfill these requirements. The first part of the course will concentrate on the conceptual principles characterizing real-time interactive systems. Questions answered are: What are the main requirements? How do we handle multiple modalities? How do we define the timeliness of RIS? Why is it important? What do we have to do to assure timeliness? The second part will introduce a concep tual model of the mission-critical aspects of time, latencies, processes, and events necessary to describe a sy stem's behavior. The third part introduces the application state, it's requirements of distribution and coherence, and the consequences these requirements have on decoupling and software quality aspects in general. The last part introduces some potential solutions to data redundancy, distribution, synchronization, and interoperability. Along the way, typical and prominent state-of-the-art approaches to reoccurring engineering tasks are discussed. This includes pipeline systems, scene graphs, application graphs (aka field routing), event systems, entity and component models, and others. Novel concepts like actor models and ontologies will be covered as alternative solutions. The theoretical and conceptual discussions will be put into a practical context of today's commercial and research systems, e.g., X3D, instant reality, Unity3d, Unreal Engine 4, and Simulator X.