APlausEMR - Audiovisuelle Plausibilität und und Erleben in Mixed Reality mit mehreren Teilnehmern
Elektrotechnik und Informationstechnik
The key objective of this project is to investigate human audiovisual perception and cognition as well as social interaction in multi-party communication scenarios using realistic audiovisual virtual environments (IVEs) as well as acoustically and visually realistic virtual participant representations. Different instances of multi-user IVEs will be addressed in this research, focusing on large multi-user 3D projection screens and 3D spatial audio via open headphones but also comparing to HMD-systems for larger ecological validity. For these systems, the audiovisual and behavioral plausibility of shared virtual environments and realistic 3D-video avatars of remote participants will be studied in context and in comparison with an actual location and further collocated participants. The ultimate goal is to gain a robust understanding of the factors influencing the plausibility of virtual audiovisual experiences while jointly being immersed in realistic IVEs. This will guide the design and implementation of future IVEs that enable close-to-real-life social experiences and communication. Our working hypothesis is that audiovisual coherence and social exchange enables plausible experiences of virtual environments despite the known limitations of 3D visualization and auralization technologies.