The HOLOTWIN project: Holographic telepresence combining 3D imaging, haptics and AI

Immersive telepresence systems have become possible because of technological advances in 360-degree and multi-view video systems, AR, VR, and immersive audio-haptic systems, as well as contributions from other relevant scientific fields, such as computer vision, deep learning, spatial audio, mobile communications, volumetric capturing, etc. This new way of communicating is based on being able to feel completely immersed in a conversation between two people who do not share the same space. This is a big improvement over the current solutions, which are based on 2D videoconferencing. The project HOLOTWIN - “Enhancing Capacity and Research Excellence in Holographic Telepresence Systems as a Catalyst of Digitalisation” laid the groundwork for research on how to overcome the challenges from the information transmission aspect, where real-time constraints and narrowband channels are imposed while heterogeneous amounts of data must be transmitted, including haptics.