Demo: Robotics meets Augmented Reality: Real-Time Mapping with Boston Dynamics Spot and Microsoft HoloLens 2

In recent years, Simultaneous Localization and Mapping (SLAM) algorithms have gained popularity in the field of robotics for generating maps of environments. This paper presents a novel approach for generating 3D maps of environments visited by a Boston Dynamics robot dog named Spot. Five stereo cameras mounted on the robot dog capture images that are transmitted to a remote machine that generates 3D maps of the environment in real-time. The human operator wears an Augmented Reality (AR) device that embeds the 3D maps into his field of view. Tasks in human demanding environments, where the operator actively intervenes in the performed processes, can be performed remotely. The intention of this application is to stay in a safe place and at the same time take the robot’s perspective.