Human-Computer Interaction for Decision Making in Digital Twins with Various Display Environments

Human-Computer Interaction (HCI) is the study of how humans and computers interact to achieve a specific purpose. The applications of digital twins in building/facility management are of special interest in this work. Digital twins of buildings are created by compiling various data into their three-dimensional virtual replicas, which are then updated in real time with the state of the buildings. By employing this approach, facility managers can minimize the time required to assess risks and devise problem-solving strategies remotely, which in turn reduces the need for their physical presence in the facility. The purpose of this study is to investigate the effectiveness of three virtual display environments when the users must make decisions regarding various building-related issues. A single monitor, a tiled display consisting of multiple monitors, and a head-mounted display (often known as VR) make up the three virtual display environments that are key to us. The times it took participants to make decisions in three simulated scenarios-detecting water leakage, identifying and extinguishing fires, and measuring objects-were recorded. Due to participants' prior expertise with the single monitor, this display setting had the best average decision making time. However, upon closer examination of each task, we discovered that the head-mounted display placed second in multiple tasks, despite the fact that the majority of participants had never used it. Decision-making duties involving the collection of data from multiple perspectives and with a realistic sense of objects or surroundings will make the most of this display environment.