An integrated working environment using advanced augmented reality techniques

This paper presents an Augmented Reality (AR) comprehensive assembly system for the multi-interactive creation of assembly processes. The special multimodal interface allows the presentation of not only new types of visual display but also interestingly designed voice instructions and material flow management. The system simulates many-sided and complicated assembly tasks in various areas of manufacturing. We use a half-silvered mirror and a face tracking system to detect the mutual interaction between users and 3D object imaging. The positional sensors of the workbench and the precise tracking of markers allow significant information on the exact position of real assembly components to be harvested. On the basis of continuous monitoring of material flow the system knows how to recognize that the value of the quantity has fallen below the permissible value which is useful for the indirect monitoring of stocks and enables upcoming predictions of low states in storerooms. The paper presents a complex AR system and the interaction techniques for improved productivity of the entire assembly process. The interaction techniques of the AR system have been tested by an industrial company. The test results are explained and show that our AR system gives powerful virtual tools to create assembly instructions without human error.