Portable Lumipen: Dynamic SAR in Your Hand

Based on the concept of spatial augmented reality (SAR), a number of applications have been developed by extending the type of target objects to include dynamically moving objects; however, the systems themselves still remain fixed. In this paper, we propose a new paradigm for dynamic SAR implemented with a mobile device and a practical architecture using a 3D-stacked vision chip and a high-speed optical gaze controller. We evaluated the prototype system that we developed, called “Portable Lumipen”, and confirmed that image capturing at 1000 fps, rapid processing and a 3 ms response time for projection were achieved on a mobile device. We also propose potential applications using this portable dynamic SAR system and demonstrated miniaturization of a high-speed visual feedback system.