Real-time Seamless Multi-Projector Displays on Deformable Surfaces

Prior work on multi-projector displays have focused primarily on rigid objects. However, works on projection based displays on deformable dynamic objects have focused only on small scale single projector systems. Tracking a deformable dynamic surface and updating projections precisely in real time to project on it is a significantly challenging task, even for single projector systems. For my dissertation, I am working on developing the first end-to-end solution for achieving a real-time, seamless display on deformable surfaces using mutliple projectors without requiring any prior knowledge of the surface shape or device calibration parameters. Challenges in achieving such a system include accurate calibration of the devices despite a continuously deforming surface, real-time tracking of the changing surface shape using multiple cameras, and real-time warp and blend of the projected imagery to create the seamless display on it. This work has tremendous applications on mobile and expeditionary systems where environmentals (e.g. wind, vibrations, suction) cannot be avoided. One can create large displays on tent walls in remote, austere military or emergency operations in minutes to support large scale command and control, mission rehearsal, large scale visualization or training operations. It can be used to create displays on mobile and inflatable objects for tradeshows/events and touring edutainment applications.