Precise Surface Color Estimation Using a Non-Diagonal Reflectance Matrix on an Adaptive Projector-Camera System

A projector camera system for controlling the appearance of real objects is useful for public viewing. However, projector camera systems need to estimate scenes under the white light from a camera image taken under the color light of the projector and adaptively generate a new projector image. In such a feedback system, the quality of the estimation of the scene color under the white light affects the quality of the projection image directly. In this study, we propose a precise online estimation of the scene color assuming that the reflectance matrix non-diagonal and can be determined with three parameters. This enables the projector-camera system to be applied to design tools or food AR, which require a high-quality grade for material perception simulations.