A Controllable Recoloring Method for Novel Views Using Segment Anything Model

This paper presents a controllable view recoloring method based on Neural Radiance Fields. Recently, a new palette-based recoloring approach has been proposed to manipulate the entire novel view synthesis in 3D scenes. However, conventional methods performed well only when the color target object is significantly different from the environment. In this paper, we propose a method that can provide a controllable way to recolor a specific object only in the 3D scene by introducing the state-of-the-art Segment Anything Model. The experimental results demonstrate the adaptability of our method to novel view synthesis manipulation.