Integrated vision and sound localization

This paper illustrates the synergic advantages of a multi-modal object localization system utilizing vision and sound localization. Prototype vision and sound localization systems were developed and integrated using spatial probability maps, which allow any number of cameras or microphones with arbitrary orientation to be easily integrated. Test results show a significant improvement in the integrated vision and sound localization (IVSL) system's ability to accurately localize objects in low signal to noise situations. Furthermore, the performance of the IVSL system was shown to surpass that of the individual sub-systems.