An Improved GaborNet Visual Encoding Model with Nonlinear Mapping and Data Augmentation

Constructing visual encoding model is an important way to understand the human visual system. Data-driven encoding models learn features by directly fitting neural data, providing novel insights for visual encoding. Prediction accuracy is an important performance goal of visual encoding. The GaborNet visual encoding (GaborNet-VE) model has both good expressiveness and interpretability, while its prediction performance still needs to be improved. In this work, we proposed an improved GaborNet-VE model by adding data augmentation and nonlinear mapping module. The experimental results show that the improved GaborNet-VE model achieves higher prediction accuracy in V2, V3, V4 and LO. Our research provides a new framework for the data-driven encoding model.