ERP Research on Semantic Matching of Audio-visual Information in Interfaces in Quiet-Noise Situations

This study analyzes the information elements of visual user interface and auditory user interface. Taking alarm information as an example, using behavioral data and brain physiological indicators to explore the cognitive rules of audiovisual interface information in quiet and noisy situations, and establish a mapping relationship between audiovisual information and cognitive. Hoping to build a more efficient human-computer interaction interface. The results show that the performance of the
$\mathbf{Icon}\times\mathbf{Earcon}$
combination under noisy environment is significantly lower than that in a quiet environment; and there is no significant difference between
$\mathbf{Text}\times\mathbf{Earcon},\mathbf{Color}\times\mathbf{Earcon}$
in different environments. This means that the combination of
$\mathbf{Icon}\times\mathbf{Earcon}$
is extremely susceptible to environmental influences, while the combination of
$\mathbf{Text}\times\mathbf{Earcon},\mathbf{Color}\times\mathbf{Earcon}$
is just the opposite.