Language Identification in Overlapped Multi-lingual Speeches

Speech, languages, and background voices are overlapped in the multi-speaker environment. The speech separation process is necessary for downstream applications like language and speaker identification and ASR tasks. A combined speech separation and language recognition approach is proposed in this paper. First, the monolingual information is extracted from a multi-speaker multilingual speech scenario, then fed the separated speech to a language identification model. The speech separation model is trained in a single-channel overlapped speech data, and the language identification model is trained in Oriental language corpus. The combined effect of these two models is evaluated in the task of language identification. When the language recognition network is fed with the audio spectrograms separated by the source separation network, the Chinese and Korean language recognition results are significantly improved in terms of accuracy and recall rate than the mixed audio spectrograms.