Automatic Speech Recognition in Indonesian Using the Transformer Model

Automatic Speech Recognition (ASR) is useful for converting speech into text. ASR is needed to display automatic subtitles on movies or when conducting video conferencing. The use of deep learning in ASR applications is currently still dominated by Long Short-Term Memory (LSTM) and Recurrent Neural Network (RNN). Several previous studies used the Transformer deep learning model in building the ASR model. The accuracy results obtained are better than the LSTM or RNN models. However, ASR research using the Transformer model is still very limited. This paper will discuss the use of the Transformer model for ASR in Indonesian. The dataset used is the Indonesian language private speech dataset. The experimental results show that the Word Error Rate (WER) and Character Error Rate (CER) produced by the proposed model using the Indonesian language primary dataset are almost the same as using the English language public dataset where the resulting WER and CER are 27.34 and 7.96 for Indonesian and 25.28 and 6.02 for English.