Adaptive context biasing in transformer-based ASR systems.

Journal: Scientific reports
Published Date:

Abstract

With the advancement of neural networks, end-to-end neural automatic speech recognition (ASR) systems have demonstrated significant improvements in identifying contextually biased words. However, the incorporation of bias layers introduces additional computational complexity, requires increased resources, and leads to redundant biases. In this paper, we propose a Context Bias Adaptive Model, which dynamically assesses the presence of biased words in the input and applies context biasing accordingly. Consequently, the bias layer is activated only for input audio containing biased words, rather than indiscriminately introducing contextual bias information for every input. Our findings indicate that the Context Bias Adaptive Model effectively mitigates the adverse effects of contextual bias while substantially reducing computational costs.

Authors

  • Nurmemet Yolwas
    School of Computer Science and Technology (School of Cyberspace Security), Xinjiang University, Urumqi, 830046, China. nurmemet@xju.edu.cn.
  • Yineng Cai
    School of Computer Science and Technology (School of Cyberspace Security), Xinjiang University, Urumqi, 830046, China.
  • Lixu Sun
    School of Computer Science and Technology (School of Cyberspace Security), Xinjiang University, Urumqi, 830046, China.
  • Yongchao Li
    School of Computer Science and Technology (School of Cyberspace Security), Xinjiang University, Urumqi, 830046, China.
  • Wushouer Silamu
    School of Information Science and Engineering, Xinjiang University, Urumqi 830046, China.
  • Qiqi Du
    College of Computer Science and Technology, Xinjiang University, Urumqi, 830046, China.
  • Ya Huang
  • Zhiwu Sun
    School of Computer Science and Technology (School of Cyberspace Security), Xinjiang University, Urumqi, 830046, China.
  • Jian Peng
    Department of Computer Science, University of Illinois Urbana-Champaign, Urbana, IL, USA.
  • Yajie Wei
    School of Computer Science and Technology (School of Cyberspace Security), Xinjiang University, Urumqi, 830046, China.

Keywords

No keywords available for this article.