Result Details

GPU-Accelerated Forward-Backward Algorithm with Application to Lattice-Free MMI

ONDEL YANG, L.; LAM-YEE-MUI, L.; KOCOUR, M.; CORRO, C.; BURGET, L. GPU-Accelerated Forward-Backward Algorithm with Application to Lattice-Free MMI. In ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. Singapore: IEEE Signal Processing Society, 2022. p. 8417-8421. ISBN: 978-1-6654-0540-9.
Type
conference paper
Language
English
Authors
Ondel Lucas Antoine Francois, Mgr., Ph.D., DCGM (FIT)
Lam-Yee-Mui L'ea-Marie
Kocour Martin, Ing., DCGM (FIT)
Corro Caio Filippo
Burget Lukáš, doc. Ing., Ph.D., DCGM (FIT)
Abstract

We propose to express the forward-backward algorithm in terms of operations between sparse matrices in a specific semiring. This new perspective naturally leads to a GPU-friendly algorithm which is easy to implement in Julia or any programming languages with native support of semiring algebra. We use this new implementation to train a TDNN with the LF-MMI objective function and we compare the training time of our system with PyChaina recently introduced C++/CUDA implementation of the LF-MMI loss. Our implementation is about two times faster while not having to use any approximation such as the "leaky-HMM".

Keywords

Lattice-Free MMI, end-to-end ASR, Julia language,forward-backward

URL
Published
2022
Pages
8417–8421
Proceedings
ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
Conference
2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP)
ISBN
978-1-6654-0540-9
Publisher
IEEE Signal Processing Society
Place
Singapore
DOI
10.1109/ICASSP43922.2022.9746824
UT WoS
000864187908145
EID Scopus
2-s2.0-85130631441
BibTeX 
@inproceedings{BUT178409,
  author="Lucas Antoine Francois {Ondel} and L'ea-Marie {Lam-Yee-Mui} and Martin {Kocour} and Caio Filippo {Corro} and Lukáš {Burget}",
  title="GPU-Accelerated Forward-Backward Algorithm with Application to Lattice-Free MMI",
  booktitle="ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings",
  year="2022",
  pages="8417--8421",
  publisher="IEEE Signal Processing Society",
  address="Singapore",
  doi="10.1109/ICASSP43922.2022.9746824",
  isbn="978-1-6654-0540-9",
  url="https://ieeexplore.ieee.org/document/9746824"
}
Files
Projects
Moderní metody zpracování, analýzy a zobrazování multimediálních a 3D dat, BUT, Vnitřní projekty VUT, FIT-S-20-6460, start: 2020-03-01, end: 2023-02-28, completed
Research groups
Speech Data Mining Research Group BUT Speech@FIT (RG SPEECH)
Departments
Department of Computer Graphics and Multimedia (DCGM)
Back to top