Result Details

Using Gradient Descent Optimization for Acoustic Training from Heterogeneous Data

KARAFIÁT, M.; SZŐKE, I.; ČERNOCKÝ, J. Using Gradient Descent Optimization for Acoustic Training from Heterogeneous Data. Proc. Text, Speech and Dialog 2010. Lecture Notes in Computer Science. LNAI 6231. Brno: Springer Verlag, 2010. no. 9, p. 322-329. ISBN: 978-3-642-15759-2. ISSN: 0302-9743.
Type
conference paper
Language
English
Authors
Karafiát Martin, Ing., Ph.D., DCGM (FIT)
Szőke Igor, Ing., Ph.D., DCGM (FIT)
Černocký Jan, prof. Dr. Ing., DCGM (FIT)
Abstract

This paper is on using the gradient descent optimization for acoustics training from heterogeneous data. We study the use of heterogeneous data for training of acoustic models.

Keywords

speech, acoustic models, heterogeneous data, HLDA system, gradient descent training, robustness

URL
Annotation

In this paper, we study the use of heterogeneous data for training of acoustic models. In initial experiments, a significant drop of accuracy has been observed on in-domain test set if the data was added without any regularization. A solution is proposed by getting control over the training data by optimization of the weights of different data-sets. The final models shows good performance on all various tests linked to various speaking styles. Furthermore, we used this approach to increase the performance over just the main test set. We obtained 0.3% absolute improvement on basic system and 0.4% on HLDA system although the size of the heterogeneous data set was quite small.

Published
2010
Pages
322–329
Journal
Lecture Notes in Computer Science, vol. 2010, no. 9, ISSN 0302-9743
Proceedings
Proc. Text, Speech and Dialog 2010
Series
LNAI 6231
Conference
13th International Conference on Text, Speech and Dialogue, TSD 2010
ISBN
978-3-642-15759-2
Publisher
Springer Verlag
Place
Brno
BibTeX 
@inproceedings{BUT34926,
  author="Martin {Karafiát} and Igor {Szőke} and Jan {Černocký}",
  title="Using Gradient Descent Optimization for Acoustic Training from Heterogeneous Data",
  booktitle="Proc. Text, Speech and Dialog 2010",
  year="2010",
  series="LNAI 6231",
  journal="Lecture Notes in Computer Science",
  volume="2010",
  number="9",
  pages="322--329",
  publisher="Springer Verlag",
  address="Brno",
  isbn="978-3-642-15759-2",
  issn="0302-9743",
  url="http://www.fit.vutbr.cz/research/groups/speech/publi/2010/karafiat_TSD_2010_322.pdf"
}
Projects
Overcoming the language barrier complicating investigation into financing terrorism and serious financial crimes, MV, Program bezpečnostního výzkumu, VD20072010B16, start: 2007-08-01, end: 2010-12-31, completed
Recognition and presentation of multimedia data, BUT, Vnitřní projekty VUT, FIT-S-10-2, 2010, start: 2010-04-01, end: 2010-12-31, completed
Security-Oriented Research in Information Technology, MŠMT, Institucionální prostředky SR ČR (např. VZ, VC), MSM0021630528, start: 2007-01-01, end: 2013-12-31, running
Speech Recognition under Real-World Conditions, GACR, Standardní projekty, GA102/08/0707, start: 2008-01-01, end: 2011-12-31, completed
Research groups
Speech Data Mining Research Group BUT Speech@FIT (RG SPEECH)
Departments
Department of Computer Graphics and Multimedia (DCGM)
Back to top