Faculty of Information Technology, BUT

Publication Details

Adaptation of Multilingual Stacked Bottle-neck Neural Network Structure for New Language

GRÉZL František, KARAFIÁT Martin and VESELÝ Karel. Adaptation of Multilingual Stacked Bottle-neck Neural Network Structure for New Language. In: Proceedings of ICASSP 2014. Florencie: IEEE Signal Processing Society, 2014, pp. 7704-7708. ISBN 978-1-4799-2892-7.
Czech title
Adaptace mutlilinguální vrstvené struktury neuronových sítí typu "bottle-neck" pro nový jazyk
Type
conference paper
Language
english
Authors
URL
Keywords
feature extraction, Bottle-neck features, neural network adaptation, multilingual neural networks, Stacked Bottle- Neck structure
Abstract
In this paper a multilingual training of Stacked Bottle- Neck neural network structure for feature extraction is addressed. While for languages with plentiful resources, the optimal approach is to train the BN-NN on the target data, limited resources call for re-using data from other languages.
Annotation
The neural network based features became an inseparable part of state-of-the-art LVCSR systems. In order to perform well, the network has to be trained on a large amount of in-domain data. With the increasing emphasis on fast development of ASR system on limited resources, there is an effort to alleviate the need of in-domain data. To evaluate the effectiveness of other resources, we have trained the Stacked Bottle-Neck neural networks structure on multilingual data investigating several training strategies while treating the target language as the unseen one. Further, the systems were adapted to the target language by re-training. Finally, we evaluated the effect of adaptation of individual NNs in the Stacked Bottle-Neck structure to find out the optimal adaptation strategy. We have shown that the adaptation can significantly improve system performance over both, the multilingual network and network trained only on target data. The experiments were performed on Babel Year 1 data.
Published
2014
Pages
7704-7708
Proceedings
Proceedings of ICASSP 2014
Conference
The 39th International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Florencie, IT
ISBN
978-1-4799-2892-7
Publisher
IEEE Signal Processing Society
Place
Florencie, IT
DOI
BibTeX
@INPROCEEDINGS{FITPUB10556,
   author = "Franti\v{s}ek Gr\'{e}zl and Martin Karafi\'{a}t and Karel Vesel\'{y}",
   title = "Adaptation of Multilingual Stacked Bottle-neck Neural Network Structure for New Language",
   pages = "7704--7708",
   booktitle = "Proceedings of ICASSP 2014",
   year = 2014,
   location = "Florencie, IT",
   publisher = "IEEE Signal Processing Society",
   ISBN = "978-1-4799-2892-7",
   doi = "10.1109/ICASSP.2014.6855089",
   language = "english",
   url = "https://www.fit.vut.cz/research/publication/10556"
}
Back to top