Result Details

Enhancing multilingual recognition of emotion in speech by language identification

SAGHA, H.; MATĚJKA, P.; GAVRYUOKOVA, M.; POVOLNÝ, F.; MARCHI, E.; SCHULLER, B. Enhancing multilingual recognition of emotion in speech by language identification. In 17TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION - Proceedings (INTERSPEECH 2016). Proceedings of Interspeech. San Francisco: International Speech Communication Association, 2016. no. 9, p. 2949-2953. ISSN: 1990-9772.
Type
conference paper
Language
English
Authors
SAGHA, H.
Matějka Pavel, Ing., Ph.D., DCGM (FIT)
GAVRYUOKOVA, M.
Povolný Filip, Ing.
MARCHI, E.
SCHULLER, B.
Abstract

We investigate, for the first time, if applying model selectionbased on automatic language identification (LID) can improvemultilingual recognition of emotion in speech. Six emotionalspeech corpora from three language families (Germanic, Romance,Sino-Tibetan) are evaluated. The emotions are representedby the quadrants in the arousal/valence plane, i. e., positive/negative arousal/valence. Four selection approaches forchoosing an optimal training set depending on the current languageare compared: within the same language family, acrosslanguage family, use of all available corpora, and selectionbased on the automatic LID. We found that, on average, theproposed LID approach for selecting training corpora is superiorto using all the available corpora when the spoken languageis not known.

Keywords

multilingual emotion recognition, language identification,language families

URL
Published
2016
Pages
2949–2953
Journal
Proceedings of Interspeech, no. 9, ISSN 1990-9772
Proceedings
17TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION - Proceedings (INTERSPEECH 2016)
Conference
Interspeech Conference
Publisher
International Speech Communication Association
Place
San Francisco
DOI
10.21437/Interspeech.2016-333
UT WoS
000409394401295
EID Scopus
2-s2.0-84994259857
BibTeX 
@inproceedings{BUT163404,
  author="SAGHA, H. and MATĚJKA, P. and GAVRYUOKOVA, M. and POVOLNÝ, F. and MARCHI, E. and SCHULLER, B.",
  title="Enhancing multilingual recognition of emotion in speech by language identification",
  booktitle="17TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION - Proceedings (INTERSPEECH 2016)",
  year="2016",
  journal="Proceedings of Interspeech",
  number="9",
  pages="2949--2953",
  publisher="International Speech Communication Association",
  address="San Francisco",
  doi="10.21437/Interspeech.2016-333",
  issn="1990-9772",
  url="https://www.isca-speech.org/archive/Interspeech_2016/pdfs/0333.PDF"
}
Files
Projects
Information mining in speech acquired by distant microphones, MV, Bezpečnostní výzkum České republiky 2015-2020, VI20152020025, start: 2015-10-01, end: 2020-09-30, completed
IT4Innovations excellence in science, MŠMT, Národní program udržitelnosti II, LQ1602, start: 2016-01-01, end: 2020-12-31, completed
Social Semantic Emotion Analysis for Innovative Multilingual Big Data Analytics Markets, EU, Horizon 2020, start: 2015-04-01, end: 2017-03-31, completed
Research groups
Speech Data Mining Research Group BUT Speech@FIT (RG SPEECH)
Departments
Department of Computer Graphics and Multimedia (DCGM)
Back to top