Publication Details

Analysis of impact of emotions on target speech extraction and speech separation

ŠVEC, J.; ŽMOLÍKOVÁ, K.; KOCOUR, M.; DELCROIX, M.; OCHIAI, T.; MOŠNER, L.; ČERNOCKÝ, J. Analysis of impact of emotions on target speech extraction and speech separation. In Proceedings of The 17th International Workshop on Acoustic Signal Enhancement (IWAENC 2022). Bamberg: IEEE Signal Processing Society, 2022. p. 1-5. ISBN: 978-1-6654-6867-1.
Czech title
Analýza vlivu emocí na extrakci řeči cílového mluvčího a na separaci řeči
Type
conference paper
Language
English
Authors
URL
Keywords

target speech extraction, SpeakerBeam, speech
separation, Conv-TasNet, emotion

Abstract

Recently, the performance of blind speech separation (BSS) and target
speech extraction (TSE) has greatly progressed. Most works,
however, focus on relatively well-controlled conditions using, e.g.,
read speech. The performance may degrade in more realistic situations.
One of the factors causing such degradation may be intrinsic
speaker variability, such as emotions, occurring commonly in realistic
speech. In this paper, we investigate the influence of emotions
on TSE and BSS. We create a new test dataset of emotional mixtures
for the evaluation of TSE and BSS. This dataset combines LibriSpeech
and Ryerson Audio-Visual Database of Emotional Speech
and Song (RAVDESS). Through controlled experiments, we can analyze
the impact of different emotions on the performance of BSS
and TSE.We observe that BSS is relatively robust to emotions, while
TSE, which requires identifying and extracting the speech of a target
speaker, is much more sensitive to emotions. On comparative
speaker verification experiments we show that identifying the target
speaker may be particularly challenging when dealing with emotional
speech. Using our findings, we outline potential future directions
that could improve the robustness of BSS and TSE systems
toward emotional speech.

Published
2022
Pages
1–5
Proceedings
Proceedings of The 17th International Workshop on Acoustic Signal Enhancement (IWAENC 2022)
Conference
The 17th International Workshop on Acoustic Signal Enhancement, Bamberg, DE
ISBN
978-1-6654-6867-1
Publisher
IEEE Signal Processing Society
Place
Bamberg
DOI
UT WoS
000934046400024
EID Scopus
BibTeX
@inproceedings{BUT179868,
  author="ŠVEC, J. and ŽMOLÍKOVÁ, K. and KOCOUR, M. and DELCROIX, M. and OCHIAI, T. and MOŠNER, L. and ČERNOCKÝ, J.",
  title="Analysis of impact of emotions on target speech extraction and speech separation",
  booktitle="Proceedings of The 17th International Workshop on Acoustic Signal Enhancement (IWAENC 2022)",
  year="2022",
  pages="1--5",
  publisher="IEEE Signal Processing Society",
  address="Bamberg",
  doi="10.1109/IWAENC53105.2022.9914718",
  isbn="978-1-6654-6867-1",
  url="https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=9914718"
}
Files
Back to top