Detail výsledku

Analysis of Speaker Diarization based on Bayesian HMM with Eigenvoice Priors

DIEZ SÁNCHEZ, M.; BURGET, L.; LANDINI, F.; ČERNOCKÝ, J. Analysis of Speaker Diarization based on Bayesian HMM with Eigenvoice Priors. IEEE-ACM Transactions on Audio Speech and Language Processing, 2020, vol. 28, no. 1, p. 355-368. ISSN: 2329-9290.
Typ
článek v časopise
Jazyk
anglicky
Autoři
Abstrakt

In our previous work, we introduced our Bayesian Hidden Markov Model with eigenvoice priors, which has been recently recognized as the state-of-the-art model for Speaker Diarization. In this paper we present a more complete analysis of the Diarization system. The inference of the model is fully described and derivations of all update formulas are provided for a complete understanding of the algorithm. An extensive analysis on the effect, sensitivity and interactions of all model parameters is provided, which might be used as a guide for their optimal setting. The newly introduced speaker regularization coefficient allows us to control the number of speakers inferred in an utterance. A naive speaker model merging strategy is also presented, which allows to drive the variational inference out of local optima. Experiments for the different diarization scenarios are presented on CALLHOME and DIHARD datasets.

Klíčová slova

Hidden Markov Models, Bayes methods, Task analysis, Probabilistic logic, Training, Speech processing, Complexity theory

URL
Rok
2020
Strany
355–368
Časopis
IEEE-ACM Transactions on Audio Speech and Language Processing, roč. 28, č. 1, ISSN 2329-9290
DOI
UT WoS
000560612800028
EID Scopus
BibTeX
@article{BUT161472,
  author="Mireia {Diez Sánchez} and Lukáš {Burget} and Federico Nicolás {Landini} and Jan {Černocký}",
  title="Analysis of Speaker Diarization based on Bayesian HMM with Eigenvoice Priors",
  journal="IEEE-ACM Transactions on Audio Speech and Language Processing",
  year="2020",
  volume="28",
  number="1",
  pages="355--368",
  doi="10.1109/TASLP.2019.2955293",
  issn="2329-9290",
  url="https://ieeexplore.ieee.org/document/8910412"
}
Soubory
Projekty
Dolování infoRmAcí z řeči Pořízené vzdÁlenými miKrofony, MV, Bezpečnostní výzkum České republiky 2015-2020, VI20152020025, zahájení: 2015-10-01, ukončení: 2020-09-30, ukončen
IT4Innovations excellence in science, MŠMT, Národní program udržitelnosti II, LQ1602, zahájení: 2016-01-01, ukončení: 2020-12-31, ukončen
Neuronové reprezentace v multimodálním a mnohojazyčném modelování, GAČR, Grantové projekty exelence v základním výzkumu EXPRO - 2019, GX19-26934X, zahájení: 2019-01-01, ukončení: 2023-12-31, ukončen
Robustní diarizace mluvčích pomocí Bayesovské inference a hlubokého učení, EU, Horizon 2020, zahájení: 2017-03-01, ukončení: 2019-02-28, ukončen
Výzkumné skupiny
Pracoviště
Nahoru