Result Details

Analysis of the BUT Diarization System for Voxconverse Challenge

LANDINI, F.; GLEMBEK, O.; MATĚJKA, P.; ROHDIN, J.; BURGET, L.; DIEZ SÁNCHEZ, M.; SILNOVA, A. Analysis of the BUT Diarization System for Voxconverse Challenge. In ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Toronto, Ontario: IEEE Signal Processing Society, 2021. p. 5819-5823. ISBN: 978-1-7281-7605-5.
Type
conference paper
Language
English
Authors
Landini Federico Nicolás, Ph.D., DCGM (FIT)
Glembek Ondřej, Ing., Ph.D., DCGM (FIT)
Matějka Pavel, Ing., Ph.D., DCGM (FIT)
Rohdin Johan Andréas, M.Sc., Ph.D., FIT (FIT), DCGM (FIT)
Burget Lukáš, doc. Ing., Ph.D., DCGM (FIT)
Diez Sánchez Mireia, M.Sc., Ph.D., DCGM (FIT)
Silnova Anna, M.Sc., Ph.D., DCGM (FIT)
Abstract

This paper describes the system developed by the BUT team for thefourth track of the VoxCeleb Speaker Recognition Challenge, focusingon diarization on the VoxConverse dataset. The system consistsof signal pre-processing, voice activity detection, speaker embeddingextraction, an initial agglomerative hierarchical clusteringfollowed by diarization using a Bayesian hidden Markov model, areclustering step based on per-speaker global embeddings and overlappedspeech detection and handling. We provide comparisons foreach of the steps and share the implementation of the most relevantmodules of our system. Our system scored second in the challengein terms of the primary metric (diarization error rate) and first accordingto the secondary metric (Jaccard error rate).

Keywords

Speaker Diarization, Variational Bayes, HMM,VoxConverse, VoxSRC Challenge

URL
Published
2021
Pages
5819–5823
Proceedings
ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Conference
2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
ISBN
978-1-7281-7605-5
Publisher
IEEE Signal Processing Society
Place
Toronto, Ontario
DOI
10.1109/ICASSP39728.2021.9414315
UT WoS
000704288406018
EID Scopus
2-s2.0-85106557901
BibTeX 
@inproceedings{BUT175790,
  author="Federico Nicolás {Landini} and Ondřej {Glembek} and Pavel {Matějka} and Johan Andréas {Rohdin} and Lukáš {Burget} and Mireia {Diez Sánchez} and Anna {Silnova}",
  title="Analysis of the BUT Diarization System for Voxconverse Challenge",
  booktitle="ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)",
  year="2021",
  pages="5819--5823",
  publisher="IEEE Signal Processing Society",
  address="Toronto, Ontario",
  doi="10.1109/ICASSP39728.2021.9414315",
  isbn="978-1-7281-7605-5",
  url="https://ieeexplore.ieee.org/document/9414315"
}
Files
Projects
Employment of artificial intelligence into an emergency call reception, MV, Program bezpečnostního výzkumu ČR v letech 2015-2022 (BV III/1-VS), VI20192022169, start: 2019-07-04, end: 2022-05-31, completed
Multi-linguality in speech technologies, MŠMT, INTER-EXCELLENCE - Podprogram INTER-ACTION, LTAIN19087, start: 2020-01-01, end: 2023-08-31, completed
Neural Representations in multi-modal and multi-lingual modeling, GACR, Grantové projekty exelence v základním výzkumu EXPRO - 2019, GX19-26934X, start: 2019-01-01, end: 2023-12-31, completed
Real time network, text, and speaker analytics for combating organized crime, EU, Horizon 2020, start: 2019-09-01, end: 2022-12-31, completed
Robust processing of recordings for operations and security, MV, PROGRAM STRATEGICKÁ PODPORA ROZVOJE BEZPEČNOSTNÍHO VÝZKUMU ČR 2019-2025 (IMPAKT 1) PODPROGRAMU 1 SPOLEČNÉ VÝZKUMNÉ PROJEKTY (BV IMP1/1VS), VJ01010108, start: 2020-10-01, end: 2025-09-30, completed
Research groups
Speech Data Mining Research Group BUT Speech@FIT (RG SPEECH)
Departments
Department of Computer Graphics and Multimedia (DCGM)
Back to top