Publication Details

An attention-based backend allowing efficient fine-tuning of transformer models for speaker verification

PENG Junyi, PLCHOT Oldřich, STAFYLAKIS Themos, MOŠNER Ladislav, BURGET Lukáš and ČERNOCKÝ Jan. An attention-based backend allowing efficient fine-tuning of transformer models for speaker verification. In: 2022 IEEE Spoken Language Technology Workshop, SLT 2022 - Proceedings. Doha: IEEE Signal Processing Society, 2023, pp. 555-562. ISBN 978-1-6654-7189-3. Available from: https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10022775

Czech title

Backend pro rozpoznávání mluvčího založený na attention modelech umožňující efektivní jemné doladění transformerových modelů

Type

conference paper

Language

english

Authors

Peng Junyi, Msc. Eng. (DCGM FIT BUT)
Plchot Oldřich, Ing., Ph.D. (DCGM FIT BUT)
Stafylakis Themos (OMILIA)
Mošner Ladislav, Ing. (DCGM FIT BUT)
Burget Lukáš, doc. Ing., Ph.D. (DCGM FIT BUT)
Černocký Jan, prof. Dr. Ing. (DCGM FIT BUT)

URL

Keywords

Pre-trained model, fine-tuning strategy, speaker verification, attentive pooling

Published

2023

Pages

555-562

Proceedings

2022 IEEE Spoken Language Technology Workshop, SLT 2022 - Proceedings

Conference

Spoken Language Technology Workshop 2022, Doha, QA

ISBN

978-1-6654-7189-3

Publisher

IEEE Signal Processing Society

Place

Doha, QA

DOI

10.1109/SLT54892.2023.10022775

EID Scopus

2-s2.0-85147794754

BibTeX

@INPROCEEDINGS{FITPUB12984,
   author = "Junyi Peng and Old\v{r}ich Plchot and Themos Stafylakis and Ladislav Mo\v{s}ner and Luk\'{a}\v{s} Burget and Jan \v{C}ernock\'{y}",
   title = "An attention-based backend allowing efficient fine-tuning of transformer models for speaker verification",
   pages = "555--562",
   booktitle = "2022 IEEE Spoken Language Technology Workshop, SLT 2022 - Proceedings",
   year = 2023,
   location = "Doha, QA",
   publisher = "IEEE Signal Processing Society",
   ISBN = "978-1-6654-7189-3",
   doi = "10.1109/SLT54892.2023.10022775",
   language = "english",
   url = "https://www.fit.vut.cz/research/publication/12984"
}