Project Details

Jazykověda, umělá inteligence a jazykové a řečové technologie: od výzkumu k aplikacím

Project Period: 1. 1. 2025 – 31. 12. 2028

Project Type: grant

Code: EH23_020/0008518

Agency: European Union

Program: MEZISEKTOROVÁ SPOLUPRÁCE

English title
Linguistics, Artificial Intelligence and Language and Speech Technologies: from Research to Applications
Type
grant
Keywords

Artificial intelligence, language and speech technologies

Abstract

The aim of the project "Artificial intelligence and language and speech technologies: from research to applications" is:
1. Deepening and implementation of cooperation between research organizations and the application sphere: specifically between Charles University (Institute of Formal and Applied Linguistics, MFF UK); Higher technical education in Brno (Faculty of Information Technologies, FIT BUT) and the companies Phonexia s.r.o.; Mamma AI Coolma, s.r.o. and Phrase, a.s. for example, in the matter of mutual exchange of knowledge, verification of the parameters of research results for their application in practice and obtaining access of enterprises to frontier knowledge and advanced methods, models and technologies.
2. Realization of the planned comprehensive research plan and four work packages (WP) in cooperation with subjects of the application sphere, especially with Phonexia s.r.o.; Mamma AI Coolma, s.r.o. and Phrase a.s. and with other cooperating entities.
3. Preparation and submission of jointly processed project applications with subjects from the application sphere: especially in areas related to the planned four work packages within VZ1, namely participation in national and international competitions/programs or in access projects to the capacities of large research infrastructures
4. Involvement of representatives of the application sphere in teaching: especially then experts from Phonexia s.r.o.; Mamma AI Coolma, s.r.o. and Phrase a.s., or other cooperating entities in topics related to the proposed research agenda.

Team members
Černocký Jan, prof. Dr. Ing. (DCGM) – research leader
Burget Lukáš, doc. Ing., Ph.D. (DCGM)
Diez Sánchez Mireia, M.Sc., Ph.D. (DCGM)
Han Jiangyu (DCGM)
Heřmanský Hynek, prof. Ing., Dr. Eng. (DCGM)
Jírovec Martin, Ing. (DFIT-Dean)
Kesiraju Santosh, Ph.D. (DCGM)
Kocmanová Martina, Ing. (RCIT)
Kudla Radim, Ing. (DCGM)
Mošner Ladislav, Ing., Ph.D. (DCGM)
Polok Alexander, Ing. (DCGM)
Singh Prachi, B.Tech., Ph.D. (DCGM)
Szőke Igor, Ing., Ph.D. (DCGM)
Vendrame Katia, Ing. (DCGM)
Publication Results

2026

  • POLOK, A.; KLEMENT, D.; KOCOUR, M.; HAN, J.; LANDINI, F.; YUSUF, B.; WIESNER, M.; KHUDANPUR, S.; ČERNOCKÝ, J.; BURGET, L. DiCoW: Diarization-Conditioned Whisper for Target Speaker Automatic Speech Recognition. COMPUTER SPEECH AND LANGUAGE, 2026, vol. 95, iss. 1, p. 1-19. Detail

2025

  • AKKIRAJU, B.; POTHULA, A.; KESIRAJU, S.; VUPPALA, A. IIITH-BUT system for IWSLT 2025 low-resource Bhojpuri to Hindi speech translation. Proceedings of the 22nd International Conference on Spoken Language Translation (IWSLT 2025). Vienna, Austria: Association for Computational Linguistics, 2025. p. 333.ISBN: 979-8-89176-272-5. Detail
  • Alexander Polok, Jiangyu Han, Dominik Klement, Samuele Cornell, Jan Černocký, Lukáš Burget. BUT System for the MLC-SLM Challenge. ISCA: ISCA, 2025. p. 23. Detail
  • BARAHONA, S.; SILNOVA, A.; MOŠNER, L.; PENG, J.; PLCHOT, O.; ROHDIN, J.; ZHANG, L.; HAN, J.; PALKA, P.; LANDINI, F.; BURGET, L.; STAFYLAKIS, T.; CUMANI, S.; BOBOŠ, D.; HLAVAČEK, M.; KODOVSKY, M.; PAVLIČEK, T. Analysis of ABC Frontend Audio Systems for the NIST-SRE24. In Proceedings of the Annual Conference of the International Speech Communication Association Interspeech. Interspeech. Rotterdam: International Speech Communication Association, 2025. p. 5763-5767. Detail
  • CUMANI, S.; SILNOVA, A.; BARAHONA, S.; MOŠNER, L.; PLCHOT, O.; ROHDIN, J. Analysis of the ABC classification backends for NIST SRE24. In Proceedings of the Annual Conference of the International Speech Communication Association Interspeech. Interspeech. Rotterdam: International Speech Communication Association, 2025. p. 3978-3982. Detail
  • HAN, J.; LANDINI, F.; ROHDIN, J.; SILNOVA, A.; DIEZ SÁNCHEZ, M.; BURGET, L. Leveraging Self-Supervised Learning for Speaker Diarization. In ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. Hyderabad: IEEE Signal Processing Society, 2025. p. 1-5. ISBN: 979-8-3503-6874-1. Detail
  • HAN, J.; LANDINI, F.; ROHDIN, J.; SILNOVA, A.; DIEZ, M.; ČERNOCKÝ, J.; BURGET, L. Fine-tune Before Structured Pruning: Towards Compact and Accurate Self-Supervised Models for Speaker Diarization. In Proceedings of the Annual Conference of the International Speech Communication Association Interspeech. Interspeech. Rotterdam, The Netherlands: International Speech Communication Association, 2025. p. 1583-1587. Detail
  • HEGDE, P.; KESIRAJU, S.; ŠVEC, J.; SEDLÁČEK, Š.; YUSUF, B.; PLCHOT, O.; DEEPAK, K.; ČERNOCKÝ, J. Factors affecting the in-context learning abilities of LLMs for dialogue state tracking. In Proceedings of the Annual Conference of the International Speech Communication Association Interspeech. Interspeech. Rotterdam, The Netherlands: International Speech Communication Association, 2025. p. 4818-4822. Detail
  • LI, J.; MAK, M.; ROHDIN, J.; LEE, K.; HERMANSKY, H. Bayesian Learning for Domain-Invariant Speaker Verification and Anti-Spoofing. In Proceedings of the Annual Conference of the International Speech Communication Association Interspeech. Interspeech. Rotterdam: International Speech Communication Association, 2025. p. 1123-1127. Detail
  • PÁLKA, P.; LANDINI, F.; KLEMENT, D.; DIEZ SÁNCHEZ, M.; SILNOVA, A.; BURGET, L.; DELCROIX, M. Joint Training of Speaker Embedding Extractor, Speech and Overlap Detection for Diarization. In Proceedings of 33rd European Signal Processing Conference (EUSIPCO 2025). Palermo: IEEE Signal Processing Society, 2025. p. 31-35. ISBN: 978-9-46-459362-4. Detail
  • PENG, J.; ASHIHARA, T.; DELCROIX, M.; OCHIAI, T.; PLCHOT, O.; ARAKI, S.; ČERNOCKÝ, J. TS-SUPERB: A Target Speech Processing Benchmark for Speech Self-Supervised Learning Models. In ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. Hyderabad: IEEE Signal Processing Society, 2025. p. 1-5. ISBN: 979-8-3503-6874-1. Detail
  • PENG, J.; MOŠNER, L.; ZHANG, L.; PLCHOT, O.; STAFYLAKIS, T.; BURGET, L.; ČERNOCKÝ, J. CA-MHFA: A Context-Aware Multi-Head Factorized Attentive Pooling for SSL-Based Speaker Verification. In ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. Hyderabad: IEEE Signal Processing Society, 2025. p. 1-5. ISBN: 979-8-3503-6874-1. Detail
  • POLOK, A.; KLEMENT, D.; WIESNER, M.; KHUDANPUR, S.; ČERNOCKÝ, J.; BURGET, L. Target Speaker ASR with Whisper. In ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. Hyderabad: IEEE Signal Processing Society, 2025. p. 1-5. ISBN: 979-8-3503-6874-1. Detail
  • POTHULA, A.; AKKIRAJU, B.; BANDARUPALLI, S.; D, C.; KESIRAJU, S.; VUPPALA, A. End-to-End Speech Translation for Low-Resource Languages Using Weakly Labeled Data. In Interspeech 2025. Interspeech. Rotterdam: ISCA, 2025. p. 41-45. Detail
  • SEDLÁČEK, Š.; YUSUF, B.; ŠVEC, J.; HEGDE, P.; KESIRAJU, S.; PLCHOT, O.; ČERNOCKÝ, J. Approaching Dialogue State Tracking via Aligning Speech Encoders and LLMs. In Proceedings of the Annual Conference of the International Speech Communication Association Interspeech. Interspeech. Rotterdam, The Netherlands: International Speech Communication Association, 2025. p. 1748-1752. Detail
Applied Results

2024

Back to top