Speech Signal Processing
ZRE Acad. year 2023/2024 Summer semester 5 credits
Applications of speech processing, digital processing of speech signals, production and perception of speech, introduction to phonetics, pre-processing and basic parameters of speech, linear-predictive model, cepstrum, fundamental frequency estimation, coding - time domain and vocoders, recognition - DTW and HMM, synthesis. Software and libraries for speech processing.
Language of instruction
- 26 hrs lectures
- 2 hrs exercises
- 12 hrs pc labs
- 12 hrs projects
- 51 pts final exam
- 14 pts mid-term test
- 6 pts labs
- 29 pts projects
To provide students with the knowledge of basic characteristics of speech signal in relation to production and hearing of speech by humans. To describe basic algorithms of speech analysis common to many applications. To give an overview of applications (recognition, synthesis, coding) and to inform about practical aspects of speech algorithms implementation.
The students will get familiar with basic characteristics of speech signal in relation to production and hearing of speech by humans. They will understand basic algorithms of speech analysis common to many applications. They will be given an overview of applications (recognition, synthesis, coding) and be informed about practical aspects of speech algorithms implementation. The students will be able to design a simple system for speech processing (speech activity detector, recognizer of limited number of isolated words), including its implementation into application programs.
Why is the course taught
Speech is the most common form of human communication and when we want to transmit information to others, we do mostly so by speaking. Automatic speech processing is necessary for processing of human-to-human communication (coding, or for example analysis of call center traffic), human-computer (voice command, voice search, authentication by voice) and computer-to-human (text to speech synthesis). The ZRE course will provide you with basic information on how speech is created, what usual features to represent it and what we do next. You will see that i tis an exciting combination of soft sciences", signal processing, machine learning, and other ingredients. Know-how acquired in ZRE is applicable also elsewhere - for example the problem of sequence recognition goes well beyond automatic speech recognition. The course is taught by members of the BUT Speech@FIT group, one of worlds prominent labs in speech data mining research.
- Gold, B., Morgan, N.: Speech and Audio Signal Processing, Wiley-Interscience; 2 edition.
- Yu, D., Deng, L., Automatic speech recognition, Springer, 2016.
- Rabiner, L. R., & Schafer, R. W. Theory and applications of digital speech processing, Pearson, 2011.
- Psutka, J., Müller, L., Matoušek, J., & Radová, V., Mluvíme s počítačem česky, Academia, 2006.
- Psutka, J.: Komunikace s počítačem mluvenou řečí. Academia, Praha, 1995, ISBN 80-200-0203-0
Gold, B., Morgan, N.: Speech and Audio Signal Processing, John Wiley & Sons, 2000, ISBN 0-471-35154-7
www stránka předmětu https://www.fit.vutbr.cz/study/courses/ZRE/public/
Syllabus of lectures
- Introduction, applications of speech processing.
- Digital processing of speech signals.
- Speech production and its signal processing model.
- Pre-processing and basic parameters of speech, cepstrum.
- Linear-predictive model.
- Fundamental frequency estimation.
- Speech coding - basics
- CELP Speech coding.
- Speech recognition - basics, DTW.
- Hidden Markov models HMM.
- Large vocabulary continuous speech recognition (LVCSR) systems.
- Speaker and language recognition. Neural networks in speech processing.
- Text to speech synthesis.
Syllabus of numerical exercises
- Parameterization, DTW, HMM.
Syllabus of computer exercises
- Linear prediction and vector quantization.
- Fundamental frequency estimation and speech coding.
- Basics of classification.
- Recognition - Dynamic time Warping (DTW).
- Recognition - hidden Markov models (HTK).
- mid-term test 14 pts
- project 29 pts
- presentation of results in computer labs 6 pts
|Mon||lecture||1., 2., 3., 4., 5., 6., 7., 8., 10., 11., 12., 13. of lectures||E105||16:00||17:50||70||1MIT 2MIT||NISY NSPE xx||Černocký|
|Mon||comp.lab||1., 2., 3., 4., 5., 6., 7., 8., 10., 11., 12., 13. of lectures||O204||18:00||19:50||20||1MIT 2MIT||xx||Černocký|
Course inclusion in study plans
- Programme IT-MGR-2, field MBI, any year of study, Compulsory-Elective group S
- Programme IT-MGR-2, field MBS, MIS, MMM, any year of study, Elective
- Programme IT-MGR-2, field MGM, 1st year of study, Compulsory
- Programme IT-MGR-2, field MIN, any year of study, Compulsory-Elective group C
- Programme IT-MGR-2, field MPV, any year of study, Compulsory-Elective group G
- Programme IT-MGR-2, field MSK, 2nd year of study, Compulsory-Elective group B
- Programme MITAI, field NADE, NBIO, NCPS, NEMB, NEMB up to 2021/22, NGRI, NHPC, NIDE, NISD, NISY, NISY up to 2020/21, NMAL, NMAT, NNET, NSEC, NSEN, NVER, NVIZ, any year of study, Elective
- Programme MITAI, field NSPE, any year of study, Compulsory