Result Details

Voice activity detection in video mediated communication from gaze

HRADIŠ, M.; EIVAZI, S.; BEDNAŘÍK, R. Voice activity detection in video mediated communication from gaze. ETRA '12 Proceedings of the Symposium on Eye Tracking Research and Applications. Santa Barbara: Association for Computing Machinery, 2012. p. 329-332. ISBN: 978-1-4503-1221-9.
Type
conference paper
Language
English
Authors
Hradiš Michal, Ing., Ph.D., FIT (FIT), DCGM (FIT)
Eivazi Shahram
Bednařík Roman
Abstract

This paper discuses prediction of active speaker in multi-party video mediated communication from gaze data. In the explored setting, we predict voice activity of participants in one room based on gaze recordings of a single participant in another room. The two rooms were connected by high definition and low delay audio and video links and the participants engaged in different activities ranging from casual discussion to simple casual games. We treat the task as classification problem. We evaluate different types of features and parameter setting in the context of Support Vector Machine classification framework. The results show that the speaker activity can be correctly predicted with the proposed approach in 90 % of the time for which the gaze data are available.

Keywords

gaze tracking, voice activity detection, speaker recog-nition, machine learning, Support Vector Machines

Published
2012
Pages
329–332
Proceedings
ETRA '12 Proceedings of the Symposium on Eye Tracking Research and Applications
Conference
Eye Tracking Research & Applications
ISBN
978-1-4503-1221-9
Publisher
Association for Computing Machinery
Place
Santa Barbara
DOI
10.1145/2168556.2168628
BibTeX 
@inproceedings{BUT91461,
  author="Michal {Hradiš} and Shahram {Eivazi} and Roman {Bednařík}",
  title="Voice activity detection in video mediated communication from gaze",
  booktitle="ETRA '12 Proceedings of the Symposium on Eye Tracking Research and Applications",
  year="2012",
  pages="329--332",
  publisher="Association for Computing Machinery",
  address="Santa Barbara",
  doi="10.1145/2168556.2168628",
  isbn="978-1-4503-1221-9",
  url="https://www.fit.vut.cz/research/publication/9861/"
}
Files
Projects
National Support for Project Together Anywhere, Together Anytime, MŠMT, Podpora projektů sedmého rámcového programu Evropského společenství pro výzkum, technologický rozvoj a demonstrace (2007 až 2013) podle zákona č. 171/2007 Sb., 7E11024, start: 2011-01-01, end: 2011-12-31, running
Security-Oriented Research in Information Technology, MŠMT, Institucionální prostředky SR ČR (např. VZ, VC), MSM0021630528, start: 2007-01-01, end: 2013-12-31, running
Research groups
Computer Graphics Research Group (RG GRAPH)
Departments
Department of Computer Graphics and Multimedia (DCGM)
Back to top