Publication Details

Implicit Hand Gestures in Aeronautics Cockpit as a Cue for Crew State and Workload Inference

BEHÚŇ Kamil, HEROUT Adam and PAVELKOVÁ Alena. Implicit Hand Gestures in Aeronautics Cockpit as a Cue for Crew State and Workload Inference. In: Proceedings of ITSC 2015. Las Palmas: The Universidad de Las Palmas de Gran Canaria, 2015, pp. 632-637. ISBN 978-1-4673-6596-3.
Czech title
Implicitní Gesta Rukou jako Způsob Odvození Stavu a Vytížení Posádky v Pilotní Kabine Letadla
Type
conference paper
Language
english
Authors
Behúň Kamil, Ing. (DCGM FIT BUT)
Herout Adam, prof. Ing., Ph.D. (DCGM FIT BUT)
Pavelková Alena, Ing. (DCGM FIT BUT)
Keywords

Implicit Gestures, Human Pose Estimation, Random Forest, Aeronautics Cockpit, Visual Recognition

Abstract

This paper aims at improving advanced aeronautic cockpit by raising its awareness of the crew's state and workload level. Our approach is based on visual analysis of pilot's upper body movements. We define the term of "implicit gestures" and further observe its subclasses. We collected a simulator dataset of practical implicit gestures, annotated semi-automatically a dataset for Human pose estimation training, and we offer these datasets for public use. Based on experiments on this data, we propose a method for recognition of implicit gestures - full interactions, touch-and-go interactions, and unfinished gestures. Our approach is purely visual (no depth data, which are hardly usable in the cockpit environment due to regulations). This method is based on human pose estimation by a hierarchical approach named Pose machine whose subsampled output is used for recognition of implicit gesture presence from sequences of frames by random forest. The experiments show that the classification works reliably and the method is able to recognize these implicit gestures in the cockpit.

Published
2015
Pages
632-637
Proceedings
Proceedings of ITSC 2015
Conference
18th IEEE International Conference on Intelligent Transportation Systems, Las Palmas de Gran Canaria, ES
ISBN
978-1-4673-6596-3
Publisher
The Universidad de Las Palmas de Gran Canaria
Place
Las Palmas, ES
DOI
UT WoS
000376668800102
EID Scopus
BibTeX
@INPROCEEDINGS{FITPUB10906,
   author = "Kamil Beh\'{u}\v{n} and Adam Herout and Alena Pavelkov\'{a}",
   title = "Implicit Hand Gestures in Aeronautics Cockpit as a Cue for Crew State and Workload Inference",
   pages = "632--637",
   booktitle = "Proceedings of ITSC 2015",
   year = 2015,
   location = "Las Palmas, ES",
   publisher = "The Universidad de Las Palmas de Gran Canaria",
   ISBN = "978-1-4673-6596-3",
   doi = "10.1109/ITSC.2015.109",
   language = "english",
   url = "https://www.fit.vut.cz/research/publication/10906"
}
Back to top