Thesis Details

Použití self-supervised learning pro rozpoznání sportovních pozic v obraze

Bachelor's Thesis Student: Olekšák Samuel Academic Year: 2021/2022 Supervisor: Herout Adam, prof. Ing., Ph.D.
English title
Self-Supervised Learning for Recognition of Sports Poses in Image
Language
Czech
Abstract

This thesis demonstrates a solution for minimizing the amount of necessary labelled training data in the classification of sports poses using a neural network trained with contrastive self-supervised learning. Training consists of two stages. The first stage trains a feature extractor which uses unlabelled training images extracted from recordings of exercises from multiple viewpoints. In the second stage, using a small amount of labelled data, a simple classifier connected to the feature extractor is trained. The thesis discusses classification in the context of yoga poses, however, the final solution can be easily applied to any other sport in case of obtaining a suitable dataset. During the development of the solution, emphasis is placed on the performance of the resulting model so that it can be used on mobile devices. The resulting model reached an accuracy of 76 % using augmentations with a data set containing four labelled images per yoga pose. On a larger data set with 800 labelled images for all poses, an accuracy of 82 % is reached. 

Keywords

image recognition, pose estimation, contrastive learning, self-supervised learning

Department
Degree Programme
Files
Status
defended, grade A
Date
14 June 2022
Reviewer
Committee
Zemčík Pavel, prof. Dr. Ing. (DCGM FIT BUT), předseda
Burget Lukáš, doc. Ing., Ph.D. (DCGM FIT BUT), člen
Holík Lukáš, doc. Mgr., Ph.D. (DITS FIT BUT), člen
Martínek Tomáš, Ing., Ph.D. (DCSY FIT BUT), člen
Matoušek Petr, doc. Ing., Ph.D., M.A. (DIFS FIT BUT), člen
Citation
OLEKŠÁK, Samuel. Použití self-supervised learning pro rozpoznání sportovních pozic v obraze. Brno, 2022. Bachelor's Thesis. Brno University of Technology, Faculty of Information Technology. 2022-06-14. Supervised by Herout Adam. Available from: https://www.fit.vut.cz/study/thesis/24516/
BibTeX
@bachelorsthesis{FITBT24516,
    author = "Samuel Olek\v{s}\'{a}k",
    type = "Bachelor's thesis",
    title = "Pou\v{z}it\'{i} self-supervised learning pro rozpozn\'{a}n\'{i} sportovn\'{i}ch pozic v obraze",
    school = "Brno University of Technology, Faculty of Information Technology",
    year = 2022,
    location = "Brno, CZ",
    language = "czech",
    url = "https://www.fit.vut.cz/study/thesis/24516/"
}
Back to top