Thesis Details

Vyhledávání tlačítek ve formulářích

Master's Thesis Student: Dyk Tomáš Academic Year: 2019/2020 Supervisor: Zemčík Pavel, prof. Dr. Ing.
English title
Button Search in Forms

Diploma thesis describes a system for automatic detection of buttons from a screen photo.The system is used together with a robotic arm and a camera to detect buttons on the screens of embedded devices. After detecting buttons on the screen, the algorithm commands the robotic arm to click on the position of the detected button. The algorithm creates a navigation map in which all screens of the device are visible by systematically clicking through all buttons on all screens. For each screen, the positions of the detected buttons and the destination to which the screen points are stored.


Detection, localization, buttons, graphical interface, computer vision, neural netwoks

Degree Programme
Information Technology, Field of Study Intelligent Systems
defended, grade B
17 July 2020
Herout Adam, prof. Ing., Ph.D. (DCGM FIT BUT), předseda
Beran Vítězslav, doc. Ing., Ph.D. (DCGM FIT BUT), člen
Burget Lukáš, doc. Ing., Ph.D. (DCGM FIT BUT), člen
Hradiš Michal, Ing., Ph.D. (DCGM FIT BUT), člen
Křivka Zbyněk, Ing., Ph.D. (DIFS FIT BUT), člen
Orság Filip, Ing., Ph.D. (DITS FIT BUT), člen
DYK, Tomáš. Vyhledávání tlačítek ve formulářích. Brno, 2020. Master's Thesis. Brno University of Technology, Faculty of Information Technology. 2020-07-17. Supervised by Zemčík Pavel. Available from:
    author = "Tom\'{a}\v{s} Dyk",
    type = "Master's thesis",
    title = "Vyhled\'{a}v\'{a}n\'{i} tla\v{c}\'{i}tek ve formul\'{a}\v{r}\'{i}ch",
    school = "Brno University of Technology, Faculty of Information Technology",
    year = 2020,
    location = "Brno, CZ",
    language = "czech",
    url = ""
Back to top