Thesis Details

Zpracování velkých dat z rozsáhlých IoT sítí

Master's Thesis Student: Benkő Krisztián Academic Year: 2018/2019 Supervisor: Krčma Martin, Ing.
English title
Big Data Processing from Large IoT Networks
Language
Czech
Abstract

The goal of this diploma thesis is to design and develop a system for collecting, processing and storing data from large IoT networks. The developed system introduces a complex solution able to process data from various IoT networks using Apache Hadoop ecosystem. The data are real-time processed and stored in a NoSQL database, but the data are also stored  in the file system for a potential later processing. The system is optimized and tested using data from IQRF network. The data stored in the NoSQL database are visualized and the system periodically generates derived predictions. Users are connected to this system via an information system, which is able to automatically generate notifications when monitored values are out of range.

Keywords

BigData, IoT, Apache, Hadoop, database, NoSQL, distributed file system, Java, real-time, HDFS, Flume, Spark, information system, OpenTSDB, Grafana, HBase, Avro, batch processing, linear regression, predictions, Ambari, IQRF

Department
Department of Computer Systems FIT BUT
Degree Programme
Information Technology, Field of Study Information Systems
Files
Status
defended, grade B
Date
20 June 2019
Reviewer
Podivínský Jakub, Ing., Ph.D.
Committee
Hruška Tomáš, prof. Ing., CSc. (DIFS FIT BUT), předseda
Janoušek Vladimír, doc. Ing., Ph.D. (DITS FIT BUT), člen
Kolář Dušan, doc. Dr. Ing. (DIFS FIT BUT), člen
Malinka Kamil, Mgr., Ph.D. (DITS FIT BUT), člen
Rybička Jiří, doc. Ing. Dr. (Mendelu), člen
Rychlý Marek, RNDr., Ph.D. (DIFS FIT BUT), člen
Citation
BENKŐ, Krisztián. Zpracování velkých dat z rozsáhlých IoT sítí. Brno, 2019. Master's Thesis. Brno University of Technology, Faculty of Information Technology. 2019-06-20. Supervised by Krčma Martin. Available from: https://www.fit.vut.cz/study/thesis/22037/
BibTeX 
@mastersthesis{FITMT22037,
    author = "Kriszti\'{a}n Benk\H{o}",
    type = "Master's thesis",
    title = "Zpracov\'{a}n\'{i} velk\'{y}ch dat z rozs\'{a}hl\'{y}ch IoT s\'{i}t\'{i}",
    school = "Brno University of Technology, Faculty of Information Technology",
    year = 2019,
    location = "Brno, CZ",
    language = "czech",
    url = "https://www.fit.vut.cz/study/thesis/22037/"
}

Theses

Back to top