Result Details

Big Data Network Flow Processing Using Apache Spark

JEŘÁBEK, K.; RYŠAVÝ, O. Big Data Network Flow Processing Using Apache Spark. In Proceedings of the 6th Conference on the Engineering of Computer Based Systems (ECBS 2019), 2019. Bukurešť: Association for Computing Machinery, 2019. p. 1-9. ISBN: 978-1-4503-7636-5.
Type
conference paper
Language
English
Authors
Jeřábek Kamil, Ing., Ph.D., DIFS (FIT)
Ryšavý Ondřej, doc. Ing., Ph.D., DIFS (FIT)
Abstract

The increasing amount of traffic flows captured as a part of network monitoring activities makes the analysis more complicated. One of the goals for network traffic analysis is to identify malicious communication. In the paper, we present a new system for big data network flow classification and clustering. The proposed system is based on the popular big data engines such as Apache Spark and Apache Ignite. The conducted experiments demonstrate the feasibility of the proposed approach and show the possible scalability.

Keywords

Big Data, Network flows, Apache Spark, Cassandra, Apache Ignite

Published
2019
Pages
1–9
Proceedings
Proceedings of the 6th Conference on the Engineering of Computer Based Systems (ECBS 2019), 2019
Conference
6th Conference on the Engineering of Computer Based Systems
ISBN
978-1-4503-7636-5
Publisher
Association for Computing Machinery
Place
Bukurešť
DOI
10.1145/3352700.3352709
UT WoS
000525376600009
EID Scopus
2-s2.0-85075893298
BibTeX 
@inproceedings{BUT161450,
  author="Kamil {Jeřábek} and Ondřej {Ryšavý}",
  title="Big Data Network Flow Processing Using Apache Spark",
  booktitle="Proceedings of the 6th Conference on the Engineering of Computer Based Systems (ECBS 2019), 2019",
  year="2019",
  pages="1--9",
  publisher="Association for Computing Machinery",
  address="Bukurešť",
  doi="10.1145/3352700.3352709",
  isbn="978-1-4503-7636-5",
  url="https://www.fit.vut.cz/research/publication/11977/"
}
Files
Projects
Integrated platform for analysis of digital data from security incidents, MV, Bezpečnostní výzkum České republiky 2015-2020, VI20172020062, start: 2017-01-01, end: 2020-06-30, completed
IT4Innovations excellence in science, MŠMT, Národní program udržitelnosti II, LQ1602, start: 2016-01-01, end: 2020-12-31, completed
Nástroje, metody a technologie ICT pro podporu konceptu smart cities, BUT, Vnitřní projekty VUT, FIT-S-17-3964, start: 2017-03-01, end: 2020-02-29, completed
Research groups
NES@FIT - Networks and distributed systems research group (RG NES@FIT)
Departments
Department of Information Systems (DIFS)
Back to top