Course details

Parallel and Distributed Algorithms

PRL Acad. year 2006/2007 Summer semester 5 credits

Current academic year

Introduction, features and languages for parallel and distributed architectures. Abstract models of parallel computing, PRAM, complexity. All prefix sums and their applications. Algorithms for parallel sorting and searching, parallel matrix operations, Interaction between processes, communication, synchronization. Typical problems.

Guarantor

Hanáček Petr, doc. Dr. Ing. (DITS)

Language of instruction

Czech

Completion

Credit+Examination

Time span

  • 39 hrs lectures
  • 13 hrs projects

Department

Department of Intelligent Systems (UITS)

Subject specific learning outcomes and competences

Students will learn basic principles of parallel and distributed computing and with parallel and distributed algorithms and their time complexity.

Students will learn basic principles and possibilities of algorithm paralelization.

Learning objectives

To acquaint students with the with the basic concepts of parallel and distributed computing. The course aims to the general principles of parallel and distributed algorithms and their time complexity.

Prerequisite knowledge and skills

Basic knowledge of algorithms.

Study literature

  • Akl, S.: The Design and Analysis of Parallel Algorithms, Prentice-Hall International, ISBN 0-13-200073-3
  • Reif, J: Synthesis of Parallel Algorithms, Morgan Kaufmann, 1993, ISBN:155860135X

Fundamental literature

  • Akl, S.: The Design and Analysis of Parallel Algorithms, Prentice-Hall International, ISBN 0-13-200073-3
  • Jaja, J.: An Introduction to Parallel Algorithms, Addison-Wesley, 1992, ISBN 0-201-54856-9
  • Tvrdík, P.: Parallel Systems and Algorithms, skripta, Praha, Vydavatelství ČVUT 1997.

Syllabus of lectures

  • Introduction, architectures and languages for parallel and distributed processing.
  • Abstract models of parallel computing, PRAM (Parallel Random Access Machine).
  • Distributed and parallel algorithms and their complexity.
  • Interaction between processes, communication, synchronization.
  • Topologie, synchrinous and asynchronous algorithms.
  • Algorithms for parallel sorting.
  • Algorithms for parallel searching.
  • Parallel matrix operations.
  • All prefix sums and their applications.
  • Graph and list algorithms.
  • Synchronization algorithms and tasks.
  • Mechanisms and language constructs for synchronization.
  • Languages for parallel and distributed computing.

Progress assessment

Projects are necessary.

Controlled instruction

A written mid-term exam, a regular evaluation of projects.

Back to top