Faculty of Information Technology, BUT

Course details

Parallel System Architecture and Programming

ARC Acad. year 2016/2017 Summer semester 5 credits

Current academic year

The course covers architecture and programming of parallel systems with functional- and data-parallelism. First the parallel system theory and program parallelization are discussed. Programming for shared memory systems in OpenMP follows and then the most proliferated multi-core multiprocessors (SMP) and the advanced DSM NUMA systems are described. The course goes on in message passing programming in standardized interface MPI. Interconnection networks are dealt with separately and then their role in clusters, many-core chips and in the most powerful systems is revealed.

Guarantor

Language of instruction

Czech

Completion

Credit+Examination (written)

Time span

39 hrs lectures, 13 hrs projects

Assessment points

60 exam, 10 half-term test, 30 projects

Department

Lecturer

Instructor

Čudová Marta, Ing. (DCSY FIT BUT)
Jaroš Jiří, doc. Ing., Ph.D. (DCSY FIT BUT)
Nikl Vojtěch, Ing. (DCSY FIT BUT)

Subject specific learning outcomes and competences

Overview of principles of parallel system design and of interconnection networks, communication techniques and algorithms. Survey of parallelization techniques of fundamental scientific problems, knowledge of parallel programming in MPI and OpenMP. Practical experience with the work on supercomputers Anselm and Salomon.

Generic learning outcomes and competences

Knowledge of capabilities and limitations of parallel processing, ability to estimate performance of parallel applications. Language means for process/thread communication and synchronization. Competence in hardware-software platforms for high-performance computing and simulations.

Learning objectives

To orientate oneself in parallel systems on the market, be able to assess communication and computing possibilities of a particular architecture and to predict the performance of parallel applications. To get acquainted with the most important parallel programming tools (MPI, OpenMP), to learn their practical use and solving problems in parallel.

Prerequisite kwnowledge and skills

Von-Neumann computer architecture, computer memory hierarchy, cache memories and their organization, programming in assembly and in C/C++.

Study literature

Fundamental literature

  • Pacecho, P.: Introduction to Parallel Programming. Morgan Kaufman Publishers, 2011, 392& p., ISBN: 9780123742605
  • Hennessy, J. L., Patterson, D.A.: Computer Architecture - A Quantitative Approach. 5. vydání, Morgan Kaufman Publishers, Inc., 2012, 856 p., ISBN: 9780123838728

Syllabus of lectures

  1. Introduction to parallel processing.
  2. Patterns for parallel programming.
  3. Shared memory programming - Introduction into OpenMP.
  4. Synchronization and performance awareness in OpenMP.
  5. Shared memory and cache coherency.
  6. Components of symmetrical multiprocessors.
  7. CC NUMA DSM architectures.
  8. Message passing interface.
  9. Collective communications, communicators, and disk operations.
  10. Interconnection networks: topology and routing algorithms.
  11. Interconnection networks: switching, flow control, message processing and performance.
  12. Message-passing architectures, current supercomputer systems. Distributed file systems.
  13. Data-parallel architectures and programming.

Syllabus of numerical exercises

Tutorials are not scheduled for this course.

Syllabus - others, projects and individual work of students

  • Development of an application on SMP in OpenMP on a NUMA node.
  • A parallel program in MPI on the supercomputer.

Progress assessment

Twol projects in duration of 26 hours in total; midterm examination.

Exam prerequisites

To complete successfully term work and be able to write examination, one has to get at least 20 points out of maximum 40.

Course inclusion in study plans

Back to top