Fundamentals of Parallelism on Intel Architecture

*** Start Note Dec 20, 2022 ***
ATTENTION LEARNERS! Access to the computing infrastructure and graded programming exercises for this course is discontinued as of December 2022. The course materials are online for archival purposes. It is no longer possible to submit graded programming exercises and receive full credit for the course.
*** End Note Dec 20, 2022 ***

This course will introduce you to the multiple forms of parallelism found in modern Intel architecture processors and teach you the programming frameworks for handling this parallelism in applications. You will get access to a cluster of modern manycore processors (Intel Xeon Phi architecture) for experiments with graded programming exercises.

This course can apply to various HPC and datacenter workloads and framework including artificial intelligence (AI). You will learn how to handle data parallelism with vector instructions, task parallelism in shared memory with threads, parallelism in distributed memory with message passing, and memory architecture parallelism with optimized data containers. This knowledge will help you to accelerate computational applications by orders of magnitude, all the while keeping your code portable and future-proof.

Prerequisite: programming in C/C++ or Fortran in the Linux environment and Linux shell proficiency (navigation, file copying, editing files in text-based editors, compilation).

• Modern Code
• In the Introduction we will learn...
• Vectorization
• Multithreading with OpenMP
• Memory Traffic
• Clusters and MPI