Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Online Course

Parallel programming

École Polytechnique Fédérale de Lausanne via Coursera

Overview

With every smartphone and computer now boasting multiple processors, the use of functional ideas to facilitate parallel programming is becoming increasingly widespread. In this course, you'll learn the fundamentals of parallel programming, from task parallelism to data parallelism. In particular, you'll see how many familiar ideas from functional programming map perfectly to to the data parallel paradigm. We'll start the nuts and bolts how to effectively parallelize familiar collections operations, and we'll build up to parallel collections, a production-ready data parallel collections library available in the Scala standard library. Throughout, we'll apply these concepts through several hands-on examples that analyze real-world data, such as popular algorithms like k-means clustering.

Learning Outcomes. By the end of this course you will be able to:

- reason about task and data parallel programs,
- express common algorithms in a functional style and solve them in parallel,
- competently microbenchmark parallel code,
- write programs that effectively use parallel collections to achieve performance

Recommended background: You should have at least one year programming experience. Proficiency with Java or C# is ideal, but experience with other languages such as C/C++, Python, Javascript or Ruby is also sufficient. You should have some familiarity using the command line. This course is intended to be taken after Functional Program Design in Scala: https://www.coursera.org/learn/progfun2.

Syllabus

Parallel Programming
-We motivate parallel programming and introduce the basic constructs for building parallel programs on JVM and Scala. Examples such as array norm and Monte Carlo computations illustrate these concepts. We show how to estimate work and depth of parallel programs as well as how to benchmark the implementations.

Basic Task Parallel Algorithms
-We continue with examples of parallel algorithms by presenting a parallel merge sort. We then explain how operations such as map, reduce, and scan can be computed in parallel. We present associativity as the key condition enabling parallel implementation of reduce and scan.

Data-Parallelism
-We show how data parallel operations enable the development of elegant data-parallel code in Scala. We give an overview of the parallel collections hierarchy, including the traits of splitters and combiners that complement iterators and builders from the sequential case.

Data Structures for Parallel Computing
-We give a glimpse of the internals of data structures for parallel computing, which helps us understand what is happening under the hood of parallel collections.

Taught by

Prof. Viktor Kuncak, Dr. Aleksandar Prokopec and Heather Miller

Related Courses

Reviews

3.7 rating, based on 6 reviews

Start your review of Parallel programming

  • Anonymous

    Anonymous completed this course.

    The first week gives an Okay introduction to the subject, even with half the lessons being about calculating limits of parallelism. I have nothing against those, but the intructors never use that again in the course. Instead, they just go trying differente...
  • Profile image for Luiz Cunha
    Luiz C.

    Luiz completed this course, spending 8 hours a week on it and found the course difficulty to be hard.

    3rd Course of the Specialization " Functional Programming In Scala": clearly down in quality compared to 2 first ones.
    (+) subject
    (+) good and challenging assignments
    (-) videos are too long
    (-) presentation not engaging
    (-) MOOC needs a refresh
  • Borowis completed this course, spending 5 hours a week on it and found the course difficulty to be medium.

    This course disappointed me a bit after first two courses of "programming in scala" specialization: turns out good old for loop with mutable vars is much much faster than for expressions and that we threw check style out of the door and our code is much...
  • Juan C.

    Juan completed this course.

  • Panayiotis completed this course.

  • Chema completed this course.

Class Central

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free

Never stop learning Never Stop Learning!

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free