Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Online Course

Big Data Analysis with Apache Spark

University of California, Berkeley via edX

Overview

Organizations use their data to support and influence decisions and build data-intensive products and services, such as recommendation, prediction, and diagnostic systems. The collection of skills required by organizations to support these functions has been grouped under the term ‘data science’.

This statistics and data analysis course will attempt to articulate the expected output of data scientists and then teach students how to use PySpark (part of Spark) to deliver against these expectations. The course assignments include log mining, textual entity recognition, and collaborative filtering exercises that teach students how to manipulate data sets using parallel processing with PySpark.

This course covers advanced undergraduate-level material. It requires a programming background and experience with Python (or the ability to learn it quickly). All exercises will use PySpark (the Python API for Spark), and previous experience with Spark equivalent to Introduction to Apache Spark, is required.

Taught by

Anthony D. Joseph

Related Courses

Reviews

4.3 rating, based on 43 reviews

Start your review of Big Data Analysis with Apache Spark

  • Gregory J Hamel ( Life Is Study) completed this course.

    CS100.1x Introduction to Big Data with Apache Spark is a 5-week intro to distributed computing offered by UC Berkeley through the edX MOOC platform focused on teaching students how to perform large-scale computation using Apache Spark. The assignments...
  • Martin Strandbygaard completed this course, spending 4 hours a week on it and found the course difficulty to be medium.

    Overall a good course, that is worthwhile spending the time on, if you want to get familiar with spark and the map-reduce programming model.

    The lecture videos and quizzes are pretty lightweight, and nothing spectacular. However, I found the assignments really well structured, interesting, and informative. They use IPython notebook which I found to be a really awesome format for this kind of course and assignments.

    The course is not heave on mathematics and statistics, but the assignments will challenge you to really understand the stated problems, and the map-reduce programming model, to successfully complete them.

  • Anoop Toffy is taking this course right now and found the course difficulty to be medium.

    It was nice course. I loved it.
    Good Intro PySpark API.
    Nice set of Problem set.
    As a part of it, if you are lucky you will get access to Databricks clouds
  • Gaurav Srivastva is taking this course right now, spending 4 hours a week on it and found the course difficulty to be medium.

    Lectures are very light in content and disappointing but the labs are good and do require students to investigate and complete them.
  • Wendao Liu is taking this course right now.

    Slightly disappointed by the content, not very informative. if u wanna learn more about spark, u definitely need explore more material.
  • Riham Soliman completed this course, spending 5 hours a week on it and found the course difficulty to be hard.

    This is an excellent course for beginners to the world of Spark but it would be a good idea to have some programming knowledge in Python as well as basic understanding of what big data means. The problem sets are organized methodically with much explanation so even if you don't know much statistics you can still follow with the programming. I'm no statistician but managed to go through all problem sets with few mistakes. It certainly was fun on top of being educational and informative.
  • Kuronosuke

    Kuronosuke is taking this course right now.

  • Rakesh is taking this course right now.

  • Gabriel Trautmann

    Gabriel Trautmann is taking this course right now.

  • Profile image for Jevgeni Martjushev
    Jevgeni Martjushev

    Jevgeni Martjushev is taking this course right now.

  • Prakhar Srivastav completed this course.

  • Karri S

    Karri S completed this course.

  • Igor Subbotin is taking this course right now.

  • Guilherme Cesário Strachan completed this course.

  • Profile image for Геночка Кузнецов
    Геночка Кузнецов

    Геночка Кузнецов completed this course.

  • Tabish Sada completed this course.

  • Rogier Werschkull

    Rogier Werschkull completed this course.

  • Hamza Rashid

    Hamza Rashid is taking this course right now.

  • Vlad Podgurschi completed this course.

  • Matteo Ferrara completed this course.

Class Central

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free

Never stop learning Never Stop Learning!

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free