Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Duke University

Web Applications and Command-Line Tools for Data Engineering

Duke University via Coursera

Overview

In this fourth course of the Python, Bash and SQL Essentials for Data Engineering Specialization, you will build upon the data engineering concepts introduced in the first three courses to apply Python, Bash and SQL techniques in tackling real-world problems. First, we will dive deeper into leveraging Jupyter notebooks to create and deploy models for machine learning tasks. Then, we will explore how to use Python microservices to break up your data warehouse into small, portable solutions that can scale. Finally, you will build a powerful command-line tool to automate testing and quality control for publishing and sharing your tool with a data registry.

Syllabus

  • Jupyter Notebooks
    • This week, you will learn how to install and run Jupyter on your local machine. Additionally, you will explore strategies to use code and text cells in a Jupyter notebook.
  • Cloud-Hosted Notebooks
    • This week, you will learn how to create and use a Cloud-based notebook in Google Colab and AWS Sagemaker.
  • Python Microservices
    • This week, you will learn how to build a Python Microservice with FastAPI and deploy a containerized machine learning Microservice for data engineering.
  • Python Packaging and Rust Command Line Tools
    • This week, you will learn how to organize a Python project so you can build a powerful command-line tool. You will use Click, a useful command-line tool framework to enhance your tool. Finally, you will automate testing and quality control for publishing and sharing your tool with a registry.

Taught by

Noah Gift, Kennedy Behrman and Alfredo Deza

Reviews

4.2 rating at Coursera based on 28 ratings

Start your review of Web Applications and Command-Line Tools for Data Engineering

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.