Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Duke University

Data Engineering with Rust

Duke University via Coursera

Overview

Are you a data engineer, software developer, or a tech enthusiast with a basic understanding of Rust, seeking to enhance your skills and dive deep into the realm of data engineering with Rust? Or are you a professional from another programming language background, aiming to explore the efficiency, safety, and concurrency features of Rust for data engineering tasks? If so, this course is designed for you. While a fundamental knowledge of Rust is expected, you should ideally be comfortable with the basics of data structures and algorithms, and have a working understanding of databases and data processing. Familiarity with SQL, the command line, and version control with git is advantageous. This four-week course focuses on leveraging Rust to create efficient, safe, and concurrent data processing systems. The journey begins with a deep dive into Rust's data structures and collections, followed by exploring Rust's safety and security features in the context of data engineering. In the subsequent week, you'll explore libraries and tools specific to data engineering like Diesel, async, Polars, and Apache Arrow, and learn to interface with data processing systems, REST, gRPC protocols, and AWS SDK for cloud-based data operations. The final week focuses on designing and implementing full-fledged data processing systems using Rust. By the end of this course, you will be well-equipped to use Rust for handling large-scale data engineering tasks, solving real-world problems with efficiency and speed. The hands-on labs and projects throughout this course will ensure you gain practical experience, putting your knowledge into action. This course is your gateway to mastering data engineering with Rust, preparing you for the next level in your data engineering journey.

Syllabus

  • Rust Data Structures: Collections
    • This week, you will get started with the Rust development ecosystem, including AI coding tools, continuous integration, and cloud-based environments.
  • Safety, Security and Concurrency with Rust
    • This week, you will explore Rust's safety, security, and concurrency capabilities including encryption, network segmentation, thread safety, and web crawling.
  • Rust Data Engineering Libraries and Tools
    • This week, you explore data processing in Rust. Manage data files and cloud storage. Build APIs and web scrapers. Power data engineering with Rust efficiency.
  • Designing Data Processing Systems in Rust
    • This week, build data pipelines. Ingest, process, store data. Create workflows, Lambdas, microservices. Deploy to cloud. Monitor and scale.

Taught by

Noah Gift and Alfredo Deza

Reviews

Start your review of Data Engineering with Rust

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.