I Don't Like Mondays - What I Learned About Data Engineering After 2 Years on Call

Explore key insights and best practices in data engineering gleaned from two years of on-call experience in this 28-minute EuroPython Conference talk. Gain an understanding of on-call practices, learn strategies to minimize emergency calls, and discover the importance of reacting promptly to errors. Examine the role of monitoring systems, data quality checks, and alerting tools in maintaining robust data infrastructure. Investigate the challenges of working with external services and the significance of building business trust through reliable data systems. Leave with practical, quick-win actions to improve your data engineering processes and better prepare for those dreaded Monday morning emergencies.