Introduction to Data Engineering - Best Practices and Production-Level Infrastructure

Explore best practices in data engineering through this 54-minute conference talk from the Data Science Festival Summer School 2021. Learn how to bring data to life by applying data science techniques to real-world scenarios, enabling seamless and reliable operation of data-critical applications and systems. Discover the process of scaling small projects from local machines to production-level infrastructure. Gain insights from Partha Dey, Infrastructure Manager at Perlego, as he shares valuable knowledge on transitioning data projects to robust, enterprise-ready solutions. Delve into key concepts of data engineering and understand its crucial role in modern data-driven organizations.