Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Discover how AI agents are revolutionizing data engineering workflows in this lightning talk from AWS re:Invent 2025. Learn how AWS addresses two critical time-consuming challenges faced by data engineers: building analytics pipelines from scratch and upgrading Apache Spark versions. Explore the Amazon SageMaker Data Agent, which transforms natural language instructions into executable SQL and Python code within SageMaker notebooks while maintaining full context awareness of your data sources and schemas. Examine the Apache Spark upgrade agent that accelerates complex multi-month upgrade projects into week-long initiatives through automated code analysis and transformation. Understand how these AI agents automate manual work in data engineering workflows, whether you're building new applications or modernizing existing systems, ultimately accelerating development cycles and reducing the burden of repetitive coding tasks.
