Data Engineering: dbt for SQL

Introduction

• Introduction
• What you should know
• Codespaces introduction

1. SQL for Data Engineers

• SQL as a data engineer
• The modern data stack and SQL
• Schema design
• Challenge: Schema design
• Solution: Schema design

2. Modeling in SQL

• Supply chain outage: SQL spaghetti
• Data build tool (dbt)
• Modeling in dbt
• Running dbt
• Challenge: Modeling taxi data
• Solution: Modeling taxi data

3. Table Materializations

• Crypto cost: Materializations
• Materialization terminology
• Incremental materializations
• Challenge: Materializations
• Solution: Materializations

4. Common Table Expressions vs. Subqueries

• Construction planning: Query complexity
• Common table expressions (CTEs) vs. subqueries
• CTEs in dbt
• Challenge: Implementing CTEs
• Solution: Implementing CTEs

5. Testing SQL with dbt

• Advertising: Testing SQL
• Unit testing using dbt
• Custom tests in dbt
• Challenge: Testing SQL
• Solution: Testing SQL

Conclusion

• Looking ahead
• Next steps