How Data Hub Flies Above the Clouds - Building a Centralized Social Media Analytics Platform
Data Science Conference via YouTube
Master Production-Ready Machine Learning, Step by Step
Learn AI, Data Science & Business — Earn Certificates That Get You Hired
Overview
Google, IBM & Meta Certificates – 40% Off
One plan covers every Professional Certificate on Coursera.
Unlock All Certificates
Explore a 45-minute conference talk from Data Science Conference Europe 2023 where Data Analysts Strahinja Miljkovic and Nikolaos Servos share their experience developing a centralized data platform in 2020. Discover how they consolidated data from multiple social media platforms including Facebook and Instagram using a sophisticated Azure-based architecture. Learn about the implementation of various Azure components including Data Lake, Delta framework, Databricks, Data Factory, Power BI, Azure Purview, Azure DevOps, and Pulumi. Gain insights into their data flow process, which progresses through raw, curated, and aggregated stages before culminating in Power BI reporting. Understand how they maintained consistency through a standardized Python framework while orchestrating this complex data management system. The presentation, delivered in Belgrade, demonstrates a practical approach to building and managing a comprehensive data hub architecture.
Syllabus
How Data Hub flies above the clouds! | Strahinja Miljkovic & Nikolaos Servos | DSC Europe 23
Taught by
Data Science Conference