Optimizing Smart Meter IIoT Data in Databricks for At-Scale Interactive Electrical Load Analytics
Databricks via YouTube
Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Learn how to optimize Databricks for large-scale interactive analytics applications through a real-world case study of Hydro-Québec's smart meter data platform. Explore the migration of Octave, a Plotly Dash application used by 1,000+ technicians and engineers to analyze electrical load and voltage data from 4.5 million smart meters across Quebec, from its original backend to Databricks to handle over 1 trillion data points. Discover specific optimization strategies implemented to support performant interactive experiences while managing complex ETL processes, including techniques to reduce query latency and improve user concurrency. Examine plans for increasing data update frequency and understand the non-technical success factors that contributed to the project's effectiveness, such as leveraging subject matter expertise, maintaining operational autonomy, ensuring code quality for long-term maintainability, and establishing proactive vendor technical support relationships. Gain insights into scaling Industrial Internet of Things (IIoT) data analytics solutions and learn practical approaches for implementing high-performance interactive analytics platforms on Databricks.
Syllabus
Optimizing Smart Meter IIoT Data in Databricks for At-Scale Interactive Electrical Load Analytics
Taught by
Databricks