Data Council Courses

Unlocking Reliable GenAI - Strategies for Assessing LLMs in Real-World Applications

Explore strategies for assessing LLMs in real-world applications, enhancing GenAI reliability through innovative evaluation methods and human feedback integration.

• YouTube
• 37 minutes
• Self-Paced
• Free Video

The Reality of Building a Modern AI Data Stack

Explore complexities of modern AI data stacks, balancing complexity, cost, scalability, and performance. Discover deep learning, LLMs, data management at scale, Data Mesh integration, and leveraging Data Products.

• YouTube
• 29 minutes
• Self-Paced
• Free Video

Building InfluxDB 3.0 with Apache Arrow, DataFusion, Flight and Parquet

Explore InfluxDB 3.0's innovative design using Apache Arrow, DataFusion, Flight, and Parquet. Discover how this deconstructed database system enables fast, high-quality data analysis and advanced interoperability.

• YouTube
• 36 minutes
• Self-Paced
• Free Video

Optimizing Time Series Data in Mixed Architectures with QuestDB

Explore time series database optimization, high-performance data ingestion, and cross-platform integration with QuestDB engineer Adam Cimarosti. Gain practical insights for handling fast-moving data in modern deployments.

• YouTube
• 24 minutes
• Self-Paced
• Free Video

Beyond Kafka: Cutting Costs and Complexity with WarpStream and S3

Explore WarpStream's solution for Apache Kafka challenges, leveraging S3 for efficient streaming storage. Learn cost-saving strategies and witness live performance tests handling high-volume data ingestion.

• YouTube
• 28 minutes
• Self-Paced
• Free Video

Unified Stream/Batch Execution with Ibis

Explore Ibis for unified stream/batch execution, featuring Voltron Data's work on merging concepts and introducing Apache Flink backend. Gain insights for cross-platform data handling.

• YouTube
• 34 minutes
• Self-Paced
• Free Video

Flappybird Game and Real-Time Data Pipeline Workshop - Tinybird

Build a real-time data pipeline for Flappybird's leaderboard. Capture in-game events, stream data, and create REST APIs while enhancing SQL skills in this hands-on workshop.

• YouTube
• 39 minutes
• Self-Paced
• Free Video

Empowering Data Teams - A Step-by-Step Playbook for Leads and Managers

Learn strategies to empower data teams, align objectives, and boost ROI. Discover how to motivate your squad, implement effective OKRs, and balance growth, productivity, and joy in data management.

• YouTube
• 26 minutes
• Self-Paced
• Free Video

The Future of Data Engineering in a Post-AI World

Explore AI's impact on data engineering, including ETL automation, data warehouses, and emerging technologies. Learn to leverage AI for significant business impact in the evolving data landscape.

• YouTube
• 35 minutes
• Self-Paced
• Free Video

Building a Unified Feature Platform with DuckDB and Arrow

Explore ML feature platform development using DuckDB and Arrow. Learn scaling strategies, DuckDB extension implementation, DeltaLake interoperability, and performance comparison with Spark.

• YouTube
• 36 minutes
• Self-Paced
• Free Video

Using AI, Mathematics, and Statistics to Find Similar Data in Massive Data Ecosystems

Explore Collibra's AI-powered data governance solution for efficient processing of vast datasets, optimizing cost and performance while extracting valuable insights and minimizing duplication.

• YouTube
• 23 minutes
• Self-Paced
• Free Video

Streamlining Entry Into Streaming Analytics with JupyterHub and Apache Flink

Boost productivity and scale by deploying pipelines with JupyterHub. Explore pre-configured environments for interactive streaming analytics and seamless execution in remote Kubernetes clusters.

• YouTube
• 26 minutes
• Self-Paced
• Free Video

Ten Years of Building Open Source Standards in Data Engineering

Explore a decade of open-source standards development, from Parquet to Arrow. Gain insights into community-driven innovation and the evolving landscape of data engineering.

• YouTube
• 38 minutes
• Self-Paced
• Free Video

How to Use Your Development Data to Make LLMs Code Like You and Your Team

Harness development data to personalize LLMs and copilots for your team. Learn to gather actionable insights between commits, enhancing coding processes and tools.

• YouTube
• 26 minutes
• Self-Paced
• Free Video

Beyond MLOps: Building AI Systems with Metaflow

Revolutionize ML systems with Metaflow: explore real-world examples, understand Generative AI's impact, and learn to build complex AI-powered systems for healthcare, finance, and entertainment.

• YouTube
• 39 minutes
• Self-Paced
• Free Video