Big Data Courses and Certifications

AWS Events

FINRA CAT: Building and Optimizing a Massive Financial Services Database System

FINRA CAT’s architecture scales a financial event database to hundreds of billions of daily records while improving performance and controlling cloud costs.

• YouTube
• 42 minutes
• Self-Paced
• Free Video

Career Certificate

IBM Data Engineering

62666 ratings at Coursera

Build ETL pipelines with Python and shell scripts, query relational and NoSQL databases with SQL, and process big data using Airflow, Kafka, and Spark.

• Coursera
• 24 weeks, 10 hours a week
• Self-Paced
• Paid Course
• 16 courses

مقدمة عن البيانات الضخمة

115 ratings at Coursera

تعرّفك هذه الدورة على خصائص البيانات الضخمة وقيمتها، ثم تشرح أسس Hadoop وتنفّذ مهمة MapReduce بسيطة.

• Coursera
• 6 weeks, 3 hours a week
• Self-Paced
• Free Online Course

Foundations of PySpark

640 ratings at DataCamp

In this course, you'll learn how to use Spark from Python!

• DataCamp
• 4 hours
• Self-Paced
• Free Trial Available

The ASF

Production Practices of Apache Celeborn on Bilibili

A Bilibili senior development engineer shares production practices for Apache Celeborn.

• YouTube
• 54 minutes
• Self-Paced
• Free Video

The ASF

The Practice of Apache Kyuubi, Celeborn, and DolphinScheduler in Cloud Native Data Engineering

Cisco data engineers present the practical use of Apache Kyuubi, Celeborn, and DolphinScheduler in a cloud native setting.

• YouTube
• 32 minutes
• Self-Paced
• Free Video

Big Data Demystified

Building Your First Petabyte-Scale Architecture - Part 4

Compare architectures for storing and processing a petabyte across Redshift, Databricks, BigQuery, and SQream, including cost and performance trade-offs.

• YouTube
• 1 hour 11 minutes
• Self-Paced
• Free Video

Big Data Demystified

Building Your First Petabyte-Scale Architecture - Part 3

A comparison of Redshift, Databricks, BigQuery, and SQream architectures for storing and processing a petabyte, including cost and performance trade-offs.

• YouTube
• 1 hour 23 minutes
• Self-Paced
• Free Video

Big Data Demystified

Building Your First Petabyte-Scale Architecture - Part 2

Compare architectures for storing and processing a petabyte of data, weighing technology fit, performance constraints, and cost.

• YouTube
• 1 hour 5 minutes
• Self-Paced
• Free Video

Big Data Demystified

Building Your First Petabyte-Scale Architecture - Part 1

Compares four data platforms to show how their architectures handle petabyte-scale storage and processing, with attention to cost and performance.

• YouTube
• 1 hour 29 minutes
• Self-Paced
• Free Video

GeeCON Conference

Large-Scale Distributed Processing in Google Cloud - 7 Lessons

Seven real-world cases show how to find and fix performance, resource-use, and cost problems in large-scale data processing on Google Cloud.

• YouTube
• 56 minutes
• Self-Paced
• Free Video

Anyscale

Large-Scale Data Shuffle in Ray with Exoshuffle

Exoshuffle shows how Ray can deliver high-performance, reliable large-scale data shuffling, reaching 82% of theoretical performance in a 100TB sort.

• YouTube
• 26 minutes
• Self-Paced
• Free Video

SNIAVideo

Overcoming Real-World Challenges Between Data and AI Infrastructure

A look at deploying compute and network infrastructure for data-heavy, latency-critical AI workloads.

• YouTube
• 15 minutes
• Self-Paced
• Free Video

The ASF

Application and Practice of Apache Linkis in Longbridge Securities

A practical account of applying Apache Linkis within Longbridge Securities’ big data platform.

• YouTube
• 15 minutes
• Self-Paced
• Free Video

JuliaHub

Financial Modeling on Large Data Streaming Sets Using Julia

Learn to analyze larger-than-memory, millisecond-resolution currency data on a standard laptop with Julia’s streaming statistics tools.

• YouTube
• 53 minutes
• Self-Paced
• Free Video