Batch Scheduling Across Multiple Kubernetes Clusters - Mirantis Labs Tech Talks

This talk introduces batch scheduling and processing across multiple Kubernetes clusters using the open-source Armada project. It covers queues, RBAC, Kubernetes pod specifications, client integrations, Apache Airflow and Jupyter use cases, and a live demo.

Syllabus

Our next installment is set to premiere a week from Tuesday, April 18, 2023 at AM PDT. If you are interested in more upcoming & on demand Tech Talks from the teams at Mirantis Labs, please visit https://www.mirantis.com/labs
- Introducing our presenter
- Some background on G Research & Armada
- Overview of Parallel Compute
- SLURM vs. HTCondor Batch Schedulers
- Then Kubernetes happened...
- Interfacing with multiple K8s clusters
- Batch Processing with Kubernetes
- Kubernetes Batch Processing open source projects
- The Armada solution
- Queue & RBAC
- Pod Specs AKA, Kubernetes constructs
- Clients: DotNet, Python, Go & CLI
- Real world use case: Apache Airflow
- Armada Jupyter integration
- Get involved in the open source K8s community
Live Demo: Armada Batch Scheduling
- CNCF resources related to Armada
- Outro