Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Basketball AI with RF-DETR, SAM2, and SmolVLM2

Roboflow via YouTube

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Learn to build a comprehensive computer vision system for basketball analytics by combining cutting-edge AI models including RF-DETR for object detection, SAM2 for player tracking, and SmolVLM2 for jersey number recognition. Follow along as this 37-minute tutorial demonstrates frame-by-frame analysis of a complete basketball possession, covering player identification, team clustering using SigLIP and UMAP, shot detection and classification, and homography mapping to visualize player movements on a top-down court representation. Master the integration of multiple open-source models to create a robust sports analytics pipeline, with access to datasets for basketball player detection, court keypoint detection, and jersey number OCR, plus comprehensive Jupyter notebooks for hands-on implementation of each component in the system.

Syllabus

- 00:00 Project Overview
- 02:04 Detect Players and Numbers with RF-DETR
- 07:12 Track Players with SAM2
- 11:59 Team Clustering with SigLIP, UMAP and K-means
- 16:31 Fine-Tuning SmolVLM2
- 21:56 Map Player Positions to Court Coordinates
- 31:51 Detect Shot Event and Classify Result
- 35:54 Conclusions

Taught by

Roboflow

Reviews

Start your review of Basketball AI with RF-DETR, SAM2, and SmolVLM2

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.