Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Training Robots Part 2 - Introduction to Robotics Modelling

Trelis Research via YouTube

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore advanced robotics modeling techniques in this 30-minute tutorial that delves into the challenges and solutions for training AI models to control robots. Begin with a comprehensive review of robotics AI models before examining the key challenges in robot modeling, including real-time processing requirements, system delays, and the complex multi-modality problem in robotics applications. Master the Action Chunking Transformer (ACT) model architecture and discover its variations including Bi-ACT for torque-based control and Multi-ACT for multi-task scenarios. Investigate cutting-edge approaches through detailed analysis of GR00T N1 and pi0 models, learning how GR00T leverages unlabeled data for training and understanding the comparative advantages of different modeling approaches. Gain practical insights into selecting appropriate robotics models for specific applications and explore advanced techniques that extend beyond traditional ACT and GR00T frameworks, with access to implementation scripts and resources for hands-on experimentation.

Syllabus

0:00 Introduction to Robotics AI Models
0:30 Video Overview: Modelling Challenges, ACT, GR00T-N1, pi0
0:59 Robotics AI Models - quick review
4:23 Challenges in modelling robots: Realtime, Delays, Styles
7:53 The style / multi-modality problem in robotics
10:42 Action Chunking Transformer ACT Model
13:03 Variations of ACT, Bi-ACT uses torques, Multi-ACT multi-task
14:50 Advanced notes on ACT
17:11 GR00T N1
19:54 How GR00T trains on unlabelled data
22:30 pi0
24:33 GR00T paper
26:04 pi0 paper
27:41 What robotics model to use?
28:10 Beyond ACT and GR00T
29:25 Scripts and future videos: Trelis.com/ADVANCED-robotics

Taught by

Trelis Research

Reviews

Start your review of Training Robots Part 2 - Introduction to Robotics Modelling

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.