Coursera Plus Annual is 40% Off — Ends July 13.

Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

VisionTasker - Mobile Task Automation Using Vision-Based UI Understanding and LLM Task Planning

Association for Computing Machinery (ACM) via YouTube

Start learning Write review
Boot.dev Ad

Learn Backend Development Part-Time, Online

Learn More → CodeSignal Ad

Learn Generative AI, Prompt Engineering, and LLMs for Free

Learn More →

Overview

Google, IBM & Meta Certificates – 40% Off
One plan covers every Professional Certificate on Coursera.
Unlock All Certificates
Watch a 12-minute conference talk from the 37th Annual ACM Symposium on User Interface Software and Technology (UIST 2024) exploring an innovative approach to mobile task automation that combines vision-based UI understanding with LLM task planning capabilities to streamline and enhance user interactions on mobile devices.

Syllabus

VisionTasker: Mobile Task Automation Using Vision Based UI Understanding and LLM Task Planning

Taught by

ACM SIGCHI

Reviews

Start your review of VisionTasker - Mobile Task Automation Using Vision-Based UI Understanding and LLM Task Planning

Start learning

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.