Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Google

Cloud Composer: Qwik Start - Command Line

Google via Google Skills

Go to class Write review
Udacity Ad

Master AI & Data—50% Off Udacity (Code CC50)

Learn More → Babbel Ad

You’re only 3 weeks away from a new language

Learn More →

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
In this lab, you use Cloud Shell command line to create the Cloud Composer environment and set Composer environment variables. You then use Composer to run a workflow that verifies a data file, creates and runs an Apache Hadoop wordcount job on a Dataproc cluster, and deletes the cluster.

Syllabus

  • GSP606
  • Overview
  • Setup and requirements
  • What is Cloud Composer?
  • What is Apache Airflow?
  • What is Cloud Dataproc?
  • Task 1. Sample workflow
  • Task 2. Verify the Composer environment
  • Task 3. Set up Apache Airflow environment variables
  • Task 4. Upload Airflow files to Cloud storage
  • Task 5. Using the Airflow web interface
  • Delete Cloud Composer Environment
  • Congratulations!

Tags

Reviews

Start your review of Cloud Composer: Qwik Start - Command Line

Go to class

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.