Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

IBM

Mastering Generative AI: LLM Architecture & Data Preparation

IBM via edX

Overview

The demand for gen AI is forecast to grow over 46% annually by 2030 (Source: Statista). AI engineers and developers, data scientists, machine learning engineers, and other AI professionals with gen AI skills are highly sought-after. This course builds in-demand skills in large language model (LLM) architecture and data preparation employers are looking for.

During the course, you’ll learn about real-world applications using generative AI. You’ll gain insights into gen AI architectures and models, such as recurrent neural networks (RNNs), transformers, generative adversarial networks (GANs), variational autoencoders (VAEs), and diffusion models. You’ll use different training approaches for each model. Plus, you’ll explore LLMs such as generative pre-trained transformers (GPT) and bidirectional encoder representations from transformers (BERT).

Additionally, you’ll gain a detailed understanding of the tokenization process, tokenization methods, and the use of tokenizers for word-based, character-based, and subword-based tokenization. You’ll get hands-on experience using data loaders for training generative AI models, using PyTorch libraries, and generative AI libraries in Hugging Face. Plus, you’ll implement tokenization and create an NLP data loader.

If you’re looking to master gen AI LLM architecture and data preparation, ENROLL TODAY and get ready to power up your resume with skills employers need!

Prerequisites: To enroll for this course, a basic knowledge of Python and PyTorch and an awareness of machine learning and neural networks would be an advantage, though not strictly required.

Syllabus

Module 1: Generative AI Architecture

  • Video: Overview of AI Engineering with LLMs Professional Certificate
  • Video: Course Introduction
  • Reading: Course Overview
  • Reading: Helpful Tips for Course Completion
  • Video: Significance of Generative AI
  • Video: Generative AI Architectures and Models
  • Video: Generative AI for NLP
  • Reading: Basics of AI Hallucinations
  • Reading: Overview of Libraries and Tools
  • Lab: Exploring Generative AI Libraries
  • Reading: Summary and Highlights
  • Practice Quiz: Generative AI Overview and Architecture
  • Graded Quiz: Generative AI Architecture

Module 2: Data Preparation for LLMs

  • Video: Tokenization
  • Lab: Implementing Tokenization
  • Video: Overview of Data Loaders
  • Lab: Creating an NLP Data Loader
  • Reading: Summary and Highlights
  • Practice Quiz: Preparing Data
  • Graded Quiz: Data Preparation for LLMs
  • Cheat Sheet: Guide to Generative AI and LLM Architectures
  • Course Glossary: Guide to Generative AI and LLM Architectures

Taught by

Joseph Santarcangelo

Reviews

Start your review of Mastering Generative AI: LLM Architecture & Data Preparation

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.