Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Zero To Mastery

Prompt Engineering Bootcamp (Working With AI & LLMs): Zero to Mastery

via Zero To Mastery

Go to class Write review

Overview

Stop memorizing random prompts. Instead, learn how AI & LLMs (Large Language Models) actually work and how to use them effectively. This course will take you from being a complete beginner to the forefront of the AI world.
  • Learn the fundamentals of prompting and its practical applications, including real-world examples from NASA and CRISPR
  • Gain practical experience and a deeper understanding of how LLMs & Reasoning Models work (and how they don't) through hands-on exercises
  • Learn to use leading closed-source LLMs like GPT-4o and Claude Opus and even set up your own open-source LLMs
  • Master empirically-proven prompting techniques to improve the effectiveness and utility of your interactions with LLMs
  • Apply your skills in real-world scenarios through numerous guided and unguided projects that teach you to apply your skills
  • Stay updated with the latest advancements in AI and prompt engineering, with continuous course updates to ensure you are always at the cutting edge

Syllabus

  •   Section 0: Introduction
    • Learn To Work With AI & LLMs with Scott Kerr
    • Course Introduction
    • Course Resources + Handbook
    • Exercise: Meet Your Classmates and Instructor
    • Understanding Your Video Player
    • Set Your Learning Streak Goal
  •   Section 1: Introduction to Prompt Engineering
    • What is Prompt Engineering?
    • Why is Prompt Engineering Even a Thing?
    • Breaking GPT
    • Applied Prompt Engineering
    • Applied Prompt Engineering with NASA
    • Why is Prompt Engineering Important to You?
    • The Latest: Am I Wrong?
    • Mandatory Homework: AlphaGo
    • Let's Have Some Fun (+ More Resources)
  •   Section 2: Choose Your LLM
    • What I'm Using - Part 1
    • What I'm Using - Part 2 (OpenAI Playground)
    • Optional: Setting Up Your Playground
    • Multi-Modality and Tools in LLMs
    • Choose Your LLM!
  •   ChatGPT Setup
    • Getting Started with ChatGPT
    • The Basics of ChatGPT
    • ChatGPT App
    • Optional: ChatGPT Plus
  •   Claude Setup
    • Getting Started with Claude
  •   Open Source Option: Llama Setup
    • Getting Started with Llama
  •   Section 3: Guided Project - Build Your First Game (Snake Game)
    • Project Introduction
    • Important Point #1 - Fundamental Truths About LLMs
    • Important Point #2 - Models are Non-Deterministic
    • Setting Up Your Replit Account
    • The First Try
    • Building Our Snake Game - Part 1
    • Building Our Snake Game - Part 2
    • Exercise: Make It Prettier!
    • Unlimited Updates
  •   Section 4: How LLMs Work
    • Introduction to LLMs
    • Tokens
    • Word Guessing Machines?
    • Thinking Like LLMs - Roll a Dice
    • Inside LLMs
    • The Transformer Model
    • GPT Meaning
    • Exercise: Visualize the LLM Architecture
    • The Training Process
    • Base Model vs. Assistant Model
    • Thinking Like LLMs - The Reversal Curse
    • Exercise: The Reversal Curse
    • Artificial General Intelligence (AGI)
    • Exercise: Use ChatGPT to Read the Research
    • The World of LLMs
    • Quiz
    • Implement a New Life System
  •   Section 5: Challenge - Build Your Second Game (Tic Tac Toe with AI opponent)
    • Challenge Instructions
  •   Section 6: Our Prompting Framework
    • Overview of Our Prompting Framework
    • The Standard Prompt
    • Prompt Library
    • Exercise: Get Hyped to Learn!
  •   Section 7: Prompting Fundamentals - The Setup
    • The Setup
    • The System Message - Part 1
    • The System Message - Part 2
    • Exercise: Strengthen Your System Message
    • Claude 3's System Message
    • Context - What it Is
    • Context - The Context Window
    • Context - Lost in the Middle
    • The Latest: 1 Million Token Context Windows
    • Personas and Roles
    • Personas - Tone, Style and Voice
    • Exercise: Talk To Your Hero
    • Exercise: Write a Movie Scene
    • Custom Instructions
    • The System Message for Custom Instructions
    • Thinking Like LLMs - Can GPT Keep a Secret?
    • Exercise: Get ChatGPT to Spill the Tea - Part 1
    • Exercise: Get ChatGPT to Spill the Tea - Part 2
    • Exercise: Get ChatGPT to Spill the Tea - Part 3
    • Exercise: Test Techniques for Securing Secrets
    • Exercise: Stump Me!
    • Case Study: Moderna's Use of ChatGPT
    • Course Check-In
  •   Section 8: Prompting Fundamentals - The Instructions
    • The User Message
    • Be Clear and Specific
    • Delimiters
    • Exercise: Identify Delimiters
    • X-Y Problem
    • Exercise: Identify X
    • Solution: Identify X
    • In-Context Training
    • Zero Shot Prompting
    • One Shot and Few Shot Prompting
    • Language Models Are Few-Shot Learners
    • How Many Examples?
    • Thinking Like LLMs - But Wait...
    • Chain-of-Thought Prompting - Part 1
    • Chain-of-Thought Prompting - Part 2
    • Zero Shot CoT
    • Exercise: Imposter Syndrome
  •   Section 9: Guided Project - Create Your Own Career Coach
    • Career Coach Ideation
    • The Setup - Persona
    • The Setup - Context and Commands
    • The Instructions - Modes
    • The Instructions - Chain of Thought
    • The Instructions - Gamify
    • Meet Your Career Coach
    • Exercise: Customize Your Career Coach
  •   Section 10: Prompting Fundamentals - The Output
    • The Output
    • Length
    • Formats
    • Exercise: Output an Excel File
    • Exercise: Make a Flowchart
  •   Section 11: The Dark Side of AI (Guardrails, Jailbreaks, Injections, Hallucinations + more)
    • Introduction to Guardrails and Jailbreaking
    • Jailbreak! (The DAN Prompt)
    • Exercise: Create Your Own Jailbreak Prompt
    • Many Shot Jailbreaking
    • Prompt Injections - Part 1
    • Prompt Injections - Part 2
    • Thinking Like LLMs - Multi-Modal Injection
    • Leaking - Part 1 (Prompt Leaking)
    • Leaking - Part 2 (Data Leaking)
    • Exposure
    • Poisoning
    • Toxicity
    • Hallucinations
    • Thinking Like LLMs - Big vs Small
    • Challenge: Conduct Your Own Mechanistic Interpretability Research on Hallucinations
    • Challenge Instructions
    • Leaderboard: Mechanistic Interpretability
    • The Model Card
    • Model Cards Deep Dive
    • Exercise: Explore the Latest Model Card and Learn Something New!
  •   Section 12: LLM Hyperparameters & The OpenAI Playground
    • Introduction to Hyperparameters and the OpenAI Playground
    • Note: Setting Up Your Playground
    • Playground UI Changes
    • Temperature
    • Top P
    • Frequency and Presence Penalties
    • Stop Sequences
  •   Section 13: ChatGPT Deep Dive (Multi-Modality, Tools, Architecture and more)
    • Introduction
    • Reminder: ChatGPT vs GPT
    • Custom Instructions
    • Memory
    • The Instruction Hierarchy
    • The Latest: Reasoning Models - Use of Developer Message
    • The Latest: Research To Prevent ChatGPT from Spilling the Tea
    • Note re: Next Lesson
    • Replay: Multi-Modality and Tools in LLMs
    • Multi-Modality Deep Dive
    • Exercise: Examples of Each Multi-modal Combination
    • Thinking Like LLMs - Attack of the (Voice) Clones
    • The Bigger Picture
    • Tools & Function Calling - Part 1
    • Tools & Function Calling - Part 2
    • Function Calling Documentation
    • Wrap Up
  •   Section 14: Open Source Models
    • What Are Open Source LLMs and Why Are They Important?
    • Chatbot Arena Leaderboard
    • Battle of the Intelligence Tests
    • Exercise: Test The Models With Your Specific Use-Case
    • Exercise: Create Your Own Test Prompt (Totem)
    • My Totem Prompt
    • The Latest - The Best Open Source Model
    • Introduction to LMStudio
    • Setting Up Your Own Model - Part 1
    • Setting Up Your Own Model - Part 2
    • Exercise: Explore the Guardrails
  •   Section 15: Advanced Prompting Techniques
    • Introduction
    • Auto-Priming
    • Chain of Density Prompting
    • Prompt Variables
    • Prompt Chaining
    • Prompt Chaining - Programmatic Visualization
    • Exercise: Prompt Chaining - Customer Support
    • Thinking Like LLMs - Dark Magic
    • Exercise: Use Your Magic Powers
    • XML Tags - There's More Than Meets The Eye!
    • Emotional Stimuli - Part 1
    • Emotional Stimuli - Part 2
    • Emotional Stimuli - Part 3 (But Why?)
    • Self-Consistency
    • Exercise: Implement the Self-Consistency Technique
    • ReAct Prompting
    • ReAct + CoT-SC
    • Applied Prompt Engineering with CRISPR - Part 1
    • Applied Prompt Engineering with CRISPR - Part 2
    • Tree of Thoughts - Part 1
    • Tree of Thoughts - Part 2
    • Tree of Thoughts - Part 3 (ToT via Code)
    • Tree of Thoughts - Part 4 (ToT via Chaining)
    • Tree of Thoughts - Part 5 ("Zero Shot" ToT)
  •   Section 16: Reasoning Models
    • Introduction
    • A Note On The Next Two Lessons
    • Replay: Chain-of-Thought Prompting - Part 1
    • Replay: Chain-of-Thought Prompting - Part 2
    • Introduction to Reasoning Models
    • First Contact with Reasoning
    • Secrets and Lies!
    • Setting Up Our Open Source Reasoning Model
    • A Reasoning Model's Real Thoughts - Part 1
    • A Reasoning Model's Real Thoughts - Part 2
    • Exercise: Compare Reasoning Style of Different Models
    • Reasoning & The Context Window
    • Thinking Like LLMs - Breaking The Chains
    • What Are Reasoning Models Good For? (The Generator-Verifier Gap)
    • Exercise: Determine GVG
    • Prompt Engineering for Reasoning Models
    • Context Engineering
    • Thinking Like LLMs: Cats Are...Confusing? - Part 1
    • Thinking Like LLMs: Cats Are...Confusing? - Part 2
    • Reinforcement Learning - The Problem
    • Reinforcement Learning - How It Works
    • Exercise: Code Your Own Maze Game
    • RL Environments (Soccer)
    • RL Environments (Go)
    • Reinforcement Learning from Human Feedback (RLHF)
    • Reinforcement Learning for Reasoning Models - Let's Verify Step-By-Step
    • Reinforcement Learning for Reasoning Models - Process Reward Model
    • PRM800K Introduction
    • PRM800K Deep Dive
    • Test-Time Compute
    • Are Reasoning Models Lying To You? - Part 1
    • Are Reasoning Models Lying To You? - Part 2
    • Are Reasoning Models Lying To You? - Part 3
    • Are Reasoning Models Lying To You? - Part 4
  •   Section 17: Challenge - Build Your Third Game (Flappy Bird)
    • Challenge Instructions
    • The Flappy Bird Hall of Fame
  •   Section 18: Prompt Testing and Model Benchmarks
    • Introduction to Prompt Testing
    • The Importance of Prompt Testing
    • Thinking Like LLMs - Schrodinger's Prompt
    • Building a Prompt Test
    • The Golden Answer
    • Model Benchmarks
    • Deep Dive: MMLU Benchmark
    • Prompt Tests vs. Model Benchmarks?
    • The Latest: MMLU Pro
    • Exercise: Create Your Own Mini-Benchmark (Totem Benchmark)!
    • Evaluating Results - Human Judge
    • Evaluating Results - Code Judge
    • Evaluating Results - AI Judge
    • Deep Dive: LLMs as a Judge - Biases
    • Deep Dive: LLMs as a Judge - Prompts
    • LLM Judge Leaderboard
    • Thinking Like LLMs - Ex Post Facto Reasoning
  •   Section 19: Applied Prompt Engineering - Developing Prompt Tests & Evaluations with PromptFoo
    • Here. We. Go!
    • Introduction to PromptFoo
    • Same As The Pros!
    • Our Prompt Testing Framework
    • Warning!
    • Our 1st Prompt Test (Adding Prompts, Metrics + Human Judge) - The Setup
    • Our 1st Prompt Test (Adding Prompts, Metrics + Human Judge) - The Results
    • Housekeeping Matters
    • Our 2nd Prompt Test (Adding New Prompts + Code Judge) - The Setup
    • Our 2nd Prompt Test (Adding New Prompts + Code Judge) - The Results
    • Our 3rd Prompt Test (Adding 152 Test Cases + AI Judge) - The Setup
    • Our 3rd Prompt Test (Adding 152 Test Cases + AI Judge) - The Results
    • Optional Exercise: Practice Converting Another MMLU Dataset
    • Exercise: Explore Metrics (Assertions) in the PromptFoo Documentation
    • Exercise: Use Your Mini-Benchmark (Totem Benchmark)!
    • Our 4th Prompt Test (Adding Multiple Models) - The Setup
    • Our 4th Prompt Test (Adding Multiple Models) - The Results
    • Our 5th Prompt Test (Adding System Messages) - The Setup
    • Our 5th Prompt Test (Adding System Messages) - The Results
    • Do You Realize What Just Happened?
  •   Section 21: AI Research and the Quest for Artificial General Intelligence
    • Introduction - Through The Looking Glass...
    • Applied Prompt Engineering with The Turing Test
    • Homework: Ex Machina
    • Mechanistic Interpretability - Part 1
    • Mechanistic Interpretability - Part 2
    • Scaling Laws - Model Size
    • Scaling Laws - Dataset Size
    • Scaling Laws - Training Compute
    • Exercise: Current AI Trends
    • Homework: Situational Awareness - The Decade Ahead
  •   Where To Go From Here?
    • What's Next?
    • Thank You!
    • Review This Course!
    • Become An Alumni
    • Learning Guideline
    • ZTM Events Every Month
    • LinkedIn Endorsements
  •   Optional Appendix: Guided Project - Prompting with Autonomous Agents (AutoGPT)
    • Project Introduction
    • A Quick Note
    • Setup Instructions
    • Setup Demo: Getting Your API Key
    • Setup Demo: Downloading AutoGPT
    • Setup Demo: Installing Docker
    • Launching Your Autonomous Agent - Part 1
    • Launching Your Autonomous Agent - Part 2
    • It's Aliiiiiive! Running Your Autonomous Agent
    • Task 1: Hello World - Your First Website
    • Task 2: Python Program - Palindrome Checker
    • Task 3: Initialize Your Own Task

Taught by

Scott Kerr

Reviews

Start your review of Prompt Engineering Bootcamp (Working With AI & LLMs): Zero to Mastery

Go to class

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.