Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Microsoft

Implement Generative AI engineering with Azure Databricks

Microsoft via Microsoft Learn

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
  • Get started with language models in Azure Databricks

    In this module, you learn how to:

    • Describe Generative AI.
    • Describe Large Language Models (LLMs).
    • Identify key components of LLM applications.
    • Use LLMs for Natural Language Processing (NLP) tasks.
  • Implement Retrieval Augmented Generation (RAG) with Azure Databricks

    In this module, you learn how to:

    • Set up a RAG workflow.
    • Prepare your data for RAG.
    • Retrieve relevant documents with vector search.
    • Improve model accuracy by reranking your search results.
  • Implement multi-stage reasoning in Azure Databricks

    In this module, you learn how to:

    • Identify the need for multi-stage reasoning systems.
    • Describe a multi-stage reasoning workflow.
    • Implement multi-stage reasoning with libraries like LangChain, LlamaIndex, Haystack, and the DSPy framework.
  • Fine-tune language models with Azure Databricks

    In this module, you learn how to:

    • Understand when to use fine-tuning.
    • Prepare your data for fine-tuning.
    • Fine-tune an Azure OpenAI model.
  • Evaluate language models with Azure Databricks

    In this module, you learn how to:

    • Evaluate LLM evaluation models
    • Describe the relationship between LLM evaluation and AI system evaluation
    • Describe standard LLM evaluation metrics like accuracy, perplexity, and toxicity
    • Describe LLM-as-a-judge for evaluation
  • Review responsible AI principles for language models in in Azure Databricks

    In this module, you learn how to:

    • Describe the responsible AI principles for implementation of language models.
    • Identify the ethical considerations for language models.
    • Mitigate the risks associated with language models.
    • Implement key security tooling for language models.
  • Implement LLMOps in Azure Databricks

    In this module, you learn how to:

    • Describe the LLM lifecycle overview.
    • Identify the model deployment option that best fits your needs.
    • Use MLflow and Unity Catalog to implement LLMops.

Syllabus

  • Get started with language models in Azure Databricks
    • Introduction
    • Understand Generative AI
    • Understand Large Language Models (LLMs)
    • Identify key components of LLM applications
    • Use LLMs for Natural Language Processing (NLP) tasks
    • Exercise - Explore language models
    • Module assessment
    • Summary
  • Implement Retrieval Augmented Generation (RAG) with Azure Databricks
    • Introduction
    • Explore the main concepts of a RAG workflow
    • Prepare your data for RAG
    • Find relevant data with vector search
    • Rerank your retrieved results
    • Exercise - Set up RAG
    • Module assessment
    • Summary
  • Implement multi-stage reasoning in Azure Databricks
    • Introduction
    • What are multi-stage reasoning systems?
    • Explore LangChain
    • Explore LlamaIndex
    • Explore Haystack
    • Explore the DSPy framework
    • Exercise - Implement multi-stage reasoning with LangChain
    • Module assessment
    • Summary
  • Fine-tune language models with Azure Databricks
    • Introduction
    • What is fine-tuning?
    • Prepare your data for fine-tuning
    • Fine-tune an Azure OpenAI model
    • Exercise - Fine-tune an Azure OpenAI model
    • Module assessment
    • Summary
  • Evaluate language models with Azure Databricks
    • Introduction
    • Explore LLM evaluation
    • Evaluate LLMs and AI systems
    • Evaluate LLMs with standard metrics
    • Describe LLM-as-a-judge for evaluation
    • Exercise - Evaluate an Azure OpenAI model
    • Module assessment
    • Summary
  • Review responsible AI principles for language models in Azure Databricks
    • Introduction
    • What is responsible AI?
    • Identify risks
    • Mitigate issues
    • Use key security tooling to protect your AI systems
    • Exercise - Implement responsible AI
    • Module assessment
    • Summary
  • Implement LLMOps in Azure Databricks
    • Introduction
    • Transition from traditional MLOps to LLMOps
    • Understand model deployments
    • Describe MLflow deployment capabilities
    • Use Unity Catalog to manage models
    • Exercise - Implement LLMOps
    • Module assessment
    • Summary

Reviews

Start your review of Implement Generative AI engineering with Azure Databricks

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.