- Get started with language models in Azure Databricks
In this module, you learn how to:
- Describe Generative AI.
- Describe Large Language Models (LLMs).
- Identify key components of LLM applications.
- Use LLMs for Natural Language Processing (NLP) tasks.
- Implement Retrieval Augmented Generation (RAG) with Azure Databricks
In this module, you learn how to:
- Set up a RAG workflow.
- Prepare your data for RAG.
- Retrieve relevant documents with vector search.
- Improve model accuracy by reranking your search results.
- Implement multi-stage reasoning in Azure Databricks
In this module, you learn how to:
- Identify the need for multi-stage reasoning systems.
- Describe a multi-stage reasoning workflow.
- Implement multi-stage reasoning with libraries like LangChain, LlamaIndex, Haystack, and the DSPy framework.
- Fine-tune language models with Azure Databricks
In this module, you learn how to:
- Understand when to use fine-tuning.
- Prepare your data for fine-tuning.
- Fine-tune an Azure OpenAI model.
- Evaluate language models with Azure Databricks
In this module, you learn how to:
- Evaluate LLM evaluation models
- Describe the relationship between LLM evaluation and AI system evaluation
- Describe standard LLM evaluation metrics like accuracy, perplexity, and toxicity
- Describe LLM-as-a-judge for evaluation
- Review responsible AI principles for language models in in Azure Databricks
In this module, you learn how to:
- Describe the responsible AI principles for implementation of language models.
- Identify the ethical considerations for language models.
- Mitigate the risks associated with language models.
- Implement key security tooling for language models.
- Implement LLMOps in Azure Databricks
In this module, you learn how to:
- Describe the LLM lifecycle overview.
- Identify the model deployment option that best fits your needs.
- Use MLflow and Unity Catalog to implement LLMops.
Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Syllabus
- Get started with language models in Azure Databricks
- Introduction
- Understand Generative AI
- Understand Large Language Models (LLMs)
- Identify key components of LLM applications
- Use LLMs for Natural Language Processing (NLP) tasks
- Exercise - Explore language models
- Module assessment
- Summary
- Implement Retrieval Augmented Generation (RAG) with Azure Databricks
- Introduction
- Explore the main concepts of a RAG workflow
- Prepare your data for RAG
- Find relevant data with vector search
- Rerank your retrieved results
- Exercise - Set up RAG
- Module assessment
- Summary
- Implement multi-stage reasoning in Azure Databricks
- Introduction
- What are multi-stage reasoning systems?
- Explore LangChain
- Explore LlamaIndex
- Explore Haystack
- Explore the DSPy framework
- Exercise - Implement multi-stage reasoning with LangChain
- Module assessment
- Summary
- Fine-tune language models with Azure Databricks
- Introduction
- What is fine-tuning?
- Prepare your data for fine-tuning
- Fine-tune an Azure OpenAI model
- Exercise - Fine-tune an Azure OpenAI model
- Module assessment
- Summary
- Evaluate language models with Azure Databricks
- Introduction
- Explore LLM evaluation
- Evaluate LLMs and AI systems
- Evaluate LLMs with standard metrics
- Describe LLM-as-a-judge for evaluation
- Exercise - Evaluate an Azure OpenAI model
- Module assessment
- Summary
- Review responsible AI principles for language models in Azure Databricks
- Introduction
- What is responsible AI?
- Identify risks
- Mitigate issues
- Use key security tooling to protect your AI systems
- Exercise - Implement responsible AI
- Module assessment
- Summary
- Implement LLMOps in Azure Databricks
- Introduction
- Transition from traditional MLOps to LLMOps
- Understand model deployments
- Describe MLflow deployment capabilities
- Use Unity Catalog to manage models
- Exercise - Implement LLMOps
- Module assessment
- Summary