Securing Generative AI

Overview

This course offers a comprehensive exploration into the crucial security measures necessary for the deployment and development of various AI implementations, including large language models (LLMs) and Retrieval-Augmented Generation (RAG). It addresses critical considerations and mitigations to reduce the overall risk in organizational AI system development processes. Experienced author and trainer Omar Santos emphasizes “secure by design” principles, focusing on security outcomes, radical transparency, and building organizational structures that prioritize security. You will be introduced to AI threats, LLM security, prompt injection, insecure output handling, and Red Team AI models. The course concludes by teaching you how to protect RAG implementations. You learn about orchestration libraries such as LangChain, LlamaIndex, and others, as well as securing vector databases, selecting embedding models, and more.

Syllabus

Securing Generative AI

This module provides a comprehensive overview of generative AI security, covering threats and mitigation strategies for large language models and related systems. Topics include prompt injection, insecure output handling, training data poisoning, model denial of service, supply chain vulnerabilities, sensitive information disclosure, insecure plugin design, excessive agency, overreliance, model theft, red teaming, and securing Retrieval Augmented Generation (RAG) implementations. Learners gain practical knowledge of industry frameworks, best practices, and tools to safeguard AI technologies in production environments.