LLMs From Dream to Deployed - Overcoming Deployment Challenges

Explore the journey of Large Language Models (LLMs) from conception to real-world implementation in this 29-minute talk by Josh Goldstein, Solutions Engineer at Seldon, presented at MLOps World: Machine Learning in Production. Discover various LLM use cases and learn strategies to overcome deployment challenges, including latency and resource usage. Gain hands-on experience by following along with the deployment of a chatbot featuring both memory and retrieval capabilities. Acquire practical skills and insights necessary for confidently deploying LLMs in production environments, empowering you to harness the full potential of these powerful language models in your projects.