Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

GenAI Grows Up - Building Production-Ready Agents on the JVM

GOTO Conferences via YouTube

Overview

Coursera Spring Sale
40% Off Coursera Plus Annual!
Grab it
Explore a comprehensive conference talk that addresses the critical challenges facing GenAI implementation in enterprise environments and presents a JVM-based solution for building production-ready AI agents. Discover why most GenAI projects fail despite the technology's potential, examining common pitfalls including treating GenAI as standalone technology, excessive reliance on prompt engineering, integration problems with existing systems, and organizational issues stemming from top-down mandates. Learn how to overcome nondeterminism in AI systems through structured approaches and domain-integrated context engineering that leverages existing business logic and data. Understand the advantages of building AI agents on the JVM platform, including seamless integration with enterprise systems, mature tooling, battle-tested reliability, and access to critical business infrastructure that most enterprises already run. Get introduced to the Embabel agent framework, which combines GenAI capabilities with JVM strengths, featuring modern Java/Kotlin APIs built on Spring framework for creating testable, maintainable, and production-ready agents. Examine practical examples including a bank support agent implementation and see how the framework enables seamless code actions and LLM invocation while maintaining software engineering best practices like domain modeling, unit testing, and type safety. Compare JVM-based approaches with Python frameworks and understand why the Java community is positioned to lead in enterprise AI development, moving beyond imitation of Python approaches to build superior solutions for business-critical applications.

Syllabus

00:00 Intro
01:53 Let's make this personal
02:24 Tools add power
03:36 "Personal assistant" use case
04:30 Powerful but not predictable is sometimes OK
06:45 Alarming failure rate
07:19 Why do GenAI projects fail?
07:21 Technology issues
09:56 Prompt engineering: The new alchemy
12:48 Integration problems
13:28 Excessive vendor influence
13:57 Top-down mandates
15:15 Organizational issues
15:55 How do we fix this?
16:04 1. Attack nondeterminism
21:11 2. Integrate with what works
22:30 Bringing structure to LLM interactions
23:42 Domain-integrated context engineering
26:47 What is the role of Java developers?
27:27 Option 1: Imitate Python approaches
28:20 Option 2: Build something better
29:10 The stakes are high
29:46 What the JVM brings to GenAI
30:32 Python vs JVM for enterprise AI
32:22 Time for Java community to lead again
33:01 Introducing Embabel
39:19 Java example: Bank support agent
41:40 Seamless code actions & LLM invocation
42:29 Builds on Spring
44:03 Modern Java/Kotlin API
46:01 Example: This slide deck
49:24 Decker agent example
50:04 Embabel vs Python frameworks
51:22 Conclusion
52:38 Start right away
53:32 Outro

Taught by

GOTO Conferences

Reviews

Start your review of GenAI Grows Up - Building Production-Ready Agents on the JVM

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.