ONNX Based Generative AI LLMs in Java with Project Babylon

Explore how to implement ONNX-based Generative AI Large Language Models using Java and Project Babylon in this conference talk. Learn about the Open Neural Network Exchange (ONNX) as a universal format for representing machine learning models and discover how Java, traditionally not associated with AI modeling, can be utilized to produce ONNX models. Understand the process of transforming Java-based LLMs into ONNX format and executing them across diverse platforms. Examine Project Babylon's code reflection capabilities and their role in enabling generative AI development in Java. Follow a practical demonstration that showcases a complete Java example of an LLM, including its transformation into ONNX format and subsequent execution, challenging the conventional Python-centric approach to AI model development.