FedOpt for Large Language Models

Learn about FedOpt optimization techniques specifically applied to Large Language Models in this one-hour conference talk from Google's Keith Rush, presented at the Simons Institute's Federated and Collaborative Learning Boot Camp, exploring how federated optimization methods can be effectively implemented for training and fine-tuning LLMs in distributed settings while maintaining privacy and efficiency across multiple participating nodes.