Twenty Thousand Tasks Under the Queue - Managing Large-Scale Analytics in Systematic Trading

Explore the complex world of systematic hedge fund operations in this 44-minute conference talk that delves into managing over 20,000 daily computational tasks at Man AHL, a systematic hedge fund trading thousands of instruments. Learn how a lead quantitative developer approaches the massive scale of data analysis required for predictor performance evaluation, competitor comparison, and opportunity identification in financial markets. Discover the systematic approach to task generation and resource management needed to handle diverse data sources with rigorous quality checks, while maintaining a vast and evolving codebase that supports both analytics and signal generation. Understand the challenges of managing daily updates, handling system failures, and ensuring resilience in high-frequency trading environments. Gain insights into operating within high-dimensional spaces and the extensive use of metrics and visualizations to maintain system robustness and efficiency in quantitative finance operations.