Loading…
October 24, 2022 | Detroit, Michigan
View More Details & Registration Information 

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for KubeCon + CloudNativeCon North America 2022 - Detroit, MI + Virtual and add this Co-Located event to your registration to participate in these sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

Please note: This schedule is automatically displayed in Eastern Daylight Time (EDT), UTC -4. To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above "Filter by Date."

The schedule is subject to change.
Back To Schedule
Monday, October 24 • 2:00pm - 2:30pm
Building Armada – Running Batch Jobs at Massive Scale on Kubernetes - Jamie Poole, G-Research

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Feedback form is now closed.
Thousands of GPUs. Hundreds of thousands of CPUs. Learn how (and why!) G-Research designed and built Armada - a system to enable massive throughput of batch jobs running on Kubernetes. In this session you’ll hear how we use large scale batch compute on Kubernetes to spot patterns in financial markets and predict the future. Armada enables us to schedule millions of batch jobs across many clusters and tens of thousands of nodes, getting optimum utilisation of our hardware to enable our researchers to run the latest machine-learning and advanced data science techniques across vast datasets. We’ll cover the architecture and approach of Armada, challenges and techniques for running Kubernetes at scale and some war stories and lessons learned along the way.
Speakers
avatar for Jamie Poole

Jamie Poole

Compute Platform Engineering Manager, G-Research
Jamie Poole is the manager of the Compute Platform Engineering group at G-Research. He has an academic background in mathematics and physics, and professional background in software development and platforms in the government, defence and financial sectors. He is very enthusiastic... Read More →

Building Armada Jamie Poole pdf
Monday October 24, 2022 2:00pm - 2:30pm EDT
Room 252 AB
  Sessions