This event has ended. Visit the official site or create your own event on Sched.
Back To Schedule
Wednesday, July 27 • 1:50pm - 2:10pm
Scaling and automating R workflows with Kubernetes and Airflow

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

During the pandemic, epidemiologists have been forced to adapt to the unprecedented scale of the data and high cadence of reporting.

At the UK Health Security Agency, we have created a platform for teams to easily deploy R and/or Python tasks onto our High-Performance Computing resources, scheduling their execution, and allowing previously unthinkable workloads to be executed with ease. Thanks to Kubernetes, git, Docker, and Airflow, our epidemiologists can stop worrying about their laptop's memory and bandwidth, and focus on answering the crucial questions of the pandemic. We'd like to tell you how we did it.

avatar for Isaac Florence

Isaac Florence

UK Health Security Agency
I am an epidemiologist and public health policy professional working for the UK Health Security Agency (UKHSA). I have been using R and RStudio products since university and both have formed a major part of my career so far. At UKHSA I write in - and teach - R, SQL, Python, and other... Read More →

Wednesday July 27, 2022 1:50pm - 2:10pm EDT
3. Cherry Blossom