Production ready airflow 2.0 on Kubernetes

Welcome to the Fullstaq Show ‘n Tell. A webinar series where engineers showcase technology they are working with. An easily accessible presentation with a couple of slides, a demo, and an opportunity to ask questions.

With the release of Airflow 2.0, we had the chance to redeploy our environment. Join us in our journey to setting up a production-ready instance of Airflow 2.0, on Kubernetes, and using the official HELM chart.

In this Show ‘n Tell, our colleague Tim will be sharing his considerations and following choices, best practices, and pitfalls to avoid for topics like CI/CD, running on Kubernetes, handling logging and monitoring, and how to manage secrets and dags for Airflow 2.0.

Agenda

  • 16:00 – 16:05 : Welcome, introduction and house rules
  • 16:05 – 16:45 : Tim van de Keer – Production ready Airflow 2.0 on Kubernetes
  • 16:45 – 17:00 : Q/A

Presenters

Gerrit Tamboer - circle

Gerrit Tamboer
Webinar host @ Fullstaq

Tim van de Keer

Tim van de Keer
DevOps engineer @ Fullstaq

This is Daniel
November 05, 2021 | | 2 MINUTES

To Serverless or not to Serverless?

In this talk Vincent will introduce you to the big world of Serverless Computing with a specific focus on Function as a Service (FaaS) on the Google …

October 20, 2021 | | 1 MINUTES

Increase Kubernetes Network Security by using Cilium as dataplane

In this Show ‘n Tell about Increasing Kubernetes Network Security by using Cilium as dataplane, our colleague Arnold will explain and show the type of …

September 24, 2021 | Show 'n Tell | 1 MINUTES

Multi-cluster metrics with Prometheus and Thanos

Wiard will be sharing his experiences handling multi-cluster metrics in Kubernetes with Thanos and Prometheus