Apache Airflow Training

17 June, 2024Amsterdam, The Netherlands

2 days
In Person
Data and AI
Data Engineering

Unravel Apache Airflow in our training, as we tackle intricate cron job management and data reliability. Engage in hands-on learning, mastering Airflow’s essentials for effortless workflow scheduling, monitoring, and data flow. Develop skills to create efficient pipelines and navigate architecture intricacies, all while making informed decisions. This training goes beyond tools, emphasizing thoughtful decision-making for robust workflows. Join us to demystify Airflow’s potential and equip yourself with skills to streamline your data processes effectively.

Book this training

Book now

Looking to upskill your team(s) or organization?

Diego will gladly help you further with custom training solutions for your organization.

Diego Teunissen
Data and AI Training Advisor

+31 6 1591 4440
Diego.Teunissen@xebia.com
linkedin.com/in/diego-teunissen//

Get in touch

Duration

2 days

Time

09:00 – 17:00

Language

English

Lunch

Included

Certification

No

Level

Advanced

What will you learn?

After the training, you will be able to:

Use basic Airflow concepts, such as DAGs, Operators, and Hooks.

Use Airflow Operators to execute predefined tasks which integrate with many different systems.

Design and create task workflows using Airflow DAGs.

Use the Airflow UI to get insights into the status of your workflows.

Program

In the Course Capstone Project, you will become a rocket scientist tasked with constructing an Apache Airflow data pipeline. Guided by a visionary boss, you leverage The SpaceDevs API to gather insights from rocket launches. Your journey centers on mastering architectural design, creating launch-scheduling operators, and optimizing pipeline efficiency. Embracing files and cloud storage, you will integrate SQL-like databases for comprehensive analysis. This achievement underscores the project’s impact on scientific exploration, offering a unique opportunity to harness Airflow’s power for orchestrating real-world data pipelines. 🚀

  • What is Airflow?
  • Airflow Installation
  • Create Your First DAG
  • Scheduling pipelines in Airflow
  • Context & Templating
  • Branching & Trigger Rules
  • Sensors
  • Introduction to the Capstone Project

Who is it for?

This training is for you if:

You want to schedule and monitor your data pipelines in a user-friendly way.

You have complex data pipelines with a lot of dependencies.

You want to schedule your data pipelines on external systems.

This training is not for you if:

You want to handle streaming data pipelines.

Your primary focus is on single, isolated tasks rather than orchestrating complex workflows.

You don’t work with data pipelines or recurring processes that require scheduling.

You have less than one year of experience working with Python in the Data Engineering field.

Why should I
follow this training?

Get a solid understanding of Apache Airflow’s core concepts and practical hands-on experience.

Learn how to author, schedule, and monitor workflows.

Learn how best to design data pipelines for real-life use cases. 

What else
should I know?

After registering for this training, you will receive a confirmation email with practical information. A week before the training, the trainer will get in touch to ask you about any requirements you may have and any pre-course tasks you will need to do.

See you soon!

All literature and course materials are included in the price. 

After registering for this course, you will receive a confirmation email with practical information. 

Also interesting for you

View all training courses
Introduction to Generative AI

Get a non-technical introduction to the field of Generative AI and learn best practices when using Generative AI tools.

Generative AI
View training
Data Quality and Observability

Navigate the landscape of data quality and observability. You will not only learn about the tools, technologies and solutions in the data quality and observability space, but also understand how to identify the data quality problems specific to your organisation to match the right solution to your organisation’s need.

analytics engineering
View training
Building LLM Applications

Delve into the world of Large Language Models (LLMs) and state-of-the-art generative AI.

Generative AI
View training
SQL for Data Analysis

Unlock the power of data with SQL – the ultimate data management system!

Data Analysis
sql
View training

Can’t find the course you’re looking for? There’s more!