Pipeline Alerts and Notifications using Microsoft Teams

Example DAG demonstrating how to implement Microsoft Teams alerting and notifications.

Alerts/Notifications


Modules:

Last Updated: Nov. 15, 2021

Run this DAG

1. Install the Astronomer CLI:Skip if you already have our CLI

2. Download the repository:

3. Navigate to where the repository was cloned and start the DAG:

Airflow Callbacks

Showcasing several ways to implement Airflow callbacks and notifications via Microsoft Teams.

Description

Monitoring tasks and DAGs at scale can be cumbersome. Sometimes you'd like to be notified of certain events, and not others. These DAGs cover several methods of implementing custom Microsoft Teams notifications, so you can be confident you aren't missing critical events that may require immediate attention.

Note: The MS Teams Hook and MS Teams Operator used in this repo were forked from mendhak/Airflow-MS-Teams-Operator

Microsoft Teams Callback Examples

Example Callbacks

Getting Started

Dependencies

To implement notifications Microsoft Teams, add this to your requirements.txt:

apache-airflow-providers-http

Installing

In order to run these demos on your localhost, be sure to install:

Executing demos

Clone this repository, then navigate to the cs-tutorial-msteams-callbacks directory and start your local Airflow instance:

astro dev start

In your browser, navigate to http://localhost:8080/

  • Username: admin

  • Password: admin

Setting up MS Teams Connections in Airflow

In order to receive callback notifications, you must also create your webhooks and set up your connections in the Airflow UI. follow the instructions found in the Appendix section of the accompanying slide deck.

Additional Resources