HivePartitionTrigger

Astronomer ProvidersCertified

A trigger that fires and it looks for a partition in the given table in the database or wait for the partition.

Access Instructions

Install the Astronomer Providers provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.

Parameters

tablethe table where the partition is present.
partitionThe partition clause to wait for.
schemadatabase which needs to be connected in hive.
metastore_conn_idconnection string to connect to hive.
polling_period_secondspolling period in seconds to check for the partition.

Documentation

A trigger that fires and it looks for a partition in the given table in the database or wait for the partition.

Was this page helpful?