Apache Hive

Waits for a partition to show up in Hive.

View on GitHub

Last Updated: Oct. 23, 2022

Access Instructions

Install the Apache Hive provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.


tableRequiredThe name of the table to wait for, supports the dot notation (my_database.my_table)
partitionThe partition clause to wait for. This is passed as is to the metastore Thrift client get_partitions_by_filter method, and apparently supports SQL like notation as in ds='2015-01-01' AND type='value' and comparison operators as in "ds>=2015-01-01"
metastore_conn_idreference to the :ref: metastore thrift service connection id


Waits for a partition to show up in Hive.

Note: Because partition supports general logical operators, it can be inefficient. Consider using NamedHivePartitionSensor instead if you don’t need the full flexibility of HivePartitionSensor.

Was this page helpful?