HivePartitionSensor
Apache HiveWaits for a partition to show up in Hive.
Access Instructions
Install the Apache Hive provider package into your Airflow environment.
Import the module into your DAG file and instantiate it with your desired params.
Parameters
tableRequiredThe name of the table to wait for, supports the dot notation (my_database.my_table)
partitionThe partition clause to wait for. This is passed as is to the metastore Thrift client get_partitions_by_filter method, and apparently supports SQL like notation as in ds='2015-01-01' AND type='value' and comparison operators as in "ds>=2015-01-01"
metastore_conn_idreference to the :ref: metastore thrift service connection id
Documentation
Waits for a partition to show up in Hive.
Note: Because partition supports general logical operators, it can be inefficient. Consider using NamedHivePartitionSensor instead if you don’t need the full flexibility of HivePartitionSensor.