AthenaSensor
AmazonAsks for the state of the Query until it reaches a failure state or success state. If the query fails, the task will fail.
Access Instructions
Install the Amazon provider package into your Airflow environment.
Import the module into your DAG file and instantiate it with your desired params.
Parameters
query_execution_idRequiredquery_execution_id to check the state of
max_retriesNumber of times to poll for query state before returning the current state, defaults to None
aws_conn_idaws connection to use, defaults to ‘aws_default’
sleep_timeTime in seconds to wait between two consecutive call to check query status on athena, defaults to 10
Documentation
Asks for the state of the Query until it reaches a failure state or success state. If the query fails, the task will fail.
See also
For more information on how to use this sensor, take a look at the guide: Wait on Amazon Athena query results