GlueCrawlerSensor
AmazonWaits for an AWS Glue crawler to reach any of the statuses below ‘FAILED’, ‘CANCELLED’, ‘SUCCEEDED’
Access Instructions
Install the Amazon provider package into your Airflow environment.
Import the module into your DAG file and instantiate it with your desired params.
Parameters
crawler_nameRequiredThe AWS Glue crawler unique name
aws_conn_idaws connection to use, defaults to ‘aws_default’
Documentation
Waits for an AWS Glue crawler to reach any of the statuses below ‘FAILED’, ‘CANCELLED’, ‘SUCCEEDED’
See also
For more information on how to use this sensor, take a look at the guide: Wait on an AWS Glue crawler state