EmrStepSensorTrigger
Astronomer ProvidersA trigger that fires once AWS EMR cluster step reaches either target or failed state
Access Instructions
Install the Astronomer Providers provider package into your Airflow environment.
Import the module into your DAG file and instantiate it with your desired params.
Parameters
job_flow_idjob_flow_id which contains the step check the state of
step_idstep to check the state of
aws_conn_idaws connection to use, defaults to ‘aws_default’
poke_intervalTime in seconds to wait between two consecutive call to check emr cluster step state
target_statesthe target states, sensor waits until step reaches any of these states
failed_statesthe failure states, sensor fails when step reaches any of these states
Documentation
A trigger that fires once AWS EMR cluster step reaches either target or failed state