EmrStepSensorAsync
Astronomer ProvidersAsync (deferring) version of EmrStepSensor
Access Instructions
Install the Astronomer Providers provider package into your Airflow environment.
Import the module into your DAG file and instantiate it with your desired params.
Parameters
job_flow_idjob_flow_id which contains the step check the state of
step_idstep to check the state of
target_statesthe target states, sensor waits until step reaches any of these states
failed_statesthe failure states, sensor fails when step reaches any of these states
Documentation
Async (deferring) version of EmrStepSensor
Asks for the state of the step until it reaches any of the target states. If the sensor errors out, then the task will fail With the default target states, sensor waits step to be COMPLETED.
- param job_flow_id
job_flow_id which contains the step check the state of
- param step_id
step to check the state of
- param target_states
the target states, sensor waits until step reaches any of these states
- param failed_states
the failure states, sensor fails when step reaches any of these states