EmrJobFlowSensorTrigger
Astronomer ProvidersEmrJobFlowSensorTrigger is fired as deferred class with params to run the task in trigger worker, when EMR JobFlow is created
Access Instructions
Install the Astronomer Providers provider package into your Airflow environment.
Import the module into your DAG file and instantiate it with your desired params.
Parameters
job_flow_idjob_flow_id to check the state of
target_statesthe target states, sensor waits until job flow reaches any of these states
failed_statesthe failure states, sensor fails when job flow reaches any of these states
poll_intervalpolling period in seconds to check for the status
Documentation
EmrJobFlowSensorTrigger is fired as deferred class with params to run the task in trigger worker, when EMR JobFlow is created