EmrContainerOperatorTrigger
Astronomer ProvidersPoll for the status of EMR container until reaches terminal state
Access Instructions
Install the Astronomer Providers provider package into your Airflow environment.
Import the module into your DAG file and instantiate it with your desired params.
Parameters
virtual_cluster_idReference Emr cluster id
job_idjob_id to check the state
max_triesmaximum try attempts for polling the status
aws_conn_idReference to AWS connection id
poll_intervalpolling period in seconds to check for the status
Documentation
Poll for the status of EMR container until reaches terminal state