EmrContainerBaseTrigger

Astronomer Providers

Poll for the status of EMR container until reaches terminal state

Access Instructions

Install the Astronomer Providers provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.

Parameters

virtual_cluster_idReference Emr cluster id
job_idjob_id to check the state
max_triesmaximum try attempts for polling the status
aws_conn_idReference to AWS connection id
poll_intervalpolling period in seconds to check for the status

Documentation

Poll for the status of EMR container until reaches terminal state

Was this page helpful?