EmrJobFlowHookAsync
Astronomer ProvidersEmrJobFlowHookAsync is wrapper Interact with AWS EMR.Using Aiobotocore client makes API call to get cluster-level details by job_flow_id. Additional arguments (such as aws_conn_id) may be specified and are passed down to the underlying AwsBaseHookAsync.
Access Instructions
Install the Astronomer Providers provider package into your Airflow environment.
Import the module into your DAG file and instantiate it with your desired params.
Parameters
aws_conn_idThe Airflow connection used for AWS credentials. If this is None or empty then the default boto3 behaviour is used. If running Airflow in a distributed manner and aws_conn_id is None or empty, then default boto3 configuration would be used (and must be maintained on each worker node).
verifyWhether or not to verify SSL certificates.
region_nameAWS region_name. If not specified then the default boto3 behaviour is used.
client_typeboto3.client client_type. Eg ‘s3’, ‘emr’ etc
resource_typeboto3.resource resource_type. Eg ‘dynamodb’ etc
configConfiguration for botocore client.
Documentation
EmrJobFlowHookAsync is wrapper Interact with AWS EMR.Using Aiobotocore client makes API call to get cluster-level details by job_flow_id. Additional arguments (such as aws_conn_id) may be specified and are passed down to the underlying AwsBaseHookAsync.