EmrStepSensorHookAsync
Astronomer ProvidersA thin wrapper to interact with AWS EMR API
Access Instructions
Install the Astronomer Providers provider package into your Airflow environment.
Import the module into your DAG file and instantiate it with your desired params.
Parameters
job_flow_idid of the JobFlow to add steps to
step_idstep to check the state of
client_typeboto3.client client_type. Eg ‘s3’, ‘emr’ etc
resource_typeboto3.resource resource_type. Eg ‘dynamodb’ etc
configConfiguration for botocore client.
Documentation
A thin wrapper to interact with AWS EMR API
Additional arguments may be specified and are passed down to the underlying AwsBaseHook.
- param job_flow_id
id of the JobFlow to add steps to
- param step_id
step to check the state of
- param client_type
boto3.client client_type. Eg ‘s3’, ‘emr’ etc
- param resource_type
boto3.resource resource_type. Eg ‘dynamodb’ etc
- param config
Configuration for botocore client.