EmrServerlessCreateApplicationOperator
AmazonOperator to create Serverless EMR Application
Access Instructions
Install the Amazon provider package into your Airflow environment.
Import the module into your DAG file and instantiate it with your desired params.
Parameters
release_labelThe EMR release version associated with the application.
job_typeThe type of application you want to start, such as Spark or Hive.
wait_for_completionIf true, wait for the Application to start before returning. Default to True. If set to False, waiter_countdown and waiter_check_interval_seconds will only be applied when waiting for the application to be in the CREATED state.
client_request_tokenThe client idempotency token of the application to create. Its value must be unique for each request.
configOptional dictionary for arbitrary parameters to the boto API create_application call.
aws_conn_idAWS connection to use
waiter_countdownTotal amount of time, in seconds, the operator will wait for the application to start. Defaults to 25 minutes.
waiter_check_interval_secondsNumber of seconds between polling the state of the application. Defaults to 60 seconds.
Documentation
Operator to create Serverless EMR Application
See also
For more information on how to use this operator, take a look at the guide: Create an EMR Serverless Application