EmrEksCreateClusterOperator

Amazon

An operator that creates EMR on EKS virtual clusters.

View on GitHub

Last Updated: Mar. 2, 2023

Access Instructions

Install the Amazon provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.

Parameters

virtual_cluster_nameRequiredThe name of the EMR EKS virtual cluster to create.
eks_cluster_nameRequiredThe EKS cluster used by the EMR virtual cluster.
eks_namespaceRequirednamespace used by the EKS cluster.
virtual_cluster_idThe EMR on EKS virtual cluster id.
aws_conn_idThe Airflow connection used for AWS credentials.
tagsThe tags assigned to created cluster. Defaults to None

Documentation

An operator that creates EMR on EKS virtual clusters.

See also

For more information on how to use this operator, take a look at the guide: Create an Amazon EMR EKS virtual cluster

Was this page helpful?