PigOperator

Apache Pig

Executes pig script.

View on GitHub

Last Updated: Nov. 13, 2022

Access Instructions

Install the Apache Pig provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.

Parameters

pigRequiredthe pig latin script to be executed. (templated)
pig_cli_conn_idreference to the Hive database
pigparams_jinja_translatewhen True, pig params-type templating ${var} gets translated into jinja-type templating {{ var }}. Note that you may want to use this along with the DAG(user_defined_macros=myargs) parameter. View the DAG object documentation for more details.
pig_optspig options, such as: -x tez, -useHCatalog, … - space separated list
pig_propertiespig properties, additional pig properties passed as list

Documentation

Executes pig script.

Was this page helpful?