
PigOperator
Apache PigExecutes pig script.
Access Instructions
Install the Apache Pig provider package into your Airflow environment.
Import the module into your DAG file and instantiate it with your desired params.
Parameters
pigRequiredthe pig latin script to be executed. (templated)
pig_cli_conn_idreference to the Hive database
pigparams_jinja_translatewhen True, pig params-type templating ${var} gets translated into jinja-type templating {{ var }}. Note that you may want to use this along with the DAG(user_defined_macros=myargs) parameter. View the DAG object documentation for more details.
pig_optspig options, such as: -x tez, -useHCatalog, … - space separated list
pig_propertiespig properties, additional pig properties passed as list
Documentation
Executes pig script.