LivyAsyncHook

Apache Livy

Hook for Apache Livy through the REST API asynchronously

View on GitHub

Last Updated: Mar. 20, 2023

Access Instructions

Install the Apache Livy provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.

Parameters

livy_conn_idreference to a pre-defined Livy Connection.
extra_optionsA dictionary of options passed to Livy.
extra_headersA dictionary of headers passed to the HTTP request to livy.

Documentation

Hook for Apache Livy through the REST API asynchronously

See also

For more details refer to the Apache Livy API reference: https://livy.apache.org/docs/latest/rest-api.html

Was this page helpful?