LivySensor
Apache LivyMonitor a Livy sessions for termination.
Access Instructions
Install the Apache Livy provider package into your Airflow environment.
Import the module into your DAG file and instantiate it with your desired params.
Parameters
livy_conn_idreference to a pre-defined Livy connection
batch_idRequiredidentifier of the monitored batch depends on the option that’s being modified.
Documentation
Monitor a Livy sessions for termination.