DatabricksExecutionTrigger
DatabricksThe trigger handles the logic of async communication with DataBricks API.
Access Instructions
Install the Databricks provider package into your Airflow environment.
Import the module into your DAG file and instantiate it with your desired params.
Parameters
run_idid of the run
databricks_conn_idReference to the Databricks connection.
polling_period_secondsControls the rate of the poll for the result of this run. By default, the trigger will poll every 30 seconds.
Documentation
The trigger handles the logic of async communication with DataBricks API.