Apache Druid

Connection to Druid overlord for ingestion

View on GitHub

Last Updated: Oct. 31, 2022

Access Instructions

Install the Apache Druid provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.


druid_ingest_conn_idThe connection id to the Druid overlord machine which accepts index jobs
timeoutThe interval between polling the Druid job for the status of the ingestion job. Must be greater than or equal to 1
max_ingestion_timeThe maximum ingestion time before assuming the job failed


Connection to Druid overlord for ingestion

To connect to a Druid cluster that is secured with the druid-basic-security extension, add the username and password to the druid ingestion connection.

Was this page helpful?