KafkaConsumerHook
Apache KafkaKafkaConsumerHook
Access Instructions
Install the Apache Kafka provider package into your Airflow environment.
Import the module into your DAG file and instantiate it with your desired params.
Parameters
kafka_conn_idOptional[str], optionalA connection id to use for connecting to the cluster, defaults to None
configOptional[Dict[Any, Any]], optionalA config dictionary to use with confluent_kafka library, defaults to None
Documentation
KafkaConsumerHook
A hook for creating a Kafka Consumer