Available Modules
Modules are Python callables available from this provider package.
Types:
OperatorsHooksTriggersAwaitKafkaMessageOperator
AwaitKafkaMessageOperator An Airflow operator that defers until a specific message is published to Kafka.
Operators
KafkaAdminClientHook
KafkaAdminClientHook
Hooks
EventTriggersFunctionOperator
EventTriggersFunctionOperator An Airflow operator that defers until a specific message is published to Kafka, then triggers a registered function
Operators
ProduceToTopicOperator
ProduceToTopicOperator An operator that produces messages to a Kafka topic
Operators
KafkaConsumerHook
KafkaConsumerHook
Hooks
KafkaProducerHook
KafkaProducerHook
Hooks
AwaitMessageTrigger
AwaitMessageTrigger A trigger that waits for a message matching specific criteria to arrive in Kafka
Triggers
ConsumeFromTopicOperator
ConsumeFromTopicOperator An operator that consumes from Kafka a topic(s) and processing the messages.
Operators