KubernetesPodOperatorAsync
Astronomer ProvidersAsync (deferring) version of KubernetesPodOperator
Access Instructions
Install the Astronomer Providers provider package into your Airflow environment.
Import the module into your DAG file and instantiate it with your desired params.
Parameters
poll_intervalinterval in seconds to sleep between checking pod status
logging_intervalmax time in seconds that task should be in deferred state before resuming to fetch latest logs. If None, then the task will remain in deferred state until pod is done, and no logs will be visible until that time.
Documentation
Async (deferring) version of KubernetesPodOperator
Warning
By default, logs will not be available in the Airflow Webserver until the task completes. However, you can configure KubernetesPodOperatorAsync to periodically resume and fetch logs. This behavior is controlled by param logging_interval.