SageMakerPipelineSensor
AmazonPolls the pipeline until it reaches a terminal state. Raises an AirflowException with the failure reason if a failed state is reached.
Access Instructions
Install the Amazon provider package into your Airflow environment.
Import the module into your DAG file and instantiate it with your desired params.
Parameters
pipeline_exec_arnRequiredARN of the pipeline to watch.
verboseWhether to print steps details while waiting for completion. Defaults to true, consider turning off for pipelines that have thousands of steps.
Documentation
Polls the pipeline until it reaches a terminal state. Raises an AirflowException with the failure reason if a failed state is reached.
See also
For more information on how to use this sensor, take a look at the guide: Wait on an Amazon SageMaker pipeline execution state