S3KeysUnchangedTrigger
Astronomer ProvidersS3KeyTrigger is fired as deferred class with params to run the task in trigger worker
Access Instructions
Install the Astronomer Providers provider package into your Airflow environment.
Import the module into your DAG file and instantiate it with your desired params.
Parameters
bucket_nameName of the S3 bucket. Only needed when bucket_key is not provided as a full s3:// url.
prefixThe prefix being waited on. Relative path from bucket root level.
inactivity_periodThe total seconds of inactivity to designate keys unchanged. Note, this mechanism is not real time and this operator may not return until a poke_interval after this period has passed with no additional objects sensed.
min_objectsThe minimum number of objects needed for keys unchanged sensor to be considered valid.
inactivity_secondsreference to the seconds of inactivity
previous_objectsThe set of object ids found during the last poke.
allow_deleteShould this sensor consider objects being deleted
aws_conn_idreference to the s3 connection
last_activity_timelast modified or last active time
verifyWhether or not to verify SSL certificates for S3 connection. By default SSL certificates are verified.
Documentation
S3KeyTrigger is fired as deferred class with params to run the task in trigger worker