SFTPToS3Operator
AmazonThis operator enables the transferring of files from a SFTP server to Amazon S3.
Access Instructions
Install the Amazon provider package into your Airflow environment.
Import the module into your DAG file and instantiate it with your desired params.
Parameters
sftp_conn_idThe sftp connection id. The name or identifier for establishing a connection to the SFTP server.
sftp_pathRequiredThe sftp remote path. This is the specified file path for downloading the file from the SFTP server.
s3_conn_idThe s3 connection id. The name or identifier for establishing a connection to S3
s3_bucketRequiredThe targeted s3 bucket. This is the S3 bucket to where the file is uploaded.
s3_keyRequiredThe targeted s3 key. This is the specified path for uploading the file to S3.
use_temp_fileIf True, copies file first to local, if False streams file from SFTP to S3.
Documentation
This operator enables the transferring of files from a SFTP server to Amazon S3.
See also
For more information on how to use this operator, take a look at the guide: SFTP to Amazon S3 transfer operator