SalesforceToS3Operator

coerce_to_timestampTrue if you want all datetime fields to be converted into Unix timestamps. False if you want them to be left in the same format as they were in Salesforce. Leaving the value as False will result in datetimes being strings. Default: False

record_time_addedTrue if you want to add a Unix timestamp field to the resulting data that marks when the data was fetched from Salesforce. Default: False

aws_conn_idThe name of the connection that has the parameters we need to connect to S3.

replaceA flag to decide whether or not to overwrite the S3 key if it already exists. If set to False and the key exists an error will be raised.

encryptIf True, the file will be encrypted on the server-side by S3 and will be stored in an encrypted form while at rest in S3.

gzipIf True, the file will be compressed locally.

acl_policyString specifying the canned ACL policy for the file being uploaded to the S3 bucket.

Documentation

Submits a Salesforce query and uploads the results to AWS S3.

Example DAGs

Using Hightouch for Reverse ETL in Airflow

An ELT pipeline which extracts Salesforce customer data to Snowflake for transformation and enrichment, and synced back to Salesforce via Hightouch.

DatabasesETL/ELTStorageBig Data & Analytics

Modern ELT from Salesforce to Snowflake

A modern ELT pipeline from extracting Salesforce data to loading and transforming in Snowflake.

DatabasesETL/ELTStorageBig Data & Analytics

salesforce_to_s3

This is a basic example DAG for using SalesforceToS3Operator to retrieve Salesforce account data and upload it to an Amazon S3 bucket.