PostgresOperator
PostgresExecutes sql code in a specific Postgres database
Access Instructions
Install the Postgres provider package into your Airflow environment.
Import the module into your DAG file and instantiate it with your desired params.
Parameters
Documentation
Executes sql code in a specific Postgres database
Example DAGs
A DAG that runs multiple, parameterized dynamic queries against a Greenplum database based on a list of provided states using the PostgresOperator, and then sends an email upon successful completion u…
An example pipeline demonstrating how to perform data quality checks in Redshift using SQL Check Operators.
This DAG performs a daily export from a CrateDB time-series table to an S3 bucket as JSON files.
Example DAG showcasing loading and data quality checking with Redshift and Great Expectations.
This is the second in a series of DAGs showing an EL pipeline with data integrity checking of data in S3 as well as Redshift.
This is the third in a series of DAGs showing an EL pipeline with data integrity and data quality checking for data in S3 and Redshift using ETag verification and row-based data quality checks where t…
Example DAG that queries the Airflow Metadata Database and moves data through GCS to Postgres.
Imports local files to S3, then to CrateDB and checks several data quality properties
