PostgresToGCSOperator
GoogleCopy data from Postgres to Google Cloud Storage in JSON, CSV or Parquet format.
Access Instructions
Install the Google provider package into your Airflow environment.
Import the module into your DAG file and instantiate it with your desired params.
Parameters
postgres_conn_idReference to a specific Postgres hook.
use_server_side_cursorIf server-side cursor should be used for querying postgres. For detailed info, check https://www.psycopg.org/docs/usage.html#server-side-cursors
cursor_itersizeHow many records are fetched at a time in case of server-side cursor.
Documentation
Copy data from Postgres to Google Cloud Storage in JSON, CSV or Parquet format.