DataprepRunJobGroupOperator

Google

Create a jobGroup, which launches the specified job as the authenticated user. This performs the same action as clicking on the Run Job button in the application. To get recipe_id please follow the Dataprep API documentation https://clouddataprep.com/documentation/api#operation/runJobGroup

View on GitHub

Last Updated: Feb. 25, 2023

Access Instructions

Install the Google provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.

Parameters

dataprep_conn_idThe Dataprep connection ID
body_requestRequiredPassed as the body_request to GoogleDataprepHook’s run_job_group, where it’s the identifier for the recipe to run

Documentation

Create a jobGroup, which launches the specified job as the authenticated user. This performs the same action as clicking on the Run Job button in the application. To get recipe_id please follow the Dataprep API documentation https://clouddataprep.com/documentation/api#operation/runJobGroup

See also

For more information on how to use this operator, take a look at the guide: Run Job Group

Was this page helpful?