DataplexCreateTaskOperator

Google

Creates a task resource within a lake.

View on GitHub

Last Updated: Feb. 25, 2023

Access Instructions

Install the Google provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.

Parameters

project_idRequired. The ID of the Google Cloud project that the task belongs to.
regionRequired. The ID of the Google Cloud region that the task belongs to.
lake_idRequired. The ID of the Google Cloud lake that the task belongs to.
bodyRequired. The Request body contains an instance of Task.
dataplex_task_idRequired. Task identifier.
validate_onlyOptional. Only validate the request, but do not perform mutations. The default is false.
api_versionThe version of the api that will be requested for example ‘v3’.
retryA retry object used to retry requests. If None is specified, requests will not be retried.
timeoutThe amount of time, in seconds, to wait for the request to complete. Note that if retry is specified, the timeout applies to each individual attempt.
metadataAdditional metadata that is provided to the method.
gcp_conn_idThe connection ID to use when fetching connection info.
delegate_toThe account to impersonate, if any. For this to work, the service accountmaking the request must have domain-wide delegation enabled.
impersonation_chainOptional service account to impersonate using short-term credentials, or chained list of accounts required to get the access_token of the last account in the list, which will be impersonated in the request. If set as a string, the account must grant the originating account the Service Account Token Creator IAM role. If set as a sequence, the identities from the list must grant Service Account Token Creator IAM role to the directly preceding identity, with first account from the list granting this role to the originating account (templated).
asynchronousFlag informing should the Dataplex task be created asynchronously. This is useful for long running creating tasks and waiting on them asynchronously using the DataplexTaskSensor

Documentation

Creates a task resource within a lake.

Was this page helpful?