AzureDataLakeStorageV2Hook

Microsoft Azure

This Hook interacts with ADLS gen2 storage account it mainly helps to create and manage directories and files in storage accounts that have a hierarchical namespace. Using Adls_v2 connection details create DataLakeServiceClient object

View on GitHub

Last Updated: Mar. 10, 2023

Access Instructions

Install the Microsoft Azure provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.

Parameters

adls_conn_idReference to the adls connection.
public_readWhether an anonymous public read access should be used. default is False

Documentation

This Hook interacts with ADLS gen2 storage account it mainly helps to create and manage directories and files in storage accounts that have a hierarchical namespace. Using Adls_v2 connection details create DataLakeServiceClient object

Due to Wasb is marked as legacy and and retirement of the (ADLS1) it would be nice to implement ADLS gen2 hook for interacting with the storage account.

Was this page helpful?