Available Modules
Modules are Python callables available from this provider package.
Types:
SensorsHooksOperatorsTransfersLogSecrets
Waits for blobs matching a prefix to arrive on Azure Blob Storage.
Interacts with Azure Blob Storage through the wasb:// protocol.
Waits for a blob to arrive on Azure Blob Storage.
Deletes blob(s) on Azure Blob Storage.
This class is deprecated. Please use airflow.providers.microsoft.azure.transfers.local_to_adls.LocalFilesystemToADLSOperator.
Moves data from Oracle to Azure Data Lake. The operator runs the query against Oracle and stores the file locally before loading it into Azure Data La…
Operator transfers data from Azure Blob Storage to specified bucket in Google Cloud Storage
This hook acts as a base hook for azure services. It offers several authentication mechanisms to authenticate the client library used for upstream azu…
WasbTaskHandler is a python log handler that handles and reads task instance logs. It extends airflow FileTaskHandler and uploads to and reads from Wa…
Uploads a file to Azure Blob Storage.
Interacts with Azure Data Explorer (Kusto).
Operator for querying Azure Data Explorer (Kusto).
Checks the status of a pipeline run.
Executes a data factory pipeline.
Uploads a file to Azure Blob Storage.
Upload file(s) to Azure Data Lake
A hook to interact with Azure Data Factory.
Retrieves Airflow Connections or Variables from Azure Key Vault secrets.
Interacts with Azure FileShare Storage.
This module contains integration with Azure Data Lake.
Checks for the existence of a document which matches the given query in CosmosDB. Example:
Inserts a new document into the specified Cosmos database and collection It will create both the database and collection if they do not already exist
Interacts with Azure CosmosDB.
A hook to communicate with a Azure Container Registry.
A hook which wraps an Azure Volume.
Start a container on Azure Container Instances
Executes a job on Azure Batch Service
A hook to communicate with Azure Container Instances.
Hook for Azure Batch APIs
Transfer files to Azure Blob Storage from SFTP server.
Delete files in the specified path.
List all files from the specified path
Deletes the topic subscription in the Azure ServiceBus namespace
Receive a batch of messages at once in a specified Queue name
Creates a Azure Service Bus queue under a Service Bus Namespace by using ServiceBusAdministrationClient
Interacts with ServiceBusAdministrationClient client to create, update, list, and delete resources of a Service Bus namespace. This hook uses the sam…
Interacts with ServiceBusClient and acts as a high level interface for getting ServiceBusSender and ServiceBusReceiver.
BaseAzureServiceBusHook class to create session and create connection using connection string
A hook to interact with Azure Synapse.
Deletes the topic in the Azure Service Bus namespace
Send Message or batch message to the Service Bus queue
Receive a Batch messages from a Service Bus Subscription under specific Topic.
Executes a Spark job on Azure Synapse.
Deletes the Queue in the Azure Service Bus namespace
Create an Azure Service Bus Topic under a Service Bus Namespace by using ServiceBusAdministrationClient
Create an Azure Service Bus Topic Subscription under a Service Bus Namespace by using ServiceBusAdministrationClient
Update an Azure ServiceBus Topic Subscription under a ServiceBus Namespace by using ServiceBusAdministrationClient
This Hook interacts with ADLS gen2 storage account it mainly helps to create and manage directories and files in storage accounts that have a hierarch…