HDFSHook
Apache HDFSInteract with HDFS. This class is a wrapper around the snakebite library.
Access Instructions
Install the Apache HDFS provider package into your Airflow environment.
Import the module into your DAG file and instantiate it with your desired params.
Parameters
hdfs_conn_idConnection id to fetch connection info
proxy_usereffective user for HDFS operations
autoconfiguse snakebite’s automatically configured client
Documentation
Interact with HDFS. This class is a wrapper around the snakebite library.