Available Modules
Modules are Python callables available from this provider package.
Types:
HooksOperatorsTransfersSensors
Simple wrapper around the hive CLI.
Wrapper to interact with the Hive Metastore
Executes hql code or hive script in a specific Hive database.
Gathers partition statistics using a dynamically generated Presto query, inserts the stats into a MySql table with this format. Stats overwrite themse…
Wrapper around the pyhive library
Moves data from Hive to MySQL, note that for now the data is loaded into memory before being pushed to MySQL, so this operator should be used for smal…
Waits for a partition to show up in Hive.
Moves data from Vertica to Hive. The operator runs your query against Vertica, stores the file locally before loading it into a Hive table. If the cre…
An alternative to the HivePartitionSensor that talk directly to the MySQL db. This was created as a result of observing sub optimal queries generated …
Executes hql code in a specific Hive database and loads the results of the query as a csv to a Samba location.
Waits for a set of partitions to show up in Hive.
Moves data from Microsoft SQL Server to Hive. The operator runs your query against Microsoft SQL Server, stores the file locally before loading it int…
Moves data from MySql to Hive. The operator runs your query against MySQL, stores the file locally before loading it into a Hive table. If the create …
Moves data from S3 to Hive. The operator downloads a file from S3, stores the file locally before loading it into a Hive table. If the create or recre…