WhylogsSummaryDriftOperator

whylogs

This operator creates a whylogs’ Summary Drift report from two existing whylogs profiles. One of them is the reference profile, the “ground truth”, and the other one is the target data, meaning that this is what the report will compare it against. In order to have it working, users should also define what reader and writer they wish to use, leveraging the existing whylogs’ API for this.

View on GitHub

Last Updated: Aug. 22, 2022

Access Instructions

Install the whylogs provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.

Parameters

Documentation

Parameters

target_profile_pathRequiredstrThe target dataset profile path location.

reference_profile_pathRequiredstrThe reference dataset profile path location.

write_report_pathRequiredstrThe location where you wish to store the HTML file for the Summary Drift Report

readerOptional, strThe desired whylogs profile reader to choose from. Learn about the existing readers on [our docs](https://whylogs.readthedocs.io/en/latest/index.html). Defaults to “local”

writerOptional, strThe desired whylogs profile writer to choose from. Learn about the existing writers on [our docs](https://whylogs.readthedocs.io/en/latest/index.html). Defaults to “local”.