RayBackend

Ray

Custom Backend Serving to use Ray.

View on GitHub

Last Updated: Oct. 3, 2021

Access Instructions

Install the Ray provider package into your Airflow environment.

Update your environment config per the instructions in the docs below.

Documentation

Example DAGs

Documentation

Custom Backend Serving to use Ray.

Setup in your airflow Dockerfile with the following lines:

FROM quay.io/astronomer/ap-airflow:2.0.2-1-buster-onbuild
USER root
RUN pip uninstall astronomer-airflow-version-check -y
USER astro
ENV AIRFLOW__CORE__XCOM_BACKEND=ray_provider.xcom.ray_backend.RayBackend

Example DAGs

xgboost_pandas_tune_breast_cancer

build dataframe from breast cancer dataset

Data ProcessingData Science

ray_pandas_dag

#### build random dataframe task

Data ProcessingData Science

task_flow_xgboost_modin

Build a dataframe task.

Data ProcessingData Science

RayBackend

Access Instructions

Documentation

Example DAGs

Was this page helpful?

Product

Resources

Company