Integrations

If you’re new to Ray Datasets, we recommend starting with the Ray Datasets Quick Start.

This is a guide on how to run Dask, Spark, Mars or Modin on Ray.

• Using Dask on Ray
  • Scheduler
  • Best Practice for Large Scale workloads
  • Out-of-Core Data Processing
  • Persist
  • Annotations, Resources, and Task Options
  • Custom optimization for Dask DataFrame shuffling
  • Callbacks
• Using Spark on Ray (RayDP)
  • Installing RayDP
  • Creating a Spark Session
  • Deep Learning with a Spark DataFrame
• Using Mars on Ray
  • Installation
  • Getting started
• Using Pandas on Ray (Modin)
  • Using Modin with Ray’s autoscaler
  • How Modin uses Ray