Ray Data: Scalable Datasets for ML
Contents
Ray Data: Scalable Datasets for ML#
Ray Data is a scalable data processing library for ML workloads. It provides flexible and performant APIs for scaling Offline batch inference and Data preprocessing and ingest for ML training. Ray Data uses streaming execution to efficiently process large datasets.
Install Ray Data#
To install Ray Data, run:
$ pip install -U 'ray[data]'
To learn more about installing Ray and its libraries, see Installing Ray.
Learn more#
Ray Data Overview
Get an overview of Ray Data, the workloads that it supports, and how it compares to alternatives.
Key Concepts
Understand the key concepts behind Ray Data. Learn what Datasets are and how they’re used.
User Guides
Learn how to use Ray Data, from basic usage to end-to-end guides.
Examples
Find both simple and scaling-out examples of using Ray Data.
API
Get more in-depth information about the Ray Data API.
Ray blogs
Get the latest on engineering updates from the Ray team and how companies are using Ray Data.