Toggle navigation sidebar
Toggle in-page Table of Contents
Ray 2.4.0
Welcome to Ray!
Ray
Overview
Getting Started Guide
Installation
Use Cases
Ecosystem
Ray Core
Ray AI Runtime (AIR)
Ray Data
Ray Train
Ray Tune
Ray Serve
Ray RLlib
More Libraries
Ray Clusters
Monitoring and Debugging
References
Ray AIR API
Ray Datasets API
Input/Output
Dataset API
DatasetIterator API
DatasetPipeline API
ExecutionOptions API
GroupedDataset API
DatasetContext API
Data Representations
(Experimental) RandomAccessDataset API
Utility
API Guide for Users from Other Data Libraries
Ray Train API
Ray Tune API
Ray Serve API
Ray RLlib API
Ray Workflows API
Ray Cluster Management API
Ray Core API
Usage Stats Collection
Ray Glossary
Developer Guides
repository
open issue
suggest edit
.rst
.pdf
Ray Datasets API
Ray Datasets API
#
Input/Output
Synthetic Data
Python Objects
Parquet
CSV
JSON
Text
Images
Binary
TFRecords
Pandas
NumPy
Arrow
MongoDB
SQL Databases
Dask
Spark
Modin
Mars
Torch
Hugging Face
TensorFlow
WebDataset
Datasource API
Partitioning API
MetadataProvider API
Dataset API
Constructor
Basic Transformations
Sorting, Shuffling, Repartitioning
Splitting and Merging Datasets
Grouped and Global Aggregations
Converting to Pipeline
Consuming Datasets
I/O and Conversion
Inspecting Metadata
Execution
Serialization
Internals
DatasetIterator API
ray.data.DatasetIterator.iter_batches
ray.data.DatasetIterator.iter_torch_batches
ray.data.DatasetIterator.to_tf
ray.data.DatasetIterator.stats
DatasetPipeline API
Constructor
Basic Transformations
Sorting, Shuffling, Repartitioning
Splitting DatasetPipelines
Creating DatasetPipelines
Consuming DatasetPipelines
I/O and Conversion
Inspecting Metadata
ExecutionOptions API
Constructor
Resource Options
GroupedDataset API
Constructor
Computations / Descriptive Stats
Function Application
Aggregate Function
DatasetContext API
Constructor
Get DatasetContext
Data Representations
Block API
Batch API
Row API
Tensor Column Extension API
(Experimental) RandomAccessDataset API
Constructor
Functions
Utility
ray.data.set_progress_bars
API Guide for Users from Other Data Libraries
For Pandas Users
For PyArrow Users