ray.data.Dataset.take_all

Dataset.take_all(limit: Optional[int] = None) → List[Dict[str, Any]]

Return all of the records in the dataset.

This will move the entire dataset to the caller’s machine; if the dataset is very large, this can result in an OutOfMemory crash on the caller.

Note

This operation will trigger execution of the lazy transformations performed on this dataset.

Time complexity: O(dataset size)

Parameters

limit – Raise an error if the size exceeds the specified limit.

Returns

A list of all the records in the dataset.