ray.data.from_mars

ray.data.from_mars(df: mars.DataFrame) → ray.data.dataset.Dataset[ray.data._internal.arrow_block.ArrowRow]

Create a dataset from a MARS dataframe.

Parameters

df – A MARS dataframe, which must be executed by MARS-on-Ray.

Returns

Dataset holding Arrow records read from the dataframe.

PublicAPI: This API is stable across Ray releases.