ray.data.Dataset.explain#
- Dataset.explain()[source]#
Show the logical plan and physical plan of the dataset.
Examples:
import ray from ray.data import Dataset ds: Dataset = ray.data.range(10, override_num_blocks=10) ds = ds.map(lambda x: x + 1) ds.explain()
<BLANKLINE> -------- Logical Plan -------- MapRows[Map(<lambda>)] +- Read[ReadRange] <BLANKLINE> -------- Logical Plan (Optimized) -------- MapRows[Map(<lambda>)] +- Read[ReadRange] <BLANKLINE> -------- Physical Plan -------- TaskPoolMapOperator[Map(<lambda>)] +- TaskPoolMapOperator[ReadRange] +- InputDataBuffer[Input] <BLANKLINE> -------- Physical Plan (Optimized) -------- TaskPoolMapOperator[ReadRange->Map(<lambda>)] +- InputDataBuffer[Input] <BLANKLINE>
PublicAPI (alpha): This API is in alpha and may change before becoming stable.