ray.util.tpu.slice_placement_group#

ray.util.tpu.slice_placement_group(topology: str, accelerator_version: str, num_slices: int = 1, **kwargs) → SlicePlacementGroup[source]#

Asynchronously creates a PlacementGroup for a TPU slice.

A slice placement group reserves num_slices TPU slice(s) and creates a placement group for scheduling tasks.

Parameters:

  • topology – The desired TPU pod topology (e.g. “4x4”, “2x8”).

  • accelerator_version – The TPU accelerator generation, (e.g. “V4”, “V5P”, “V6E”).

  • num_slices – The number of tpu slices within the placement group

  • **kwargs – Additional arguments for the placement group, such as ‘name’, ‘lifetime’, or ‘strategy’.

Returns:

The handle for the created SlicePlacementGroup.

PublicAPI (alpha): This API is in alpha and may change before becoming stable.