ray.serve.config.GangPlacementStrategy#

class ray.serve.config.GangPlacementStrategy(value)[source]#

Bases: str, Enum

Placement strategy for replicas within a gang.

PublicAPI (alpha): This API is in alpha and may change before becoming stable.

PACK = 'PACK'#

Pack replicas on as few nodes as possible (best effort).

SPREAD = 'SPREAD'#

Spread replicas across distinct nodes as evenly as possible (best effort).