ray.serve.config.GangSchedulingConfig#

class ray.serve.config.GangSchedulingConfig(*, gang_size: ConstrainedIntValue, gang_placement_strategy: GangPlacementStrategy = GangPlacementStrategy.PACK, runtime_failure_policy: GangRuntimeFailurePolicy = GangRuntimeFailurePolicy.RESTART_GANG)[source]#

Bases: BaseModel

Configuration for gang scheduling of deployment replicas.

PublicAPI (alpha): This API is in alpha and may change before becoming stable.

Methods

`__init__`	Create a new model by parsing and validating input data from keyword arguments.
`construct`	Creates a new model setting __dict__ and __fields_set__ from trusted or pre-validated data.
`copy`	Duplicate a model, optionally choose which fields to include, exclude and change.
`dict`	Generate a dictionary representation of the model, optionally specifying which fields to include or exclude.
`json`	Generate a JSON representation of the model, `include` and `exclude` arguments as per `dict()`.
`update_forward_refs`	Try to update ForwardRefs on fields based on this Model, globalns and localns.

Attributes

`gang_size`
`gang_placement_strategy`
`runtime_failure_policy`