ray.serve.config.ProxyLocation#

class ray.serve.config.ProxyLocation(value)[source]#

Bases: str, enum.Enum

Config for where to run proxies to receive ingress traffic to the cluster.

Options:

  • Disabled: don’t run proxies at all. This should be used if you are only making calls to your applications via deployment handles.

  • HeadOnly: only run a single proxy on the head node.

  • EveryNode: run a proxy on every node in the cluster that has at least one replica actor. This is the default.

Attributes

Disabled

HeadOnly

EveryNode