ray.serve.config.ProxyLocation
ray.serve.config.ProxyLocation#
- class ray.serve.config.ProxyLocation(value)[source]#
-
Config for where to run proxies to receive ingress traffic to the cluster.
Options:
Disabled: don’t run proxies at all. This should be used if you are only making calls to your applications via deployment handles.
HeadOnly: only run a single proxy on the head node.
EveryNode: run a proxy on every node in the cluster that has at least one replica actor. This is the default.
Attributes