Community Supported Cluster Managers
Community Supported Cluster Managers#
If you’re using AWS, Azure or GCP you can use the Ray cluster launcher to simplify the cluster setup process.
The following is a list of community supported cluster managers.
- Deploying on YARN
- Deploying on Slurm
- Deploying on LSF
- Deploying on Spark Standalone cluster
Using a custom cloud or cluster manager#
The Ray cluster launcher currently supports AWS, Azure, GCP, Aliyun and Kuberay out of the box. To use the Ray cluster launcher and Autoscaler on other cloud providers or cluster managers, you can implement the node_provider.py interface (100 LOC). Once the node provider is implemented, you can register it in the provider section of the cluster launcher config.
provider: type: "external" module: "my.module.MyCustomNodeProvider"
- You can refer to AWSNodeProvider, KuberayNodeProvider and
LocalNodeProvider for more examples.