Ray
serve build
Internally, RLlib uses the following wrapper class to convert your provided gym.Env class into a VectorEnv first. After that, RLlib will convert the resulting objects into a BaseEnv.
gym.Env
VectorEnv
BaseEnv