ray.serve.llm.LLMServer.check_health#

async LLMServer.check_health() None[source]#

Check the health of the replica. Does not return anything. Raise error when the engine is dead and needs to be restarted.