ray.serve.ingress#

ray.serve.ingress(app: Union[fastapi.FastAPI, fastapi.APIRouter, Callable]) → Callable[source]#

Wrap a deployment class with a FastAPI application for HTTP request parsing.

Example

from ray import serve
from fastapi import FastAPI

app = FastAPI()

@serve.deployment
@serve.ingress(app)
class MyFastAPIDeployment:
    @app.get("/hi")
    def say_hi(self) -> str:
        return "Hello world!"

app = MyFastAPIDeployment.bind()
Parameters

app – the FastAPI app or router object to wrap this class with. Can be any ASGI-compatible callable.