Writing applications#
These ray.serve APIs define deployments and compose them into applications.
Deployments and applications#
Class (or function) decorated with the |
|
One or more deployments bound with arguments that can be deployed together. |
Deployment decorators#
Decorator that converts a Python class to a |
|
Wrap a deployment class with an ASGI application for HTTP request parsing. |
|
Converts a function to asynchronously handle batches. |
|
Wrap a callable or method used to load multiplexed models in a replica. |