ray.rllib.models.tf.tf_modelv2.TFModelV2#

class ray.rllib.models.tf.tf_modelv2.TFModelV2(obs_space: gymnasium.spaces.Space, action_space: gymnasium.spaces.Space, num_outputs: int, model_config: dict, name: str)[source]#

TF version of ModelV2, which should contain a tf keras Model.

Note that this class by itself is not a valid model unless you implement forward() in a subclass.

Methods

`__init__`	Initializes a TFModelV2 instance.
`context`	Returns a contextmanager for the current TF graph.
`custom_loss`	Override to customize the loss function used to optimize this model.
`forward`	Call the model with the given input tensors and state.
`get_initial_state`	Get the initial recurrent state values for the model.
`is_time_major`	If True, data for calling this ModelV2 must be in time-major format.
`last_output`	Returns the last output returned from calling the model.
`metrics`	Override to return custom metrics from your model.
`register_variables`	Register the given list of variables with this model.
`update_ops`	Return the list of update ops for this model.
`value_function`	Returns the value function output for the most recent forward pass.