ray.rllib.core.rl_module.rl_module.SingleAgentRLModuleSpec#

class ray.rllib.core.rl_module.rl_module.SingleAgentRLModuleSpec(module_class: Optional[Type[RLModule]] = None, observation_space: Optional[<MagicMock name='mock.Space' id='140096994818384'>] = None, action_space: Optional[<MagicMock name='mock.Space' id='140096994818384'>] = None, model_config_dict: Optional[Dict[str, Any]] = None, catalog_class: Optional[Type[Catalog]] = None, load_state_path: Optional[str] = None)[source]#

Bases: object

Utility spec class to make constructing RLModules (in single-agent case) easier.

Parameters

  • module_class – The RLModule class to use.

  • observation_space – The observation space of the RLModule. This may differ from the observation space of the environment. For example, a discrete observation space of an environment, would usually correspond to a one-hot encoded observation space of the RLModule because of preprocessing.

  • action_space – The action space of the RLModule.

  • model_config_dict – The model config dict to use.

  • catalog_class – The Catalog class to use.

  • load_state_path – The path to the module state to load from. NOTE: This must be an absolute path.

Methods

build()

Builds the RLModule from this spec.

from_dict(d)

Returns a single agent RLModule spec from a serialized representation.

get_rl_module_config()

Returns the RLModule config for this spec.

to_dict()

Returns a serialized representation of the spec.

update(other)

Updates this spec with the given other spec.

Attributes

action_space

catalog_class

load_state_path

model_config_dict

module_class

observation_space