Class CliffWorld

Inheritance Relationships

Base Type

Class Documentation

class CliffWorld : public bitrl::envs::gymnasium::ToyTextEnvBase<TimeStep<uint_t>, 37, 4>

The CliffWorld class.

Public Types

typedef std::vector<std::tuple<real_t, uint_t, real_t, bool>> dynamics_type

dynamics_t

typedef ToyTextEnvBase<TimeStep<uint_t>, 37, 4>::base_type base_type

The base type.

typedef base_type::time_step_type time_step_type

The time step type we return every time a step in the environment is performed.

typedef base_type::state_space_type state_space_type

The type describing the state space for the environment.

typedef base_type::action_space_type action_space_type

The type of the action space for the environment.

typedef base_type::action_type action_type

The type of the action to be undertaken in the environment.

typedef base_type::state_type state_type

The type of the action to be undertaken in the environment.

Public Functions

CliffWorld(const RESTApiServerWrapper &api_server)

CliffWorld.

CliffWorld(const RESTApiServerWrapper &api_server, const uint_t cidx)

Constructor.

CliffWorld(const CliffWorld &other)

copy constructor

~CliffWorld() = default

~CliffWorld. Destructor

virtual void make(const std::string &version, const std::unordered_map<std::string, std::any> &options) final override

make. Builds the environment. Optionally we can choose if the environment will be slippery

virtual time_step_type step(const action_type &action) final override

step

Parameters:

action –

Returns:

CliffWorld make_copy(uint_t cidx) const

Create a new copy of the environment with the given copy index.

Public Static Attributes

static const std::string name = "CliffWalking"

name

static const std::string URI = "/gymnasium/cliff-walking-env"

The URI for accessing the environment.

Protected Functions

virtual time_step_type create_time_step_from_response_(const nlohmann::json &response) const final override

build the dynamics from response

Handle the reset response from the environment server

Protected Attributes

uint_t max_episode_steps_

Maximum episodes per step.