Skip to content

Commit

Permalink
Merge pull request #253 from HridayM25/main
Browse files Browse the repository at this point in the history
Fixed reward description of `PointMaze` dense environments
  • Loading branch information
Kallinteris-Andreas authored Oct 30, 2024
2 parents 2714761 + 93c3adb commit 4eec964
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion gymnasium_robotics/envs/maze/point_maze.py
Original file line number Diff line number Diff line change
Expand Up @@ -249,7 +249,7 @@ class PointMazeEnv(MazeEnv, EzPickle):
The reward can be initialized as `sparse` or `dense`:
- *sparse*: the returned reward can have two values: `0` if the ball hasn't reached its final target position, and `1` if the ball is in the final target position (the ball is considered to have reached the goal if the Euclidean distance between both is lower than 0.5 m).
- *dense*: the returned reward is the negative Euclidean distance between the achieved goal position and the desired goal.
- *dense*: the returned reward is the exponential negative Euclidean distance between the achieved goal position and the desired goal.
To initialize this environment with one of the mentioned reward functions the type of reward must be specified in the id string when the environment is initialized. For `sparse` reward the id is the default of the environment, `PointMaze_UMaze-v3`. However, for `dense`
reward the id must be modified to `PointMaze_UMazeDense-v3` and initialized as follows:
Expand Down

0 comments on commit 4eec964

Please sign in to comment.