Migrating to new RLStudio and migrating mountain car to RLStudio 0.1.0 (Month 12)

The goals of this month are:

• Migration of the robot_mesh problem to the new RLStudio 0.1.0
• getting the mountain car problem working in RLStudio 0.1.0

In the meanwhile:

• Some ros tutorials has been done to understand how the communication with the robots and the environment occurs.
• some other modifications were suggested to be included in the Nacho TFM:
  1. Install manual miss some steps
  2. There is one logs folder not created which gives error when executing the train_qlearn.py script
  3. The lines 46 and 49 of train_qlearn requires a modification

In spite of completing the mountain car migration to rl-studio and customized to better ilustrate the problem adding a local minimum, the agent is not learning as expected, so besides the mountain car code migration, it will need to be adaptated so it completes the problem (same problem concept but different “now in 3D” scenario)

Lectures

The only formal lecture done this month was for understanding the inference accomplished by Nacho in his TFM:

• qlearning inference with python tutorial

Lab work

• basic ros tutorial

• ros deeper practice in gazebo