Week 33 – Training failed
After last week’s new network, my goal this week was to train another one with the elbows fixed in position and, if that worked, try to make them move during training.
The first issue appeared while I was reviewing last week’s network. I discovered that the observations did not include any information about the elbows. Because of this, I had to train a new network after finding the reason why the elbow data was missing from the observations. Fortunately, this new training run was successful.
After that, I started training another network with the elbows fixed in position. However, when I tested how well it walked, I found that the elbows were just as “dead” as they had been in the previous training.
Next week, I will continue investigating this issue and hopefully achieve what I originally intended to do this week.
Summary
- Fixed the observation space to include elbow information.
- Successfully retrained the previous network.
- Failed to train a network with fixed elbows.