Training models with weather changes
less than 1 minute read
MAE & MSE metrics comparison between models trained without and with weather changes.
| Model |
Weather changes training |
MAE train |
MAE val |
MAE test |
MSE train |
MSE val |
MSE test |
| PilotNet |
- |
0.0044 |
0.00546 |
0.0851 |
0.00016 |
0.00064 |
0.0576 |
| PilotNet |
YES |
0.0083 |
0.0067 |
- |
0.00100 |
0.00060 |
- |
| Deepest |
- |
0.018 |
0.0016 |
0.1202 |
0.00416 |
0.00382 |
0.0508 |
| Deepest |
YES |
- |
- |
- |
- |
- |
- |
| PilotNetx3 |
- |
0.0044 |
0.0048 |
0.0738 |
0.00018 |
0.00032 |
0.044 |
| PilotNetx3 |
YES |
0.0126 |
0.0075 |
- |
0.00209 |
0.00058 |
- |
| Frankenstein |
- |
0.019 |
0.018 |
0.0694 |
0.0039 |
0.0035 |
0.0436 |
| Frankenstein |
YES |
0.025 |
0.016 |
- |
0.0051 |
0.0027 |
- |