Training models with weather changes
less than 1 minute read
MAE & MSE metrics comparison between models trained without and with weather changes.
Model |
Weather changes training |
MAE train |
MAE val |
MAE test |
MSE train |
MSE val |
MSE test |
PilotNet |
- |
0.0044 |
0.00546 |
0.0851 |
0.00016 |
0.00064 |
0.0576 |
PilotNet |
YES |
0.0083 |
0.0067 |
- |
0.00100 |
0.00060 |
- |
Deepest |
- |
0.018 |
0.0016 |
0.1202 |
0.00416 |
0.00382 |
0.0508 |
Deepest |
YES |
- |
- |
- |
- |
- |
- |
PilotNetx3 |
- |
0.0044 |
0.0048 |
0.0738 |
0.00018 |
0.00032 |
0.044 |
PilotNetx3 |
YES |
0.0126 |
0.0075 |
- |
0.00209 |
0.00058 |
- |
Frankenstein |
- |
0.019 |
0.018 |
0.0694 |
0.0039 |
0.0035 |
0.0436 |
Frankenstein |
YES |
0.025 |
0.016 |
- |
0.0051 |
0.0027 |
- |