[devops] Upgrade to lightning 2.0 (#1514) #73
GitHub Actions / ModelReport
succeeded
Jun 21, 2024 in 0s
ModelReport
Model Benchmark
Benchmark | Metric | main | current | diff | |
---|---|---|---|---|---|
PeytonManning | MAE_val | 0.34955 | 0.35511 | 1.59% | ✅ |
PeytonManning | RMSE_val | 0.50049 | 0.50375 | 0.65% | ✅ |
PeytonManning | Loss_val | 0.01771 | 0.01801 | 1.69% | ✅ |
PeytonManning | train_loss | nan | 0.01463 | 0.0% | ✅ |
PeytonManning | reg_loss | nan | 0 | 0.0% | ✅ |
PeytonManning | MAE | 0.34653 | 0.34734 | 0.24% | ✅ |
PeytonManning | RMSE | 0.49312 | 0.49386 | 0.15% | ✅ |
PeytonManning | Loss | 0.01464 | 0.01463 | -0.09% | ✅ |
PeytonManning | time | 11.8065 | 12.7 | 7.57% | ❌ |
AirPassengers | MAE_val | 30.6285 | 30.8786 | 0.82% | ✅ |
AirPassengers | RMSE_val | 31.5254 | 31.8365 | 0.99% | ✅ |
AirPassengers | Loss_val | 0.01277 | 0.01303 | 1.98% | ✅ |
AirPassengers | train_loss | nan | 0.00071 | 0.0% | ✅ |
AirPassengers | reg_loss | nan | 0 | 0.0% | ✅ |
AirPassengers | MAE | 6.16861 | 6.85845 | 11.18% | ❌ |
AirPassengers | RMSE | 7.85225 | 8.90745 | 13.44% | ❌ |
AirPassengers | Loss | 0.00065 | 0.00076 | 16.92% | ❌ |
AirPassengers | time | 7.29709 | 7.76 | 6.34% | |
EnergyPriceDaily | MAE_val | 5.41157 | 5.64156 | 4.25% | |
EnergyPriceDaily | RMSE_val | 6.71538 | 7.19554 | 7.15% | ❌ |
EnergyPriceDaily | Loss_val | 0.02525 | 0.0289 | 14.47% | ❌ |
EnergyPriceDaily | train_loss | nan | 0.02962 | 0.0% | ✅ |
EnergyPriceDaily | reg_loss | nan | 0 | 0.0% | ✅ |
EnergyPriceDaily | MAE | 5.94936 | 6.40067 | 7.59% | ❌ |
EnergyPriceDaily | RMSE | 7.9833 | 8.56962 | 7.34% | ❌ |
EnergyPriceDaily | Loss | 0.02579 | 0.02941 | 14.05% | ❌ |
EnergyPriceDaily | time | 14.2089 | 15.82 | 11.34% | ❌ |
YosemiteTemps | MAE_val | 0.56412 | 0.48186 | -14.58% | 🎉 |
YosemiteTemps | RMSE_val | 0.83161 | 0.71525 | -13.99% | 🎉 |
YosemiteTemps | Loss_val | 0.0004 | 0.0003 | -26.0% | 🎉 |
YosemiteTemps | train_loss | nan | 0.00103 | 0.0% | ✅ |
YosemiteTemps | reg_loss | nan | 0 | 0.0% | ✅ |
YosemiteTemps | MAE | 0.98449 | 0.85851 | -12.8% | 🎉 |
YosemiteTemps | RMSE | 1.75389 | 1.54684 | -11.81% | 🎉 |
YosemiteTemps | Loss | 0.00132 | 0.00103 | -21.4% | 🎉 |
YosemiteTemps | time | 30.8231 | 35.24 | 14.33% | ❌ |
\n
Model training plots
\n ## Model Training ### PeytonManning ![](https://asset.cml.dev/1d71ab731130716a13ca5609c24d52e4e540dbcd?cml=svg%2Bxml&cache-bypass=3c0b1bd7-0cd7-448a-aa0b-27a9d908b270) ### YosemiteTemps ![](https://asset.cml.dev/25c0d646f1807f399110bf3dd41a6af7b5e4d0bb?cml=svg%2Bxml&cache-bypass=07bc006a-81a4-40cd-a3ea-4902b537b8b9) ### AirPassengers ![](https://asset.cml.dev/85d58e6f0d87f903ddc54d6984086a6e1661dec8?cml=svg%2Bxml&cache-bypass=4a361a46-2823-4af3-8f49-d1143b7be716) ### EnergyPriceDaily ![](https://asset.cml.dev/88a4f18f9122a4b1cfb9ad479dcdb8c1c0883759?cml=svg%2Bxml&cache-bypass=499b3718-3366-4903-a754-8d5a27f5859a) \n
Loading