[devops] Upgrade to lightning 2.0 (#1514) #73
GitHub Actions / ModelReport
succeeded
Jun 21, 2024 in 0s
ModelReport
Model Benchmark
| Benchmark | Metric | main | current | diff | |
|---|---|---|---|---|---|
| PeytonManning | MAE_val | 0.34955 | 0.35511 | 1.59% | ✅ |
| PeytonManning | RMSE_val | 0.50049 | 0.50375 | 0.65% | ✅ |
| PeytonManning | Loss_val | 0.01771 | 0.01801 | 1.69% | ✅ |
| PeytonManning | train_loss | nan | 0.01463 | 0.0% | ✅ |
| PeytonManning | reg_loss | nan | 0 | 0.0% | ✅ |
| PeytonManning | MAE | 0.34653 | 0.34734 | 0.24% | ✅ |
| PeytonManning | RMSE | 0.49312 | 0.49386 | 0.15% | ✅ |
| PeytonManning | Loss | 0.01464 | 0.01463 | -0.09% | ✅ |
| PeytonManning | time | 11.8065 | 12.7 | 7.57% | ❌ |
| AirPassengers | MAE_val | 30.6285 | 30.8786 | 0.82% | ✅ |
| AirPassengers | RMSE_val | 31.5254 | 31.8365 | 0.99% | ✅ |
| AirPassengers | Loss_val | 0.01277 | 0.01303 | 1.98% | ✅ |
| AirPassengers | train_loss | nan | 0.00071 | 0.0% | ✅ |
| AirPassengers | reg_loss | nan | 0 | 0.0% | ✅ |
| AirPassengers | MAE | 6.16861 | 6.85845 | 11.18% | ❌ |
| AirPassengers | RMSE | 7.85225 | 8.90745 | 13.44% | ❌ |
| AirPassengers | Loss | 0.00065 | 0.00076 | 16.92% | ❌ |
| AirPassengers | time | 7.29709 | 7.76 | 6.34% | |
| EnergyPriceDaily | MAE_val | 5.41157 | 5.64156 | 4.25% | |
| EnergyPriceDaily | RMSE_val | 6.71538 | 7.19554 | 7.15% | ❌ |
| EnergyPriceDaily | Loss_val | 0.02525 | 0.0289 | 14.47% | ❌ |
| EnergyPriceDaily | train_loss | nan | 0.02962 | 0.0% | ✅ |
| EnergyPriceDaily | reg_loss | nan | 0 | 0.0% | ✅ |
| EnergyPriceDaily | MAE | 5.94936 | 6.40067 | 7.59% | ❌ |
| EnergyPriceDaily | RMSE | 7.9833 | 8.56962 | 7.34% | ❌ |
| EnergyPriceDaily | Loss | 0.02579 | 0.02941 | 14.05% | ❌ |
| EnergyPriceDaily | time | 14.2089 | 15.82 | 11.34% | ❌ |
| YosemiteTemps | MAE_val | 0.56412 | 0.48186 | -14.58% | 🎉 |
| YosemiteTemps | RMSE_val | 0.83161 | 0.71525 | -13.99% | 🎉 |
| YosemiteTemps | Loss_val | 0.0004 | 0.0003 | -26.0% | 🎉 |
| YosemiteTemps | train_loss | nan | 0.00103 | 0.0% | ✅ |
| YosemiteTemps | reg_loss | nan | 0 | 0.0% | ✅ |
| YosemiteTemps | MAE | 0.98449 | 0.85851 | -12.8% | 🎉 |
| YosemiteTemps | RMSE | 1.75389 | 1.54684 | -11.81% | 🎉 |
| YosemiteTemps | Loss | 0.00132 | 0.00103 | -21.4% | 🎉 |
| YosemiteTemps | time | 30.8231 | 35.24 | 14.33% | ❌ |
\n
Model training plots
\n ## Model Training ### PeytonManning  ### YosemiteTemps  ### AirPassengers  ### EnergyPriceDaily  \n
Loading