v0.4 🔥 New models
- applied the SAITS embedding strategy to models Crossformer, PatchTST, DLinear, ETSformer, FEDformer, Informer, and Autoformer to make them applicable to POTS data as imputation methods;
- fixed a bug in USGAN loss function;
- gathered several Transformer embedding methods into the package
pypots.nn.modules.transformer.embedding
; - added the attribute
best_epoch
for NN models to record the best epoch num and log it after model training; - made the self-attention operator replaceable in the class
MultiHeadAttention
for Transformer models; - renamed the argument
d_inner
of all models in previous versions intod_ffn
. This is for unified argument naming and easier understanding; - removed deprecated functions
save_model()
andload_model()
in all NN model classes, which are now replaced bysave()
andload()
;
What's Changed
- Removing deprecated functions by @WenjieDu in #318
- Add Autoformer as an imputation model by @WenjieDu in #320
- Removing deprecated save_model and load_model, adding the imputation model Autoformer by @WenjieDu in #321
- Simplify MultiHeadAttention by @WenjieDu in #322
- Add PatchTST as an imputation model by @WenjieDu in #323
- Renaming d_inner into d_ffn by @WenjieDu in #325
- Adding PatchTST, renaming d_innner into d_ffn, and refactoring Autofomer by @WenjieDu in #326
- Add DLinear as an imputation model by @WenjieDu in #327
- Add ETSformer as an imputation model by @WenjieDu in #328
- Add Crossformer as an imputation model by @WenjieDu in #329
- Add FEDformer as an imputation model by @WenjieDu in #330
- Add Crossformer, Autoformer, PatchTST, DLinear, ETSformer, FEDformer as imputation models by @WenjieDu in #331
- Refactor embedding package, remove the unused part in Autoformer, and update the docs by @WenjieDu in #332
- Make the self-attention operator replaceable in Transformer by @WenjieDu in #334
- Add informer as an imputation model by @WenjieDu in #335
- Speed up testing procedure by @WenjieDu in #336
- Add Informer, speed up CI testing, and make self-attention operator replaceable by @WenjieDu in #337
- debug USGAN by @AugustJW in #339
- Fix USGAN loss function, and update the docs by @WenjieDu in #340
- Add the attribute
best_epoch
to record the best epoch num by @WenjieDu in #342 - Apply SAITS embedding strategy to new added models by @WenjieDu in #343
- Release v0.4, apply SAITS embedding strategy to the newly added models, and update README by @WenjieDu in #344
Full Changelog: v0.3.2...v0.4