General improvements, features, and bug fixes

Changes made during development of discrete_intonation repo, includes new features, refactoring for usability, and bug fixes. Currently the code is still lacking tests, this is next on the TODO but might take some time.

Feature additions

• Added 5 new metrics
• Improved RecurrentCuDNNWrapper (now works without seq_len)
• Added CyclicNoamLR schedule
• Added cross entropy loss
• Added normaliser_sources function for model specification
• Added command line device option
• Samplers work for higher-dimensional arrays

Breaking changes

• Loss branching changes
• *_data_source and normaliser_source breaking changes
• Change analysis_for_train_batch default behaviour
• Remove BaseVAE.loss default definition

Bug fixes

• viz/plotting: undefined metrics
• viz/synthesis: MLP now detaches seq_len
• experiment_builder: num_data_workers default, plateau sanity check, plotting after training
• losses: fixed loss wrapper argument order
• metrics: fixed hidden option
• utils: detach_batched_seqs handling of seq_len, detach_batch_seqs specification of squeezing, get_epoch_from_checkpoint_path bug

API changes galore

New normaliser API
New loss API
New metrics
New sequence utilities

Added analysis_kwargs option
Added initial SPSS baselines

Changes since v0.0.1 are not backwards compatible

• _DataSources moved to tts_data_tools (breaking change)
• Improved collate_fn and removed separation of base_names (breaking change)
• Added analysis_for_*_epoch hook (will replace with ignite in the future)
• Improved docs