Skip to content

v2.0.3 Minor improvements

Compare
Choose a tag to compare
@Natooz Natooz released this 04 Apr 09:06
· 230 commits to main since this release

Changes

  • ff1bb5e and 195cb65 the __call__ magic method allows to load MIDI and json files before converting them
  • c045630 TokSequences are now subscriptable! (you can do tok_seq[id_])
  • a632214 Special tokens are now stored without the None value
  • Minor code and documentation improvements

Compatibility

  • In case you use token_type_graph and tokens_errors: previous config files store special tokens with None value (eg PAD_None), have to modified to remove it (eg just PAD) (special_tokens entry only). No change in vocabulary / tokens.