Code

Pad each batch, not the whole dataset#30

Code

Open

sshleifer wants to merge 16 commits intohuggingface:masterhuggingface/transfer-learning-conv-ai:masterfrom sshleifer:batch-paddingsshleifer/transfer-learning-conv-ai:batch-paddingCopy head branch name to clipboard

+59-24

Commits

Commits on Sep 19, 2019

• fix logdir

  sshleifer

  committed
  150aaac

• Migrate eval code

  sshleifer

  committed
  68f926b

• Utils import

  sshleifer

  committed
  bfdd032

• Train.py and tokenizer test

  sshleifer

  committed
  e7d6e7b

• Pin tensorboardx

  sshleifer

  committed
  517eb77

• Add compatibility comment to eval

  sshleifer

  committed
  2f475cb

• Partial GPT2 compatibility fix

  sshleifer

  committed
  0f56c4a

• add special tokens before interact

  sshleifer

  committed
  2f1207a

Commits on Sep 23, 2019

• Convai eval for GPT2

  sshleifer

  committed
  8477c2e

• add args.model_checkpoint to logdir path

  sshleifer

  committed
  1ba3929

• comment, warning about infinite loop hack

  sshleifer

  committed
  d4e007f

• cleanup: remove extra newlines

  sshleifer

  committed
  1a00f96

• Pad on the batch level

  sshleifer

  committed
  e92ee7c

Commits on Sep 26, 2019

• Merge branch 'master' into batch-padding

  sshleifer

  authored
  2c90fdb

Commits on Oct 21, 2019

• Fix merge conflicts

  sshleifer

  committed
  d7a3c5e

• More conflicts

  sshleifer

  committed
  bc89893