Code

Instruction-tuning Support#196

Code

Open

lllAlexanderlll wants to merge 81 commits intomainModalities/modalities:mainfrom sft_with_mainModalities/modalities:sft_with_mainCopy head branch name to clipboard

+2,418-549

Commits

Commits on Jul 15, 2024

• Add example config for the construction of chat templates

  rrutmann

  committed
  59f0191

  Copy full SHA for 59f0191

• chore: add chat template config based on jinja2

  lllAlexanderlll

  committed
  8b60a83

  Copy full SHA for 8b60a83

• chore: update chat template config based on jinja2

  lllAlexanderlll

  committed
  ba2f65c

  Copy full SHA for ba2f65c

• chore: Add apply chat template feature with role mapping

  lllAlexanderlll

  committed
  47e71c3

  Copy full SHA for 47e71c3

Commits on Jul 16, 2024

• chore: extend to multiple chat templates

  lllAlexanderlll

  committed
  3303147

  Copy full SHA for 3303147

• fix: data driven chat tempalte key retrieval

  lllAlexanderlll

  committed
  0c6bbf5

  Copy full SHA for 0c6bbf5

• chore: Add 'index' to output JSONL

  lllAlexanderlll

  committed
  32f5756

  Copy full SHA for 32f5756

• fix: Add süecical token to be kept during treinaing to allow for early stopping of generation

  lllAlexanderlll

  committed
  482f7af

  Copy full SHA for 482f7af

• chore: Update output file

  lllAlexanderlll

  committed
  1d72770

  Copy full SHA for 1d72770

• build: Add jsonlines dependency

  rrutmann

  committed
  0bd9bfa

  Copy full SHA for 0bd9bfa

• chore: integration of collator wrapper with loss masking functionality. Unit test still needed.

  lllAlexanderlll

  committed
  ed2f4ce

  Copy full SHA for ed2f4ce

Commits on Jul 18, 2024

• chore: Use SFT config replaction with uuid as file pair identification.

  lllAlexanderlll

  committed
  6e24ea2

  Copy full SHA for 6e24ea2

• chore: Add loss masking test

  lllAlexanderlll

  committed
  6e716b4

  Copy full SHA for 6e716b4

• chore: Merge branch 'main' into sft_loss_masking

  lllAlexanderlll

  committed
  a0376a6

  Copy full SHA for a0376a6

Commits on Jul 19, 2024

• fix: copy raw config file for truly original content

  lllAlexanderlll

  committed
  70dc498

  Copy full SHA for 70dc498

Commits on Jul 22, 2024

• chore: add pbin file for testing loss masking

  

  Shangrui Nie

  committed
  242e429

  Copy full SHA for 242e429

• chore: add pbin file with more data for testing loss masking

  

  Shangrui Nie

  committed
  bddcf8b

  Copy full SHA for bddcf8b

• chore: use a hash not uuid for showing which config belongs to whoch data. Change symbol for special tokens, which are actaully a single token within the vocab.

  lllAlexanderlll

  committed
  f86b6ed

  Copy full SHA for f86b6ed

• chore: add pbin file for testing loss masking

  

  Shangrui Nie

  committed
  7632a02

  Copy full SHA for 7632a02

• chore: Fix loss masking when starting within an assistant answer

  lllAlexanderlll

  committed
  15719a3

  Copy full SHA for 15719a3

• chore: add lost collator wrappr again

  lllAlexanderlll

  committed
  ab0f34c

  Copy full SHA for ab0f34c

• chore: fix the loss masking test and the implementation. Improve documentation.

  lllAlexanderlll

  committed
  0a545ca

  Copy full SHA for 0a545ca

• chore: Merge commit '15ed069beaa2c83dcd15b087e4d0864b1aec4caa' into sft_with_main

  lllAlexanderlll

  committed
  c6d0a61

  Copy full SHA for c6d0a61

• chore: Merge branch 'sft_with_main' into sft_loss_masking

  lllAlexanderlll

  committed
  0c52856

  Copy full SHA for 0c52856

Commits on Jul 23, 2024

• feat(sft): Do not reuse last targets for Instruction Tuning

  rrutmann

  committed
  12c74bc

  Copy full SHA for 12c74bc

• Merge remote-tracking branch 'origin/sft_with_main' into sft_sample_generator

  rrutmann

  committed
  fc7bec1

  Copy full SHA for fc7bec1

• refactor(sft): Make reuse_last_target optional

  rrutmann

  committed
  25fdcd7

  Copy full SHA for 25fdcd7

• docs: Correct spelling

  rrutmann

  authored
  01109e2

  Copy full SHA for 01109e2

• Update comment

  Show description for 7148e1e
  

  rrutmann

  and

  lllAlexanderlll

  authored
  7148e1e

  Copy full SHA for 7148e1e

• Merge pull request #193 from Modalities/sft_sample_generator

  Show description for 75611dd
  rrutmann

  authored
  75611dd

  Copy full SHA for 75611dd

• chore: apply review changes: only single chat template, do raise error when end tmask oken before begin mask token

  lllAlexanderlll

  committed
  1f36d64

  Copy full SHA for 1f36d64

• chore: Merge branch 'sft_with_main' into sft_loss_masking

  lllAlexanderlll

  committed
  9921ed3

  Copy full SHA for 9921ed3

• chore: run loss masking with padded and truncated pbin file. Refine error messages.

  lllAlexanderlll

  committed
  0f49355

  Copy full SHA for 0f49355

• chore: restore original lorem ipsum config, as we have our own sft config

  lllAlexanderlll

  committed
  bf2f1a3

  Copy full SHA for bf2f1a3

Commits on Jul 24, 2024

• Merge pull request #192 from Modalities/sft_loss_masking

  Show description for 99e7ac3
  lllAlexanderlll

  authored
  99e7ac3

  Copy full SHA for 99e7ac3

Commits on Jul 29, 2024

• feat: added fixed number of elements to ResumableBatchSampler

  

  le1nux

  authored and

  lllAlexanderlll

  committed
  76b34ab

  Copy full SHA for 76b34ab

• feat: added fixed number of batches to dataloader

  

  le1nux

  authored and

  lllAlexanderlll

  committed
  2f4bdb2

  Copy full SHA for 2f4bdb2

• fix: fixed error in fixed_num_batches calculation

  

  le1nux

  authored and

  lllAlexanderlll

  committed
  9840e0a

  Copy full SHA for 9840e0a

• feat: implemented test for fixed_num_batches in dataloader

  

  le1nux

  authored and

  lllAlexanderlll

  committed
  3906845

  Copy full SHA for 3906845

• refactor: removed fixed_num_batches from config_lorem_ipsum.yaml

  

  le1nux

  authored and

  lllAlexanderlll

  committed
  cc57125

  Copy full SHA for cc57125

• refactor: moved SequenceDataset to test

  

  le1nux

  authored and

  lllAlexanderlll

  committed
  603b367

  Copy full SHA for 603b367

• refactor: added another check that fixed_num_batches > skip_num_batches

  

  le1nux

  authored and

  lllAlexanderlll

  committed
  78f4d03

  Copy full SHA for 78f4d03

• fix: check for fixed_num_batches is not None before comparison

  lllAlexanderlll

  committed
  8372b21

  Copy full SHA for 8372b21

• chore: add missing reuse_last_target: False in example SFT config

  lllAlexanderlll

  committed
  c8ba69c

  Copy full SHA for c8ba69c

Commits on Jul 30, 2024

• chore: Merge branch 'main' into sft_with_main

  le1nux

  committed
  60e9894

  Copy full SHA for 60e9894

Commits on Jul 31, 2024

• fix: removed sequence_length from MemMapDataset

  le1nux

  committed
  b0c69a9

  Copy full SHA for b0c69a9

• chore: added reraise of exception in PackedMemMapDatasetBase

  le1nux

  committed
  d041900

  Copy full SHA for d041900

• chore: fixed typo

  le1nux

  committed
  3912e36

  Copy full SHA for 3912e36

• refactor: made non-public methods related to apply_chat_template private

  le1nux

  committed
  cc4eef7

  Copy full SHA for cc4eef7

• chore: minor style improvement

  le1nux

  committed
  00a35ee

  Copy full SHA for 00a35ee

Commits on Aug 5, 2024

• chore: fix suggestions of PR first round

  lllAlexanderlll

  committed
  009bb8a

  Copy full SHA for 009bb8a

• chore: Move collate functions to dataloader package

  lllAlexanderlll

  committed
  a47dc8c

  Copy full SHA for a47dc8c

• chore: renamed MaskingTokenConfig to LossMaskingTokenConfig

  lllAlexanderlll

  committed
  705101c

  Copy full SHA for 705101c

• chore: Add explaination to vectorized loss masking

  lllAlexanderlll

  committed
  c399b94

  Copy full SHA for c399b94

• chore: moved SFTConfig and tests

  lllAlexanderlll

  committed
  483ea83

  Copy full SHA for 483ea83

Commits on Aug 12, 2024

• chore: update SFT README

  lllAlexanderlll

  committed
  4ea1d76

  Copy full SHA for 4ea1d76

• chore: test for reuse last target, update sft readme, create folder for chat template related data, add special tokens for HF tokenizers

  lllAlexanderlll

  committed
  3945426

  Copy full SHA for 3945426

• chore: Merge branch 'main' into sft_with_main

  lllAlexanderlll

  committed
  4d7e53d

  Copy full SHA for 4d7e53d

• chore: fix tokenization tests and renaming of loss masking config field

  lllAlexanderlll

  committed
  eee2bac

  Copy full SHA for eee2bac

Commits on Aug 13, 2024

• chore: Update SFT_README.md

  Show description for 4f53f0c
  

  lllAlexanderlll

  and

  le1nux

  authored
  4f53f0c

  Copy full SHA for 4f53f0c

• docs: add doc strings

  lllAlexanderlll

  committed
  ed50d2f

  Copy full SHA for ed50d2f

• chore: update instruction tuning e2e test with output artifact check

  lllAlexanderlll

  committed
  d5867a4

  Copy full SHA for d5867a4

• chore: Update readme

  lllAlexanderlll

  committed
  94d89cb

  Copy full SHA for 94d89cb

Commits on Aug 19, 2024

• chore: refine names of helper functions and doc strings

  lllAlexanderlll

  committed
  42cf6ce

  Copy full SHA for 42cf6ce

• fix: apply renaming

  lllAlexanderlll

  committed
  d98a26a

  Copy full SHA for d98a26a

• chore: Update SFT_README

  lllAlexanderlll

  committed
  d95bd46

  Copy full SHA for d95bd46

Commits on Aug 20, 2024

• chore(sft): Improve check on correctness of loss masked sequences

  

  rrutmann

  authored and

  lllAlexanderlll

  committed
  c6b0e4c

  Copy full SHA for c6b0e4c

• chore(sft): Change special tokens used for instruction tuning

  

  rrutmann

  authored and

  lllAlexanderlll

  committed
  b9fbcec

  Copy full SHA for b9fbcec

• chore: Add artifacts to .gitignore

  

  rrutmann

  authored and

  lllAlexanderlll

  committed
  6538072

  Copy full SHA for 6538072

• chore(sft): Add splitting functionality and introduce a new entry point to convert, split, and create idx and pdbin files per data partition

  lllAlexanderlll

  committed
  2748887

  Copy full SHA for 2748887

• fix(sft): do not append hash twice

  lllAlexanderlll

  committed
  72ed828

  Copy full SHA for 72ed828

Commits on Sep 9, 2024

• test(sft): Use special tokens already existing in tokenizers vocabulary

  rrutmann

  committed
  6594633

  Copy full SHA for 6594633

• test(sft): Add data and config for tests

  rrutmann

  committed
  66f0bea

  Copy full SHA for 66f0bea

• test(sft): Add documentation for test

  rrutmann

  committed
  0daec5b

  Copy full SHA for 0daec5b

• chore: Pass black check

  rrutmann

  committed
  125311f

  Copy full SHA for 125311f

• chore: Merge remote-tracking branch 'origin/main' into sft_with_main

  rrutmann

  committed
  9cbc8f3

  Copy full SHA for 9cbc8f3

Commits on Sep 16, 2024

• chore: improve error message and readme

  lllAlexanderlll

  committed
  b121eea

  Copy full SHA for b121eea

• chore: Update SFT_README.md

  lllAlexanderlll

  committed
  396aba5

  Copy full SHA for 396aba5

• Update SFT_README.md

  lllAlexanderlll

  authored
  8416c9d

  Copy full SHA for 8416c9d

Commits on Sep 23, 2024

• chore: Merge branch 'main' into sft_with_main

  rrutmann

  committed
  b08f02f

  Copy full SHA for b08f02f

Commits on Nov 4, 2024

• test: fix failing sft e2e test

  davidkaczer

  committed
  eb658c9

  Copy full SHA for eb658c9