Code

Bug fix#1249

Code

Merged

danielhanchen merged 175 commits intomainunslothai/unsloth:mainfrom nightlyunslothai/unsloth:nightlyCopy head branch name to clipboardNov 6, 2024

+11-10

Commits

Commits on Oct 21, 2024

• Fix TRL

  danielhanchen

  committed
  f0aca90

Commits on Oct 22, 2024

• Update mistral.py

  danielhanchen

  committed
  f4ae585

• Patch processing_class

  danielhanchen

  committed
  106f213

• Update tokenizer_utils.py

  danielhanchen

  committed
  ef84212

• Update tokenizer_utils.py

  danielhanchen

  committed
  4f7c527

• Update tokenizer_utils.py

  danielhanchen

  committed
  aa2b207

• Update tokenizer_utils.py

  danielhanchen

  committed
  101389d

• Update tokenizer_utils.py

  danielhanchen

  committed
  c0f0fc9

• Update tokenizer_utils.py

  danielhanchen

  committed
  b3e0033

Commits on Oct 23, 2024

• Installation guide (#1165)

  timothelaborie

  authored
  aabb5ff

• chore: update chat_templates.py (#1166)

  Show description for 30bf339
  eltociear

  authored
  30bf339

• Disable Flex Attention

  danielhanchen

  committed
  2895839

• Update tokenizer_utils.py

  danielhanchen

  committed
  06f5d75

• Update _utils.py

  danielhanchen

  committed
  28e6eea

Commits on Oct 24, 2024

• n_items

  danielhanchen

  committed
  b821f20

• Update cross_entropy_loss.py

  danielhanchen

  committed
  e561366

• Fix DPO, ORPO

  danielhanchen

  committed
  4ff247a

• Merge branch 'main' into nightly

  danielhanchen

  committed
  2b858a5

• Update _utils.py

  danielhanchen

  committed
  1c063b4

• Update _utils.py

  danielhanchen

  committed
  f195ee1

• fix/transformers-unpack (#1180)

  Show description for faf2747
  

  4 peopleauthored
  faf2747

• Update cross_entropy_loss.py

  danielhanchen

  committed
  5961c34

• Update _utils.py

  danielhanchen

  committed
  7308bb8

• Update _utils.py

  danielhanchen

  committed
  0096e5b

• Merge branch 'main' into nightly

  danielhanchen

  committed
  44b480f

Commits on Oct 25, 2024

• donot upcast lm_head and embeddings to float32 (#1186)

  Datta0

  authored
  6776055

• Cleanup upcast logs (#1188)

  Datta0

  authored
  625209e

• Fix/phi-longrope (#1193)

  Show description for 2bc189f
  

  Erland366

  and

  danielhanchen

  authored
  2bc189f

Commits on Oct 26, 2024

• Update transformers

  danielhanchen

  committed
  6f28d16

• Merge branch 'main' into nightly

  danielhanchen

  committed
  f94f7c1

Commits on Oct 27, 2024

• Merge branch 'main' into nightly

  danielhanchen

  committed
  bf3b175

Commits on Oct 28, 2024

• Unk token issues

  danielhanchen

  committed
  7083a1d

• Update _utils.py

  danielhanchen

  committed
  3acc5af

• Fix pad token

  danielhanchen

  committed
  1c044da

• Update llama.py

  danielhanchen

  committed
  5286f19

• Typo

  danielhanchen

  committed
  02437a8

• ignored labels

  danielhanchen

  committed
  9d07be0

• Revert "ignored labels"

  Show description for a8b37a3
  danielhanchen

  committed
  a8b37a3

• More patching

  danielhanchen

  committed
  2dfdba3

• Update _utils.py

  danielhanchen

  committed
  5541ab4

• Update _utils.py

  danielhanchen

  committed
  c6e9af2

• Update cross_entropy_loss.py

  danielhanchen

  committed
  cac56d1

• Update cross_entropy_loss.py

  danielhanchen

  committed
  5ee1189

• Update cross_entropy_loss.py

  danielhanchen

  committed
  85a5f60

Commits on Oct 30, 2024

• Feat/all tmp (#1219)

  Show description for 20e38ed
  

  3 peopleauthored
  20e38ed

• Bug fixes

  danielhanchen

  committed
  7e1692a

• Update pyproject.toml

  danielhanchen

  committed
  6bef8f1

• Update _utils.py

  danielhanchen

  committed
  9ccbc0e

• Update __init__.py

  danielhanchen

  committed
  95ecc57

• Update __init__.py

  danielhanchen

  committed
  5f5fef8

• Update _utils.py

  danielhanchen

  committed
  784dd13

• Update _utils.py

  danielhanchen

  committed
  5b75e21

• Update _utils.py

  danielhanchen

  committed
  74ab93c

• Update _utils.py

  danielhanchen

  committed
  526505c

• Update cross_entropy_loss.py

  danielhanchen

  committed
  251ba77

• Update cross_entropy_loss.py

  danielhanchen

  committed
  530c495

• Update cross_entropy_loss.py

  danielhanchen

  committed
  07394c3

• Update cross_entropy_loss.py

  danielhanchen

  committed
  6d7004b

• Update cross_entropy_loss.py

  danielhanchen

  committed
  d86b20a

• Update cross_entropy_loss.py

  danielhanchen

  committed
  9920950

• Update cross_entropy_loss.py

  danielhanchen

  committed
  9f926ce

• Update cross_entropy_loss.py

  danielhanchen

  committed
  30cdf65

Commits on Oct 31, 2024

• Update cross_entropy_loss.py

  danielhanchen

  committed
  54b901b

• Update cross_entropy_loss.py

  danielhanchen

  committed
  6db9d28

• Update cross_entropy_loss.py

  danielhanchen

  committed
  8aefcd0

• Update cross_entropy_loss.py

  danielhanchen

  committed
  7bf626b

• Update cross_entropy_loss.py

  danielhanchen

  committed
  d455751

• Update cross_entropy_loss.py

  danielhanchen

  committed
  055eeb8

• Tied weights

  danielhanchen

  committed
  8090b7c

• Revert "Tied weights"

  Show description for 7559efb
  danielhanchen

  committed
  7559efb

• Tied weights

  danielhanchen

  committed
  ad63a32

Commits on Nov 3, 2024

• Utils

  danielhanchen

  committed
  35aa992

• CE Loss patching

  danielhanchen

  committed
  0172ee3

• Update __init__.py

  danielhanchen

  committed
  c228682

• Update __init__.py

  danielhanchen

  committed
  9aa221a

• Patching

  danielhanchen

  committed
  751413e

• Update cross_entropy_loss.py

  danielhanchen

  committed
  82db087

• CE Loss

  danielhanchen

  committed
  cf68202

• Update _utils.py

  danielhanchen

  committed
  63a1828

• Update _utils.py

  danielhanchen

  committed
  3f0e56f

• CE Loss

  danielhanchen

  committed
  1190ed4

• Update _utils.py

  danielhanchen

  committed
  607ac34

• Update _utils.py

  danielhanchen

  committed
  32eac0b

Commits on Nov 4, 2024

• Layernorm

  danielhanchen

  committed
  5b6d401

• Update _utils.py

  danielhanchen

  committed
  3d19a71

• Update _utils.py

  danielhanchen

  committed
  76da511

• Post patch

  danielhanchen

  committed
  013ebaa

• Update _utils.py

  danielhanchen

  committed
  608916a

• Update llama.py

  danielhanchen

  committed
  19836e3

• Update _utils.py

  danielhanchen

  committed
  0164087

• Update cross_entropy_loss.py

  danielhanchen

  committed
  205f7ad

• Update cross_entropy_loss.py

  danielhanchen

  committed
  2f1f393

• Update cross_entropy_loss.py

  danielhanchen

  committed
  05b8f66

• Update cross_entropy_loss.py

  danielhanchen

  committed
  8d205c0

• Update cross_entropy_loss.py

  danielhanchen

  committed
  a1e9e13

• Update cross_entropy_loss.py

  danielhanchen

  committed
  94655f8

• Update cross_entropy_loss.py

  danielhanchen

  committed
  085f998

• Update cross_entropy_loss.py

  danielhanchen

  committed
  c796fd9

• Update cross_entropy_loss.py

  danielhanchen

  committed
  e943d77

• Update cross_entropy_loss.py

  danielhanchen

  committed
  16a7df6

• Update cross_entropy_loss.py

  danielhanchen

  committed
  f65b064

• Update cross_entropy_loss.py

  danielhanchen

  committed
  1ff49b8

• Update cross_entropy_loss.py

  danielhanchen

  committed
  080e558

• Update cross_entropy_loss.py

  danielhanchen

  committed
  f6d50c7

• Update cross_entropy_loss.py

  danielhanchen

  committed
  fad4202

• Update cross_entropy_loss.py

  danielhanchen

  committed
  736b16a

• Update cross_entropy_loss.py

  danielhanchen

  committed
  eb76416

• typing

  danielhanchen

  committed
  367e43f

• Update cross_entropy_loss.py

  danielhanchen

  committed
  993df20

• Update cross_entropy_loss.py

  danielhanchen

  committed
  8f566b3

• Update cross_entropy_loss.py

  danielhanchen

  committed
  22bb46b

• Update cross_entropy_loss.py

  danielhanchen

  committed
  b5c9f81

• Update cross_entropy_loss.py

  danielhanchen

  committed
  c7b2220

• Update cross_entropy_loss.py

  danielhanchen

  committed
  2d0ab26

• Update cross_entropy_loss.py

  danielhanchen

  committed
  428f662

• Update cross_entropy_loss.py

  danielhanchen

  committed
  5023ce9

• Update cross_entropy_loss.py

  danielhanchen

  committed
  5ca3d4a

• int64

  danielhanchen

  committed
  3b32d81

• Update _utils.py

  danielhanchen

  committed
  9bae6e2

• Update cross_entropy_loss.py

  danielhanchen

  committed
  5123623

• constexpr

  danielhanchen

  committed
  4b1d9e2

• constexpr

  danielhanchen

  committed
  7d5111a

• Update cross_entropy_loss.py

  danielhanchen

  committed
  dff5a52

• Update cross_entropy_loss.py

  danielhanchen

  committed
  969d1bd

• Update _utils.py

  danielhanchen

  committed
  4b5847f

• Update _utils.py

  danielhanchen

  committed
  766bf1e

Commits on Nov 5, 2024

• Update _utils.py

  danielhanchen

  committed
  646f1b7

• CE

  danielhanchen

  committed
  97f37ac

• Update cross_entropy_loss.py

  danielhanchen

  committed
  cc563fa

• Update _utils.py

  danielhanchen

  committed
  f643148

• Update llama.py

  danielhanchen

  committed
  f28d7f6

• Update _utils.py

  danielhanchen

  committed
  d8103e1

• Update rms_layernorm.py

  danielhanchen

  committed
  b9e1a49

• Update rms_layernorm.py

  danielhanchen

  committed
  56af302

• Update rms_layernorm.py

  danielhanchen

  committed
  a3c84a3

• Update rms_layernorm.py

  danielhanchen

  committed
  f7d5c56

• Update rms_layernorm.py

  danielhanchen

  committed
  8496ff6

• Update rms_layernorm.py

  danielhanchen

  committed
  2909eaf

• Update utils.py

  danielhanchen

  committed
  afc8af6

• Update rms_layernorm.py

  danielhanchen

  committed
  2d8d1e1

• Update rms_layernorm.py

  danielhanchen

  committed
  ecc1ad2

• Update rms_layernorm.py

  danielhanchen

  committed
  ae7cb78

• Update rms_layernorm.py

  danielhanchen

  committed
  22da266

• Update rms_layernorm.py

  danielhanchen

  committed
  beb6854

• Update rms_layernorm.py

  danielhanchen

  committed
  14c3d2f

• Update rms_layernorm.py

  danielhanchen

  committed
  ef4b079

• Update rms_layernorm.py

  danielhanchen

  committed
  ef684f8

• Update rms_layernorm.py

  danielhanchen

  committed
  3e4c42f

• Update rms_layernorm.py

  danielhanchen

  committed
  8f825eb

• Update rms_layernorm.py

  danielhanchen

  committed
  bd4ac7b

• Update rms_layernorm.py

  danielhanchen

  committed
  6f38731

• typing

  danielhanchen

  committed
  2df35d4

• Update rope_embedding.py

  danielhanchen

  committed
  74d89d1

• types

  danielhanchen

  committed
  98927ee

• Disable compiling

  danielhanchen

  committed
  f3e2bd6

• Update _utils.py

  danielhanchen

  committed
  c30bd2a

• Update _utils.py

  danielhanchen

  committed
  813cbdd

• Forward hook

  danielhanchen

  committed
  34ce5d1

• Update _utils.py

  danielhanchen

  committed
  f84cf4b

• Update llama.py

  danielhanchen

  committed
  745814c

• Update _utils.py

  danielhanchen

  committed
  ab9f8e1

• Update llama.py

  danielhanchen

  committed
  daa7909

• Update llama.py

  danielhanchen

  committed
  536a1a6

• Update _utils.py

  danielhanchen

  committed
  648ca59

• Update pyproject.toml

  danielhanchen

  committed
  486d0d6

• Update _utils.py

  danielhanchen

  committed
  eb4da9d

• Update llama.py

  danielhanchen

  committed
  da397f4

• CE Loss

  danielhanchen

  committed
  70b65cf

• Update cross_entropy_loss.py

  danielhanchen

  committed
  aeec57e

• Update _utils.py

  danielhanchen

  committed
  fb393fc

Commits on Nov 6, 2024

• Update cross_entropy_loss.py

  danielhanchen

  committed
  cab1e72

• Update cross_entropy_loss.py

  danielhanchen

  committed
  51fea97

• Update cross_entropy_loss.py

  danielhanchen

  committed
  58e541b

• Merge branch 'main' into nightly

  danielhanchen

  committed
  0ed0532

• Update llama.py

  danielhanchen

  committed
  ef2c56f