Skip to content

v0.0.5

Latest
Compare
Choose a tag to compare
@brian6091 brian6091 released this 21 Dec 09:34
· 80 commits to master since this release
b64b1d4
v 0.0.5 (#42)

* Add parameter to control rank of decomposition (#28)

* ENH: allow controlling rank of approximation

* Training script accepts lora_rank

* feat : statefully monkeypatch different loras + example ipynb + readme

* Fix lora inject, added weight self apply lora (#39)

* Develop (#34)

* Add parameter to control rank of decomposition (#28)

* ENH: allow controlling rank of approximation

* Training script accepts lora_rank

* feat : statefully monkeypatch different loras + example ipynb + readme

Co-authored-by: brian6091 <[email protected]>

* release : version 0.0.4, now able to tune rank, now add loras dynamically

* readme : add brain6091's discussions

* fix:inject lora in to_out module list

* feat: added weight self apply lora

* chore: add import copy

* fix: readded r

Co-authored-by: Simo Ryu <[email protected]>
Co-authored-by: brian6091 <[email protected]>
Co-authored-by: SimoRyu <[email protected]>

* Revert "Fix lora inject, added weight self apply lora (#39)" (#40)

This reverts commit fececf303f216a54a9c3f5b0cf0ac46b44b9b913.

* fix : rank bug in monkeypatch

* fix cli fix

* visualizatio on effect of LR

Co-authored-by: brian6091 <[email protected]>
Co-authored-by: Davide Paglieri <[email protected]>