Skip to content

Model Patcher moved to Framework, Instruct Lab Plugin

Compare
Choose a tag to compare
@fabianlim fabianlim released this 02 Aug 05:24
· 32 commits to main since this release

Release

  • framework v0.2, minor version: ModelPatcher now moved into framework. Also now bench supports pretokenized datasets
  • ilab v0.1, new_plugin: New plugin with padding free support (native after transformers 4.44
  • peft v0.1.1: Patch bump. Minor changes.
  • foak v0.2: Minor patch bump with ModelPatcher moved out from it.

Update: we decided to remove the ilab plugin and replace it with an attention-and-distributed-packing plugin in the upcoming releases

What's Changed

  • Refactored Model Patcher Class by @achew010 in #55
  • Address Package Bound and Triton Issues for Torch 2.4 by @fabianlim in #58
  • Introduce Padding-Free Plugin to FMS-Acceleration by @achew010 in #57
  • Allow Bench To Configure Data Processing Pipeline Per Scenario by @fabianlim in #60
  • Fix Mistakes with FA Padding Free by @fabianlim in #62
  • Additional README Changes for PR #57 by @achew010 in #61

Full Changelog: v0.1.2.0...v0.2.0