545999961
released this
31 Oct 16:23
·
112 commits
to master
since this release
We have completely updated the BGE code repository, including the following key improvements:
Inference Code
- Added
FlagAutoModel
andFlagAutoReranker
, making it easier to utilize the models.
Inference Optimization
- Implemented multi-GPU support.
- Introduced dynamic batch sizing to prevent out-of-memory (OOM) issues.
- Optimized padding to improve efficiency.
Evaluation Code
- Integrated support for common evaluation datasets to enhance user convenience.
- Provided a custom evaluation interface, adhering to specified data organization standards, to simplify the evaluation process.
Project Structure Organization
- Reorganized the project to streamline processes related to inference, fine-tuning, and evaluation.