LIBMoE: A Library for comprehensive benchmarking Mixture of Experts in Large Language Models Project page of LIBMoE. Check out its GitHub page. Acknowledgments Parts of this project page were adopted from the Nerfies page. Website License This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.