SqueezeAILab

All

8 repositories

SqueezedAttention
Public
SQUEEZED ATTENTION: Accelerating Long Prompt LLM Inference
Python
•0•8•0•0•Updated Nov 20, 2024Nov 20, 2024
Tool2Vec
Public
Efficient and Scalable Estimation of Tool Representations in Vector Space
nlp natural-language-processing tool transformer bert llm deberta-v3 function-calling tool-learning
Python
•
MIT License
•0•16•0•0•Updated Sep 5, 2024Sep 5, 2024
TinyAgent
Public
[EMNLP 2024 Demo] TinyAgent: Function Calling at the Edge!
Python
•
MIT License
•51•313•6•1•Updated Sep 4, 2024Sep 4, 2024
KVQuant
Public
[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
natural-language-processing compression text-generation transformer llama quantization mistral model-compression efficient-inference efficient-model
Python
•26•306•11•1•Updated Aug 13, 2024Aug 13, 2024
SqueezeLLM
Public
[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
natural-language-processing text-generation transformer llama quantization model-compression efficient-inference post-training-quantization large-language-models llm
Python
•
MIT License
•43•650•15•3•Updated Aug 13, 2024Aug 13, 2024
LLMCompiler
Public
[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
nlp natural-language-processing transformer llama efficient-inference large-language-models llm llms llm-agent function-calling
Python
•
MIT License
•110•1.5k•4•1•Updated Jul 10, 2024Jul 10, 2024
LLM2LLM
Public
[ACL 2024] LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement
nlp natural-language-processing transformer llama data-augmentation synthetic-dataset-generation llm llms llama2
Python
•
MIT License
•10•156•2•0•Updated Mar 25, 2024Mar 25, 2024
open_source_projects
Public
Open Source Projects from Pallas Lab
MIT License
•2•20•0•0•Updated Oct 10, 2021Oct 10, 2021