Skip to content

Pull requests: huggingface/text-generation-inference

New pull request New
18 Open 1,310 Closed
18 Open 1,310 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix the error that limit_concurrent_requests could not meet if reques…
#2754 opened Nov 18, 2024 by sywangyi Loading…
1
CI for add ipex moe implementation to support Mixtral and PhiMoe
#2753 opened Nov 18, 2024 by danieldk • Draft
5 tasks
Add support for compressed-tensors w8a8 int checkpoints
#2745 opened Nov 14, 2024 by danieldk • Draft
5 tasks
1
Support continue final message
#2733 opened Nov 8, 2024 by drbh Loading…
4
feat: add payload limit
#2726 opened Nov 5, 2024 by OlivierDehaene Loading…
3
Add llama.cpp backend
#2723 opened Nov 4, 2024 by mfuntowicz • Draft
feat: support flash attention 2 in qwen2 vl vision blocks
#2721 opened Nov 4, 2024 by drbh Loading…
Update to moe-kernels 0.7.0
#2720 opened Nov 4, 2024 by danieldk Loading…
5 tasks
add ipex moe implementation to support Mixtral and PhiMoe
#2707 opened Oct 30, 2024 by sywangyi Loading…
11
fix: improve find_segments via numpy diff
#2686 opened Oct 24, 2024 by drbh Loading…
Get opentelemetry trace id from request headers instead of creating a new trace
#2648 opened Oct 15, 2024 by kozistr Loading…
3 of 5 tasks
1
1
PR 2634 CI - Fix the tool_choice format for named choice by adapting OpenAIs scheme
#2645 opened Oct 14, 2024 by drbh Loading…
49
[WIP] Add gfx1100 support to AMD pytorch build
#2642 opened Oct 13, 2024 by cazlo • Draft
1 of 5 tasks
1
1
Fix the tool_choice format for named choice by adapting OpenAIs scheme
#2634 opened Oct 10, 2024 by linusbierhoff Loading…
[DOCS] Add Google Cloud TGI integration via dedicated DLCs
#2612 opened Oct 5, 2024 by alvarobartt • Draft
1 of 5 tasks
8
feat: Add automatic nightly benchmarks
#2591 opened Sep 30, 2024 by Hugoch Loading…
1 of 5 tasks
@Hugoch
Improve vlm support (add idefics3 support)
#2437 opened Aug 20, 2024 by drbh • Draft
4 tasks
Add model_load_time metric
#2311 opened Jul 26, 2024 by Edwinhr716 Loading…
2 of 5 tasks
2
ProTip! no:milestone will show everything without a milestone.