[Core] Implementing disaggregated prefilling, and caching KV cache in CPU/disk/database. #21775
Annotations
4 errors
|
|
|
Mypy:
vllm/utils.py#L531
Name "dist_kv" is not defined [name-defined]
|
|
Mypy:
vllm/config.py#L2105
"KVTransferConfig" has no attribute "kv_disagg_role" [attr-defined]
|
|
Mypy
The operation was canceled.
|
Loading