Skip to content

[Core] Implementing disaggregated prefilling, and caching KV cache in CPU/disk/database. #21775

[Core] Implementing disaggregated prefilling, and caching KV cache in CPU/disk/database.

[Core] Implementing disaggregated prefilling, and caching KV cache in CPU/disk/database. #21775

Triggered via pull request November 18, 2024 07:00
Status Failure
Total duration 31s
Artifacts

mypy.yaml

on: pull_request
Matrix: mypy
Fit to window
Zoom out
Zoom in

Annotations

14 errors
mypy (3.11): vllm/utils.py#L531
Name "dist_kv" is not defined [name-defined]
mypy (3.11): vllm/config.py#L2105
"KVTransferConfig" has no attribute "kv_disagg_role" [attr-defined]
mypy (3.11)
Process completed with exit code 1.
mypy (3.12): vllm/utils.py#L531
Name "dist_kv" is not defined [name-defined]
mypy (3.12): vllm/config.py#L2105
"KVTransferConfig" has no attribute "kv_disagg_role" [attr-defined]
mypy (3.12)
Process completed with exit code 1.
mypy (3.10)
The job was canceled because "_3_11" failed.
mypy (3.10): vllm/utils.py#L531
Name "dist_kv" is not defined [name-defined]
mypy (3.10): vllm/config.py#L2105
"KVTransferConfig" has no attribute "kv_disagg_role" [attr-defined]
mypy (3.10)
Process completed with exit code 1.
mypy (3.9)
The job was canceled because "_3_11" failed.
mypy (3.9): vllm/utils.py#L531
Name "dist_kv" is not defined [name-defined]
mypy (3.9): vllm/config.py#L2105
"KVTransferConfig" has no attribute "kv_disagg_role" [attr-defined]
mypy (3.9)
The operation was canceled.