Skip to content

Recompute KV cache for Phi3 when switching from short to long factor #2368

Recompute KV cache for Phi3 when switching from short to long factor

Recompute KV cache for Phi3 when switching from short to long factor #2368

Triggered via pull request December 20, 2024 19:20
Status Failure
Total duration 9m 29s
Artifacts

win-cuda-x64-build.yml

on: pull_request
windows-cuda-x64-build
6m 12s
windows-cuda-x64-build
Fit to window
Zoom out
Zoom in

Annotations

2 errors and 10 warnings
windows-cuda-x64-build: src/generators.cpp#L396
'params': undeclared identifier
windows-cuda-x64-build
Process completed with exit code 1.
windows-cuda-x64-build: cuda_sdk/v12.2/include/thrust/detail/alignment.h#L139
'thrust::detail::aligned_type<2>::type': structure was padded due to alignment specifier
windows-cuda-x64-build: cuda_sdk/v12.2/include/thrust/detail/alignment.h#L140
'thrust::detail::aligned_type<4>::type': structure was padded due to alignment specifier
windows-cuda-x64-build: cuda_sdk/v12.2/include/thrust/detail/alignment.h#L141
'thrust::detail::aligned_type<8>::type': structure was padded due to alignment specifier
windows-cuda-x64-build: cuda_sdk/v12.2/include/thrust/detail/alignment.h#L142
'thrust::detail::aligned_type<16>::type': structure was padded due to alignment specifier
windows-cuda-x64-build: cuda_sdk/v12.2/include/thrust/detail/alignment.h#L143
'thrust::detail::aligned_type<32>::type': structure was padded due to alignment specifier
windows-cuda-x64-build: cuda_sdk/v12.2/include/thrust/detail/alignment.h#L144
'thrust::detail::aligned_type<64>::type': structure was padded due to alignment specifier
windows-cuda-x64-build: cuda_sdk/v12.2/include/thrust/detail/alignment.h#L145
'thrust::detail::aligned_type<128>::type': structure was padded due to alignment specifier
windows-cuda-x64-build: cuda_sdk/v12.2/include/thrust/system/cuda/detail/core/alignment.h#L91
'thrust::cuda_cub::aligned_type<2>::type': structure was padded due to alignment specifier
windows-cuda-x64-build: cuda_sdk/v12.2/include/thrust/system/cuda/detail/core/alignment.h#L97
'thrust::cuda_cub::aligned_type<4>::type': structure was padded due to alignment specifier
windows-cuda-x64-build: cuda_sdk/v12.2/include/thrust/system/cuda/detail/core/alignment.h#L103
'thrust::cuda_cub::aligned_type<8>::type': structure was padded due to alignment specifier