Skip to content
Generation Utils - Test (deprecated)

Set FP16 KV-cache for non-quantized text models #4036

Sign in to view logs

Set FP16 KV-cache for non-quantized text models

Set FP16 KV-cache for non-quantized text models #4036

Triggered via pull request November 29, 2024 12:22
@AlexKoff88AlexKoff88
opened #1043
ak/fp16_cache_for_fp16_models
Status Cancelled
Total duration 2m 41s
Artifacts –

test_generation.yml

on: pull_request
build
2m 28s
build
Fit to window
Zoom out
Zoom in

Annotations

2 errors
build
Canceling since a higher priority waiting request for 'Generation Utils - Test (deprecated)-ak/fp16_cache_for_fp16_models' exists
build
The operation was canceled.