Skip to content

qserve is slower then awq int4 for llama2-7b on H100 #20

qserve is slower then awq int4 for llama2-7b on H100

qserve is slower then awq int4 for llama2-7b on H100 #20