[INT4 Quantization] failed:Node (/query_key_value/MatMul_Q4) Op (MatMulFpQ4) [ShapeInferenceError] 4b quantization not yet supported on this hardware platform! #2940
Triggered via issue
October 13, 2023 06:27
zjc664656505
Status
Success
Total duration
15s
Artifacts
–