[INT4 Quantization] failed:Node (/query_key_value/MatMul_Q4) Op (MatMulFpQ4) [ShapeInferenceError] 4b quantization not yet supported on this hardware platform! #2914
Triggered via issue
October 11, 2023 06:52
zjc664656505
Status
Success
Total duration
12s
Artifacts
–
This run and associated checks have been archived and are scheduled for deletion.
Learn more about checks retention