[INT4 Quantization] failed:Node (/query_key_value/MatMul_Q4) Op (MatMulFpQ4) [ShapeInferenceError] 4b quantization not yet supported on this hardware platform! #2912
Triggered via issue
October 11, 2023 05:08
zjc664656505
Status
Success
Total duration
23s
Artifacts
–
This run and associated checks have been archived and are scheduled for deletion.
Learn more about checks retention