Skip to content

Commit

Permalink
tolerance 1
Browse files Browse the repository at this point in the history
  • Loading branch information
evelynmitchell committed Dec 30, 2023
1 parent be088f0 commit f0cbb70
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion tests/utils/test_absmax.py
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ def test_absmax_quantize_default_bits():
quant, dequant = absmax_quantize(x)
assert quant.dtype == torch.int8
assert dequant.dtype == torch.float32
assert torch.allclose(dequant, x, atol=1e-2)
assert torch.allclose(dequant, x, atol=1e-1)

Check notice

Code scanning / Bandit

Use of assert detected. The enclosed code will be removed when compiling to optimised byte code. Note test

Use of assert detected. The enclosed code will be removed when compiling to optimised byte code.

Check warning

Code scanning / Bandit (reported by Codacy)

Use of assert detected. The enclosed code will be removed when compiling to optimised byte code. Warning test

Use of assert detected. The enclosed code will be removed when compiling to optimised byte code.


def test_absmax_quantize_custom_bits():
Expand Down

0 comments on commit f0cbb70

Please sign in to comment.