Skip to content

Commit

Permalink
fix typo
Browse files Browse the repository at this point in the history
  • Loading branch information
Michael Gschwind committed Apr 10, 2024
1 parent c5fac59 commit 0a6383a
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion quantize.py
Original file line number Diff line number Diff line change
Expand Up @@ -54,7 +54,7 @@ def quantize_model(model: nn.Module, quantize_options):
).quantized_model()
elif quantizer == "linear:int4":
linears_quantized = True
model = Int8DynActInt4WeightQuantHandler(
model = WeightOnlyInt4QuantHandler(
model,
**q_kwargs
).quantized_model()
Expand Down

0 comments on commit 0a6383a

Please sign in to comment.