Skip to content

Commit

Permalink
Give up inplace sanity check for a specific test
Browse files Browse the repository at this point in the history
  • Loading branch information
shino16 committed Sep 25, 2024
1 parent 9f005ca commit d7ff759
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion thunder/tests/test_jit_general.py
Original file line number Diff line number Diff line change
Expand Up @@ -760,7 +760,9 @@ def sample(logits):

with device:
model.set_kv_cache(batch_size=1)
tom = thunder.jit(model, executors=executors) # , disable_torch_autograd_support=True
tom = thunder.jit(
model, executors=executors, disable_inplace_copy_check=True
) # , disable_torch_autograd_support=True

# kv cache prefill
thunder_logits_1 = tom(x, torch.tensor([0, 1], device=device))
Expand Down

0 comments on commit d7ff759

Please sign in to comment.