Skip to content

Commit

Permalink
yolov3: reduce batch size due to OOM (#111959)
Browse files Browse the repository at this point in the history
Summary:
yolov3 w/ cudagraphs (known to use more memory) is failing perf test due to OOM (https://hud.pytorch.org/benchmark/torchbench/inductor_with_cudagraphs?startTime=Mon,%2016%20Oct%202023%2020:19:47%20GMT&stopTime=Mon,%2023%20Oct%202023%2020:19:47%20GMT&granularity=hour&mode=training&dtype=amp&lBranch=main&lCommit=0b424ee0b7bfe09e0a438a63e8336e95eea85901&rBranch=main&rCommit=29048be41ca3aa8974795d93b9ea9fd6dee415fc)

I'm reducing the batch size from 16 to 8 to keep the same batch size for all yolov3 HUD benchmarks

X-link: pytorch/pytorch#111959
Approved by: https://github.com/xuzhao9

Reviewed By: clee2000

Differential Revision: D50676423

Pulled By: xmfan

fbshipit-source-id: 356901d51c79e3b292a8db9f4226799e3d426447
  • Loading branch information
xmfan authored and facebook-github-bot committed Oct 27, 2023
1 parent edf7115 commit c533c93
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions userbenchmark/dynamo/dynamobench/torchbench.py
Original file line number Diff line number Diff line change
Expand Up @@ -56,6 +56,7 @@ def setup_torchbench_cwd():
"hf_T5_base": 4,
"timm_efficientdet": 1,
"llama_v2_7b_16h": 1,
"yolov3": 8, # reduced from 16 due to cudagraphs OOM in TorchInductor dashboard
}

DETECTRON2_MODELS = {
Expand Down

0 comments on commit c533c93

Please sign in to comment.