%bench 1+1 takes several minutes on macOS

[oxinabox]

When i use %bench it sits there using 100% CPU for like 10 minutes.
and reports timing to match.
Outside of %bench it doesn't seem to take a noticable amount of time.
This seems to happen on even if i have called the function before doing %bench and also occurs when i %bench it again.

>=> %bench "demo"
... 1+1
2

demo
Compile time: 611.293 s
Run time:     609.396 us        (based on 1000000 runs)

Runtime also seems pretty high.

This is with a fresh build of dex on commit 8646638.
Running on Mac.
This wasn't the case a week ago.

[apaszke]

I can't really reproduce the same thing locally. Note that "Compile time" as it was in the commit you've seen is really compile time + benchmark time, so it's really the later that dominates it. I've made some improvements to the benchmark suite in #372 and hopefully that will be enough to resolve your issue? If not, feel free to reopen.

[oxinabox]

I've made some improvements to the benchmark suite in #372 and hopefully that will be enough to resolve your issue? If not, feel free to reopen.

Tried a fresh build of main just now.
Seems not to be fixed.

>=> %bench "demo"
... 1+1
2

demo
Compile time: 25.439 ms
Run time:     505.765 us 	(based on 400000 runs)

it still took like several minutes wall time, and the runtime is still unreasonably high given @apaszke reported 150ns for 1+1 in #372

[duvenaud]

I also find that %bench takes at least a few minutes to run. I think me and @oxinabox are both using Macs.

[apaszke]

Hah, mac is a good pointer! I've been trying to reproduce on Linux, but couldn't!