-
-
Notifications
You must be signed in to change notification settings - Fork 17
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
M4 Mac mini #57
Comments
This system is much more of a 'Single Board Computer' than a couple of the Ampere systems I'm also testing in this repo; and in a nice advancement over some SBCs, it has a power supply integrated in its diminutive body. For a nice video showing how to upgrade the storage (lol why Apple still doesn't just go to M.2 is crazy): https://www.youtube.com/watch?v=cJPXLE9uPr8 And Snazzy Labs has a good teardown: https://www.youtube.com/watch?v=OYlF0NVXS70 I don't feel obligated to gut mine, since plenty of other people already have done so to theirs. I do feel obligated to test it like crazy before putting it into service. My current plan is to replace my M2 MacBook Air at home with this machine, and then the Air might come to the office and replace my old 2013 Air for a 'bench' laptop. |
M.2 as in 'standard NVMe SSD with own controller'? Well, two reasons against:
|
At the office, where the Mac mini is in open air (ambient temp 23°C / 73°F), Cinebench is still pushing the SoC to 100°F pretty quickly. Maybe Apple's fan curve isn't aggressive enough? I can hear the fan, but it's certainly very quiet. Only barely audible in the studio. Fan is at 1920 rpm |
Heh... I thought I had ordered an M4 Pro. Little did I know, I ordered an M4. Oopsie! It's still way faster than my M2 Air I'm replacing, and it still has 32 GB of RAM (double my Air), 1 TB HDD (double my Air), and 10 GbE (which my Air had to use a TB3 dongle for), so I'm happy with it, but disappointed I didn't look as closely when I ordered it. Though looking at the prices now, I'm okay with not paying the like $500 premium for the Pro + RAM upgrade. |
@ThomasKaiser - Since the |
I ran my https://github.com/geerlingguy/ollama-benchmark a couple times, even tried loading up the llama3.1:70b model but that tried consuming almost 40 GB of RAM—which meant 12 GB of swap, and slaughtered the performance. Need more RAM to run larger models. |
Would be great to run this standardised benchmark of llama models! The pinned commit is very old (but required for obvious reasons) so newer versions of the repo might also be interesting to explore to see the impact and efficiency of the GPU/Neural engine. |
That's good news, but ouch! That seems like a really slow fan. Curious to know how well it handles high-res video transcoding. I'm sure I'm not the only one who thinks this screams "my next media server" for only $550 (on Amazon). |
Please consider testing in High Power Mode. |
@nreilly - Low Power mode has been switched off in all my testing: |
The Mac mini (2024) should have 3 options for the energy level. Low, Automatic and High. The Apple article indicates it's available for the Mac mini (2024), and doesn't clarify it's only for the M4 Pro versions, so I would expect it to be an option for you, but your screenshot obviously says no. |
Great thx for sharing! Is there also a computer vision (non LLM) AI benchmark result? |
If only APFS and Disk Utility offered RAID5 functionality… I'd use this as a home server in a heartbeat, with two external M.2 thunderbolt enclosures, each sporting an M.2 gen3 x2 to 6xSATA adapter… using three SATA SSDs on each adapter for a combined storage pool. Afaik the only way to implement RAID5 is by using OWC's SoftRAID, and that's a subscription model, and I don't know if we should trust their software for an application as fundamental as storage. OpenZFS seems to be buggy as hell on macOS, so RAIDz1 is probably out of the question. Come on, Apple, give us more RAID levels already. 🙏 |
the M4 (non-Pro) only has the Low Power Mode. only M4 Pro Mac mini has High Power Mode. in Low Power Mode, the M4 SoC consumes less than 7 W under full load (HandBrake H.265 encoding on the CPUs). |
I unplugged 10 GbE and just used WiFi 6, and idle power consumption goes from 6W to 4.1W. The HPL efficiency score increased from 6.74 Gflop/W to 7.57 Gflops/W (much wow). |
Wow! Does apple power down the radio completely when wifi and Bluetooth are disabled? Can’t help but wonder if radios are using power at idle when 10 GbE is connected. |
Have you also tried to 'downgrade' the Ethernet link by connecting to a GbE or 2.5GbE switch port and measured idle consumption? |
@ThomasKaiser - I haven't tried that yet. May do so soon, left my power cord at home so I can't test right now :( (at least unless I have a compatible AC cord laying around in one of my boxes lol) |
Looks like a good candidate to run as a home server. With 2 thunderbolt 5 ports its not a problem anymore to connect even 990 pro ssds. Would love to see such kind of video on the channel! |
@geerlingguy in case the Mini is still in 'testing territory' with Xcode installed it should take just a few minutes of your time to get 7-zip 16.02 scores (16.02 to be comparable with
This will download 16.02 sources (with all known vulnerabilities patched), build from source and run the 7-zip benchmark single-threaded and on all 6 P-cores in parallel (5 continous runs each, then displaying best score each). Numbers to be compared with (counting/measuring only P-cores on the Macs):
(the ratio for all the Apple results is obviously strange since should be lower than count of threads) I checked parallel with |
The integrated controller appears to offer low-overhead encryption which shows almost no performance degradation. Not that many people will compare devices with encryption enabled. |
Basic information
Linux/system information
Benchmark results
CPU
Power
stress-ng --matrix 0
): 31.2 Wtop500
HPL benchmark: 39.6 WDisk
Internal Apple Storage
Network
iperf3
results:iperf3 -c $SERVER_IP
: 9.40 Gbpsiperf3 -c $SERVER_IP --reverse
: 9.38 Gbpsiperf3 -c $SERVER_IP --bidir
: 9.37 Gbps up, 7.73 Gbps downThe 10 GbE connection adds about 2W to total system power draw.
(Be sure to test all interfaces, noting any that are non-functional.)
GPU
Memory
tinymembench
results:Click to expand memory benchmark result
sbc-bench
resultsThe script doesn't run on macOS.
Phoronix Test Suite
Results from pi-general-benchmark.sh:
Run inside a Docker container:
Additional Benchmarks
Ollama (LLMs)
See: https://github.com/geerlingguy/ollama-benchmark?tab=readme-ov-file#findings and geerlingguy/ollama-benchmark#2
The text was updated successfully, but these errors were encountered: