system/mpv reports "No Test Results"

[josch]

This is on Debian bookworm with mpv 0.35.1-4. Steps to reproduce:

$ phoronix-test-suite debug-benchmark system/mpv

    Evaluating System Dependencies ........................................................

Phoronix Test Suite v10.8.4

    Installed:     system/mpv-1.0.1


MPV:
system/mpv-1.0.1
System Test Configuration
1: Big Buck Bunny Sunflower 1080p
2: Big Buck Bunny Sunflower 4K
3: Test All Options
** Multiple items can be selected, delimit by a comma. **
Video Input: 1


========================================
Phoronix Test Suite v10.8.4
System Information
========================================


  PROCESSOR:              ARMv8 Cortex-A53 @ 1.50GHz
    Core Count:           4                    
    Scaling Driver:       cpufreq-dt schedutil 

  GRAPHICS:               imx-dcssdrmfb
    Screen:               1920x1080        

  MOTHERBOARD:            MNT Reform 2
    Chipset:              Synopsys DWC_usb3 /           
    Network:              Qualcomm Atheros QCA986x/988x 

  MEMORY:                 4096MB

  DISK:                   1000GB Western Digital WDS100T2B0C-00PXH0 + 16GB TB2916 + SD01G
    File-System:          ext4                          
    Mount Options:        errors=remount-ro relatime rw 
    Disk Scheduler:       NONE                          
    Disk Details:         Block Size: 4096              

  OPERATING SYSTEM:       Debian 12
    Kernel:               6.5.0-1-reform2-arm64 (aarch64)                         
    Desktop:              Sway 1.7                                                
    Display Server:       Wayland                                                 
    Compiler:             GCC 12.2.0 + Clang 14.0.6 + LLVM 14.0.6                 
    Security:             gather_data_sampling: Not affected                      
                          + itlb_multihit: Not affected                           
                          + l1tf: Not affected                                    
                          + mds: Not affected                                     
                          + meltdown: Not affected                                
                          + mmio_stale_data: Not affected                         
                          + retbleed: Not affected                                
                          + spec_rstack_overflow: Not affected                    
                          + spec_store_bypass: Not affected                       
                          + spectre_v1: Mitigation of __user pointer sanitization 
                          + spectre_v2: Not affected                              
                          + srbds: Not affected                                   
                          + tsx_async_abort: Not affected                         

The CPU scaling governor is currently not set to performance. It's possible to obtain greater performance if using the performance governor.To change behavior, run: echo performance | tee /sys/devices/system/cpu/cpu*/cpufreq/scaling_governorReference: https://openbenchmarking.org/result/1706268-TR-CPUGOVERN32
To stop showing performance tips, run: phoronix-test-suite unload-module perf_tipsContinuing in 5 seconds or press CTRL-C to stop the testing process.
===================================================================
MPV (Run 1 of 1)
Video Input: Big Buck Bunny Sunflower 1080p - Decode: Software Only
===================================================================


Test Run Directory: /home/josch/.phoronix-test-suite/installed-tests/system/mpv-1.0.1/


Test Run Command: ./mpv-run bbb_sunflower_1080p_30fps_normal.mp4 --hwdec=no


Result Key: #_RESULT_#


Template Line: [  30.156][s][statusline] FPS: #_RESULT_#


Result Parsing Search Key: "FPS:"


Result Line: [   0.632][v][vd] Container reported FPS: 30.000000


Trying Backup Result Line: [   0.027][v][cplayer] Setting option 'term-status-msg' = 'FPS: ${estimated-display-fps}' (flags = 8)


Trying Backup Result Line: [   0.027][v][cplayer] Setting option 'osd-msg1' = 'FPS: ${estimated-display-fps}' (flags = 8)


Trying Backup Result Line: [   0.020][v][cplayer] Command line options: '--no-audio' '--untimed' '--opengl-swapinterval=0' '--video-sync=display-desync' '-v' '--osd-msg1=FPS: ${estimated-display-fps}' '--term-status-msg=FPS: ${estimated-display-fps}' '--term-osd-bar' '--length=300' '--log-file=/home/josch/.phoronix-test-suite/installed-tests/system/mpv-1.0.1/mpv-1.0.1-1701602384-1.log' 'bbb_sunflower_1080p_30fps_normal.mp4' '--hwdec=no'


No Test Results


The test run did not produce a result.


E: [   0.058][d][console] lua-settings/console.conf not found. 


Log File At: /home/josch/.phoronix-test-suite/installed-tests/system/mpv-1.0.1/mpv-1.0.1-1701602384-1.log



The following tests failed to properly run:

    - system/mpv-1.0.1: Video Input: Big Buck Bunny Sunflower 1080p - Decode: Software Only

I attached the log file. It seems that the issue is, that the FPS: lines do not get printed into the log file. If I run the mpv command manually from the command line I see the FPS lines printed. But they do not seem to end up in the log.
mpv-1.0.1-1701602384-1.log

[josch]

I bisected mpv to find out the reason for this and reported it here:

mpv-player/mpv#13038

In this issue, you can also read why mpv developers think that currently, the phoronix mpv test is doing the benchmarking wrong.