Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Results not posted at website #32

Closed
theofficialgman opened this issue Nov 12, 2023 · 14 comments
Closed

Results not posted at website #32

theofficialgman opened this issue Nov 12, 2023 · 14 comments
Assignees

Comments

@theofficialgman
Copy link

I have run the benchmark as have others a few times and results never got posted on the website

eg:

sudo curl https://raw.githubusercontent.com/TheRemote/PiBenchmarks/master/Storage.sh | sudo bash
[sudo] password for gman: 
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0Trimming and syncing drives ...
100 35746  100 35746    0     0  95527      0 --:--:-- --:--:-- --:--:-- 95577
/media/gman/Universal: 10.7 GiB (11460980736 bytes) trimmed on /dev/mmcblk0p4
fstrim: /media/gman/switch: the discard operation is not supported
/media/gman/SWR-UBU: 52.7 GiB (56619118592 bytes) trimmed on /dev/mmcblk0p2
/media/gman/SWR-FED: 15.5 GiB (16661729280 bytes) trimmed on /dev/mmcblk0p5
/: 22.9 GiB (24611069952 bytes) trimmed on /dev/mmcblk0p3
Board information: Manufacturer:  - Model: Nintendo Switch (2017) - Architecture: aarch64 - OS: Ubuntu 22.04.3 LTS
Fetching required components ...
Install lsscsi
Get:1 http://packages.microsoft.com/repos/code stable InRelease [3,569 B]
Hit:2 https://Pi-Apps-Coders.github.io/box64-debs/debian ./ InRelease          
Hit:3 https://brave-browser-apt-release.s3.brave.com stable InRelease          
Hit:4 http://ports.ubuntu.com/ubuntu-ports jammy InRelease                     
Hit:5 https://Pi-Apps-Coders.github.io/box86-debs/debian ./ InRelease          
Hit:6 https://theofficialgman.github.io/l4t-debs l4t InRelease                 
Hit:7 https://download.sublimetext.com apt/stable/ InRelease                   
Get:8 http://ports.ubuntu.com/ubuntu-ports jammy-updates InRelease [119 kB]    
Get:9 https://dl.cloudsmith.io/public/moonlight-game-streaming/moonlight-l4t/deb/ubuntu bionic InRelease [5,084 B]
Hit:10 https://repo.steampowered.com/steam stable InRelease                    
Hit:11 https://adoptium.jfrog.io/artifactory/deb jammy InRelease               
Hit:12 https://ppa.launchpadcontent.net/kisak/kisak-mesa/ubuntu jammy InRelease
Get:13 http://ports.ubuntu.com/ubuntu-ports jammy-backports InRelease [109 kB] 
Get:14 http://ports.ubuntu.com/ubuntu-ports jammy-security InRelease [110 kB]  
Hit:15 https://ppa.launchpadcontent.net/libreoffice/ppa/ubuntu jammy InRelease
Hit:16 https://ppa.launchpadcontent.net/mozillateam/ppa/ubuntu jammy InRelease
Hit:17 https://ppa.launchpadcontent.net/theofficialgman/gpu-tools/ubuntu jammy InRelease
Get:18 http://ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 DEP-11 Metadata [101 kB]
Get:19 http://ports.ubuntu.com/ubuntu-ports jammy-updates/universe arm64 DEP-11 Metadata [301 kB]
Get:20 http://ports.ubuntu.com/ubuntu-ports jammy-updates/multiverse arm64 DEP-11 Metadata [212 B]
Get:21 http://ports.ubuntu.com/ubuntu-ports jammy-backports/main arm64 DEP-11 Metadata [3,504 B]
Get:22 http://ports.ubuntu.com/ubuntu-ports jammy-backports/universe arm64 DEP-11 Metadata [18.6 kB]
Get:23 http://ports.ubuntu.com/ubuntu-ports jammy-security/main arm64 DEP-11 Metadata [43.0 kB]
Get:24 http://ports.ubuntu.com/ubuntu-ports jammy-security/universe arm64 DEP-11 Metadata [54.8 kB]
Fetched 868 kB in 3s (290 kB/s)                                             
Reading package lists... Done
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
bc is already the newest version (1.07.1-3build1).
hdparm is already the newest version (9.60+ds-1build3).
hdparm set to manually installed.
lshw is already the newest version (02.19.git.2021.06.19.996aaad9c7-2build1).
lshw set to manually installed.
pciutils is already the newest version (1:3.7.0-6).
usbutils is already the newest version (1:014-1build1).
fio is already the newest version (3.28-1).
curl is already the newest version (7.81.0-1ubuntu1.14).
dmidecode is already the newest version (3.3-3ubuntu0.1).
dmidecode set to manually installed.
xxd is already the newest version (2:8.2.3995-1ubuntu2.13).
xxd set to manually installed.
The following additional packages will be installed:
  libhd21
Suggested packages:
  gsmartcontrol smart-notifier mailx | mailutils
The following NEW packages will be installed:
  hwinfo libhd21 libxml-dumper-perl lsscsi nvme-cli sdparm smartmontools
0 upgraded, 7 newly installed, 0 to remove and 0 not upgraded.
Need to get 1,904 kB of archives.
After this operation, 6,648 kB of additional disk space will be used.
Get:1 http://ports.ubuntu.com/ubuntu-ports jammy/universe arm64 libhd21 arm64 21.72-1 [648 kB]
Get:2 http://ports.ubuntu.com/ubuntu-ports jammy/universe arm64 hwinfo arm64 21.72-1 [17.5 kB]
Get:3 http://ports.ubuntu.com/ubuntu-ports jammy/universe arm64 libxml-dumper-perl all 0.81-1.3 [16.9 kB]
Get:4 http://ports.ubuntu.com/ubuntu-ports jammy/main arm64 lsscsi arm64 0.31-1build2 [48.6 kB]
Get:5 http://ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 nvme-cli arm64 1.16-3ubuntu0.1 [487 kB]
Get:6 http://ports.ubuntu.com/ubuntu-ports jammy/universe arm64 sdparm arm64 1.10-1 [117 kB]
Get:7 http://ports.ubuntu.com/ubuntu-ports jammy/main arm64 smartmontools arm64 7.2-1build2 [570 kB]
Fetched 1,904 kB in 2s (930 kB/s)      
Selecting previously unselected package libhd21:arm64.
(Reading database ... 202685 files and directories currently installed.)
Preparing to unpack .../0-libhd21_21.72-1_arm64.deb ...
Unpacking libhd21:arm64 (21.72-1) ...
Selecting previously unselected package hwinfo.
Preparing to unpack .../1-hwinfo_21.72-1_arm64.deb ...
Unpacking hwinfo (21.72-1) ...
Selecting previously unselected package libxml-dumper-perl.
Preparing to unpack .../2-libxml-dumper-perl_0.81-1.3_all.deb ...
Unpacking libxml-dumper-perl (0.81-1.3) ...
Selecting previously unselected package lsscsi.
Preparing to unpack .../3-lsscsi_0.31-1build2_arm64.deb ...
Unpacking lsscsi (0.31-1build2) ...
Selecting previously unselected package nvme-cli.
Preparing to unpack .../4-nvme-cli_1.16-3ubuntu0.1_arm64.deb ...
Unpacking nvme-cli (1.16-3ubuntu0.1) ...
Selecting previously unselected package sdparm.
Preparing to unpack .../5-sdparm_1.10-1_arm64.deb ...
Unpacking sdparm (1.10-1) ...
Selecting previously unselected package smartmontools.
Preparing to unpack .../6-smartmontools_7.2-1build2_arm64.deb ...
Unpacking smartmontools (7.2-1build2) ...
Setting up smartmontools (7.2-1build2) ...
Created symlink /etc/systemd/system/smartd.service → /lib/systemd/system/smartmontools.service.
Created symlink /etc/systemd/system/multi-user.target.wants/smartmontools.service → /lib/systemd/system/smartmontools.service.
Setting up nvme-cli (1.16-3ubuntu0.1) ...
Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service.
Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service.
nvmf-connect.target is a disabled or a static unit, not starting it.
Could not execute systemctl:  at /usr/bin/deb-systemd-invoke line 142.
Setting up libxml-dumper-perl (0.81-1.3) ...
Setting up sdparm (1.10-1) ...
Setting up libhd21:arm64 (21.72-1) ...
Setting up lsscsi (0.31-1build2) ...
Setting up hwinfo (21.72-1) ...
Processing triggers for man-db (2.10.2-1) ...
Processing triggers for libc-bin (2.35-9ubuntu3.1) ...
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
lsscsi is already the newest version (0.31-1build2).
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
Install iozone3
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following NEW packages will be installed:
  iozone3
0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 406 kB of archives.
After this operation, 748 kB of additional disk space will be used.
Get:1 http://ports.ubuntu.com/ubuntu-ports jammy/multiverse arm64 iozone3 arm64 489-1 [406 kB]
Fetched 406 kB in 1s (601 kB/s) 
Selecting previously unselected package iozone3.
(Reading database ... 202949 files and directories currently installed.)
Preparing to unpack .../iozone3_489-1_arm64.deb ...
Unpacking iozone3 (489-1) ...
Setting up iozone3 (489-1) ...
Processing triggers for man-db (2.10.2-1) ...
Clock speeds: CPU: 2091 - Core: 
System rootfs drive (/) has been detected as /dev/mmcblk0p3 (mmcblk0p3)
Starting INXI hardware identification...
System:
  Kernel: 4.9.140-l4t arch: aarch64 bits: 64 compiler: gcc v: 7.3.1 Desktop: GNOME v: 42.9
    Distro: Ubuntu 22.04.3 LTS (Jammy Jellyfish)
Machine:
  Type: ARM System: Nintendo Switch (2017) details: N/A serial: <filter>
Battery:
  ID-1: battery charge: 12.8 Wh (96.2%) condition: 13.3/14.9 Wh (88.7%) volts: 4.0 min: 3.2
    model: N/A status: charging
  Device-1: nintendo_switch_controller_battery_serial0-0 model: N/A charge: Full
    status: discharging
  Device-2: nintendo_switch_controller_battery_serial1-0 model: N/A charge: Full
    status: discharging
CPU:
  Info: quad core model: ARMv8 v8l variant: cortex-a57 bits: 64 type: MCP arch: v8l rev: 1 cache:
    L1: 320 KiB L2: 2 MiB
  Speed (MHz): avg: 1657 high: 2091 min/max: 102/2091 cores: 1: 1224 2: 2091 3: 2091 4: 1224
    bogomips: N/A
  Features: Use -f option to see features
Graphics:
  Device-1: tegra210-gm20b driver: gk20a v: N/A bus-ID: N/A
  Device-2: tegra210-gm20b driver: gk20a v: N/A bus-ID: N/A
  Device-3: tegra210-gm20b driver: gk20a v: N/A bus-ID: N/A
  Display: server: X.Org v: 1.20.13 with: Xwayland v: 22.1.1 driver: X: loaded: N/A
    failed: nvidia gpu: gk20a,gk20a,gk20a resolution: 1: 1920x1080~60Hz 2: N/A
  API: OpenGL v: 4.6.0 vendor: nvidia v: 32.3.1 glx-v: 1.4 direct-render: yes renderer: NVIDIA
    Tegra X1 (nvgpu)/integrated
Network:
  Device-1: Broadcom BCM4356 802.11ac Wireless Network Adapter driver: brcmfmac v: kernel
    bus-ID: 01:00.0
  IF: wlp1s0 state: down mac: <filter>
  Device-2: ASIX AX88179 Gigabit Ethernet driver: ax88179_178a type: USB bus-ID: 1-1.3:13
  IF: enx0050b62942ef state: up speed: 1000 Mbps duplex: full mac: <filter>
  IF-ID-1: bond0 state: down mac: <filter>
  IF-ID-2: bonding_masters state: N/A speed: N/A duplex: N/A mac: N/A
  IF-ID-3: dummy0 state: down mac: <filter>
  IF-ID-4: sit0 state: down mac: <filter>
  IF-ID-5: tunl0 state: down mac: <filter>
Drives:
  Local Storage: total: 477.5 GiB used: 299.35 GiB (62.7%)
  ID-1: /dev/mmcblk0 model: YF8SD size: 477.5 GiB
  Message: No optical or floppy data found.
Partition:
  ID-1: / size: 115.74 GiB used: 86.11 GiB (74.4%) fs: ext4 dev: /dev/mmcblk0p3
Info:
  Processes: 311 Uptime: 2h 29m Memory: total: 4 GiB available: 3.9 GiB used: 1.26 GiB (32.4%)
  Init: systemd target: graphical (5) Compilers: gcc: 11.4.0 clang: 14.0.0-1ubuntu1.1
  Packages: 3018 Client: Sudo v: 1.9.9 inxi: 3.3.31
Running additional hardware identification tests...
Additional hardware identification tests completed.
Starting MMC/SD identification...
Starting SD card identification...
Card CSD status register: MID: 1b OID: SM PNM: YF8SD PRV: 3.0 MDATE: 8/2023
Card SCR status register: SD Physical Version Specification: 6
MicroSD information: Clock Speed: 199.7 - Manufacturer: Samsung - Model: YF8SD - Vendor:  - Product: SD - HW Version: 0x3 - FW Version: 0x0 - Date Manufactured: 08/2023 - Class: A2 Class 10 V30 U3
Running HDParm tests ...
/dev/mmcblk0p3:
 Timing O_DIRECT cached reads:   268 MB in  2.01 seconds = 133.42 MB/sec
 Timing O_DIRECT disk reads: 408 MB in  3.01 seconds = 135.52 MB/sec
HDParm: 135.52 MB/s - HDParmCached: 133.42 MB/s
Running dd tests ...
133120+0 records in
133120+0 records out
545259520 bytes (545 MB, 520 MiB) copied, 5.40151 s, 101 MB/s
DD Write Speed: 101 MB/s
Running fio write test ...
Running fio read test ...
FIO results - 4k RandWrite: 2684 IOPS (10736 KB/s) - 4k RandRead: 7543 IOPS (30173 KB/s)
Running iozone test ...
	Iozone: Performance Test of File I/O
	        Version $Revision: 3.489 $
		Compiled for 64 bit mode.
		Build: linux 
	Run began: Sun Nov 12 12:58:08 2023
	Auto Mode
	Include fsync in write timing
	O_DIRECT feature enabled
	File size set to 81920 kB
	Record Size 4 kB
	Command line used: iozone -a -e -I -i 0 -i 1 -i 2 -s 80M -r 4k
	Output is in kBytes/sec
	Time Resolution = 0.000001 seconds.
	Processor cache size set to 1024 kBytes.
	Processor cache line size set to 32 bytes.
	File stride size set to 17 * record size.
                                                              random    random     bkwd    record    stride                                    
              kB  reclen    write  rewrite    read    reread    read     write     read   rewrite      read   fwrite frewrite    fread  freread
           81920       4     8433     8082    21524    21344    21376     8068                                                                
iozone test complete.
RandRead: 21376 - RandWrite: 8068 - Read: 21524 - Write: 8433
Enter a description of your storage and setup (Example: Kingston A400 SSD on Pi 4 using StarTech SATA to USB adapter)
Description: Samsung 512GB Pro Ultimate on Nintendo Switch
(Optional) Enter alias to use on benchmark results.  Leave blank for completely anonymous.
Alias (leave blank for Anonymous): theofficialgman
Result submitted successfully and will appear live on https://pibenchmarks.com within a couple of minutes.

     Category                  Test                      Result     
HDParm                    Disk Read                 135.52 MB/s              
HDParm                    Cached Disk Read          133.42 MB/s              
DD                        Disk Write                101 MB/s                 
FIO                       4k random read            7543 IOPS (30173 KB/s)   
FIO                       4k random write           2684 IOPS (10736 KB/s)   
IOZone                    4k read                   21524 KB/s               
IOZone                    4k write                  8433 KB/s                
IOZone                    4k random read            21376 KB/s               
IOZone                    4k random write           8068 KB/s                

                          Score: 3565                                        

Compare with previous benchmark results at:
https://pibenchmarks.com/
@rglidden
Copy link

rglidden commented Nov 14, 2023

The error appears to be caused by a bug in the nvme command an recent kernel changes in newer Linux versions. See my #31 (comment) for a temporary work around.

EDIT: My mistake. This does not appear to be relevant to this particular issue.

@theofficialgman
Copy link
Author

The error appears to be caused by a bug in the nvme command an recent kernel changes in newer Linux versions. See my #31 (comment) for a temporary work around.

I am sure you were well meaning but I do not have or show that issue here. This system is running kernel 4.9 and not affected by that change whatsoever.

@rglidden
Copy link

My apologies. Your issue popped up in one of my searches when I was digging into the issue, and they all looked very similar. You're right, your issue appears to be something different.

@arekm
Copy link

arekm commented Nov 22, 2023

For me

        Failed query in <b>FormTools\Submissions, /var/www/storage/formtools/global/code/Submissions.class.php</b>, line 204, error: SQLSTATE[HY000]: General error: 3988 Conversion from collation utf8mb3_general_ci into utf8mb4_bin impossible for parameter

(actual error from "bash -x Storage.sh" - that way we can see what php page returns)

I suggest adding export LC_ALL=C to beginning of Storage.sh script (my locale was en_GB.UTF-8 and that resulted in above failure to properly handle utf8).

Also pointing to this github project on https://pibenchmarks.com/ page would be nice.

@TheRemote
Copy link
Owner

The problem with the OP's submission is that the SD card YF8SD was not recognized. I've since added it to the database.

Thanks arekm for posting that fix for your language settings. I've actually added this into storage.sh. Thanks!

@theofficialgman
Copy link
Author

@TheRemote I have other new Samsung SD cards. Can you post the models you have in your database currently and I can give you the other numbers

@theofficialgman
Copy link
Author

@TheRemote the brand you put is incorrect
this (YF8SD) is a samsung pro ultimate card (specifically model MB-MY512SA/AM). not a samsung pro plus.
https://pibenchmarks.com/brand/Samsung_SD_Pro_Plus_%28YF8SD%29/

I have multiple pro plus's as well (the up to 160MB/s and up to 180MB/s variants)

brand info:
Samsung Pro Plus (up to 160MB/s, 128GB, MB-MD128KA/AM): FD4Q5
Samsung Pro Plus (up to 180MB/s, 128GB, MB-MD128SA/AM): FD4Q9
Samsung Pro Ultimate (up to 200MB/s, 512GB, MB-MY512SA): YF8SD

@theofficialgman
Copy link
Author

Also the various pro plus models should NOT be grouped together. they are different cards and are marketed as such.
the old grey/white card is nothing like the new blue/black cards

@TheRemote
Copy link
Owner

TheRemote commented Dec 2, 2023

Hey officialgman,

I can definitely fix the Samsung Pro Ultimate card. That is clearly a brand new one they are trying to differentiate (which is refreshing).

As far as the Pro Plus being marketed differently what do you mean by that? They're literally reusing their same brand name. They do this with all of their cards as well. A Samsung Evo Plus from 10 years ago is not the same as a Samsung Evo Plus today.

Isn't this true for just about every SD card? How about a SanDisk Ultra? That has been a SD card for 20+ years and range from everything from not even class 10 to application class A2.

Why do manufacturers do this? Reuse their same brand name for new / different products? It's definitely not to differentiate them. I think it's quite the opposite. They're trying to capitalize on that brand name with a different / newer product and that is their choice. If that's the brand they are marketed as then that's the brand they'll get grouped on for the site.

We have the same problem with storage adapters on the site. Some of the recommended USB to SATA adapters have existed for 10-15+ years and have had several different chipsets. I hate that the manufacturers reuse their own brands but they do and you're right that it makes my job very, very, very difficult to try to differentiate these products because the manufacturer is not trying to differentiate them. They're trying to capitalize on previous brand names they've built with a completely different product.

If it weren't for your report I would have had no idea about the new Samsung Pro Ultimate card. There are no lists of these models #s available anywhere. If you google that model # you gave me my site will be the #1 result (and a bunch of the other ones down the top 10).

I can definitely further differentiate the Pro Plus cards but it's hard without exact reports / information like this. I do differentiate them on some of the other cards though that have similar situations going on.

I can only get this information from you guys so thank you for reporting it! Most of this information is considered proprietary / trade secrets. They literally do not release these model #s publicly (intentionally). We just need to capture and identity them.

@theofficialgman
Copy link
Author

I have one more model number as well
Samsung Pro Plus (unknown max speed, this was a user report, 512GB): FF8S5

@theofficialgman
Copy link
Author

theofficialgman commented Dec 2, 2023

As far as the Pro Plus being marketed differently what do you mean by that? They're literally reusing their same brand name. They do this with all of their cards as well. A Samsung Evo Plus from 10 years ago is not the same as a Samsung Evo Plus today.

Isn't this true for just about every SD card? How about a SanDisk Ultra? That has been a SD card for 20+ years and range from everything from not even class 10 to application class A2.

I just want the results to be separate on your website depending on the actual model number. It seems you already do that so no concerns there.

BTW, why has my card disappeared from the fastest SD card list? It should be # 1

Also, something is wrong with the parsing of that lexar card. its an ssd and shows at the top of the SD card list
image

@theofficialgman
Copy link
Author

theofficialgman commented Dec 2, 2023

I can only get this information from you guys so thank you for reporting it! Most of this information is considered proprietary / trade secrets. They literally do not release these model #s publicly (intentionally). We just need to capture and identity them.

Maybe it would be good to just show "unknown" on the website whenever a card does not have a known "friendly" model name (eg: Samsung SD Unknown (YF8SD)). that way users when they see that for their card know that they need to report it. rather than the current situation which is to just to not display the card on the website at all.

@TheRemote
Copy link
Owner

There's a minimum of 3 results required to display on the top charts. You could just run the test on it two more times for it to show.

I'm investigating the best way to show unidentified results. I've been working on showing unidentified/unidentifiable storage adapters mostly first but I'll investigate the best way to show SD results as well!

@theofficialgman
Copy link
Author

I have one more model number as well Samsung Pro Plus (unknown max speed, this was a user report, 512GB): FF8S5

Got a response from the user. It's the up to 160MB/s model.

So it either looks like each storage capacity has its own unique model number or there are just multiple models numbers marketed with the up to 160MB/s branding.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants