Results for dgemm up. Ior source included in repo. More documentation…

… written.

doc/sphinx/10_microbenchmarks/M2_DAXPY/DAXPY.rst

@@ -23,12 +23,6 @@ Figure of Merit
 Building
 ========
 
-RHEL Systems
-------------
-
-CrayOS Systems
---------------
-
 Running
 =======
 

doc/sphinx/10_microbenchmarks/M3_DGEMM/DGEMM.rst

@@ -61,8 +61,9 @@ Set the number of OpenMP threads before running.
 
 .. code-block:: bash
 
-    export OPENBLAS_NUM_THREADS = <nthreads>
-    export OMP_NUM_THREADS = <nthreads>
+    export OPENBLAS_NUM_THREADS=<nthreads>
+    export OMP_NUM_THREADS=<nthreads>
+    export OMP_PLACES=cores
 
 ..
 
@@ -81,3 +82,18 @@ These are positional arguments, so, for instance, R cannot be set without settin
 Example Results
 ===============
 
+ATS-3 Rocinante HBM
+-------------------
+
+This test was built with the intel 2023.1.0 compiler using the crayOS compiler wrapper where: :math:`N=2500, R=500, \alpha=1.0, \beta=1.0`. The 110 core run (cores are used as OpenMP threads) avoids the OS dedicated cores and takes roughly an hour. All four runs on rocinante hbm take 5-6 hours.
+
+.. csv-table:: DGEMM microbenchmark FLOPs measurement
+   :file: dgemm_ats3.csv
+   :align: center
+   :widths: 10, 10
+   :header-rows: 1
+
+.. figure:: dgemm_ats3.png
+   :align: center
+   :scale: 50%
+   :alt: DGEMM microbenchmark FLOPs measurement

doc/sphinx/10_microbenchmarks/M3_DGEMM/cpu.gp

@@ -21,7 +21,10 @@ set key autotitle columnheader
 set style line 1 linetype 6 dashtype 1 linecolor rgb "#FF0000" linewidth 2 pointtype 6 pointsize 3
 set style line 2 linetype 1 dashtype 2 linecolor rgb "#FF0000" linewidth 2
 
-#plot "cpu_66M.csv" using 1:2 with linespoints linestyle 1, "" using 1:3 with line linestyle 2
+#plot "dgemm_cts1.csv" using 1:2 with linespoints linestyle 1, "" using 1:3 with line linestyle 2
 
+set output "dgemm_ats3.png"
+set xrange [4:128]
+plot "dgemm_ats3.csv" using 1:2 with linespoints linestyle 1
 
 

doc/sphinx/10_microbenchmarks/M3_DGEMM/dgemm_ats3.csv

@@ -0,0 +1,5 @@
+No. Cores,GFlops
+32,2176.5
+56,3460.0
+88,4949.1
+110,4850.5

doc/sphinx/10_microbenchmarks/M4_IOR/IOR.rst

@@ -5,13 +5,13 @@ IOR
 Purpose
 =======
 
-IOR is used for testing performance of parallel file systems using various interfaces and access patterns.
+IOR is used for testing performance of parallel file systems using various interfaces and access patterns at the POSIX and MPI-IO level.
 
 Characteristics
 ===============
 
 IOR is available:
-- Github: `IOR <https://github.com/hpc/ior>`_
+- Github: `IOR Public <https://github.com/hpc/ior>`_
 - LANL Crossroads Site: `IOR <https://www.lanl.gov/projects/crossroads/_assets/docs/micro/ior-3.0.1-xroads_v1.0.0.tgz>`_
 
 The github repo also contains mdtest.
@@ -22,14 +22,30 @@ Problem
 Figure of Merit
 ---------------
 
+Run Rules
+---------
+
+Modifications to the benchmark application code are only permissible to enable correct compilation and execution on the target platform. Any modifications must be fully documented (e.g., as a diff or patch file) and reported with the benchmark results.
+
 Building
 ========
 
-RHEL Systems
-------------
+MPI, MPI-IO, and OpenMP are required in order to build and run the code. The
+source code used for this benchmark is derived from IOR 3.0.1 and it is
+included here. 
+
+Ensure that the MPI compiler wrappers (e.g., `mpicc`) are in `$PATH`. Then create a build directory and an (optional) install directory.
+
+.. code-block:: bash
+
+    
+    ${BENCHMARK_PATH}/microbenchmarks/ior/configure --prefix=<INSTALL_DIR>
+    make
+    #make install
+..
 
-CrayOS Systems
---------------
+This will build both IOR with the POSIX and MPI-IO interfaces and create the
+IOR executable at `src/ior`.
 
 Running
 =======

doc/sphinx/10_microbenchmarks/M4_IOR/cpu.gp

@@ -1,10 +1,10 @@
 #!/usr/bin/gnuplot
 set terminal pngcairo enhanced size 1024, 768 dashed font 'Helvetica,18'
-set output "cpu_66M.png"
+set output "dgemm_cts1.png"
 
-set title "Branson Strong Scaling Performance on CTS-1, 66M particles" font "serif,22"
+set title " Single node Dgemm" font "serif,22"
 set xlabel "No. Processing Elements"
-set ylabel "Figure of Merit (particles/sec)"
+set ylabel "Figure of Merit (GFlops)"
 
 set xrange [1:64]
 set key left top
@@ -21,15 +21,10 @@ set key autotitle columnheader
 set style line 1 linetype 6 dashtype 1 linecolor rgb "#FF0000" linewidth 2 pointtype 6 pointsize 3
 set style line 2 linetype 1 dashtype 2 linecolor rgb "#FF0000" linewidth 2
 
-plot "cpu_66M.csv" using 1:2 with linespoints linestyle 1, "" using 1:3 with line linestyle 2
+#plot "dgemm_cts1.csv" using 1:2 with linespoints linestyle 1, "" using 1:3 with line linestyle 2
 
-set output "cpu_133M.png"
-set title "Branson Strong Scaling Performance on CTS-1, 133M particles" font "serif,22"
-plot "cpu_133M.csv" using 1:2 with linespoints linestyle 1, "" using 1:3 with line linestyle 2
-
-
-set output "cpu_200M.png"
-set title "Branson Strong Scaling Performance on CTS-1, 200M particles" font "serif,22"
-plot "cpu_200M.csv" using 1:2 with linespoints linestyle 1, "" using 1:3 with line linestyle 2
+set output "dgemm_ats3.png"
+set xrange [4:128]
+plot "dgemm_ats3.csv" using 1:2 with linespoints linestyle 1
 
 

doc/sphinx/10_microbenchmarks/M5_OSUMB/OSUMB.rst

@@ -16,6 +16,9 @@ Problem
 Figure of Merit
 ---------------
 
+Run Rules
+---------
+
 Building
 ========
 

doc/sphinx/10_microbenchmarks/M5_OSUMB/cpu.gp

@@ -1,10 +1,10 @@
 #!/usr/bin/gnuplot
 set terminal pngcairo enhanced size 1024, 768 dashed font 'Helvetica,18'
-set output "cpu_66M.png"
+set output "dgemm_cts1.png"
 
-set title "Branson Strong Scaling Performance on CTS-1, 66M particles" font "serif,22"
+set title " Single node Dgemm" font "serif,22"
 set xlabel "No. Processing Elements"
-set ylabel "Figure of Merit (particles/sec)"
+set ylabel "Figure of Merit (GFlops)"
 
 set xrange [1:64]
 set key left top
@@ -21,15 +21,10 @@ set key autotitle columnheader
 set style line 1 linetype 6 dashtype 1 linecolor rgb "#FF0000" linewidth 2 pointtype 6 pointsize 3
 set style line 2 linetype 1 dashtype 2 linecolor rgb "#FF0000" linewidth 2
 
-plot "cpu_66M.csv" using 1:2 with linespoints linestyle 1, "" using 1:3 with line linestyle 2
+#plot "dgemm_cts1.csv" using 1:2 with linespoints linestyle 1, "" using 1:3 with line linestyle 2
 
-set output "cpu_133M.png"
-set title "Branson Strong Scaling Performance on CTS-1, 133M particles" font "serif,22"
-plot "cpu_133M.csv" using 1:2 with linespoints linestyle 1, "" using 1:3 with line linestyle 2
-
-
-set output "cpu_200M.png"
-set title "Branson Strong Scaling Performance on CTS-1, 200M particles" font "serif,22"
-plot "cpu_200M.csv" using 1:2 with linespoints linestyle 1, "" using 1:3 with line linestyle 2
+set output "dgemm_ats3.png"
+set xrange [4:128]
+plot "dgemm_ats3.csv" using 1:2 with linespoints linestyle 1
 
 

doc/sphinx/10_microbenchmarks/M6_MDTEST/MDTEST.rst

@@ -15,6 +15,9 @@ Characteristics
 Problem
 -------
 
+Run Rules
+---------
+
 Figure of Merit
 ---------------
 

doc/sphinx/10_microbenchmarks/M6_MDTEST/cpu.gp

@@ -1,10 +1,10 @@
 #!/usr/bin/gnuplot
 set terminal pngcairo enhanced size 1024, 768 dashed font 'Helvetica,18'
-set output ""
+set output "dgemm_cts1.png"
 
-set title "Branson Strong Scaling Performance on CTS-1, 66M particles" font "serif,22"
+set title " Single node Dgemm" font "serif,22"
 set xlabel "No. Processing Elements"
-set ylabel "Figure of Merit (particles/sec)"
+set ylabel "Figure of Merit (GFlops)"
 
 set xrange [1:64]
 set key left top
@@ -21,6 +21,10 @@ set key autotitle columnheader
 set style line 1 linetype 6 dashtype 1 linecolor rgb "#FF0000" linewidth 2 pointtype 6 pointsize 3
 set style line 2 linetype 1 dashtype 2 linecolor rgb "#FF0000" linewidth 2
 
-plot "cpu_66M.csv" using 1:2 with linespoints linestyle 1, "" using 1:3 with line linestyle 2
+#plot "dgemm_cts1.csv" using 1:2 with linespoints linestyle 1, "" using 1:3 with line linestyle 2
+
+set output "dgemm_ats3.png"
+set xrange [4:128]
+plot "dgemm_ats3.csv" using 1:2 with linespoints linestyle 1