SPEC CPU®2017 Floating Point Rate Result

Supermicro

A+ Server 2024US-TRT
(H12DSU-iN , AMD EPYC 7F72)

SPECrate®2017_fp_base = 37900

SPECrate®2017_fp_peak = 38500

CPU2017 License:	001176	Test Date:	Aug-2020
Test Sponsor:	Supermicro	Hardware Availability:	Apr-2020
Tested by:	Supermicro	Software Availability:	Aug-2019

Benchmark result graphs are available in the PDF report.

Hardware
CPU Name:	AMD EPYC 7F72
Max MHz:	3700
Nominal:	3200
Enabled:	48 cores, 2 chips, 2 threads/core
Orderable:	1,2 chips
Cache L1:	32 KB I + 32 KB D on chip per core
L2:	512 KB I+D on chip per core
L3:	192 MB I+D on chip per chip, 16 MB shared / 2 cores
Other:	None
Memory:	512 GB (32 x 16 GB 2Rx8 PC4-3200AA-R)
Storage:	1 x 200 GB SATA III SSD
Other:	None

Software
OS:	Ubuntu 19.04 kernel 5.0.0-25-generic
Compiler:	C/C++/Fortran: Version 2.0.0 of AOCC
Parallel:	No
Firmware:	Version 1.0a released Jun-2020
File System:	ext4
System State:	Run level 3 (multi-user)
Base Pointers:	64-bit
Peak Pointers:	64-bit
Other:	jemalloc: jemalloc memory allocator library v5.2.0
Power Management:	BIOS set to prefer performance at the cost of additional power usage.

Results Table

Benchmark	Base							Peak
Benchmark	Copies	Seconds	Ratio	Seconds	Ratio	Seconds	Ratio	Copies	Seconds	Ratio	Seconds	Ratio	Seconds	Ratio
SPECrate®2017_fp_base			37900
SPECrate®2017_fp_peak			38500
Results appear in the order in which they were run. Bold underlined text indicates a median measurement.
503.bwaves_r	96	1527	630	1529	630	1528	630	96	1529	630	1527	630	1527	631
507.cactuBSSN_r	96	219	556	218	556	218	559	96	219	556	218	557	218	559
508.namd_r	96	324	282	325	281	324	281	96	324	282	325	281	324	281
510.parest_r	96	733	343	734	342	733	343	96	733	343	734	342	733	343
511.povray_r	96	542	414	546	410	543	413	96	537	417	534	420	537	417
519.lbm_r	96	631	160	632	160	633	160	96	631	160	630	161	630	161
521.wrf_r	96	519	414	515	418	514	418	96	519	414	515	418	514	418
526.blender_r	96	343	427	344	426	344	425	96	343	427	344	426	344	425
527.cam4_r	96	425	395	429	391	437	384	96	425	395	429	391	437	384
538.imagick_r	96	210	1140	211	1130	210	1140	96	210	1140	210	1140	212	1120
544.nab_r	96	312	517	313	516	313	516	96	312	518	312	517	312	518
549.fotonik3d_r	96	1711	219	1712	218	1712	218	48	855	219	853	219	852	220
554.roms_r	96	919	166	918	166	916	166	48	380	201	379	201	379	201

Compiler Notes

The AMD64 AOCC Compiler Suite is available at
http://developer.amd.com/amd-aocc/

Submit Notes

The config file option 'submit' was used.
'numactl' was used to bind copies to the cores.
See the configuration file for details.

Operating System Notes

'ulimit -s unlimited' was used to set environment stack size
'ulimit -l 2097152' was used to set environment locked pages in memory limit

runcpu command invoked through numactl i.e.:
numactl --interleave=all runcpu <etc>

Set dirty_ratio=8 to limit dirty cache to 8% of memory
Set swappiness=1 to swap only if necessary
Set zone_reclaim_mode=1 to free local node memory and avoid remote memory
sync then drop_caches=3 to reset caches before invoking runcpu

dirty_ratio, swappiness, zone_reclaim_mode and drop_caches were
all set using privileged echo (e.g. echo 1 > /proc/sys/vm/swappiness).

Transparent huge pages set to 'always' for this run (OS default)

Environment Variables Notes

Environment variables set by runcpu before the start of the run:
LD_LIBRARY_PATH =
     "/home/cpu2017/amd_rate_aocc200_rome_C_lib/64;/home/cpu2017/amd_rate_aoc
     c200_rome_C_lib/32:"
MALLOC_CONF = "retain:true"

General Notes

Binaries were compiled on a system with 2x AMD EPYC 7601 CPU + 512GB Memory using Fedora 26

NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown)
is mitigated in the system as tested and documented.
Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1)
is mitigated in the system as tested and documented.
Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2)
is mitigated in the system as tested and documented.

jemalloc: configured and built with GCC v9.1.0 in Ubuntu 19.04 with -O3 -znver2 -flto
jemalloc 5.2.0 is available here:
https://github.com/jemalloc/jemalloc/releases/download/5.2.0/jemalloc-5.2.0.tar.bz2

Platform Notes

BIOS Settings:
Determinism Control = Manual
Determinism Slider = Power
APBDIS = 1
NUMA Nodes Per Socket = NPS4

 Sysinfo program /home/cpu2017/bin/sysinfo
 Rev: r6365 of 2019-08-21 295195f888a3d7edb1e6e46a485a0011
 running on h12dsu Thu Aug  6 18:19:17 2020

 SUT (System Under Test) info as seen by some common utilities.
 For more information on this section, see
    https://www.spec.org/cpu2017/Docs/config.html#sysinfo

 From /proc/cpuinfo
    model name : AMD EPYC 7F72 24-Core Processor
       2  "physical id"s (chips)
       96 "processors"
    cores, siblings (Caution: counting these is hw and system dependent. The following
    excerpts from /proc/cpuinfo might not be reliable.  Use with caution.)
       cpu cores : 24
       siblings  : 48
       physical 0: cores 0 1 4 5 8 9 12 13 16 17 20 21 24 25 28 29 32 33 36 37 40 41 44 45
       physical 1: cores 0 1 4 5 8 9 12 13 16 17 20 21 24 25 28 29 32 33 36 37 40 41 44 45

 From lscpu:
      Architecture:        x86_64
      CPU op-mode(s):      32-bit, 64-bit
      Byte Order:          Little Endian
      Address sizes:       43 bits physical, 48 bits virtual
      CPU(s):              96
      On-line CPU(s) list: 0-95
      Thread(s) per core:  2
      Core(s) per socket:  24
      Socket(s):           2
      NUMA node(s):        4
      Vendor ID:           AuthenticAMD
      CPU family:          23
      Model:               49
      Model name:          AMD EPYC 7F72 24-Core Processor
      Stepping:            0
      CPU MHz:             1827.421
      CPU max MHz:         3200.0000
      CPU min MHz:         2500.0000
      BogoMIPS:            6399.49
      Virtualization:      AMD-V
      L1d cache:           32K
      L1i cache:           32K
      L2 cache:            512K
      L3 cache:            16384K
      NUMA node0 CPU(s):   0-11,48-59
      NUMA node1 CPU(s):   12-23,60-71
      NUMA node2 CPU(s):   24-35,72-83
      NUMA node3 CPU(s):   36-47,84-95
      Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov
      pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm
      constant_tsc rep_good nopl xtopology nonstop_tsc cpuid extd_apicid aperfmperf pni
      pclmulqdq monitor ssse3 fma cx16 sse4_1 sse4_2 movbe popcnt aes xsave avx f16c
      rdrand lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a misalignsse 3dnowprefetch
      osvw ibs skinit wdt tce topoext perfctr_core perfctr_nb bpext perfctr_llc mwaitx cpb
      cat_l3 cdp_l3 hw_pstate sme ssbd mba sev ibrs ibpb stibp vmmcall fsgsbase bmi1 avx2
      smep bmi2 cqm rdt_a rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1
      xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local clzero irperf xsaveerptr
      wbnoinvd arat npt lbrv svm_lock nrip_save tsc_scale vmcb_clean flushbyasid
      decodeassists pausefilter pfthreshold avic v_vmsave_vmload vgif umip rdpid
      overflow_recov succor smca

 /proc/cpuinfo cache data
    cache size : 512 KB

 From numactl --hardware  WARNING: a numactl 'node' might or might not correspond to a
 physical chip.
   available: 4 nodes (0-3)
   node 0 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 48 49 50 51 52 53 54 55 56 57 58 59
   node 0 size: 128892 MB
   node 0 free: 128223 MB
   node 1 cpus: 12 13 14 15 16 17 18 19 20 21 22 23 60 61 62 63 64 65 66 67 68 69 70 71
   node 1 size: 129004 MB
   node 1 free: 128489 MB
   node 2 cpus: 24 25 26 27 28 29 30 31 32 33 34 35 72 73 74 75 76 77 78 79 80 81 82 83
   node 2 size: 128992 MB
   node 2 free: 128450 MB
   node 3 cpus: 36 37 38 39 40 41 42 43 44 45 46 47 84 85 86 87 88 89 90 91 92 93 94 95
   node 3 size: 129016 MB
   node 3 free: 128503 MB
   node distances:
   node   0   1   2   3
     0:  10  12  32  32
     1:  12  10  32  32
     2:  32  32  10  12
     3:  32  32  12  10

 From /proc/meminfo
    MemTotal:       528288044 kB
    HugePages_Total:       0
    Hugepagesize:       2048 kB

 /usr/bin/lsb_release -d
    Ubuntu 19.04

 From /etc/*release* /etc/*version*
    debian_version: buster/sid
    os-release:
       NAME="Ubuntu"
       VERSION="19.04 (Disco Dingo)"
       ID=ubuntu
       ID_LIKE=debian
       PRETTY_NAME="Ubuntu 19.04"
       VERSION_ID="19.04"
       HOME_URL="https://www.ubuntu.com/"
       SUPPORT_URL="https://help.ubuntu.com/"

 uname -a:
    Linux h12dsu 5.0.0-25-generic #26-Ubuntu SMP Thu Aug 1 12:04:58 UTC 2019 x86_64 x86_64
    x86_64 GNU/Linux

 Kernel self-reported vulnerability status:

 CVE-2018-3620 (L1 Terminal Fault):        Not affected
 Microarchitectural Data Sampling:         Not affected
 CVE-2017-5754 (Meltdown):                 Not affected
 CVE-2018-3639 (Speculative Store Bypass): Mitigation: Speculative Store Bypass disabled
                                           via prctl and seccomp
 CVE-2017-5753 (Spectre variant 1):        Mitigation: usercopy/swapgs barriers and __user
                                           pointer sanitization
 CVE-2017-5715 (Spectre variant 2):        Mitigation: Full AMD retpoline, IBPB:
                                           conditional, IBRS_FW, STIBP: conditional, RSB
                                           filling

 run-level 3 Aug 6 11:39

 SPEC is set to: /home/cpu2017
    Filesystem     Type  Size  Used Avail Use% Mounted on
    /dev/sda2      ext4  183G   32G  142G  19% /

 From /sys/devices/virtual/dmi/id
     BIOS:    American Megatrends Inc. 1.0a 06/10/2020
     Vendor:  Supermicro
     Product: Super Server
     Serial:  0123456789

 Additional information from dmidecode follows.  WARNING: Use caution when you interpret
 this section. The 'dmidecode' program reads system data which is "intended to allow
 hardware to be accurately determined", but the intent may not be met, as there are
 frequent changes to hardware, firmware, and the "DMTF SMBIOS" standard.
   Memory:
     32x SK Hynix HMA82GR7DJR8N-XN 16 kB 2 rank 3200

 (End of data from sysinfo program)

Compiler Version Notes

==============================================================================
C               | 519.lbm_r(base, peak) 538.imagick_r(base, peak)
                | 544.nab_r(base, peak)
------------------------------------------------------------------------------
AOCC.LLVM.2.0.0.B191.2019_07_19 clang version 8.0.0 (CLANG: Jenkins
  AOCC_2_0_0-Build#191) (based on LLVM AOCC.LLVM.2.0.0.B191.2019_07_19)
Target: x86_64-unknown-linux-gnu
Thread model: posix
InstalledDir: /sppo/dev/compilers/aocc-compiler-2.0.0/bin
------------------------------------------------------------------------------

==============================================================================
C++             | 508.namd_r(base, peak) 510.parest_r(base, peak)
------------------------------------------------------------------------------
AOCC.LLVM.2.0.0.B191.2019_07_19 clang version 8.0.0 (CLANG: Jenkins
  AOCC_2_0_0-Build#191) (based on LLVM AOCC.LLVM.2.0.0.B191.2019_07_19)
Target: x86_64-unknown-linux-gnu
Thread model: posix
InstalledDir: /sppo/dev/compilers/aocc-compiler-2.0.0/bin
------------------------------------------------------------------------------

==============================================================================
C++, C          | 511.povray_r(base, peak) 526.blender_r(base, peak)
------------------------------------------------------------------------------
AOCC.LLVM.2.0.0.B191.2019_07_19 clang version 8.0.0 (CLANG: Jenkins
  AOCC_2_0_0-Build#191) (based on LLVM AOCC.LLVM.2.0.0.B191.2019_07_19)
Target: x86_64-unknown-linux-gnu
Thread model: posix
InstalledDir: /sppo/dev/compilers/aocc-compiler-2.0.0/bin
AOCC.LLVM.2.0.0.B191.2019_07_19 clang version 8.0.0 (CLANG: Jenkins
  AOCC_2_0_0-Build#191) (based on LLVM AOCC.LLVM.2.0.0.B191.2019_07_19)
Target: x86_64-unknown-linux-gnu
Thread model: posix
InstalledDir: /sppo/dev/compilers/aocc-compiler-2.0.0/bin
------------------------------------------------------------------------------

==============================================================================
C++, C, Fortran | 507.cactuBSSN_r(base, peak)
------------------------------------------------------------------------------
AOCC.LLVM.2.0.0.B191.2019_07_19 clang version 8.0.0 (CLANG: Jenkins
  AOCC_2_0_0-Build#191) (based on LLVM AOCC.LLVM.2.0.0.B191.2019_07_19)
Target: x86_64-unknown-linux-gnu
Thread model: posix
InstalledDir: /sppo/dev/compilers/aocc-compiler-2.0.0/bin
AOCC.LLVM.2.0.0.B191.2019_07_19 clang version 8.0.0 (CLANG: Jenkins
  AOCC_2_0_0-Build#191) (based on LLVM AOCC.LLVM.2.0.0.B191.2019_07_19)
Target: x86_64-unknown-linux-gnu
Thread model: posix
InstalledDir: /sppo/dev/compilers/aocc-compiler-2.0.0/bin
AOCC.LLVM.2.0.0.B191.2019_07_19 clang version 8.0.0 (CLANG: Jenkins
  AOCC_2_0_0-Build#191) (based on LLVM AOCC.LLVM.2.0.0.B191.2019_07_19)
Target: x86_64-unknown-linux-gnu
Thread model: posix
InstalledDir: /sppo/dev/compilers/aocc-compiler-2.0.0/bin
------------------------------------------------------------------------------

==============================================================================
Fortran         | 503.bwaves_r(base, peak) 549.fotonik3d_r(base, peak)
                | 554.roms_r(base, peak)
------------------------------------------------------------------------------
AOCC.LLVM.2.0.0.B191.2019_07_19 clang version 8.0.0 (CLANG: Jenkins
  AOCC_2_0_0-Build#191) (based on LLVM AOCC.LLVM.2.0.0.B191.2019_07_19)
Target: x86_64-unknown-linux-gnu
Thread model: posix
InstalledDir: /sppo/dev/compilers/aocc-compiler-2.0.0/bin
------------------------------------------------------------------------------

==============================================================================
Fortran, C      | 521.wrf_r(base, peak) 527.cam4_r(base, peak)
------------------------------------------------------------------------------
AOCC.LLVM.2.0.0.B191.2019_07_19 clang version 8.0.0 (CLANG: Jenkins
  AOCC_2_0_0-Build#191) (based on LLVM AOCC.LLVM.2.0.0.B191.2019_07_19)
Target: x86_64-unknown-linux-gnu
Thread model: posix
InstalledDir: /sppo/dev/compilers/aocc-compiler-2.0.0/bin
AOCC.LLVM.2.0.0.B191.2019_07_19 clang version 8.0.0 (CLANG: Jenkins
  AOCC_2_0_0-Build#191) (based on LLVM AOCC.LLVM.2.0.0.B191.2019_07_19)
Target: x86_64-unknown-linux-gnu
Thread model: posix
InstalledDir: /sppo/dev/compilers/aocc-compiler-2.0.0/bin
------------------------------------------------------------------------------

Base Compiler Invocation

C benchmarks:

clang

C++ benchmarks:

clang++

Fortran benchmarks:

flang

Benchmarks using both Fortran and C:

flang clang

Benchmarks using both C and C++:

clang++ clang

Benchmarks using Fortran, C, and C++:

clang++ clang flang

Base Portability Flags

503.bwaves_r:	-DSPEC_LP64
507.cactuBSSN_r:	-DSPEC_LP64
508.namd_r:	-DSPEC_LP64
510.parest_r:	-DSPEC_LP64
511.povray_r:	-DSPEC_LP64
519.lbm_r:	-DSPEC_LP64
521.wrf_r:	-DSPEC_CASE_FLAG -Mbyteswapio -DSPEC_LP64
526.blender_r:	-funsigned-char -D__BOOL_DEFINED -DSPEC_LP64
527.cam4_r:	-DSPEC_CASE_FLAG -DSPEC_LP64
538.imagick_r:	-DSPEC_LP64
544.nab_r:	-DSPEC_LP64
549.fotonik3d_r:	-DSPEC_LP64
554.roms_r:	-DSPEC_LP64

Base Optimization Flags

C benchmarks:

C++ benchmarks:

Fortran benchmarks:

-flto -Wl,-mllvm -Wl,-function-specialize -Wl,-mllvm -Wl,-region-vectorize -Wl,-mllvm -Wl,-vector-library=LIBMVEC -Wl,-mllvm -Wl,-reduce-array-computations=3 -O3 -march=znver2 -funroll-loops -Mrecursive -mllvm -vector-library=LIBMVEC -z muldefs -Kieee -fno-finite-math-only -lmvec -lamdlibm -ljemalloc -lflang

Benchmarks using both Fortran and C:

Benchmarks using both C and C++:

-std=c++98 -flto -Wl,-mllvm -Wl,-function-specialize -Wl,-mllvm -Wl,-region-vectorize -Wl,-mllvm -Wl,-vector-library=LIBMVEC -Wl,-mllvm -Wl,-reduce-array-computations=3 -Wl,-mllvm -Wl,-suppress-fmas -O3 -ffast-math -march=znver2 -fstruct-layout=3 -mllvm -unroll-threshold=50 -fremap-arrays -mllvm -function-specialize -mllvm -enable-gvn-hoist -mllvm -reduce-array-computations=3 -mllvm -global-vectorize-slp -mllvm -vector-library=LIBMVEC -mllvm -inline-threshold=1000 -flv-function-specialization -mllvm -loop-unswitch-threshold=200000 -mllvm -unroll-threshold=100 -mllvm -enable-partial-unswitch -z muldefs -lmvec -lamdlibm -ljemalloc -lflang

Benchmarks using Fortran, C, and C++:

Peak Compiler Invocation

C benchmarks:

clang

C++ benchmarks:

clang++

Fortran benchmarks:

flang

Benchmarks using both Fortran and C:

flang clang

Benchmarks using both C and C++:

clang++ clang

Benchmarks using Fortran, C, and C++:

clang++ clang flang

Peak Portability Flags

Same as Base Portability Flags

Peak Optimization Flags

C benchmarks:

C++ benchmarks:

508.namd_r:	basepeak = yes
510.parest_r:	basepeak = yes

Fortran benchmarks:

503.bwaves_r:	-flto -Wl,-mllvm -Wl,-function-specialize -Wl,-mllvm -Wl,-region-vectorize -Wl,-mllvm -Wl,-vector-library=LIBMVEC -Wl,-mllvm -Wl,-reduce-array-computations=3 -O3 -march=znver2 -funroll-loops -Mrecursive -mllvm -vector-library=LIBMVEC -Kieee -fno-finite-math-only -lmvec -lamdlibm -ljemalloc -lflang
549.fotonik3d_r:	Same as 503.bwaves_r
554.roms_r:	-flto -Wl,-mllvm -Wl,-function-specialize -Wl,-mllvm -Wl,-region-vectorize -Wl,-mllvm -Wl,-vector-library=LIBMVEC -Wl,-mllvm -Wl,-reduce-array-computations=3 -Wl,-mllvm -Wl,-enable-X86-prefetching -O3 -march=znver2 -funroll-loops -Mrecursive -mllvm -vector-library=LIBMVEC -Kieee -fno-finite-math-only -lmvec -lamdlibm -ljemalloc -lflang

Benchmarks using both Fortran and C:

521.wrf_r:	basepeak = yes
527.cam4_r:	basepeak = yes

Benchmarks using both C and C++:

511.povray_r:

-std=c++98 -flto -Wl,-mllvm -Wl,-function-specialize -Wl,-mllvm -Wl,-region-vectorize -Wl,-mllvm -Wl,-vector-library=LIBMVEC -Wl,-mllvm -Wl,-reduce-array-computations=3 -Wl,-mllvm -Wl,-x86-use-vzeroupper=false -Ofast -march=znver2 -mno-sse4a -fstruct-layout=5 -mllvm -vectorize-memory-aggressively -mllvm -function-specialize -mllvm -enable-gvn-hoist -mllvm -unroll-threshold=50 -fremap-arrays -mllvm -vector-library=LIBMVEC -mllvm -reduce-array-computations=3 -mllvm -global-vectorize-slp -mllvm -inline-threshold=1000 -flv-function-specialization -mllvm -unroll-threshold=100 -mllvm -enable-partial-unswitch -mllvm -loop-unswitch-threshold=200000 -lmvec -lamdlibm -ljemalloc -lflang

526.blender_r:

basepeak = yes

Benchmarks using Fortran, C, and C++:

-std=c++98 -flto -Wl,-mllvm -Wl,-function-specialize -Wl,-mllvm -Wl,-region-vectorize -Wl,-mllvm -Wl,-vector-library=LIBMVEC -Wl,-mllvm -Wl,-reduce-array-computations=3 -Ofast -march=znver2 -mno-sse4a -fstruct-layout=5 -mllvm -vectorize-memory-aggressively -mllvm -function-specialize -mllvm -enable-gvn-hoist -mllvm -unroll-threshold=50 -fremap-arrays -mllvm -vector-library=LIBMVEC -mllvm -reduce-array-computations=3 -mllvm -global-vectorize-slp -mllvm -inline-threshold=1000 -flv-function-specialization -mllvm -unroll-threshold=100 -mllvm -enable-partial-unswitch -mllvm -loop-unswitch-threshold=200000 -O3 -funroll-loops -Mrecursive -Kieee -fno-finite-math-only -lmvec -lamdlibm -ljemalloc -lflang

The flags files that were used to format this result can be browsed at
http://www.spec.org/cpu2017/flags/aocc200-flags-C4.html,
http://www.spec.org/cpu2017/flags/Supermicro-Platform-Settings-V1.2-Rome-revB.html.

You can also download the XML flags sources by saving the following links:
http://www.spec.org/cpu2017/flags/aocc200-flags-C4.xml,
http://www.spec.org/cpu2017/flags/Supermicro-Platform-Settings-V1.2-Rome-revB.xml.