SPEC CPU®2017 Floating Point Speed Result

Supermicro

GPU SuperServer SYS-741GE-TNRT
(X13DEG-QT , Intel Xeon Gold 6548Y+)

SPECspeed®2017_fp_base = 33800

SPECspeed®2017_fp_peak = 33800

CPU2017 License:	001176	Test Date:	Jan-2024
Test Sponsor:	Supermicro	Hardware Availability:	Dec-2023
Tested by:	Supermicro	Software Availability:	Dec-2023

Benchmark result graphs are available in the PDF report.

Hardware
CPU Name:	Intel Xeon Gold 6548Y+
Max MHz:	4100
Nominal:	2500
Enabled:	64 cores, 2 chips
Orderable:	2 chips
Cache L1:	32 KB I + 48 KB D on chip per core
L2:	2 MB I+D on chip per core
L3:	60 MB I+D on chip per chip
Other:	None
Memory:	1 TB (16 x 64 GB 2Rx4 PC5-5600B-R, running at 5200)
Storage:	1 x 512 GB M.2 NVMe SSD
Other:	None

Software
OS:	SUSE Linux Enterprise Server 15 SP5 Kernel 5.14.21-150500.53-default
Compiler:	C/C++: Version 2023.2.3 of Intel oneAPI DPC++/C++ Compiler for Linux; Fortran: Version 2023.2.3 of Intel Fortran Compiler for Linux;
Parallel:	Yes
Firmware:	Version 2.1 released Dec-2023
File System:	xfs
System State:	Run level 3 (multi-user)
Base Pointers:	64-bit
Peak Pointers:	64-bit
Other:	jemalloc memory allocator V5.0.1
Power Management:	BIOS and OS set to prefer performance at the cost of additional power usage.

Results Table

Benchmark	Base							Peak
Benchmark	Threads	Seconds	Ratio	Seconds	Ratio	Seconds	Ratio	Threads	Seconds	Ratio	Seconds	Ratio	Seconds	Ratio
SPECspeed®2017_fp_base			33800
SPECspeed®2017_fp_peak			33800
Results appear in the order in which they were run. Bold underlined text indicates a median measurement.
603.bwaves_s	64	52.3	11300	52.9	11100	52.3	11300	64	52.3	11300	52.9	11100	52.3	11300
607.cactuBSSN_s	64	37.1	4490	37.4	4460	37.6	4440	64	37.1	4490	37.4	4460	37.6	4440
619.lbm_s	64	21.4	2450	21.7	2410	22.1	2370	64	21.4	2450	21.7	2410	22.1	2370
621.wrf_s	64	56.3	2350	56.3	2350	56.2	2350	64	56.3	2350	56.3	2350	56.2	2350
627.cam4_s	64	43.4	2040	43.5	2040	43.4	2040	64	43.4	2040	43.5	2040	43.4	2040
628.pop2_s	64	1280	93.1	1270	93.6	1280	92.5	64	1280	93.1	1270	93.6	1280	92.5
638.imagick_s	64	20.5	7040	20.4	7080	20.5	7020	64	20.5	7040	20.4	7080	20.5	7020
644.nab_s	64	27.6	6330	27.7	6310	27.6	6330	64	27.6	6330	27.7	6310	27.6	6330
649.fotonik3d_s	64	53.1	1720	52.4	1740	52.5	1740	64	53.1	1720	52.4	1740	52.5	1740
654.roms_s	64	34.0	4630	33.9	4650	34.0	4620	64	34.0	4630	33.9	4650	34.0	4620

Operating System Notes

 Stack size set to unlimited using "ulimit -s unlimited"

Environment Variables Notes

Environment variables set by runcpu before the start of the run:
KMP_AFFINITY = "granularity=fine,compact"
LD_LIBRARY_PATH = "/home/cpu2017/lib/intel64:/home/cpu2017/je5.0.1-64"
MALLOC_CONF = "retain:true"
OMP_STACKSIZE = "192M"

General Notes

 Binaries compiled on a system with 2x Intel Xeon Platinum 8280M CPU + 384GB RAM
 memory using Redhat Enterprise Linux 8.0
 Transparent Huge Pages enabled by default
 Prior to runcpu invocation
 Filesystem page cache synced and cleared with:
 sync; echo 3>       /proc/sys/vm/drop_caches

 NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown)
 is mitigated in the system as tested and documented.
 Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1)
 is mitigated in the system as tested and documented.
 Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2)
 is mitigated in the system as tested and documented.
 jemalloc, a general purpose malloc implementation
 built with the RedHat Enterprise 7.5, and the system compiler gcc 4.8.5
 sources available from jemalloc.net or https://github.com/jemalloc/jemalloc/releases

Platform Notes

BIOS Settings:
Power Technology = Custom
Power Performance Tuning = BIOS Controls EPB
ENERGY_PERF_BIAS_CFG mode = Performance
DCU Streamer Prefetcher = Disable
Hyper-Threading [ALL] = Disable
LLC Dead Line Alloc = Disable
KTI Prefetch = Enable
Stale AtoS = Disable
Patrol Scrub = Disable

 Sysinfo program /home/cpu2017/bin/sysinfo
 Rev: r6732 of 2022-11-07 fe91c89b7ed5c36ae2c92cc097bec197
 running on 135-172-248 Wed Jan 10 14:55:48 2024

 SUT (System Under Test) info as seen by some common utilities.

 ------------------------------------------------------------
 Table of contents
 ------------------------------------------------------------
  1. uname -a
  2. w
  3. Username
  4. ulimit -a
  5. sysinfo process ancestry
  6. /proc/cpuinfo
  7. lscpu
  8. numactl --hardware
  9. /proc/meminfo
 10. who -r
 11. Systemd service manager version: systemd 249 (249.16+suse.171.gdad0071f15)
 12. Services, from systemctl list-unit-files
 13. Linux kernel boot-time arguments, from /proc/cmdline
 14. cpupower frequency-info
 15. sysctl
 16. /sys/kernel/mm/transparent_hugepage
 17. /sys/kernel/mm/transparent_hugepage/khugepaged
 18. OS release
 19. Disk information
 20. /sys/devices/virtual/dmi/id
 21. dmidecode
 22. BIOS
 ------------------------------------------------------------

 ------------------------------------------------------------
 1. uname -a
   Linux 135-172-248 5.14.21-150500.53-default #1 SMP PREEMPT_DYNAMIC Wed May 10 07:56:26 UTC 2023 (b630043)
   x86_64 x86_64 x86_64 GNU/Linux

 ------------------------------------------------------------
 2. w
    14:55:48 up  3:11,  1 user,  load average: 6.68, 5.96, 3.50
   USER     TTY      FROM             LOGIN@   IDLE   JCPU   PCPU WHAT
   root     tty1     -                11:46    3:09m  0.86s  0.01s -bash

 ------------------------------------------------------------
 3. Username
   From environment variable $USER:  root

 ------------------------------------------------------------
 4. ulimit -a
   core file size          (blocks, -c) unlimited
   data seg size           (kbytes, -d) unlimited
   scheduling priority             (-e) 0
   file size               (blocks, -f) unlimited
   pending signals                 (-i) 4126907
   max locked memory       (kbytes, -l) 64
   max memory size         (kbytes, -m) unlimited
   open files                      (-n) 1024
   pipe size            (512 bytes, -p) 8
   POSIX message queues     (bytes, -q) 819200
   real-time priority              (-r) 0
   stack size              (kbytes, -s) unlimited
   cpu time               (seconds, -t) unlimited
   max user processes              (-u) 4126907
   virtual memory          (kbytes, -v) unlimited
   file locks                      (-x) unlimited

 ------------------------------------------------------------
 5. sysinfo process ancestry
  /usr/lib/systemd/systemd --switched-root --system --deserialize 30
  login -- root
  -bash
  -bash
  runcpu --nobuild --action validate --define default-platform-flags -c
    ic2023.2.3-lin-core-avx512-speed-20231121.cfg --define cores=64 --tune base,peak -o all --define
    drop_caches fpspeed
  runcpu --nobuild --action validate --define default-platform-flags --configfile
    ic2023.2.3-lin-core-avx512-speed-20231121.cfg --define cores=64 --tune base,peak --output_format all
    --define drop_caches --nopower --runmode speed --tune base:peak --size refspeed fpspeed --nopreenv
    --note-preenv --logfile $SPEC/tmp/CPU2017.004/templogs/preenv.fpspeed.004.0.log --lognum 004.0
    --from_runcpu 2
  specperl $SPEC/bin/sysinfo
 $SPEC = /home/cpu2017

 ------------------------------------------------------------
 6. /proc/cpuinfo
     model name      : INTEL(R) XEON(R) GOLD 6548Y+
     vendor_id       : GenuineIntel
     cpu family      : 6
     model           : 207
     stepping        : 2
     microcode       : 0x21000200
     bugs            : spectre_v1 spectre_v2 spec_store_bypass swapgs eibrs_pbrsb
     cpu cores       : 32
     siblings        : 32
     2 physical ids (chips)
     64 processors (hardware threads)
     physical id 0: core ids 0-31
     physical id 1: core ids 0-31
     physical id 0: apicids
     0,2,4,6,8,10,12,14,16,18,20,22,24,26,28,30,32,34,36,38,40,42,44,46,48,50,52,54,56,58,60,62
     physical id 1: apicids
     128,130,132,134,136,138,140,142,144,146,148,150,152,154,156,158,160,162,164,166,168,170,172,174,176,178,1
     80,182,184,186,188,190
   Caution: /proc/cpuinfo data regarding chips, cores, and threads is not necessarily reliable, especially for
   virtualized systems.  Use the above data carefully.

 ------------------------------------------------------------
 7. lscpu

 From lscpu from util-linux 2.37.4:
   Architecture:                    x86_64
   CPU op-mode(s):                  32-bit, 64-bit
   Address sizes:                   46 bits physical, 57 bits virtual
   Byte Order:                      Little Endian
   CPU(s):                          64
   On-line CPU(s) list:             0-63
   Vendor ID:                       GenuineIntel
   Model name:                      INTEL(R) XEON(R) GOLD 6548Y+
   CPU family:                      6
   Model:                           207
   Thread(s) per core:              1
   Core(s) per socket:              32
   Socket(s):                       2
   Stepping:                        2
   Frequency boost:                 enabled
   CPU max MHz:                     2501.0000
   CPU min MHz:                     800.0000
   BogoMIPS:                        5000.00
   Flags:                           fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36
                                    clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp
                                    lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology
                                    nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor
                                    ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1
                                    sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand
                                    lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cat_l2 cdp_l3
                                    invpcid_single cdp_l2 ssbd mba ibrs ibpb stibp ibrs_enhanced tpr_shadow
                                    vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep
                                    bmi2 erms invpcid rtm cqm rdt_a avx512f avx512dq rdseed adx smap
                                    avx512ifma clflushopt clwb intel_pt avx512cd sha_ni avx512bw avx512vl
                                    xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total
                                    cqm_mbm_local avx_vnni avx512_bf16 wbnoinvd dtherm ida arat pln pts hfi
                                    avx512vbmi umip pku ospke waitpkg avx512_vbmi2 gfni vaes vpclmulqdq
                                    avx512_vnni avx512_bitalg tme avx512_vpopcntdq la57 rdpid bus_lock_detect
                                    cldemote movdiri movdir64b enqcmd fsrm md_clear serialize tsxldtrk pconfig
                                    arch_lbr avx512_fp16 amx_tile flush_l1d arch_capabilities
   Virtualization:                  VT-x
   L1d cache:                       3 MiB (64 instances)
   L1i cache:                       2 MiB (64 instances)
   L2 cache:                        128 MiB (64 instances)
   L3 cache:                        120 MiB (2 instances)
   NUMA node(s):                    2
   NUMA node0 CPU(s):               0-31
   NUMA node1 CPU(s):               32-63
   Vulnerability Itlb multihit:     Not affected
   Vulnerability L1tf:              Not affected
   Vulnerability Mds:               Not affected
   Vulnerability Meltdown:          Not affected
   Vulnerability Mmio stale data:   Not affected
   Vulnerability Retbleed:          Not affected
   Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl and seccomp
   Vulnerability Spectre v1:        Mitigation; usercopy/swapgs barriers and __user pointer sanitization
   Vulnerability Spectre v2:        Mitigation; Enhanced IBRS, IBPB conditional, RSB filling, PBRSB-eIBRS SW
                                    sequence
   Vulnerability Srbds:             Not affected
   Vulnerability Tsx async abort:   Not affected

 From lscpu --cache:
      NAME ONE-SIZE ALL-SIZE WAYS TYPE        LEVEL  SETS PHY-LINE COHERENCY-SIZE
      L1d       48K       3M   12 Data            1    64        1             64
      L1i       32K       2M    8 Instruction     1    64        1             64
      L2         2M     128M   16 Unified         2  2048        1             64
      L3        60M     120M   15 Unified         3 65536        1             64

 ------------------------------------------------------------
 8. numactl --hardware
 NOTE: a numactl 'node' might or might not correspond to a physical chip.
   available: 2 nodes (0-1)
   node 0 cpus: 0-31
   node 0 size: 515690 MB
   node 0 free: 514545 MB
   node 1 cpus: 32-63
   node 1 size: 516066 MB
   node 1 free: 508473 MB
   node distances:
   node   0   1
     0:  10  21
     1:  21  10

 ------------------------------------------------------------
 9. /proc/meminfo
    MemTotal:       1056519908 kB

 ------------------------------------------------------------
 10. who -r
   run-level 3 Jan 10 11:45

 ------------------------------------------------------------
 11. Systemd service manager version: systemd 249 (249.16+suse.171.gdad0071f15)
   Default Target  Status
   multi-user      running

 ------------------------------------------------------------
 12. Services, from systemctl list-unit-files
   STATE            UNIT FILES
   enabled          YaST2-Firstboot YaST2-Second-Stage apparmor auditd cron display-manager getty@ irqbalance
                    issue-generator kbdsettings klog lvm2-monitor nscd nvmefc-boot-connections postfix
                    purge-kernels rollback rsyslog smartd sshd systemd-pstore wicked wickedd-auto4
                    wickedd-dhcp4 wickedd-dhcp6 wickedd-nanny
   enabled-runtime  systemd-remount-fs
   disabled         autofs autoyast-initscripts blk-availability boot-sysctl ca-certificates chrony-wait
                    chronyd console-getty cups cups-browsed debug-shell ebtables exchange-bmc-os-info
                    firewalld gpm grub2-once haveged haveged-switch-root ipmi ipmievd issue-add-ssh-keys
                    kexec-load lunmask man-db-create multipathd nfs nfs-blkmap nvmf-autoconnect rpcbind
                    rpmconfigcheck rsyncd serial-getty@ smartd_generate_opts snmpd snmptrapd
                    systemd-boot-check-no-failures systemd-network-generator systemd-sysext
                    systemd-time-wait-sync systemd-timesyncd udisks2 vncserver@
   indirect         wickedd

 ------------------------------------------------------------
 13. Linux kernel boot-time arguments, from /proc/cmdline
   BOOT_IMAGE=/boot/vmlinuz-5.14.21-150500.53-default
   root=UUID=9de9855c-b179-4e5b-8330-3742dedc18b2
   splash=silent
   mitigations=auto
   quiet
   security=apparmor

 ------------------------------------------------------------
 14. cpupower frequency-info
   analyzing CPU 0:
     current policy: frequency should be within 800 MHz and 2.50 GHz.
                     The governor "ondemand" may decide which speed to use
                     within this range.
     boost state support:
       Supported: yes
       Active: yes

 ------------------------------------------------------------
 15. sysctl
   kernel.numa_balancing               1
   kernel.randomize_va_space           2
   vm.compaction_proactiveness        20
   vm.dirty_background_bytes           0
   vm.dirty_background_ratio          10
   vm.dirty_bytes                      0
   vm.dirty_expire_centisecs        3000
   vm.dirty_ratio                     20
   vm.dirty_writeback_centisecs      500
   vm.dirtytime_expire_seconds     43200
   vm.extfrag_threshold              500
   vm.min_unmapped_ratio               1
   vm.nr_hugepages                     0
   vm.nr_hugepages_mempolicy           0
   vm.nr_overcommit_hugepages          0
   vm.swappiness                      60
   vm.watermark_boost_factor       15000
   vm.watermark_scale_factor          10
   vm.zone_reclaim_mode                0

 ------------------------------------------------------------
 16. /sys/kernel/mm/transparent_hugepage
   defrag          always defer defer+madvise [madvise] never
   enabled         [always] madvise never
   hpage_pmd_size  2097152
   shmem_enabled   always within_size advise [never] deny force

 ------------------------------------------------------------
 17. /sys/kernel/mm/transparent_hugepage/khugepaged
   alloc_sleep_millisecs   60000
   defrag                      1
   max_ptes_none             511
   max_ptes_shared           256
   max_ptes_swap              64
   pages_to_scan            4096
   scan_sleep_millisecs    10000

 ------------------------------------------------------------
 18. OS release
   From /etc/*-release /etc/*-version
   os-release SUSE Linux Enterprise Server 15 SP5

 ------------------------------------------------------------
 19. Disk information
 SPEC is set to: /home/cpu2017
   Filesystem     Type  Size  Used Avail Use% Mounted on
   /dev/nvme0n1p2 xfs   475G  103G  372G  22% /

 ------------------------------------------------------------
 20. /sys/devices/virtual/dmi/id
     Vendor:         Supermicro
     Product:        X13DEG-QT
     Product Family: Family
     Serial:         1234567890

 ------------------------------------------------------------
 21. dmidecode
   Additional information from dmidecode 3.4 follows.  WARNING: Use caution when you interpret this section.
   The 'dmidecode' program reads system data which is "intended to allow hardware to be accurately
   determined", but the intent may not be met, as there are frequent changes to hardware, firmware, and the
   "DMTF SMBIOS" standard.
   Memory:
     14x SK Hynix HMCG94AGBRA181N 64 GB 2 rank 5600, configured at 5200
     2x SK Hynix HMCG94AGBRA184N 64 GB 2 rank 5600, configured at 5200


 ------------------------------------------------------------
 22. BIOS
 (This section combines info from /sys/devices and dmidecode.)
    BIOS Vendor:       American Megatrends International, LLC.
    BIOS Version:      2.1
    BIOS Date:         12/12/2023
    BIOS Revision:     5.32

Compiler Version Notes

============================================================================================================
C               | 619.lbm_s(base, peak) 638.imagick_s(base, peak) 644.nab_s(base, peak)
------------------------------------------------------------------------------------------------------------
Intel(R) oneAPI DPC++/C++ Compiler for applications running on Intel(R) 64, Version 2023.2.3 Build x
Copyright (C) 1985-2023 Intel Corporation. All rights reserved.
------------------------------------------------------------------------------------------------------------

============================================================================================================
C++, C, Fortran | 607.cactuBSSN_s(base, peak)
------------------------------------------------------------------------------------------------------------
Intel(R) oneAPI DPC++/C++ Compiler for applications running on Intel(R) 64, Version 2023.2.3 Build x
Copyright (C) 1985-2023 Intel Corporation. All rights reserved.
Intel(R) oneAPI DPC++/C++ Compiler for applications running on Intel(R) 64, Version 2023.2.3 Build x
Copyright (C) 1985-2023 Intel Corporation. All rights reserved.
Intel(R) Fortran Compiler for applications running on Intel(R) 64, Version 2023.2.3 Build x
Copyright (C) 1985-2023 Intel Corporation. All rights reserved.
------------------------------------------------------------------------------------------------------------

============================================================================================================
Fortran         | 603.bwaves_s(base, peak) 649.fotonik3d_s(base, peak) 654.roms_s(base, peak)
------------------------------------------------------------------------------------------------------------
Intel(R) Fortran Compiler for applications running on Intel(R) 64, Version 2023.2.3 Build x
Copyright (C) 1985-2023 Intel Corporation. All rights reserved.
------------------------------------------------------------------------------------------------------------

============================================================================================================
Fortran, C      | 621.wrf_s(base, peak) 627.cam4_s(base, peak) 628.pop2_s(base, peak)
------------------------------------------------------------------------------------------------------------
Intel(R) Fortran Compiler for applications running on Intel(R) 64, Version 2023.2.3 Build x
Copyright (C) 1985-2023 Intel Corporation. All rights reserved.
Intel(R) oneAPI DPC++/C++ Compiler for applications running on Intel(R) 64, Version 2023.2.3 Build x
Copyright (C) 1985-2023 Intel Corporation. All rights reserved.
------------------------------------------------------------------------------------------------------------

Base Compiler Invocation

C benchmarks:

icx

Fortran benchmarks:

ifx

Benchmarks using both Fortran and C:

ifx icx

Benchmarks using Fortran, C, and C++:

icpx icx ifx

Base Portability Flags

603.bwaves_s:	-DSPEC_LP64
607.cactuBSSN_s:	-DSPEC_LP64
619.lbm_s:	-DSPEC_LP64
621.wrf_s:	-DSPEC_LP64 -DSPEC_CASE_FLAG -convert big_endian
627.cam4_s:	-DSPEC_LP64 -DSPEC_CASE_FLAG
628.pop2_s:	-DSPEC_LP64 -DSPEC_CASE_FLAG -convert big_endian -assume byterecl
638.imagick_s:	-DSPEC_LP64
644.nab_s:	-DSPEC_LP64
649.fotonik3d_s:	-DSPEC_LP64
654.roms_s:	-DSPEC_LP64