Supermicro AI Training SuperServer SYS-822GA-NGR3 921188 SPECjbb2015-MultiJVM max-jOPS
813582 SPECjbb2015-MultiJVM critical-jOPS
Tested by: Supermicro Test Sponsor: Supermicro Test location: Taipei, Taiwan Test date: Dec 10, 2024
SPEC license #: 001176 Hardware Availability: Dec-2024 Software Availability: Nov-2024 Publication: Thu Jan 9 11:14:55 EST 2025
Benchmark Results Summary
 
Overall Throughput RT curve
Overall SUT (System Under Test) Description
VendorSupermicro
Vendor URLhttps://www.supermicro.com
System SourceSingle Supplier
System DesignationServer Rack
Total Systems1
All SUT Systems IdenticalYES
Total Nodes1
All Nodes IdenticalYES
Nodes Per System1
Total Chips2
Total Cores256
Total Threads512
Total Memory Amount (GB)1536
Total OS Images1
SW EnvironmentNon-virtual
 
Hardware hw_1
NameAI Training SuperServer SYS-822GA-NGR3
VendorSupermicro
Vendor URLhttps://www.supermicro.com
AvailableDec-2024
ModelX14DBG-GD
Form Factor8U
CPU NameIntel Xeon 6980P
CPU Characteristics128 Core, 2.00 GHz, 504 MB L3 Cache (Turbo Boost Technology up to 3.90 GHz)
Number of Systems1
Nodes Per System1
Chips Per System2
Cores Per System256
Cores Per Chip128
Threads Per System512
Threads Per Core2
Version1.0a (11/05/2024)
CPU Frequency (MHz)2000
Primary Cache64 KB(I) + 48 KB(D) per core
Secondary Cache2 MB (I+D) per core
Tertiary Cache504 MB (I+D) on chip per chip
Other CacheNone
Disk1 x 480 GB M.2 NVMe SSD
File Systemxfs
Memory Amount (GB)1536
# and size of DIMM(s)24 x 64 GB
Memory Details64 GB 2Rx4 PC5-8800B-R
# and type of Network Interface Cards (NICs)2 x 10Gbit NICs
Power Supply Quantity and Rating (W)4 x PWS-3K02G-2R
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_1
NameSUSE Linux Enterprise Server 15 SP6
VendorSUSE
Vendor URLhttps://www.suse.com/
Version6.4.0-150600.21-default
AvailableJun-2024
Bitness64
NotesNone
Java Virtual Machine jvm_1
NameOracle Java SE 23.0.1
VendorOracle
Vendor URLhttp://www.oracle.com/
VersionJava HotSpot 64-bit Server VM, version 23.0.1
AvailableOct-2024
Bitness64
NotesNone
Other Software other_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware
OS Images os_Image_1(1)
Hardware Description hw_1
Number of Systems 1
SW Environment non-virtual
Tuning

BIOS Settings:

  • Workload Profile=HPC

Notes None
OS Image os_Image_1
JVM Instances jvm_Ctr_1(1), jvm_Backend_1(6), jvm_TxInjector_1(6)
OS Image Description os_1
Tuning

  • tuned-adm profile throughput-performance
  • systemctl stop systemd-update-utmp-runlevel.service
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
  • echo 56000000 > /sys/kernel/debug/sched/latency_ns
  • echo 180000 > /sys/kernel/debug/sched/min_granularity_ns
  • echo 750 > /sys/kernel/debug/sched/migration_cost_ns
  • echo 1000000 > /sys/kernel/debug/sched/wakeup_granularity_ns
  • echo 12 > /sys/kernel/debug/sched/nr_migrate
  • ulimit -v 800000000
  • ulimit -m 800000000
  • ulimit -l 800000000
  • ulimit -n 1024000

Notes None
JVM Instance jvm_Ctr_1
Parts of Benchmark Controller
JVM Instance Description jvm_1
Command Line

-server -Xms2g -Xmx2g -Xmn1536m -XX:+UseLargePages -XX:LargePageSizeInBytes=1G -XX:+UseParallelGC -XX:ParallelGCThreads=2

Tuning

Used numactl to interleave memory on all CPUs

  • numactl --interleave=all

Notes None
JVM Instance jvm_Backend_1
Parts of Benchmark Backend
JVM Instance Description jvm_1
Command Line

-server -Xms235G -Xmx235G -Xmn232G -XX:+UseLargePages -XX:LargePageSizeInBytes=2m -XX:+UseParallelGC -XX:ParallelGCThreads=85 -XX:+AlwaysPreTouch -XX:-UseAdaptiveSizePolicy -XX:MaxTenuringThreshold=15 -XX:TargetSurvivorRatio=95 -XX:-UsePerfData -Xnoclassgc -XX:SurvivorRatio=64 -XX:InitialCodeCacheSize=25m -XX:InlineSmallCode=10k

Tuning

Used numactl to affinitize one Backend JVM to one NUMA node

    • Group1: numactl --cpunodebind=0 --localalloc
    • Group2:numactl --cpunodebind=1 --localalloc
    • Group3:numactl --cpunodebind=2 --localalloc
    • Group4: numactl --cpunodebind=3 --localalloc
    • Group5:numactl --cpunodebind=4 --localalloc
    • Group6:numactl --cpunodebind=5 --localalloc

Notes None
JVM Instance jvm_TxInjector_1
Parts of Benchmark TxInjector
JVM Instance Description jvm_1
Command Line

-server -Xms2g -Xmx2g -Xmn1536m -XX:+UseLargePages -XX:LargePageSizeInBytes=1G -XX:+UseParallelGC -XX:ParallelGCThreads=2

Tuning

Used numactl to affinitize one Backend JVM to one NUMA node

    • Group1: numactl --cpunodebind=0 --localalloc
    • Group2:numactl --cpunodebind=1 --localalloc
    • Group3:numactl --cpunodebind=2 --localalloc
    • Group4: numactl --cpunodebind=3 --localalloc
    • Group5:numactl --cpunodebind=4 --localalloc
    • Group6:numactl --cpunodebind=5 --localalloc

Notes None
max-jOPS = jOPS passed before the First Failure
Pass/Fail Pass Pass Fail Fail Fail
jOPS 910600 921188 931777 942365 952953
critical-jOPS = Geomean ( jOPS @ 10000; 25000; 50000; 75000; 100000; SLAs )
Response time percentile is 99-th
SLA (us) 10000 25000 50000 75000 100000 Geomean
jOPS 696185 778245 841775 873540 894717 813582
  Percentile
  10-th 50-th 90-th 95-th 99-th 100-th
500us 10588 / 21177 - / 10588 - / 10588 - / 10588 - / 10588 - / 10588
1000us 921188 / - 21177 / 31765 10588 / 21177 10588 / 21177 - / 10588 - / 10588
5000us 921188 / - 921188 / - 889423 / 900011 836481 / 804716 508242 / 455300 63530 / 31765
10000us 921188 / - 921188 / - 921188 / - 878835 / 889423 720009 / 688244 63530 / 31765
25000us 921188 / - 921188 / - 921188 / - 910600 / 921188 772951 / 783539 63530 / 31765
50000us 921188 / - 921188 / - 921188 / - 921188 / - 836481 / 847070 243533 / 52942
75000us 921188 / - 921188 / - 921188 / - 921188 / - 868246 / 878835 508242 / 95295
100000us 921188 / - 921188 / - 921188 / - 921188 / - 889423 / 900011 614125 / 582360
200000us 921188 / - 921188 / - 921188 / - 921188 / - 921188 / - 815304 / 741186
500000us 921188 / - 921188 / - 921188 / - 921188 / - 921188 / - 921188 / 900011
1000000us 921188 / - 921188 / - 921188 / - 921188 / - 921188 / - 921188 / -
Probes jOPS / Total jOPS
Request Mix Accuracy
Note
(Actual % in the Mix - Expected % in the Mix) must be within:
'Main Tx' limit of +/-5.0% for the requests whose expected % in the mix is >= 10.0%
'Minor Tx' limit of +/-1.0% for the requests whose expected % in the mix is < 10.0%
There were no non-critical failures in Response Time curve building
Delay between status pings
IR/PR Accuracy
This section lists properties only set by user
Property Name Default Controller
specjbb.comm.connect.client.pool.size 256 232
specjbb.comm.connect.selector.runner.count 0 21
specjbb.comm.connect.timeouts.connect 60000 600000
specjbb.comm.connect.timeouts.read 60000 600000
specjbb.comm.connect.timeouts.write 60000 600000
specjbb.comm.connect.worker.pool.max 256 512
specjbb.comm.connect.worker.pool.min 1 1
specjbb.controller.host localhost localhost
specjbb.controller.port 24000 24000
specjbb.controller.type HBIR_RT HBIR_RT
specjbb.customerDriver.threads 64 {=75, probe=69, saturate=85}
specjbb.forkjoin.workers 512 {Tier1=165, Tier2=1, Tier3=11}
specjbb.group.count 1 6
specjbb.mapreducer.pool.size 512 85
specjbb.txi.pergroup.count 1 1
View table in csv format
 
Level: COMPLIANCE
Check Agent Result
Check properties on compliance All PASSED
 
Level: CORRECTNESS
Check Agent Result
Compare SM and HQ Inventory All PASSED
High-bound (max attempted) is 1058837 IR
High-bound (settled) is 1024890 IR