SPECvirt_sc2013 Result: Huawei Technologies Co., Ltd

SPECvirt_sc2013 Result
Copyright © 2010-2015 Standard Performance Evaluation Corporation

Huawei Technologies Co., Ltd: Huawei FusionServer RH2288H V3 (Intel Xeon E5-2699 v3)
Huawei Technologies Co., Ltd.: Huawei FusionSphere V1R5C10

SPECvirt_sc2013 1616 @ 95 VMs

Tested By:

Huawei Technologies Co., Ltd.

SPEC License #:

3175

Test Date:

Jun-2015

Performance Section
Performance Summary
Performance Details
Validation Errors

SUT Configuration Section
Physical Configuration
Virtual Configuration

Power Section

N/A

Notes Section
Physical System Notes
Virtualization SW Notes
Hosted VM Notes

Performance Summary:

Performance
Tile #	Pct Load	Application Server	Web Server	Mail Server	Batch Server	Per-Tile Score	Overall Score
1	100%	165.74	177.79	127.11	PASSED	94.13	1616
2	100%	166.65	177.91	127.41	PASSED	94.40
3	100%	163.87	177.82	127.05	PASSED	93.76
4	100%	164.44	177.99	127.46	PASSED	94.00
5	100%	165.47	177.85	127.41	PASSED	94.16
6	100%	166.23	177.65	127.37	PASSED	94.26
7	100%	165.95	177.94	127.41	PASSED	94.27
8	100%	164.30	177.55	127.37	PASSED	93.87
9	100%	164.96	177.86	126.91	PASSED	93.95
10	100%	162.36	177.77	127.29	PASSED	93.52
11	100%	162.69	178.24	127.68	PASSED	93.76
12	100%	164.88	177.95	127.62	PASSED	94.11
13	100%	165.71	177.96	127.40	PASSED	94.22
14	100%	163.53	178.06	127.52	PASSED	93.85
15	100%	163.79	177.75	127.38	PASSED	93.81
16	100%	163.30	177.88	127.53	PASSED	93.78
17	100%	165.13	177.94	127.56	PASSED	94.15
18	20%	33.39	35.65	25.71	PASSED	18.96

Quality Of Service (QOS)
Tile #	Pct Load	Application Server	Web Server	Mail Server	Batch Server	Per-Tile Score	Overall Score
1	100%	0.98	1.00	1.00	1.00	1.00	99.26%
2	100%	0.99	1.00	1.00	1.00	1.00
3	100%	0.98	1.00	1.00	1.00	1.00
4	100%	0.96	1.00	1.00	1.00	0.99
5	100%	0.97	1.00	1.00	1.00	0.99
6	100%	0.99	1.00	1.00	1.00	1.00
7	100%	0.99	1.00	1.00	1.00	1.00
8	100%	0.96	1.00	1.00	1.00	0.99
9	100%	0.97	1.00	1.00	1.00	0.99
10	100%	0.95	1.00	1.00	1.00	0.99
11	100%	0.96	1.00	1.00	1.00	0.99
12	100%	0.97	1.00	1.00	1.00	0.99
13	100%	0.98	1.00	1.00	1.00	1.00
14	100%	0.96	1.00	1.00	1.00	0.99
15	100%	0.95	1.00	1.00	1.00	0.99
16	100%	0.97	1.00	1.00	1.00	0.99
17	100%	0.96	1.00	1.00	1.00	0.99
18	20%	1.00	1.00	1.00	1.00	1.00

Validation Errors:

No Validation Errors Found

Physical Configuration:

System Under Test (SUT)
Virt. Vendor/Product	Huawei Technologies Co., Ltd. Huawei FusionSphere V1R5C10
# of SUTs	1
Server Vendor	Huawei Technologies Co., Ltd
Server Model	Huawei FusionServer RH2288H V3 (Intel Xeon E5-2699 v3)
Processor	Intel Xeon E5-2699 v3
Processor Speed (MHz)	2300
Processor Cores	36 cores, 2 chips, 18 cores/chip, 2 threads/core
Primary Cache	32 KB I + 32 KB D on chip per core
Secondary Cache	256 KB I+D on chip per core
Other Cache	45 MB I+D on chip per chip
Memory	512 GB (16 x 32GB 4DRX4 PC4-2133P-LD0-10-DC0)
Operating System	Huawei FusionSphere V1R5C10
File System	ext4
Other Hardware	1 x Huawei Quidway S9303 fibre channel switch
Other Software	N/A

SUT Storage
Storage Controllers	2 x Dual port QLogic Corp ISP2532-based 8Gbps Fibre Channel HBA
Storage Enclosure	1 x Huawei Local Disk 2 x Huawei Dorado5100
Disk Description	2 x 300GB 6Gb SCSI 15KRPM 8 x 24 x 200GB SSD
RAID Level	RAID 1 RAID 10
UPS Required?	No

SUT Network
Network Adapters	2 x Intel Corporation X540 10-Gigabit Network Connection 4 x Intel Corporation 82599EB 10-Gigabit Network Connection 1 x Intel Corporation 82576 Gigabit Network Connection
SUT Ports Total	4 8 2
SUT Ports Used	4 8 1
Network Type	10GBASE-2T 10GBASE-SR 1000BASE-T
Network Speed	10 Gb/s 10 Gb/s 1 Gb/s

Clients
Model	Huawei FusionServer RH5885 v2 Huawei FusionServer RH5885 v2
# of Clients	1 1
Processor	Intel(R) Xeon(R) CPU E7- 8860 Intel(R) Xeon(R) CPU E7- 8867
Processor Speed (MHz)	2266 2133
# Processors	4 4
Memory	512 GB SDRAM 512 GB SDRAM
Network Controller	2 x Intel Corporation 82599EB 10-Gigabit Network Connection (rev 01) 2 x Intel Corporation 82599EB 10-Gigabit Network Connection (rev 01)
Operating System	Physical Client:Huawei FusionSphere V1R5C10 Client VMs: Red Hat Enterprise Server 6.4 (kernel 2.6.32-358.el6.x86_64)
JVM Version	Java version 1.8.0_25 Java HotSpot(TM) 64-Bit Server VM (build 25.25-b02, mixed mode) Java version 1.8.0_25 Java HotSpot(TM) 64-Bit Server VM (build 25.25-b02, mixed mode)
Other Hardware	N/A
Other Software	N/A

Availability Dates
SUT Hardware	Sep-2014
Virt. Software	May-2015
Other Components	N/A

Virtual Configuration:

Web Server

VM Configuration Details
# VCPUS	2
VCPU Speed (MHz)	2300
Memory (MB)	14088
# VNICs	2
VNIC Description	2 x ixgbevf
Storage Description	1 x virtio_scsi
Virtual Disk Size (MB)	20480
Datastore Size (MB)	0
VM OS	Red Hat Enterprise Server 6.4 (kernel 2.6.32-358.el6.x86_64)
VM OS Availability	Feb-2013

Web Server Configuration Details
Web Server Vendor	Red Hat Inc.
Web Server Name/Version	Apache 2.2.15
Availability Date	Feb-2013
Script Vendor	Red Hat Inc.
Script Name/Version	PHP 5.3.3
Script Availability Date	Feb-2013
JVM Version	Java version 1.8.0_25 Java HotSpot(TM) 64-Bit Server VM (build 25.25-b02, mixed mode)
Other Software	Alternative PHP Cache APC 3.1.9 (Red Hat) Smarty Template Engine 2.6.26 ixgbevf 2.11.3

Application Server

VM Configuration Details
# VCPUS	3
VCPU Speed (MHz)	2300
Memory (MB)	3264
# VNICs	2
VNIC Description	2 x ixgbevf
Storage Description	1 x virtio_scsi
Virtual Disk Size (MB)	20480
Datastore Size (MB)	0
VM OS	Red Hat Enterprise Server 6.5 (kernel 2.6.32-431.el6.x86_64)
VM OS Availability	Nov-2013

App Server Configuration Details
Application Server Vendor	IBM
App. Server Name/Version	WebSphere Application Server 8.5.5
Availability Date	Jul-2013
Emulator Vendor	IBM
Emulator Name/Version	WebSphere Application Server 8.5.5
Emulator Availability Date	Jul-2013
JVM Description	IBM IBM J9 VM (build 2.6, JRE 1.7.0 Linux amd64-64 Compressed References 20141114_222490 (JIT enabled, AOT enabled)
JVM Availability	Jan-2015
Other Software	ixgbevf 2.11.3

Mail Server

VM Configuration Details
# VCPUS	1
VCPU Speed (MHz)	2300
Memory (MB)	768
# VNICs	1
VNIC Description	1 x ixgbevf
Storage Description	2 x virtio_blk
Virtual Disk Size (MB)	20480
Datastore Size (MB)	25600
VM OS	Red Hat Enterprise Server 6.5 (kernel 2.6.32-431.el6.x86_64)
VM OS Availability	Nov-2013

Mail Server Configuration Details
Mail Server Vendor	Dovecot.org
Mail Server Name/Version	Dovecot 2.2.18
Availability Date	May-2015
JVM Version	Java version 1.8.0_25 Java HotSpot(TM) 64-Bit Server VM (build 25.25-b02, mixed mode)
Other Software	ixgbevf 2.11.3

Database Server

VM Configuration Details
# VCPUS	5
VCPU Speed (MHz)	2300
Memory (MB)	28672
# VNICs	2
VNIC Description	2 x ixgbevf
Storage Description	2 x virtio_blk
Virtual Disk Size (MB)	20480
Datastore Size (MB)	51200
VM OS	Red Hat Enterprise Server 6.5 (kernel 2.6.32-431.el6.x86_64)
VM OS Availability	Nov-2013

Database Configuration Details
Database Vendor	IBM
Database Name/Version	DB2 v9.7
Availability Date	Mar-2010
JVM Version	java version 1.7.0_45 OpenJDK 64-Bit Server VM (build 24.45-b08, mixed mode)
Other Software	ixgbevf 2.11.3

Infraserver

VM Configuration Details
# VCPUS	1
VCPU Speed (MHz)	2300
Memory (MB)	768
# VNICs	2
VNIC Description	2 x ixgbevf
Storage Description	2 x virtio_blk
Virtual Disk Size (MB)	20480
Datastore Size (MB)	51200
VM OS	Red Hat Enterprise Server 6.4 (kernel 2.6.32-358.el6.x86_64)
VM OS Availability	Feb-2013

Infraserver Configuration Details
Web Server Vendor	Red Hat Inc.
Web Server Name/Version	Apache 2.2.15
Availability Date	Feb-2013
Script Vendor	fastcgi.com
Script Name/Version	FastCGI 2.4.6
Script Availability Date	Nov-2007
JVM Version	Java version 1.8.0_25 Java HotSpot(TM) 64-Bit Server VM (build 25.25-b02, mixed mode)
Other Software	ixgbevf 2.11.3

Batch Server

VM Configuration Details
# VCPUS	1
VCPU Speed (MHz)	2300
Memory (MB)	768
# VNICs	1
VNIC Description	1 x ixgbevf
Storage Description	1 x virtio_scsi
Virtual Disk Size (MB)	20480
Datastore Size (MB)	0
VM OS	Red Hat Enterprise Server 6.4 (kernel 2.6.32-358.el6.x86_64)
VM OS Availability	Feb-2013

Batch Server Configuration Details
JVM Version	Java version 1.8.0_25 Java HotSpot(TM) 64-Bit Server VM (build 25.25-b02, mixed mode)
C Compiler Version	gcc 4.4.7-3
Optimization Flags	-O2
Other Software	ixgbevf 2.11.3

Notes:

Physical System Notes

BIOS settings used:
Power Profile set to Maximum Performance
Thermal Configuration set to Maximum Cooling
Turbo Mode:Enable

Storage Notes

2 x 300GB internal SAS drivers were connected to the LSI3008 controller,built as RAID1 and used for OS
The SUT was connected to 2 x HUAWEI Dorado5100 via 2 x Dual port QLogic Corp ISP2532-based 8Gbps Frbre Channel HBA,each HUAWEI Dorado5100 has 4 enclosures,each encloseure has 24 x 200GB SSD drives.
2 x HUAWEI Dorado5100 holds 8 x 24 x 200 GB SSD drives. There are 8 RAID10 arrays, each consisting of 24 drives . Each array has 4 LUNs,each LUN was partitioned for the VMs of 1 tile.

Virtualization Software Notes

The following lines were added to /etc/sysctl.conf:
net.ipv6.conf.all.disable_ipv6 = 1
net.ipv4.icmp_echo_ignore_broadcasts = 1
net.ipv4.conf.all.rp_filter = 1
fs.inotify.max_user_watches = 65536
net.ipv4.conf.default.promote_secondaries = 1
net.ipv4.conf.all.promote_secondaries = 1
net.core.somaxconn = 8192
net.ipv4.tcp_max_tw_buckets = 500000
net.ipv4.conf.default.arp_filter = 1
net.ipv4.conf.all.arp_filter = 1
net.core.netdev_max_backlog = 500000
fs.aio-max-nr = 70656
vm.swappiness = 0
vm.dirty_ratio = 10
vm.dirty_background_ratio = 5
kernel.sched_min_granularity_ns = 10000000
kernel.sched_wakeup_granularity_ns = 15000000
kernel.sched_latency_ns = 20000000
kernel.sched_migration_cost_ns = 500000
The following boot options were used:
showopts hpet=disable clocksource=tsc tsc=reliable nohz=on highres=off elevator=deadline selinux=0 audit=0 intel_iommu=on iommu=pt cgroup_disable=memory,blkio nmi_watchdog=0 pci=realloc
The following services are disabled:
abrt-ccpp, abrt-oops, abrtd, atd, auditd, autofs, certmonger, cgconfig, cgred, crond, cups, dnsmasq, ebtables, ip6tables, iptables, irqbalance, iscsi, iscsid, ksm, ksmtuned, mdmonitor, netconsole, ntpdate, numad, oddjobd, postfix, psacct, quota_nld, radvd, rdisc, restorecond, rhnsd, rhsmcertd, rngd, rpcsvcgssd, saslauthd, smartd, sssd, vncserver, winbind, ypbind
ixgbe module option used: InterruptThrottleRate=4000
2 Intel X540 for internal communication between WEBserver & INFRAserver, 4 Intel 82599 configured for SUT-client and APP-DB communication. A maximum of 768 virtual functions were configured and 154 virtual functions were used for the Web, App, DB, Mail Infra and Batch VMs.
VMs are bound to host CPUs via their XML configuration in the following manner:
dbserver1 dbserver5 & dbserver17 were bound to NUMA node 1, dbserver9 & dbserver13 were bound to NUMA node 0
All VMs of tiles 1,2,3,4,5,6,7,8,17,18 (except the dbserver1 dbserver5 dbserver17 batch18 appserver17&appserver18 are bound to NUMA node 1,appserver5 appserver6 appserver7 are bound to CPUs 0-17,36-44) are bound to NUMA node 0
All VMs of tiles 9,10,11,12,13,14,15,16 (except the dbserver9&dbserver13 are bound to NUMA node 0) are bound to NUMA node 1
Web, Mail, and Infra VMs have a cputune shares value of 1024
DB and APP VMs have a cputune shares value of 16384
Batch VMs have a cputune shares value of 258
VM configurations are as follows:
All VMs are managed with libvirt and created using virsh define & virsh start
All VMs are created with the following xml template, exceptions noted below template. (Each VM's xml template is at System_Under_Test/vmconfig directory):
<domain type='kvm'>
<name>$vm_name</name>
<memory>$vm_memory</memory>
<currentMemory>$vm_memory</currentMemory>
<vcpu cpuset='$host-cpu-list'>$vm_cpu</vcpu>
<cpu model='host-passthrough'>
<topology sockets=$sockets cores=$cores threads=$threads/>
</cpu>
<cputune> <shares>$shares</shares> </cputune>
<numatune>
<memory mode='strict' nodeset='$vm_node'/>
</numatune>
<os>
<type arch='x86_64' machine='pc'>hvm</type>
<boot dev='hd'/>
</os>
<features>
<apic eoi='on'/>
<pae/>
<acpi/>
</features>
<clock offset='utc'>
<timer name='pit' tickpolicy='delay'/>
</clock>
<on_poweroff>destroy</on_poweroff>
<on_reboot>restart</on_reboot>
<on_crash>destroy</on_crash>
<devices>
<emulator>/usr/libexec/qemu-kvm</emulator>
<disk type='block' device='disk'>
<driver name='qemu' type='raw' cache='none' io='native'/>
<source dev='$vm_disk' />
<target dev='vda' bus='virtio'/>
</disk>
<hostdev mode='subsystem' type='pci' managed='no'>
<source>
<address domain='0x0000' bus='$bus' slot='$slot' function='$function'/>
</source>
</hostdev>
<graphics type='vnc' port='-1' autoport='yes' listen='0.0.0.0'>
<listen type='address' address='0.0.0.0'/>
</graphics>
<memballoon model='none'>
<alias name='balloon0'/>
</memballoon>
</devices>
</domain>
Web Batch VMs do not use qemu for disk emulator, and therefore have the following declaration instead of 'disk type' block above:
<controller type='scsi' model='vhost-scsi' index='0'>
<source wwpn='naa.$vm_scsi' event_idx='on'/>
<driver queue='$queue_num'/>
</controller>
The following section is repeated for the second PCI device used in the app,db,web and infra VMs:
<hostdev mode='subsystem' type='pci' managed='no'>
<source>
<address domain='0x0000' bus='$bus' slot='$slot' function='$function'/>
</source>
</hostdev>
The following section is repeated for the second disk used in the db,mail and infra VMs for their data:
<disk type='block' device='disk'>
<driver name='qemu' type='raw' cache='none' io='native'/>
<source dev='$vm_disk' />
<target dev='vdb' bus='virtio'/>
</disk>

Web Server VM Notes

The following boot options were used:
hpet=disable highres=off cgroup_disable=memory,blkio nohz=on selinux=0 audit=0 watchdog=0 clocksource=tsc tsc=realiable elevator=deadline
The following services are disabled:
abrtd atd auditd autofs avahi-daemon cgconfig httpd iptables ip6tables irqbalance iscsi iscsid ksm ksmtuned NetworkManager postfix rhnsd rpcgssd rpcidmapd sysstat
/etc/fstab changes:
root file-system options: barrier=0,noatime
nfs file-system defaults options: noatime,actimeo=14400,nocto
MTU=9000 for eth1 (internal network).
The MTU is set after all VMs are started through the following command: ifconfig eth1 mtu 9000 (the script setmtu.sh runs this command and the script is at System_Under_Test directory).
httpd.conf changes:

KeepAlive on

MaxKeepAliveRequests 0

KeepAliveTimeout 60

StartServers 10

MinSpareServers 25

MaxSpareServers 75

ServerLimit 4400

MaxClients 4400

MaxRequestsPerChild 1024

CustomLog logs/access_log common

StartServers 2

MaxClients 150

<Directory />

Options FollowSymLinks

AllowOverride None

Order allow,deny

Allow from all

</Directory>

httpd.conf adds:

ServerName webserver

Listen 81

<Directory "/var/www/html/support">

AllowOverride None

Options +ExecCGI -Includes

SetHandler fastcgi-script

Order allow,deny

Allow from all

</Directory>

ScriptAlias /fcgi-bin/ "/var/www/fcgi-bin/

The following httpd modules were disabled:

env dav status info dav_fs actions proxy proxy_balancer proxy_ftp proxy_http proxy_ajp proxy_connect cgi

The following httpd modules were loaded:

file_cache mem_cache

Following items were added to /etc/sysctl.conf:
fs.file-max = 500000
net.core.somaxconn = 81920
net.ipv4.tcp_max_tw_buckets = 1500000
net.ipv4.conf.default.arp_filter = 1
net.ipv4.conf.all.arp_filter = 1
net.ipv4.tcp_tw_reuse = 1
net.ipv4.tcp_keepalive_time = 120
net.ipv4.tcp_keepalive_intvl = 30
net.ipv4.tcp_timestamps = 0
vm.swappiness = 0
net.ipv4.tcp_fin_timeout=60
net.ipv4.tcp_tw_recycle=1
The following items were added to /etc/bashrc:
ulimit -n 100000 > /dev/null 2>&1
The tuned-0.2.19 package was installed and activated with virtual-guest profile
ixgbevf module option used: InterruptThrottleRate=2000
/etc/security/limits.conf changes:
hard and soft nofile set to 102400
hard and soft nproc set to 102400

Application Server VM Notes

The following services are disabled:
abrtd atd auditd autofs avahi-daemon cgconfig httpd iptables ip6tables irqbalance iscsi iscsid ksm ksmtuned NetworkManager postfix rhnsd rpcgssd rpcidmapd sysstat
/etc/fstab changes:
root file-system options: barrier=0
Following items were added to /etc/sysctl.conf:
fs.file-max = 500000
net.core.somaxconn = 8192
net.ipv4.tcp_max_tw_buckets = 500000
net.ipv4.conf.default.arp_filter = 1
net.ipv4.conf.all.arp_filter = 1
vm.swappiness=0
ixgbevf module option used: InterruptThrottleRate=7000
/etc/security/limits.conf changes:
* - nofile 1048576
Update the JVM from 1.6.0 which is installed with the Websphere 8.5.5 to 1.7.0 which is download from IBM WebSite

Mail Server VM Notes

The following boot options were used:
selinux=0 audit=0 elevator=deadline
The following services are disabled:
abrt-ccpp abrtd atd auditd autofs certmonger cgconfig cgred crond cups haldaemon ip6tables iptables irqbalance kdump mcelogd messagebus netconsole nfs nfslock ntpd ntpdate numad oddjobd portreserve postfix psacct quota_nld rdisc restorecond rhnsd rhsmcertd rngd rpcgssd rpcsvcgssd saslauthd smartd sssd svnserve winbind ypbind
/etc/fstab changes:
root file-system options: barrier=0
datadisk file-system defaults options:noatime,barrier=0,data=writeback
Dovecot was compiled with default options and the following dovecot.conf was used:
base_dir = /var/run/dovecot/
ssl = no
disable_plaintext_auth = no
listen = *
log_path = /var/log/dovecot
mail_debug = no
mmap_disable = yes
mail_fsync = never
mail_location = dbox:/mailstore/dovecot/maildir/%u
mdbox_rotate_size = 8192
passdb {
args = /etc/passwd.dovecot
driver = passwd-file
}
protocols = imap
service auth {
user = root
}
service imap-login {
inet_listener imap {
port = 143
}
process_min_avail = 10
}
userdb {
driver = passwd
}
Following items were added to /etc/sysctl.conf:
net.ipv6.conf.all.disable_ipv6=1
fs.file-max = 500000
net.core.somaxconn = 8192
net.ipv4.tcp_max_tw_buckets = 500000
net.ipv4.conf.default.arp_filter = 1
net.ipv4.conf.all.arp_filter = 1
net.core.optmem_max = 1000000
net.core.rmem_default = 1000000
net.core.rmem_max = 1000000
net.core.wmem_default = 1000000
net.core.wmem_max = 1000000
net.ipv4.tcp_mem = 10000000 10000000 10000000
net.ipv4.tcp_rmem = 10000000 10000000 10000000
net.ipv4.tcp_wmem = 10000000 10000000 10000000
The following items were added to /etc/bashrc:
ulimit -n 100000
ulimit -u 10240
The tuned-0.2.19 package was installed and activated with virtual-guest profile
ixgbevf module option used: InterruptThrottleRate=7000
/etc/security/limits.conf changes:
hard and soft nofile set to 102400
hard and soft nproc set to 102400
mysql hard memlock unlimited
mysql soft memlock unlimited

Database Server VM Notes

The following boot options were used:
selinux=0 audit=0 elevator=deadline
The following services are disabled:
abrt-ccpp abrtd atd auditd autofs certmonger cgconfig cgred crond cups haldaemon ip6tables iptables irqbalance kdump mcelogd messagebus netconsole nfs nfslock ntpd ntpdate numad oddjobd portreserve postfix psacct quota_nld rdisc restorecond rhnsd rhsmcertd rngd rpcgssd rpcsvcgssd saslauthd smartd sssd svnserve winbind ypbind
/etc/fstab changes:
datadisk file-system defaults options:noatime,barrier=0,data=writeback
root file-system defaults options:barrier=0
Database tuning options:
db2 update db cfg for specdb using DATABASE_MEMORY 610000
db2set DB2_LARGE_PAGE_MEM=DB; db2set DB2_PINNED_BP=ON
alter bufferpool IBMDEFAULTBP size 5500000
alter tablespace roll_space NO FILE SYSTEM CACHING
alter tablespace C_cust_space NO FILE SYSTEM CACHING
alter tablespace C_supp_space NO FILE SYSTEM CACHING
alter tablespace C_site_space NO FILE SYSTEM CACHING
alter tablespace C_parts_space NO FILE SYSTEM CACHING
alter tablespace C_custinv_space NO FILE SYSTEM CACHING
alter tablespace M_parts_space NO FILE SYSTEM CACHING
alter tablespace M_bom_space NO FILE SYSTEM CACHING
alter tablespace M_wo_space NO FILE SYSTEM CACHING
alter tablespace M_lo_space NO FILE SYSTEM CACHING
alter tablespace M_inv_space NO FILE SYSTEM CACHING
alter tablespace O_cust_space NO FILE SYSTEM CACHING
alter tablespace O_ords_space NO FILE SYSTEM CACHING
alter tablespace O_ordl_space NO FILE SYSTEM CACHING
alter tablespace O_item_space NO FILE SYSTEM CACHING
alter tablespace S_comp_space NO FILE SYSTEM CACHING
alter tablespace S_sc_space NO FILE SYSTEM CACHING
alter tablespace S_po_space NO FILE SYSTEM CACHING
alter tablespace S_site_space NO FILE SYSTEM CACHING
alter tablespace S_supp_space NO FILE SYSTEM CACHING
alter tablespace U_space NO FILE SYSTEM CACHING
db2 update database config for specdb using LOGFILSIZ 65536
db2 update db cfg for specdb using logprimary 54 logsecond 4
Following items were added to /etc/sysctl.conf:
fs.file-max = 500000
net.core.somaxconn = 32384
net.ipv4.tcp_max_tw_buckets = 1000000
net.ipv4.conf.default.arp_filter = 1
net.ipv4.conf.all.arp_filter = 1
vm.swappiness=0
kernel.sem = 500 64000 400 512
kernel.shmmax = 137438953472
kernel.shmmni = 11118096
kernel.shmall = 8294967296
vm.nr_hugepages=12288
vm.hugetlb_shm_group=501
vm.nr_overcommit_hugepages=512
ixgbevf module option used: InterruptThrottleRate=7000
/etc/security/limits.conf changes:
* hard nofile 102400
* soft nofile 102400
* hard nproc 102400
* soft nproc 102400

Infraserver VM Notes

The following boot options were used:
hpet=disable highres=off cgroup_disable=memory,blkio nohz=on selinux=0 audit=0 watchdog=0 clocksource=tsc tsc=realiable elevator=deadline
The following services are disabled:
abrtd atd auditd autofs avahi-daemon cgconfig httpd iptables ip6tables irqbalance iscsi iscsid ksm ksmtuned NetworkManager postfix rhnsd rpcgssd rpcidmapd sysstat
/etc/fstab changes:
root file-system options: barrier=0,noatime
datadisk file-system defaults options:noatime,barrier=0,data=writeback
MTU=9000 for eth1 (internal network).
The MTU is set after all VMs are started through the following command: ifconfig eth1 mtu 9000 (the script setmtu.sh runs this command and the script is at System_Under_Test directory).
httpd.conf changes:

Timeout 20

KeepAlive on

MaxKeepAliveRequests 0

KeepAliveTimeout 60

StartServers 20

MinSpareServers 20

ServerLimit 4096

MaxClients 4096

MaxRequestsPerChild 640000

StartServers 20

MaxClients 4096

MaxRequestsPerChild 640000

Listen 81

ServerName besim:80

httpd.conf adds:

ScriptAlias /fcgi-bin/ "/var/www/fcgi-bin/

FastCgilpcDir /etc/httpd/fastcgi

<Directory "/var/www/html/support">

AllowOverride None

Options +ExecCGI -Includes

SetHandler fastcgi-script

Order allow,deny

Allow from all

</Directory>

Addhandler fastcgi-script fcgi

FastCgiServer /var/www/fcgi-bin/besim_fcgi.fcgi -processes 500

The following httpd modules were loaded:

file_cache mem_cache fastcgi

Following items were added to /etc/sysctl.conf:
fs.file-max = 500000
net.core.somaxconn = 81920
net.ipv4.tcp_max_tw_buckets = 1500000
net.ipv4.conf.default.arp_filter = 1
net.ipv4.conf.all.arp_filter = 1
net.ipv4.tcp_tw_reuse = 1
net.ipv4.tcp_keepalive_time = 120
net.ipv4.tcp_keepalive_intvl = 30
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_syn_retries = 4
net.ipv4.tcp_retries2 = 7
vm.swappiness = 0
The following items were added to /etc/bashrc:
ulimit -n 100000 > /dev/null 2>&1
The tuned-0.2.19 package was installed and activated with virtual-guest profile
ixgbevf module option used: InterruptThrottleRate=2000
/etc/security/limits.conf changes:
hard and soft nofile set to 102400
hard and soft nproc set to 102400
NFS export options:

rw,no_subtree_check,crossmnt,no_root_squash

Batch Server VM Notes

The following boot options were used:
hpet=disable highres=off cgroup_disable=memory,blkio nohz=on selinux=0 audit=0 watchdog=0 clocksource=tsc tsc=realiable elevator=deadline
The following services are disabled:
abrtd atd auditd autofs avahi-daemon cgconfig httpd iptables ip6tables irqbalance iscsi iscsid ksm ksmtuned NetworkManager postfix rhnsd rpcgssd rpcidmapd sysstat
/etc/fstab changes:
root file-system options: barrier=0
Following items were added to /etc/sysctl.conf:
fs.file-max = 500000
net.core.somaxconn = 8192
net.ipv4.tcp_max_tw_buckets = 500000
net.ipv4.conf.default.arp_filter = 1
net.ipv4.conf.all.arp_filter = 1
The following items were added to /etc/bashrc:
ulimit -n 100000 > /dev/null 2>&1
The tuned-0.2.19 package was installed and activated with virtual-guest profile
ixgbevf module option used: InterruptThrottleRate=7000
/etc/security/limits.conf changes:
hard and soft nofile set to 102400
hard and soft nproc set to 102400

Client Driver Notes

The client systems VMs using Red Hat Enterprise Linux 6.4.
Two virtual clients were used for each tile,One virtual client per tile ran the webserver workload and the other virtual client per tile ran the other workloads.
The first virtual client is the prime controller.
Each prime client VM has 10 VCPUs, 10240 MB memory, and a 20 GB disk,1 ixgbevf device and 1 virtio_blk device are used.

Other Notes

A Quidway S9303 36-port switch was used to connect client systems to SUT. The 10GbE ports were attached to a dual port 10 GbE SFP+ expansion module.

Performance Details:

Tile 1

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.36	1.38	13.51	1.75	5
Dealer	99.38	0.23/0.23/0.25	24.14/25.19/18.54	0.30/0.50/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	177.79	1279011	1099	13	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.53	147821	147821	0	100.00
Fetch	52.01	374484	374484	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 2

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.45	1.32	13.02	1.50	5
Dealer	100.20	0.16/0.20/0.16	17.06/16.48/17.37	0.30/0.40/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	177.91	1280013	912	11	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.50	147605	147605	0	100.00
Fetch	52.07	374906	374906	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 3

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	65.63	1.39	17.45	1.50	5
Dealer	98.24	0.30/0.28/0.27	32.15/30.78/25.12	0.30/0.40/0.20	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	177.82	1279337	935	22	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.49	147511	147511	0	100.00
Fetch	51.88	373512	373512	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 4

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.07	1.47	12.64	1.75	5
Dealer	98.37	0.38/0.30/0.44	23.88/28.08/20.08	0.30/0.50/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	177.99	1280770	732	7	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.49	147534	147534	0	100.00
Fetch	51.96	374080	374080	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 5

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.22	1.41	11.19	1.75	5
Dealer	99.24	0.32/0.28/0.36	19.68/18.78/17.67	0.40/0.60/0.40	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	177.85	1279596	933	13	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.36	146618	146618	0	100.00
Fetch	52.24	376155	376155	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 6

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.49	1.32	9.04	1.50	5
Dealer	99.74	0.16/0.19/0.17	18.57/21.05/13.72	0.30/0.40/0.20	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	177.65	1277447	1613	27	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.51	147637	147637	0	100.00
Fetch	51.98	374234	374234	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 7

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.42	1.33	11.99	1.50	5
Dealer	99.53	0.19/0.27/0.20	26.86/26.90/25.84	0.30/0.40/0.20	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	177.94	1280260	865	15	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.55	147935	147935	0	100.00
Fetch	51.97	374196	374196	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 8

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.01	1.45	12.89	1.75	5
Dealer	98.30	0.36/0.29/0.41	30.58/30.34/23.79	0.30/0.50/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	177.55	1277537	779	17	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.50	147570	147570	0	100.00
Fetch	51.98	374245	374245	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 9

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.08	1.44	13.14	1.75	5
Dealer	98.88	0.29/0.27/0.33	22.44/22.42/20.72	0.30/0.50/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	177.86	1279167	1384	13	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.35	146545	146545	0	100.00
Fetch	52.16	375582	375582	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 10

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	65.29	1.58	15.23	1.75	5
Dealer	97.07	0.49/0.37/0.56	28.35/27.17/25.11	0.40/0.60/0.40	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	177.77	1279240	655	14	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.43	147130	147130	0	100.00
Fetch	52.05	374730	374730	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 11

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	65.47	1.54	14.21	1.75	5
Dealer	97.22	0.45/0.42/0.52	27.61/33.99/24.84	0.30/0.60/0.40	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	178.24	1282539	807	9	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.53	147798	147798	0	100.00
Fetch	52.08	374979	374979	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 12

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.03	1.43	9.97	1.75	5
Dealer	98.85	0.30/0.27/0.34	17.33/17.54/13.61	0.30/0.50/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	177.95	1279985	1216	19	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.62	148443	148443	0	100.00
Fetch	51.96	374101	374101	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 13

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.20	1.38	14.74	1.50	5
Dealer	99.51	0.24/0.24/0.26	26.22/25.99/25.09	0.30/0.50/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	177.96	1279773	1511	24	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.38	146718	146718	0	100.00
Fetch	52.06	374857	374857	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 14

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	65.74	1.52	13.41	1.75	5
Dealer	97.79	0.43/0.34/0.50	27.30/25.48/24.05	0.40/0.60/0.40	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	178.06	1281024	977	15	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.49	147501	147501	0	100.00
Fetch	52.02	374567	374567	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 15

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	65.89	1.55	10.75	2.00	5
Dealer	97.89	0.49/0.39/0.56	21.12/20.88/17.03	0.60/0.70/0.70	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	177.75	1278494	1299	23	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.56	148036	148036	0	100.00
Fetch	51.94	373981	373981	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 16

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	65.50	1.50	16.32	1.75	5
Dealer	97.79	0.40/0.34/0.46	38.50/39.74/34.60	0.40/0.60/0.40	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	177.88	1279999	746	21	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.46	147313	147313	0	100.00
Fetch	52.02	374508	374508	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 17

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.29	1.46	10.12	1.75	5
Dealer	98.85	0.39/0.31/0.45	20.37/21.96/16.27	0.50/0.60/0.50	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	177.94	1279609	1568	16	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.54	147909	147909	0	100.00
Fetch	52.00	374427	374427	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 18

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.34	1.20	2.67	1.50	5
Dealer	20.06	0.05/0.12/0.03	0.68/2.93/1.21	0.10/0.30/0.10	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	35.65	256570	74	1	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	4.14	29840	29840	0	100.00
Fetch	10.43	75067	75067	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

For questions about this result, please contact the submitter: Huawei Technologies Co., Ltd.

First published at SPEC.org on 30-Jul-2015