SPECvirt_sc2013 Result: Hewlett-Packard Company

SPECvirt_sc2013 Result
Copyright © 2010-2014 Standard Performance Evaluation Corporation

Hewlett-Packard Company: ProLiant DL360 Gen9
Red Hat Inc.: Red Hat Enterprise Linux Server 7 (KVM)

SPECvirt_sc2013 1614 @ 95 VMs

Tested By:

Hewlett-Packard Company

SPEC License #:

Test Date:

Aug-2014

Performance Section
Performance Summary
Performance Details
Validation Errors

SUT Configuration Section
Physical Configuration
Virtual Configuration

Power Section

N/A

Notes Section
Physical System Notes
Virtualization SW Notes
Hosted VM Notes

Performance Summary:

Performance
Run #	Tile #	Pct Load	Application Server	Web Server	Mail Server	Batch Server	Per-Tile Score	Overall Score
1	1	100%	167.57	178.15	126.66	PASSED	94.44	1614
	2	100%	167.28	177.45	126.27	PASSED	94.17
	3	100%	166.64	178.39	126.21	PASSED	94.20
	4	100%	167.64	177.85	126.00	PASSED	94.25
	5	100%	167.62	179.29	126.13	PASSED	94.54
	6	100%	167.54	178.76	126.26	PASSED	94.46
	7	100%	167.02	179.08	126.47	PASSED	94.46
	8	100%	167.50	178.21	126.23	PASSED	94.34
	9	100%	167.28	179.27	126.01	PASSED	94.44
	10	100%	167.60	178.89	125.95	PASSED	94.42
	11	100%	167.71	178.50	126.17	PASSED	94.42
	12	100%	167.07	178.91	126.13	PASSED	94.36
	13	100%	167.53	178.93	125.62	PASSED	94.34
	14	100%	167.73	178.95	126.18	PASSED	94.51
	15	100%	167.35	179.22	126.63	PASSED	94.59
	16	100%	167.18	178.99	126.62	PASSED	94.51
	17	100%	166.67	178.88	127.07	PASSED	94.50
	18	10%	16.82	17.91	12.69	PASSED	9.48

Quality Of Service (QOS)
Run #	Tile #	Pct Load	Application Server	Web Server	Mail Server	Batch Server	Per-Tile Score	Overall Score
1	1	100%	0.99	0.99	1.00	1.00	1.00	99.69%
	2	100%	0.99	0.99	1.00	1.00	1.00
	3	100%	0.98	0.99	1.00	1.00	0.99
	4	100%	1.00	0.99	1.00	1.00	1.00
	5	100%	1.00	1.00	1.00	1.00	1.00
	6	100%	0.99	1.00	1.00	1.00	1.00
	7	100%	1.00	1.00	1.00	1.00	1.00
	8	100%	1.00	0.99	1.00	1.00	1.00
	9	100%	0.99	1.00	1.00	1.00	1.00
	10	100%	1.00	1.00	1.00	1.00	1.00
	11	100%	0.99	0.99	1.00	1.00	1.00
	12	100%	0.99	1.00	1.00	1.00	1.00
	13	100%	0.99	1.00	1.00	1.00	1.00
	14	100%	1.00	1.00	1.00	1.00	1.00
	15	100%	0.99	1.00	1.00	1.00	1.00
	16	100%	0.99	1.00	1.00	1.00	1.00
	17	100%	0.96	1.00	1.00	1.00	0.99
	18	10%	1.00	1.00	1.00	1.00	1.00

Validation Errors:

No Validation Errors Found

Physical Configuration:

System Under Test (SUT)
Virt. Vendor/Product	Red Hat Inc. Red Hat Enterprise Linux Server 7 (KVM)
# of SUTs	1
Server Vendor	Hewlett-Packard Company
Server Model	ProLiant DL360 Gen9
Processor	Intel Xeon E5-2699 v3
Processor Speed (MHz)	2300
Processor Cores	36 cores, 2 chips, 18 cores/chip, 2 threads/core
Primary Cache	32 KB I + 32 KB D on chip per core
Secondary Cache	256 KB I+D on chip per core
Other Cache	45 MB I+D on chip per chip
Memory	512 GB (16 x 32 GB, 4R x4 PC4-17000 DDR4 2133MHz LRDIMM)
Operating System	Red Hat Enterprise Linux Server 7
File System	xfs
Other Hardware	N/A
Other Software	N/A

SUT Storage
Storage Controllers	1 x HP Smart Array P440ar Controller 1 x HP Smart Array P441 Controller
Storage Enclosure	2 x HP D3700 Disk Enclosure
Disk Description	2 x 300 GB 15K SFF SAS 48 x 400 GB 12G SAS MLC SFF Solid State Drive
RAID Level	RAID 1 RAID 10
UPS Required?	No

SUT Network
Network Adapters	1 x HP Ethernet 1Gb 4-port 331i Adapter 2 x HP Ethernet 10Gb 2-port 560SFP+ Adapter
SUT Ports Total	4 4
SUT Ports Used	1 4
Network Type	1 Gigabit Ethernet Base-T 10 Gigabit Ethernet Base-T
Network Speed	1 Gb/s 10 Gb/s

Clients
Model	ProLiant BL460c G6 ProLiant DL380p Gen8
# of Clients	9
Processor	Intel Xeon X5570 Intel Xeon E5-2697 v2
Processor Speed (MHz)	2933 2700
# Processors	2 1
Memory	64 GB SDRAM 256 GB SDRAM
Network Controller	1 x HP NC532i Dual Port 10GbE Adapter 1 x HP NC542m Dual Port Flex-10 10GbE Adapter 1 x HP Ethernet 1Gb 4-port 331FLR Adapter 1 x HP Ethernet 10Gb 2-port 560SFP+ Adapter
Operating System	Red Hat Enterprise Linux Server 6.5 (kernel 2.6.32-431.el6.x86_64) Red Hat Enterprise Linux Server 6.5 (kernel 2.6.32-431.el6.x86_64)
JVM Version	OpenJDK Runtime Environment (1.7.0.45-2.4.3.3.el6.x86_64) OpenJDK Runtime Environment (1.7.0.45-2.4.3.3.el6.x86_64)
Other Hardware	N/A
Other Software	N/A

Availability Dates
SUT Hardware	Sep-2014
Virt. Software	May-2014
Other Components	N/A

Virtual Configuration:

Web Server

VM Configuration Details
# VCPUS	2
VCPU Speed (MHz)	2300
Memory (MB)	14088
# VNICs	1
VNIC Description	1 x ixgbevf
Storage Description	1 x virtio_blk
Virtual Disk Size (MB)	15360
Datastore Size (MB)	0
VM OS	Red Hat Enterprise Linux Server 6.5 (kernel 2.6.32-431.el6.x86_64)
VM OS Availability	Nov-2013

Web Server Configuration Details
Web Server Vendor	Red Hat
Web Server Name/Version	Apache 2.2.15
Availability Date	Nov-2013
Script Vendor	Red Hat
Script Name/Version	PHP 5.3.3
Script Availability Date	Nov-2013
JVM Version	OpenJDK Runtime Environment (1.7.0.45-2.4.3.3.el6.x86_64)
Other Software	Alternative PHP Cache APC 3.1.9 Smarty Template Engine 2.6.26 ixgbevf.so v2.14.2

Application Server

VM Configuration Details
# VCPUS	3
VCPU Speed (MHz)	2300
Memory (MB)	3264
# VNICs	1
VNIC Description	1 x ixgbevf
Storage Description	1 x virtio_blk
Virtual Disk Size (MB)	20480
Datastore Size (MB)	0
VM OS	Red Hat Enterprise Linux Server 6.5 (kernel 2.6.32-431.el6.x86_64)
VM OS Availability	Nov-2013

App Server Configuration Details
Application Server Vendor	IBM
App. Server Name/Version	WebSphere Application Server 8.5.5
Availability Date	Jul-2013
Emulator Vendor	IBM
Emulator Name/Version	WebSphere Application Server 8.5.5
Emulator Availability Date	Jul-2013
JVM Description	IBM IBM J9 VM (build 2.6, JRE 1.7.0 Linux amd64-64 Compressed References 20130421_145945 (JIT enabled, AOT enabled)
JVM Availability	Jul-2013
Other Software	ixgbevf.so v2.14.2

Mail Server

VM Configuration Details
# VCPUS	1
VCPU Speed (MHz)	2300
Memory (MB)	768
# VNICs	1
VNIC Description	1 x ixgbevf
Storage Description	1 x virtio_blk
Virtual Disk Size (MB)	40960
Datastore Size (MB)	0
VM OS	Red Hat Enterprise Linux Server 6.5 (kernel 2.6.32-431.el6.x86_64)
VM OS Availability	Nov-2013

Mail Server Configuration Details
Mail Server Vendor	dovecot.org
Mail Server Name/Version	dovecot 2.2.13
Availability Date	May-2014
JVM Version	OpenJDK Runtime Environment (1.7.0.45-2.4.3.3.el6.x86_64)
Other Software	ixgbevf.so v2.14.2

Database Server

VM Configuration Details
# VCPUS	5
VCPU Speed (MHz)	2300
Memory (MB)	28672
# VNICs	1
VNIC Description	1 x ixgbevf
Storage Description	1 x virtio_blk
Virtual Disk Size (MB)	40960
Datastore Size (MB)	0
VM OS	Red Hat Enterprise Linux Server 6.5 (kernel 2.6.32-431.el6.x86_64)
VM OS Availability	Nov-2013

Database Configuration Details
Database Vendor	IBM
Database Name/Version	DB2 v9.7
Availability Date	Mar-2010
JVM Version	OpenJDK Runtime Environment (1.7.0.45-2.4.3.3.el6.x86_64)
Other Software	ixgbevf.so v2.14.2

Infraserver

VM Configuration Details
# VCPUS	1
VCPU Speed (MHz)	2300
Memory (MB)	1024
# VNICs	1
VNIC Description	1 x ixgbevf
Storage Description	1 x virtio_blk
Virtual Disk Size (MB)	51200
Datastore Size (MB)	0
VM OS	Red Hat Enterprise Linux Server 6.5 (kernel 2.6.32-431.el6.x86_64)
VM OS Availability	Nov-2013

Infraserver Configuration Details
Web Server Vendor	Red Hat
Web Server Name/Version	Apache 2.2.15
Availability Date	Nov-2013
Script Vendor	fastcgi.com
Script Name/Version	FastCGI 2.4.6
Script Availability Date	Nov-2007
JVM Version	OpenJDK Runtime Environment (1.7.0.45-2.4.3.3.el6.x86_64)
Other Software	ixgbevf.so v2.14.2

Batch Server

VM Configuration Details
# VCPUS	2
VCPU Speed (MHz)	2300
Memory (MB)	768
# VNICs	1
VNIC Description	1 x virtio-net
Storage Description	1 x virtio_blk
Virtual Disk Size (MB)	20480
Datastore Size (MB)	0
VM OS	Red Hat Enterprise Linux Server 6.5 (kernel 2.6.32-431.el6.x86_64)
VM OS Availability	Nov-2013

Batch Server Configuration Details
JVM Version	OpenJDK Runtime Environment (1.7.0.45-2.4.3.3.el6.x86_64)
C Compiler Version	gcc 4.4.7-4
Optimization Flags	-O2
Other Software	N/A

Notes:

Physical System Notes

BIOS settings used:

HP Power Profile: Maximum Performance

Thermal Configuration: Maximum Cooling

SR-IOV: Enabled

Processor Power and Utilization Montoring: Disabled

Memory Refresh Rate: 1x Refresh

Storage Notes

2 x 300GB internal SAS drives were connected to the P440ar controller, built as RAID1 and used for OS
2 x D3700 disk enclosures were connected to the 2 port HP Smart Array P441 controllers
Each D3700 contained 24 x 400 GB MLC SSD drives
Each enclosure was partitioned and used as follows:

Create 2 x RAID10 array and each has 12 x SSD drives

Create 8 x logic disks for each RAID array

Each logic disk was partitioned for the VMs of 1 tile

Virtualization Software Notes

Boot parameters set: selinux=0 audit=0 elevator=deadline clocksource=tsc intel_iommu=on pci=realloc cgroup_disable=memory,cpu,cpuacct,blkio,hugetlb pci=realloc nosoftlockup intel_idle.max_cstate=0 mce=ignore_ce
The following services were disabled:

abrt-oops abrtd atd avahi-daemon chronyd crond dbus iprdump iprinit iprupdate libstoragemgmt lvm2-lvmetad polkit postfix rhsmcertd rngd smartd firewalld ksmtuned irqbalance NetworkManager

/usr/lib/sysctl.d/specvirt.conf was updated with the following lines:

kernel.sched_min_granularity_ns = 10000000

kernel.sched_wakeup_granularity_ns = 15000000

vm.dirty_background_ratio = 5

vm.dirty_ratio = 10

vm.swappiness = 0

kernel.sched_latency_ns = 20000000

kernel.sched_migration_cost_ns = 500000

kernel.numa_balancing = 0

Network configuration is as follows:

One 331FLR NIC port(eno4) was used for host access

The 4 x 560SFP+ ports were assigned to bridges (br0,br1,br2,br3)

The 560SFP+ were configured with

max_vfs=63,63,63,63

All the webservers, infraservers, mailservers, appservers and dbservers were assigned with a VF

Batch VMs did not use VFs, instead virtio-net via the bridge was used
VM configurations were as follows:
All VMs were managed with libvirt
All VMs were created with the following XML template (Note that the template description below is a general framework
for the XML files used by the VMs. Refer to the supporting .tgz file for the specific VMs' XML files.):

<domain type='kvm'>

<name>$vmname</name>

<memory>$vmem</memory>

<currentMemory>$vmem</currentMemory>

<vcpu placement='static' cpuset='$host_cpu_list'>$vcpus</vcpu>

<os>

<type arch='x86_64' machine='pc'>hvm</type>

<boot dev='hd'/>

</os>

<features>

<acpi/>

<apic/>

<pae/>

</features>

<cpu mode='custom' match='exact'>

<model>SandyBridge</model>

<vendor>Intel/>vendor>

<topology sockets='1' cores='$vcpus' threads='1'/>

</cpu>

<clock offset='utc'>

<timer name='pit' tickpolicy='delay'/>

</clock>

<on_poweroff>destroy</on_poweroff>

<on_reboot>restart</on_reboot>

<on_crash>restart</on_crash>

<devices>

<emulator>/usr/libexec/qemu-kvm</emulator>

<disk type='block' device='disk'>

<driver name='qemu' type='raw' cache='none' io='native'/>

<source dev='$vdisk'/>

<target dev='vda' bus='virtio'/>

<address type='pci' domain='0x0000' bus='$bus' slot='$slot' function='$function'/>

</disk>

<interface type='hostdev' managed='yes'/>

<mac address='$vmac'/>

<source>

<address type='pci' domain='0x0000' bus='0x$bus' slot='0x$slot' function='0x$func'/>

</source>

</interface>

<controller type='usb' index='0'>

<address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/>

</controller>

<memballoon model='none'>

</devices>

</domain>

Batch VMs had the following declaration instead of 'hostdev' block above:

<interface type='bridge'>

<source bridge='$bridge'/>

<mac address='$vmac'/>

<model type='virtio'/>

<address type='pci' domain='0x0000' bus='$bus' slot='$slot' function='$function'/>

</interface>

All VMs of tiles 1-8 were bound to NUMA node 0 except dbserver1, dbserver5, and appserver8 which were bound to NUMA node 1
All VMs of tiles 9-16 were bound to NUMA node 1, except dbserver 9 and dbserver13 which were bound to NUMA node 0
dbserver17 appserver17&18 were bound to NUMA node 0
webserver17&18 mailserver17&18 infraserver17&18 and batchserver17&18 were bound to NUMA node 1
VMs' nice value was set after startup via the renice command to the following settings:

appservers = -16

dbserver = -10

webserver = -10

infraserver = 19

mailserver = 19

Web Server VM Notes

Boot parameters set: selinux=0 audit=0 elevator=deadline
ixgbevf module option used: InterruptThrottleRate=2000
The following services were disabled:

abrtd, atd, auditd, autofs, cups, ip6tables, iptables, irqbalance, kdump, mcelogd, netfs, nfslock, portreserve, postfix, rhnsd, rhsmcertd, rpcgssd, rpcidmapd, sysstat

tuned virtual-guest profile applied to VM
Following items were added in /etc/sysctl.conf

fs.file-max = 500000

net.core.somaxconn = 81920

net.ipv4.tcp_max_tw_buckets = 1500000

net.ipv4.conf.default.arp_filter = 1

net.ipv4.conf.all.arp_filter = 1

net.ipv4.tcp_tw_reuse=1

net.ipv4.tcp_keepalive_time = 120

net.ipv4.tcp_keepalive_intvl = 30

net.ipv4.tcp_timestamps = 0

vm.swappiness=0

root file-system options: barrier=0,noatime
httpd.conf changes

Timeout 20

KeepAlive on

MaxKeepAliveRequest 0

KeepAliveTimeout 150

StartServers 4400

MinSpareServers 50

MaxSpareServers 100

ServerLimit 8000

MaxClients 8000

MaxRequestsPerChild 32000

#LanguagePriority

#ForceLanguagePriority

#AddHandler type-map var

#AddType text/html .shtml

#AddOutputFilter INCLUDES .shtml

#BrowserMatch "Mozilla/2" nokeepalive

#BrowserMatch "MSIE 4/.0b2;" nokeepalive downgrade-1.0 force-response-1.0

#BrowserMatch "RealPlayer 4/.0" force-response-1.0

#BrowserMatch "Java/1/.0" force-response-1.0

#BrowserMatch "JDK/1/.0" force-response-1.0

#BrowserMatch "Microsoft Data Access Internet Publishing Provider" redirect-carefully

#BrowserMatch "MS FrontPage" redirect-carefully

#BrowserMatch "^WebDrive" redirect-carefully

#BrowserMatch "^WebDAVFS/1.[0123]" redirect-carefully

#BrowserMatch "^gnome-vfs/1.0" redirect-carefully

#BrowserMatch "^XML Spy" redirect-carefully

#BrowserMatch "^Dreamweaver-WebDAV-SCM1" redirect-carefully

The following httpd modules were disabled:

auth_basic auth_digest authn_file authn_alias authn_anon authn_dbm authn_default authz_user authz_owner authz_groupfile authz_dbm authz_default ldap authnz_ldap include ext_filter expires deflate usertrack dav status info dav_fs negotiation actions speling userdir substitute rewrite proxy proxy_balancer proxy_ftp proxy_http proxy_ajp proxy_connect cache suexec disk_cache cgi version

The following httpd language modules were disabled:

ca cs da de el en eo es et fr he hr it ja ko ltz nl nn no pl pt pt-BR ru sv zh-CN zh-TW

ssl.conf changes

SSLSessionCacheTimeout 100

ixgbevf module was upgraded to v2.14.2

Application Server VM Notes

Boot parameters set: selinux=0 audit=0 elevator=deadline
The following services were disabled:

abrtd, atd, auditd, autofs, cpuspeed, cups, ip6tables, iptables, irqbalance, kdump, mcelogd, netfs, nfslock, portreserve, postfix, rhnsd, rhsmcertd, rpcgssd, rpcidmapd, sysstat

tuned virtual-guest profile applied to VM
Following items were added in /etc/sysctl.conf

fs.file-max = 500000

net.core.somaxconn = 8192

net.ipv4.tcp_max_tw_buckets = 500000

net.ipv4.conf.default.arp_filter = 1

net.ipv4.conf.all.arp_filter = 1

vm.swappiness = 0

root file-system options: barrier=0
Following items were set in /opt/common_scripts/ostune_misc.sh and executed by /etc/rc.d/rc.local

echo tsc > /sys/devices/system/clocksource/clocksource0/current_clocksource

There are two WebSphere profiles, AppSrv01 for SPECjAppServer2004 and AppSrv02 for SPEC Emulator
Heap size for AppSrv01 has been changed to 2048 MB
The following change was made to the defaults in run.properties

runLO=4

ixgbevf module was upgraded to v2.14.2
ixgbevf module option used: InterruptThrottleRate=1500

Mail Server VM Notes

Boot parameters set: selinux=0 audit=0 elevator=deadline
ixgbevf module option used: InterruptThrottleRate=1000
The following services were disabled:

abrtd, atd, auditd, autofs, cpuspeed, cups, ip6tables, iptables, irqbalance, kdump, mcelogd, netfs, nfslock, portreserve, postfix, rhnsd, rhsmcertd, rpcgssd, rpcidmapd, sysstat

tuned virtual-guest profile applied to VM
Following items were added in /etc/sysctl.conf

fs.file-max = 500000

net.core.somaxconn = 8192

net.ipv4.tcp_max_tw_buckets = 500000

net.ipv4.conf.default.arp_filter = 1

net.ipv4.conf.all.arp_filter = 1

root file-system options: barrier=0
datastore file-system options: noatime,barrier=0,data=writeback
Contents of dovecot configuration file /etc/dovecot/dovecot.conf:

dict {

}

!include conf.d/*.conf

base_dir = /var/run/dovecot/

disable_plaintext_auth = no

log_path = /var/log/dovecot

mail_location = dbox:/mailstore/dovecot/maildir/%u

maildir_very_dirty_syncs = yes

mbox_very_dirty_syncs = yes

mbox_write_locks = fcntl

passdb {

args = scheme=plain /etc/dovecot/passwd.dovecot

driver = passwd-file

}

postmaster_address = [email protected]

service auth {

user = root

}

service imap-login {

inet_listener imap {

port = 143

}

process_min_avail = 10

service_count = 0

}

service imap {

process_limit = 1024

}

ssl = no

ssl_cert =

ssl_key =

userdb {

driver = passwd

}

ixgbevf module was upgraded to v2.14.2

Database Server VM Notes

Boot parameters set: selinux=0 audit=0 elevator=deadline
The following services were disabled:

abrtd, atd, auditd, autofs, cpuspeed, cups, ip6tables, iptables, irqbalance, kdump, mcelogd, netfs, nfslock, portreserve, postfix, rhnsd, rhsmcertd, rpcgssd, rpcidmapd, sysstat

tuned virtual-guest profile applied to VM
Following items were added in /etc/sysctl.conf

fs.file-max = 500000

net.core.somaxconn = 32384

net.ipv4.tcp_max_tw_buckets = 1000000

net.ipv4.conf.default.arp_filter = 1

net.ipv4.conf.all.arp_filter = 1

vm.swappiness = 0

kernel.sem = 500 64000 400 512

kernel.shmmax = 137438953472

kernel.shmmni = 11118096

kernel.shmall = 8294967296

root file-system options: barrier=0
datastore file-system options: noatime,barrier=0,data=writeback
Following items were executed by /etc/rc.d/rc.local:

echo tsc > /sys/devices/system/clocksource/clocksource0/current_clocksource

sysctl -w kernel.randomize_va_space=0

sysctl -w vm.nr_hugepages=0

sysctl -w vm.nr_hugepages=12288

sysctl -w vm.nr_overcommit_hugepages=512

ixgbevf module was upgraded to v2.14.2
ixgbevf module option used: InterruptThrottleRate=1500
Database tuning options:

db2 update db cfg for specdb using DATABASE_MEMORY 6100000

db2set DB2_LARGE_PAGE_MEM=DB; db2set DB2_PINNED_BP=ON

alter bufferpool IBMDEFAULTBP size 5500000

alter tablespace roll_space NO FILE SYSTEM CACHING

alter tablespace C_cust_space NO FILE SYSTEM CACHING

alter tablespace C_supp_space NO FILE SYSTEM CACHING

alter tablespace C_site_space NO FILE SYSTEM CACHING

alter tablespace C_parts_space NO FILE SYSTEM CACHING

alter tablespace C_custinv_space NO FILE SYSTEM CACHING

alter tablespace M_parts_space NO FILE SYSTEM CACHING

alter tablespace M_bom_space NO FILE SYSTEM CACHING

alter tablespace M_wo_space NO FILE SYSTEM CACHING

alter tablespace M_lo_space NO FILE SYSTEM CACHING

alter tablespace M_inv_space NO FILE SYSTEM CACHING

alter tablespace O_cust_space NO FILE SYSTEM CACHING

alter tablespace O_ords_space NO FILE SYSTEM CACHING

alter tablespace O_ordl_space NO FILE SYSTEM CACHING

alter tablespace O_item_space NO FILE SYSTEM CACHING

alter tablespace S_comp_space NO FILE SYSTEM CACHING

alter tablespace S_sc_space NO FILE SYSTEM CACHING

alter tablespace S_po_space NO FILE SYSTEM CACHING

alter tablespace S_site_space NO FILE SYSTEM CACHING

alter tablespace S_supp_space NO FILE SYSTEM CACHING

alter tablespace U_space NO FILE SYSTEM CACHING

update database config for specdb using LOGFILSIZ 65536

update db cfg for specdb using logprimary 54 logsecond 4

Infraserver VM Notes

Boot parameters set: selinux=0 audit=0 elevator=deadline
The following services were disabled:

abrtd, atd, auditd, autofs, cpuspeed, cups, ip6tables, iptables, irqbalance, kdump, mcelogd, netfs, nfslock, portreserve, postfix, rhnsd, rhsmcertd, rpcgssd, rpcidmapd, sysstat

tuned virtual-guest profile applied to VM
Following items were added in /etc/sysctl.conf

fs.file-max = 500000

net.core.somaxconn = 8192

net.ipv4.tcp_max_tw_buckets = 1500000

net.ipv4.conf.default.arp_filter = 1

net.ipv4.conf.all.arp_filter = 1

net.ipv4.tcp_tw_reuse=1

net.ipv4.tcp_keepalive_time = 120

net.ipv4.tcp_keepalive_intvl = 30

net.ipv4.tcp_timestamps = 0

net.ipv4.tcp_syn_retries = 4

net.ipv4.tcp_retries2 = 7

vm.swappiness=0

root file-system options: barrier=0,noatime
datastore file-system options: noatime,barrier=0,data=writeback
httpd.conf changes

Timeout 20

#MaxKeepAliveRequests 100

Listen 81

ServerName besim:80

StartServers 10

MinSpareServers 10

MaxSpareServers 10

ServerLimit 4096

MaxClients 4096

MaxRequestsPerChild 640000

CustomLog logs/access_log common

ScriptAlias /fcgi-bin/ "/var/www/fcgi-bin/"

FastCgiIpcDir /etc/httpd/fastcgi

<Directory "/var/www/fcgi-bin">

AllowOverride None

Options +ExecCGI -Includes

SetHandler fastcgi-script

Order allow,deny:

Allow from all

</Directory>

AddHandler fastcgi-script fcgi

FastCgiServer /var/www/fcgi-bin/besim_fcgi.fcgi -processes 50

NFS export options:

rw,async,no_subtree_check,no_root_squash

ixgbevf module was upgraded to v2.14.2
ixgbevf module option used: InterruptThrottleRate=3000

Batch Server VM Notes

Boot parameters set: selinux=0 audit=0 elevator=deadline
The following services were disabled:

abrtd, atd, auditd, autofs, cpuspeed, cups, ip6tables, iptables, irqbalance, kdump, mcelogd, netfs, nfslock, portreserve, postfix, rhnsd, rhsmcertd, rpcgssd, rpcidmapd, sysstat

tuned virtual-guest profile applied to VM
Following items were added in /etc/sysctl.conf

fs.file-max = 500000

net.core.somaxconn = 8192

net.ipv4.tcp_max_tw_buckets = 500000

net.ipv4.conf.default.arp_filter = 1

net.ipv4.conf.all.arp_filter = 1

Following items were set /etc/rc.d/rc.local

echo tsc > /sys/devices/system/clocksource/clocksource0/current_clocksource

Client Driver Notes

All prime clients were VMs running on Red Hat Enterprise Linux Server 6.5 KVM
The prime controller runs on the first vClient
Two vClients were used for each tile. One vClient per tile ran the
webserver workload and the other vClient per tile ran the other workloads
Each vClient has 4 vCPUs, 6GB memory, 16GB disk, 1 virtio_blk device and 1 virtio_net device
The first vClient acted as prime controller therefore had one more virtio_net device for management
All physical clients have 2 x 10 Gbps ports, and were configured as software bridges for the vClients
The client VM images were provided by the system local disk
9 physical clients host 36 vClients, 4 vClients run in each physical client

Power Configuration Notes

PTD[0] was connected to SUT only.
PTD[1] was connected to the 2 x D3700 enclosures.

Other Notes

1 x HP H3C S5820-24XG-SFP+ switch was used to connect the clients and the SUT

Performance Details:

Run 1

Tile 1

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.84	1.16	10.52	1.50	5
Dealer	100.73	0.15/0.22/0.16	11.56/14.53/13.71	0.30/0.50/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	178.15	1269761	6268	6674	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.39	146784	146784	0	100.00
Fetch	51.63	371722	371722	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 2

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.89	1.16	11.39	1.50	5
Dealer	100.40	0.15/0.21/0.16	12.80/13.00/12.36	0.30/0.50/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	177.45	1259090	8235	10321	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.34	146413	146413	0	100.00
Fetch	51.51	370866	370866	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 3

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.60	1.25	13.03	1.75	5
Dealer	100.04	0.27/0.26/0.24	20.37/13.14/16.85	0.40/0.50/0.40	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	178.39	1277277	2425	4697	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.33	146397	146397	0	100.00
Fetch	51.54	371113	371113	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 4

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.97	1.16	13.17	1.50	5
Dealer	100.67	0.13/0.21/0.13	10.15/11.59/5.19	0.30/0.50/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	177.85	1267581	6056	6877	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.25	145806	145806	0	100.00
Fetch	51.54	371069	371069	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 5

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.97	1.14	12.80	1.50	5
Dealer	100.65	0.11/0.18/0.11	5.77/10.12/9.69	0.30/0.40/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	179.29	1289296	1255	361	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.42	147005	147005	0	100.00
Fetch	51.47	370558	370558	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 6

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.98	1.16	13.43	1.50	5
Dealer	100.55	0.15/0.20/0.15	14.48/12.98/15.30	0.30/0.50/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	178.76	1283176	2970	926	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.32	146323	146323	0	100.00
Fetch	51.63	371728	371728	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 7

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.80	1.18	13.55	1.50	5
Dealer	100.21	0.10/0.29/0.11	27.81/27.79/27.27	0.20/0.50/0.20	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	179.08	1287005	1872	530	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.34	146440	146440	0	100.00
Fetch	51.66	371936	371936	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 8

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.96	1.16	18.93	1.50	5
Dealer	100.54	0.12/0.21/0.12	12.40/13.06/12.08	0.30/0.50/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	178.21	1273958	3109	6012	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.38	146710	146710	0	100.00
Fetch	51.43	370286	370286	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 9

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.88	1.16	6.45	1.50	5
Dealer	100.40	0.20/0.24/0.23	10.57/12.46/8.93	0.40/0.60/0.40	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	179.27	1289919	682	137	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.36	146621	146621	0	100.00
Fetch	51.71	372338	372338	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 10

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.97	1.14	2.81	1.50	5
Dealer	100.63	0.12/0.19/0.12	9.74/8.75/7.16	0.30/0.50/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	178.89	1286273	1057	681	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.22	145571	145571	0	100.00
Fetch	51.53	371030	371030	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 11

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	67.15	1.15	3.53	1.50	5
Dealer	100.56	0.15/0.24/0.17	7.59/10.24/9.00	0.30/0.50/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	178.50	1276884	3753	4540	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.32	146298	146298	0	100.00
Fetch	51.46	370519	370519	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 12

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.80	1.14	3.29	1.50	5
Dealer	100.27	0.16/0.21/0.17	13.34/11.21/9.24	0.30/0.50/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	178.91	1286123	1280	768	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.29	146064	146064	0	100.00
Fetch	51.50	370817	370817	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 13

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.96	1.14	5.04	1.50	5
Dealer	100.58	0.15/0.21/0.16	6.94/8.10/8.69	0.30/0.50/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	178.93	1285196	2477	606	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.22	145570	145570	0	100.00
Fetch	51.44	370343	370343	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 14

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.83	1.15	4.37	1.50	5
Dealer	100.89	0.12/0.20/0.12	5.51/7.42/3.84	0.30/0.50/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	178.95	1285056	1545	1856	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.41	146974	146974	0	100.00
Fetch	51.55	371194	371194	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 15

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.96	1.15	4.42	1.50	5
Dealer	100.39	0.18/0.21/0.19	12.41/11.98/9.06	0.30/0.50/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	179.22	1288199	1006	1188	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.24	145720	145720	0	100.00
Fetch	51.70	372234	372234	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 16

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.93	1.14	3.23	1.50	5
Dealer	100.25	0.16/0.22/0.17	12.03/14.53/8.19	0.20/0.50/0.20	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	178.99	1284243	2986	1480	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.39	146824	146824	0	100.00
Fetch	51.66	371968	371968	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 17

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	66.73	1.20	4.69	1.50	5
Dealer	99.94	0.39/0.37/0.46	12.06/14.80/8.61	0.80/0.90/0.90	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	178.88	1283270	1511	3165	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	20.39	146819	146819	0	100.00
Fetch	51.73	372473	372473	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

Tile 18

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	6.70	1.12	2.55	1.25	5
Dealer	10.12	0.07/0.18/0.06	1.26/2.49/0.98	0.20/0.40/0.20	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	17.91	128977	0	0	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	2.01	14478	14478	0	100.00
Fetch	5.25	37783	37783	0	100.00

Batch Server
Interval[0]	Interval[1]	Required Poll QoS	Achieved Poll QoS
PASSED within the 900sec time duration	PASSED within the 900sec time duration	95.0%	100.0%

For questions about this result, please contact the submitter: Hewlett-Packard Company

First published at SPEC.org on 08-Sep-2014