![]() |
SPECmail2001 Result Copyright © 1999-2001 Standard Performance Evaluation Corporation |
MIO Mail Server 3.30 | SPECmail2001 msgs/min = 1,000 |
SPEC license # 000071 | Tested by: Mobile Internet (Mobico) |
Test date: Jul-2002 |
Hardware Avail: Sep-2001 |
Software Avail: Jun-2002 |
1,000 SPECmail2001 messages per minute is equivalent to 200,000 SPECmail2001_users.
Summary Results |
||||||
---|---|---|---|---|---|---|
Function | Response time limit (seconds) |
Required Percentage Compliant |
Percentage Compliant | |||
80% | 100% | 120% | ||||
SMTP Connect | 5 | >95% | 100.00% | 100.00% | 70.24% | |
SMTP Data | 5 | >95% | 98.80% | 96.91% | 24.99% | |
POP Connect | 5 | >95% | 100.00% | 100.00% | 44.27% | |
POP Status | 5 | >95% | 100.00% | 100.00% | 100.00% | |
POP Retrieve | 5 | >95% | 100.00% | 100.00% | 99.79% | |
POP Delete | 5 | >95% | 100.00% | 100.00% | 100.00% | |
Delivery Time | 60 | >95% | 99.37% | 99.74% | 65.95% | |
Error Rate | NA | <1% | 0.00% | 0.00% | 20.11% |
SMTP Server,POP3 Server,Message Store (1 system) | ||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||
|
Benchmark Manager, Mail Sink (2 systems) | ||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||
|
Load Generator I, Load Generator II, Load Generator III (3 systems) | ||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||
|
Detailed Results -- 80% Load |
|||
---|---|---|---|
Load | User Count | Message Rate (msg/min) |
|
Attempted | 160,000 | 800 | |
Actual | 159,800 | 799 | |
Function | Attempts | # Pass QoS |
% Pass QoS |
SMTP Connect | 91,012 | 91,012 | 100.00% |
SMTP Hello | 91,012 | 91,012 | 100.00% |
SMTP Mail From | 91,013 | 91,013 | 100.00% |
SMTP Rcpt To | 181,637 | 181,637 | 100.00% |
SMTP Data | 91,013 | 89,919 | 98.80% |
SMTP Quit | 90,124 | 90,124 | 100.00% |
POP Connect | 96,044 | 96,044 | 100.00% |
POP User ID | 96,044 | 96,044 | 100.00% |
POP Password | 96,049 | 96,049 | 100.00% |
POP Status | 96,049 | 96,049 | 100.00% |
POP Retrieve | 95,160 | 95,160 | 100.00% |
POP Delete | 94,894 | 94,894 | 100.00% |
POP Quit | 95,776 | 95,776 | 100.00% |
Delivery Time | 949 | 943 | 99.37% |
SMTP Data Response Time | 91,013 | 89,604 | 98.45% |
POP Retrieve Response Time | 95,160 | 95,021 | 99.85% |
Remote Message Delivery | 85,521 | 85,650 | 100.15% |
Counter |
Value |
||
SMTP Connect Error | 0 | ||
SMTP Protocol Error | 0 | ||
SMTP Disconnect | 889 | ||
SMTP Session | 90,124 | ||
SMTP To Local | 96,116 | ||
SMTP To Remote | 85,521 | ||
SINK Connect Error | 0 | ||
POP Connect Error | 0 | ||
POP Protocol Error | 0 | ||
POP Disconnect | 266 | ||
POP Session | 95,776 | ||
Delivery Time Connect Error | 0 | ||
Function | Minimum Time (millisec) |
Maximum Time (millisec) |
Average Time (millisec) |
SMTP Connect | 0 | 250 | 3.82 |
SMTP Hello | 0 | 300 | 7.35 |
SMTP Mail From | 0 | 240 | 6.13 |
SMTP Rcpt To | 0 | 241 | 6.38 |
SMTP Data | 0 | 12,718 | 441.93 |
SMTP Quit | 0 | 281 | 5.13 |
POP Connect | 0 | 361 | 11.91 |
POP User ID | 0 | 330 | 20.06 |
POP Password | 0 | 1,632 | 248.00 |
POP Status | 0 | 300 | 4.13 |
POP Retrieve | 0 | 1,191 | 70.64 |
POP Delete | 0 | 391 | 5.73 |
POP Quit | 0 | 3,605 | 56.09 |
Function | Minimum Size (KB) |
Maximum Size (KB) |
Average Size (KB) |
SMTP Data (KB up) | 1 | 2,674 | 24.15 |
POP Retrieve (KB down) | 0 | 2,675 | 24.21 |
Detailed Results -- 100% Load |
|||
---|---|---|---|
Load | User Count | Message Rate (msg/min) |
|
Attempted | 200,000 | 1,000 | |
Actual | 199,200 | 996 | |
Function | Attempts | # Pass QoS |
% Pass QoS |
SMTP Connect | 113,054 | 113,054 | 100.00% |
SMTP Hello | 113,053 | 113,053 | 100.00% |
SMTP Mail From | 113,053 | 113,053 | 100.00% |
SMTP Rcpt To | 226,831 | 226,831 | 100.00% |
SMTP Data | 113,059 | 109,562 | 96.91% |
SMTP Quit | 111,918 | 111,918 | 100.00% |
POP Connect | 120,028 | 120,028 | 100.00% |
POP User ID | 120,027 | 120,027 | 100.00% |
POP Password | 120,038 | 120,038 | 100.00% |
POP Status | 120,038 | 120,038 | 100.00% |
POP Retrieve | 120,174 | 120,174 | 100.00% |
POP Delete | 119,860 | 119,860 | 100.00% |
POP Quit | 119,756 | 119,756 | 100.00% |
Delivery Time | 1,149 | 1,146 | 99.74% |
SMTP Data Response Time | 113,059 | 109,460 | 96.82% |
POP Retrieve Response Time | 120,174 | 120,003 | 99.86% |
Remote Message Delivery | 108,280 | 108,235 | 99.96% |
Counter |
Value |
||
SMTP Connect Error | 0 | ||
SMTP Protocol Error | 0 | ||
SMTP Disconnect | 1,141 | ||
SMTP Session | 111,918 | ||
SMTP To Local | 118,549 | ||
SMTP To Remote | 108,280 | ||
SINK Connect Error | 0 | ||
POP Connect Error | 0 | ||
POP Protocol Error | 0 | ||
POP Disconnect | 314 | ||
POP Session | 119,756 | ||
Delivery Time Connect Error | 0 | ||
Function | Minimum Time (millisec) |
Maximum Time (millisec) |
Average Time (millisec) |
SMTP Connect | 0 | 2,984 | 4.85 |
SMTP Hello | 0 | 1,112 | 8.32 |
SMTP Mail From | 0 | 340 | 6.49 |
SMTP Rcpt To | 0 | 501 | 6.82 |
SMTP Data | 0 | 26,172 | 811.72 |
SMTP Quit | 0 | 471 | 5.55 |
POP Connect | 0 | 631 | 14.26 |
POP User ID | 0 | 511 | 22.74 |
POP Password | 0 | 2,953 | 501.17 |
POP Status | 0 | 921 | 4.72 |
POP Retrieve | 0 | 2,003 | 161.84 |
POP Delete | 0 | 1,061 | 6.53 |
POP Quit | 0 | 4,719 | 90.07 |
Function | Minimum Size (KB) |
Maximum Size (KB) |
Average Size (KB) |
SMTP Data (KB up) | 1 | 2,674 | 24.86 |
POP Retrieve (KB down) | 0 | 2,675 | 25.13 |
Detailed Results -- 120% Load |
|||
---|---|---|---|
Load | User Count | Message Rate (msg/min) |
|
Attempted | 240,000 | 1,200 | |
Actual | 192,400 | 962 | |
Function | Attempts | # Pass QoS |
% Pass QoS |
SMTP Connect | 116,625 | 81,919 | 70.24% |
SMTP Hello | 116,625 | 94,390 | 80.93% |
SMTP Mail From | 116,625 | 116,625 | 100.00% |
SMTP Rcpt To | 234,891 | 234,891 | 100.00% |
SMTP Data | 113,476 | 28,352 | 24.99% |
SMTP Quit | 112,310 | 112,310 | 100.00% |
POP Connect | 111,480 | 49,349 | 44.27% |
POP User ID | 111,479 | 81,568 | 73.17% |
POP Password | 111,495 | 107,016 | 95.98% |
POP Status | 111,494 | 111,493 | 100.00% |
POP Retrieve | 115,327 | 115,085 | 99.79% |
POP Delete | 115,005 | 115,005 | 100.00% |
POP Quit | 110,947 | 98,197 | 88.51% |
Delivery Time | 1,395 | 920 | 65.95% |
SMTP Data Response Time | 113,476 | 40,999 | 36.13% |
POP Retrieve Response Time | 115,327 | 114,354 | 99.16% |
Remote Message Delivery | 110,171 | 35,673 | 32.38% |
Counter |
Value |
||
SMTP Connect Error | 24,019 | ||
SMTP Protocol Error | 0 | ||
SMTP Disconnect | 1,166 | ||
SMTP Session | 136,329 | ||
SMTP To Local | 124,720 | ||
SMTP To Remote | 110,171 | ||
SINK Connect Error | 0 | ||
POP Connect Error | 32,550 | ||
POP Protocol Error | 0 | ||
POP Disconnect | 321 | ||
POP Session | 143,497 | ||
Delivery Time Connect Error | 511 | ||
Function | Minimum Time (millisec) |
Maximum Time (millisec) |
Average Time (millisec) |
SMTP Connect | 0 | 67,188 | 3,652.57 |
SMTP Hello | 0 | 58,219 | 2,382.73 |
SMTP Mail From | 0 | 3,785 | 26.60 |
SMTP Rcpt To | 0 | 3,946 | 29.22 |
SMTP Data | 0 | 61,279 | 12,341.57 |
SMTP Quit | 0 | 4,146 | 30.24 |
POP Connect | 841 | 64,502 | 7,909.64 |
POP User ID | 200 | 57,172 | 5,571.93 |
POP Password | 0 | 21,531 | 1,948.68 |
POP Status | 0 | 17,775 | 16.40 |
POP Retrieve | 0 | 18,286 | 550.01 |
POP Delete | 0 | 4,366 | 23.18 |
POP Quit | 0 | 59,985 | 1,657.24 |
Function | Minimum Size (KB) |
Maximum Size (KB) |
Average Size (KB) |
SMTP Data (KB up) | 1 | 2,674 | 24.86 |
POP Retrieve (KB down) | 0 | 2,675 | 25.28 |
General Notes / Tuning Information |
---|
-Network connectivity ATI FS708 8-port ethernet switch 1/100Mb -Install software package pkgadd -d MIOserv.pkg and start standart configuration creation script cd mio/bin ./makedefconf.sh ./admcmd -def -s servman setprop autostart mqueue,smtp,pop3 ./admcmd -def -s general setprop msg_daemon_mode 1 ./admcmd -def -s general setprop max_mbox_size_unit 1 ./admcmd -def -s general setprop max_mbox_size 104857600 ./admcmd -def -s general setprop max_num_recps 100 ./admcmd -def -s pop3 setprop minprocs 2 ./admcmd -def -s pop3 setprop threads 200 ./admcmd -def -s pop3 setprop incpercent 100 ./admcmd -def -s pop3 setprop log_level 2 ./admcmd -def -s smtp setprop minprocs 2 ./admcmd -def -s smtp setprop threads 200 ./admcmd -def -s smtp setprop incpercent 100 ./admcmd -def -s smtp setprop log_level 2 ./admcmd -def -s smtp setprop direct_delivery 1 ./admcmd -def -s mqueue setprop max_local_channels 50 ./admcmd -def -s mqueue setprop max_remote_channels 50 ./admcmd -def -s mqueue setprop jobs_per_leaf 50 ./admcmd -def -s mqueue setprop log_level 2 The SUT requires an APC Smart UPS 1400. |
First published at SPEC.org on 31-Jul-2002
Benchmark run on Tue Jul 16 00:58:22 GMT-03:00 2002 by SPECmail2001 v1.00