SPEC Seal of Reviewal SPECmail2001 Result
Copyright © 1999-2001 Standard Performance Evaluation Corporation
Mirapoint MSR 3.2 - M4000 SPECmail2001 msgs/min = 1,125
SPEC license # 69 Tested by:
Mirapoint		 Test date:
Mar-2002		 Hardware Avail:
Mar-2002		 Software Avail:
Jun-2002

1,125 SPECmail2001 messages per minute is equivalent to 225,000 SPECmail2001_users.

Detail Summary | General Notes
System configurations: Internet Message Server - Message Store | Benchmark Manager | Load Generator | SMTP Sink | Configuration diagram
Detailed results: Detailed Results 80% load | Detailed Results 100% load | Detailed Results 120% load


Summary Results
Function Response
time limit
(seconds)		 Required
Percentage
Compliant		 Percentage Compliant
80% 100% 120%
SMTP Connect 5 >95% 99.51% 100.00% 100.00%
SMTP Data 5 >95% 99.73% 99.99% 88.80%
POP Connect 5 >95% 99.66% 100.00% 100.00%
POP Status 5 >95% 100.00% 100.00% 100.00%
POP Retrieve 5 >95% 100.00% 100.00% 99.99%
POP Delete 5 >95% 100.00% 100.00% 100.00%
Delivery Time 60 >95% 98.81% 99.06% 87.69%
Error Rate NA <1% 0.00% 0.00% 0.37%

Internet Message Server - Message Store (1 system)
Software
System Release: MSR 3.2 Operating System: MOS
Availability: Jun-2002 File System: MessageBase (tm)
Hardware
Vendor: Mirapoint CPU: Intel PIII
Model Name: M4000 CPU MHz: 1400
Availability: Mar-2002 CPUs Enabled: 2 cores, 2 chips, 1 core/chip
Disk Subsystem: 14 x 73GB 10K RPM FCAL Primary Cache: 32KB L1 cache on chip
Memory (MB): 2048 Secondary Cache: 512KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 1 Other: 1xRAID10 + 2 Hot-spares
Notes / Tuning Information 
Hostname: mperf5

Licenses: User-limit unlimited, POP unlimited users

CLI configuration commands:

    # Don't send system alerts, etc. to [email protected]
    conf disable customercare

    # Accept mail for the local domain
    maildom add local.p.net

    # Relay mail for the remote domain
    relay add remote13.p.net

    # Turn off authentication check to prevent unauthorized relaying
    smtp set smtpauth off

    # Enable option to minimize message queueing
    smtp set fastpath on

MSL is 30 seconds (not configurable)

TIME_WAIT is 60 seconds (not configurable)

MSS is 1460 bytes (not configurable)

Benchmark Manager (1 system)
Software
JVM: Sun Java 2 SDK, Standard Edition, v1.2.2_008 (symcjit) Operating System: Microsoft Windows NT Workstation 4.0 (service pack 5)
Availability: Apr-2001 File System: FAT
Hardware
Vendor: Hewlett-Packard CPU: AMD-K6-2
Model Name: Pavilion 4440 CPU MHz: 333
Availability: Jan-2000 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: 1 x 4GB EIDE Primary Cache: 32KB(I) + 32KB(D) on chip
Memory (MB): 156 Secondary Cache: 512KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 1 Other: N/A
Notes / Tuning Information 
Hostname: operf9

MaxUserPort set to value 65534

Load Generator (3 systems)
Software
JVM: Sun Java 2 SDK, Standard Edition, v1.2.2_008 (symcjit) Operating System: Microsoft Windows NT Workstation 4.0 (service pack 5)
Availability: Apr-2001 File System: NTFS
Hardware
Vendor: FIT CPU: Intel PIII
Model Name: Server-1000 CPU MHz: 800
Availability: Jun-2000 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: 1 x 30GB EIDE Primary Cache: 16KB(I) + 16KB(D) on chip
Memory (MB): 256 Secondary Cache: 256KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 3 Other: N/A
Notes / Tuning Information 
Hostnames: operf10, operf11, operf12

MaxUserPort set to value 65534

SMTP Sink (1 system)
Software
JVM: Sun Java 2 SDK, Standard Edition, v1.2.2_008 (symcjit) Operating System: Microsoft Windows NT Workstation 4.0 (service pack 5)
Availability: Apr-2001 File System: NTFS
Hardware
Vendor: FIT CPU: Intel PIII
Model Name: Server-1000 CPU MHz: 800
Availability: Jun-2000 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: 1 x 30GB EIDE Primary Cache: 16KB(I) + 16KB(D) on chip
Memory (MB): 256 Secondary Cache: 256KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 1 Other: N/A
Notes / Tuning Information 
Hostnames: operf13

MaxUserPort set to value 65534


Detailed Results -- 80% Load
Load User Count Message Rate
(msg/min)
Attempted 180,000 900
Actual 180,200 901
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 102,904 102,402 99.51%
SMTP Hello 102,905 102,071 99.19%
SMTP Mail From 102,904 102,856 99.95%
SMTP Rcpt To 205,331 205,310 99.99%
SMTP Data 102,898 102,625 99.73%
SMTP Quit 101,862 101,862 100.00%
POP Connect 107,980 107,613 99.66%
POP User ID 107,982 107,420 99.48%
POP Password 107,983 107,921 99.94%
POP Status 107,982 107,982 100.00%
POP Retrieve 108,167 108,163 100.00%
POP Delete 107,896 107,895 100.00%
POP Quit 107,719 107,685 99.97%
Delivery Time 1,092 1,079 98.81%
SMTP Data Response Time 102,898 101,735 98.87%
POP Retrieve Response Time 108,167 107,995 99.84%
Remote Message Delivery 97,914 96,883 98.95%

Counter
Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 1,036
SMTP Session 101,862
SMTP To Local 107,417
SMTP To Remote 97,914
SINK Connect Error 0
POP Connect Error 0
POP Protocol Error 0
POP Disconnect 277
POP Session 107,719
Delivery Time Connect Error 0
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 0 9,734 330.83
SMTP Hello 0 10,224 361.32
SMTP Mail From 0 6,679 50.54
SMTP Rcpt To 0 6,669 25.75
SMTP Data 0 13,690 233.20
SMTP Quit 0 4,476 8.31
POP Connect 0 10,545 300.42
POP User ID 0 11,036 323.30
POP Password 0 12,177 213.07
POP Status 0 4,296 13.70
POP Retrieve 0 6,540 33.33
POP Delete 0 5,959 70.56
POP Quit 0 8,462 69.16
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.64
POP Retrieve (KB down) 1 2,675 25.18


Detailed Results -- 100% Load
Load User Count Message Rate
(msg/min)
Attempted 225,000 1,125
Actual 225,800 1,129
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 128,755 128,755 100.00%
SMTP Hello 128,755 128,755 100.00%
SMTP Mail From 128,754 128,754 100.00%
SMTP Rcpt To 255,915 255,915 100.00%
SMTP Data 128,743 128,735 99.99%
SMTP Quit 127,446 127,446 100.00%
POP Connect 135,454 135,454 100.00%
POP User ID 135,455 135,455 100.00%
POP Password 135,444 135,444 100.00%
POP Status 135,443 135,443 100.00%
POP Retrieve 134,337 134,337 100.00%
POP Delete 133,952 133,952 100.00%
POP Quit 135,075 135,075 100.00%
Delivery Time 1,283 1,271 99.06%
SMTP Data Response Time 128,743 127,446 98.99%
POP Retrieve Response Time 134,337 134,142 99.85%
Remote Message Delivery 121,121 119,894 98.99%

Counter
Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 1,297
SMTP Session 127,446
SMTP To Local 134,794
SMTP To Remote 121,121
SINK Connect Error 0
POP Connect Error 0
POP Protocol Error 0
POP Disconnect 385
POP Session 135,075
Delivery Time Connect Error 0
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 0 3,004 11.10
SMTP Hello 0 621 13.93
SMTP Mail From 0 540 4.54
SMTP Rcpt To 0 380 7.10
SMTP Data 0 6,028 131.49
SMTP Quit 0 1,151 2.66
POP Connect 0 2,994 16.60
POP User ID 0 1,221 22.77
POP Password 0 2,343 117.09
POP Status 0 1,903 4.48
POP Retrieve 0 1,212 18.72
POP Delete 0 721 8.83
POP Quit 0 2,093 52.98
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 25.04
POP Retrieve (KB down) 1 2,675 24.43


Detailed Results -- 120% Load
Load User Count Message Rate
(msg/min)
Attempted 270,000 1,350
Actual 269,600 1,348
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 154,150 154,150 100.00%
SMTP Hello 154,150 154,150 100.00%
SMTP Mail From 154,150 154,150 100.00%
SMTP Rcpt To 308,261 308,261 100.00%
SMTP Data 152,939 135,813 88.80%
SMTP Quit 151,406 151,406 100.00%
POP Connect 162,685 162,685 100.00%
POP User ID 162,688 162,688 100.00%
POP Password 162,621 95,300 58.60%
POP Status 162,623 162,623 100.00%
POP Retrieve 158,475 158,463 99.99%
POP Delete 158,056 158,056 100.00%
POP Quit 162,123 127,612 78.71%
Delivery Time 1,511 1,325 87.69%
SMTP Data Response Time 152,939 141,754 92.69%
POP Retrieve Response Time 158,475 158,252 99.86%
Remote Message Delivery 147,108 145,588 98.97%

Counter
Value
SMTP Connect Error 1,169
SMTP Protocol Error 0
SMTP Disconnect 1,533
SMTP Session 152,575
SMTP To Local 161,155
SMTP To Remote 147,108
SINK Connect Error 0
POP Connect Error 0
POP Protocol Error 0
POP Disconnect 417
POP Session 162,123
Delivery Time Connect Error 0
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 0 3,024 19.36
SMTP Hello 0 2,334 22.61
SMTP Mail From 0 2,293 5.35
SMTP Rcpt To 0 1,753 10.84
SMTP Data 0 60,006 3,204.35
SMTP Quit 0 1,171 3.92
POP Connect 0 3,705 166.69
POP User ID 0 4,547 226.27
POP Password 411 28,041 4,544.88
POP Status 0 3,355 61.69
POP Retrieve 0 6,860 80.02
POP Delete 0 3,264 96.14
POP Quit 0 31,044 2,498.30
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 25.20
POP Retrieve (KB down) 1 2,675 24.42

General Notes / Tuning Information 

Network hardware:

  Cisco System Catalyst 2900 Series XL 10BaseT/100BaseTX 24 ports

DNS configuration:

  "A" records for every host on the network (to map hostnames to IP
  addresses).

  "PTR" records for every host on the network (to reverse map IP
  addresses to hostnames).

  Specify operf13.p.net as the only mail exchange for domain remote13.p.net
  with an MX record of preference level 10.


Testing performed at Mirapoint Headquarters (Performance Lab) in Sunnyvale, CA.

For questions about this result, please contact the tester.
For other inquiries, please contact webmaster@spec.org
Copyright © 1999-2001 Standard Performance Evaluation Corporation

First published at SPEC.org on 28-Mar-2002

Benchmark run on Sun Mar 03 08:34:16 PST 2002 by SPECmail2001 v1.01
Report generated on Mon Apr 25 17:24:26 EDT 2005 by SPECmail2001 v1.05 HTML Formatter