Standard Performance Evaluation Corporation

The SPECjbb® 2015 benchmark has been developed from the ground up to measure performance based on the latest Java application features. It is relevant to all audiences who are interested in Java server performance, including JVM vendors, hardware developers, Java application developers, researchers and members of the academic community.

The SPECjbb 2015 benchmark price is $1500 for new customers and $375 for qualified non profit organizations and accredited academic institutions. To find out if your organization has an existing license for a SPEC product please contact SPEC at [email protected].

May 2, 2024: The SPECjbb® 2015 benchmark V1.04 is now available. This update fixes crashes which were observed during the testing with the very large core count systems and includes some minor fixes to the warnings in the output logs when parameters are changed in the property file as well as in the launch command line of the application.

Results from using V1.04 remain comparable to V1.03 or results from the earlier versions 1.02, 1.01, and 1.00. It is important to move ahead to V1.04. Starting with the submission cycle beginning on August 8, 2024, all result submissions must be made using V1.04 and V1.03 will be retired.

Licensees of version 1.00, 1.01, 1.02 and 1.03 are entitled to a complimentary V1.04 upgrade. Contact SPEC to request your upgrade.

Features include:

• A usage model based on a world-wide supermarket company with an IT infrastructure that handles a mix of point-of-sale requests, online purchases and data-mining operations.
• Both a pure throughput metric and a metric that measures critical throughput under service level agreements (SLAs) specifying response times ranging from 10ms to 100ms.
• Support for multiple run configurations, enabling users to analyze and overcome bottlenecks at multiple layers of the system stack, including hardware, OS, JVM and application layers.
• Exercising new Java 7 features and other important performance elements, including the latest data formats (XML), communication using compression, and messaging with security.
• Support for virtualization and cloud environments.

Results

Submitted Results

Includes all of the results submitted to SPEC from licensees of the benchmark.

Information

Press Release

Benchmark Documentation

• FAQ (Last updated: December 9, 2020)
• User's Guide (Last updated: May 25, 2017)
• Run and Reporting Rules (Last updated: December 6, 2018)
• Design Document (Last updated: May 25, 2017)
• Result File Field Descriptions (Last updated: October 4, 2019)
• Known Issues (Last updated: October 4, 2019)