SPECstorage(TM) Solution 2020_genomics Result Samsung Datacenter : Samsung PM9A3 NVMe and WekaFS Technology and Cloud Solutions Lab SPECstorage Solution = 1120 Jobs (Overall Response Time = 0.38 msec) 2020_genomics =============================================================================== Performance =========== Business Average Metric Latency (Jobs) (msec) Jobs Ops/Sec Jobs MB/Sec ------------ ------------ ------------ ------------ 80 0.2 80002 6794 160 0.2 160004 13590 240 0.2 240006 20381 320 0.2 320007 27178 400 0.2 400010 33980 480 0.2 480012 40763 560 0.3 560014 47574 640 0.3 640016 54367 720 0.3 720019 61151 800 0.3 800021 67947 880 0.4 880024 74748 960 0.4 960027 81543 1040 0.6 1040030 88340 1120 2.4 1117289 94890 =============================================================================== Product and Test Information ============================ +---------------------------------------------------------------+ | Samsung PM9A3 NVMe and WekaFS | +---------------------------------------------------------------+ Tested by Samsung Datacenter Technology and Cloud Solutions Lab Hardware Available December 2021 Software Available December 2021 Date Tested December 2021 License Number 6309 Licensee Locations San Diego, California Our performance results show that the Weka high performance filesystem paired with Samsung’s latest datacenter NVMe SSD, the PM9A3, delivers exceptional performance optimal for a wide variety of demanding workloads found in today’s datacenters. With the Samsung PM9A3, users benefit from a combination of high performance and enterprise functionality built especially for datacenters. Solution Under Test Bill of Materials ===================================== Item No Qty Type Vendor Model/Name Description ---- ---- ---------- ---------- ---------- ----------------------------------- 1 6 Storage Dell R7515 The Dell EMC PowerEdge R7515 Rack Server Server is a highly scalable Single- socket 2U rack server. The CPU is a single AMD EPYC 7702P 64-Core Processor @ 3.9 GHz. 512 GiB of system memory. Each storage server has 2x Mellanox ConnectX-6 200GbE dual-port network cards as well as an embedded Broadcom 1GbE Ethernet card. A Micron Technology 240GB SATA SSD is used for the Linux OS and boot. There are 15 Samsung PM9A3 3.84TB NVMe U.2 drives being used for WekaFS. 2 8 Client Dell R7525 The Dell EMC PowerEdge R7525 is a Server two socket, 2U rack servers that is designed to run workloads using flexible I/O and network configurations. The CPUs are two AMD EPYC 7702P 64-Core Processor @ 3.9 GHz. 1 TiB of system memory. Each client server has 1x Mellanox ConnectX-6 200GbE dual-port network card as well as an embedded Broadcom 1GbE Ethernet card. A Micron Technology 240GB SATA SSD is used for the Linux OS and boot. 3 20 200GbE HBA Mellanox ConnectX-6 ConnectX-6 Virtual Protocol Card VP 200GbE Interconnect® (VPI) cards are a Dual-Port groundbreaking addition to the Mellanox ConnectX series of industry-leading adapter cards. Providing two ports of 200Gb/s for InfiniBand and Ethernet connectivity, sub-600ns latency and 215 million messages per second, ConnectX-6 VPI cards enable the highest performance and most flexible solution aimed at meeting the continually growing demands of data center applications. 4 90 SSD Samsung PM9A3 PM9A3 offers tremendous performance for Read-Intensive data centers by applying PCIe® Gen 4, achieving 1000K IOPS in Random Read and 6800 MB/s in sequential read speed. Using impressively low power in small form factors (E1.S, U.2, M.2), PM9A3 delivers an efficient SSD solution for mixed data workloads. Samsung PM9A3 3.84TB NVMe U.2 drives were used in this test. 5 2 Switch Mellanox SN3700 Mellanox SN3700 spine/super-spine offers 32 ports of 200GbE in a compact 1U form factor. It enables connectivity to endpoints at different speeds and carries a throughput of 12.8Tb/s, with a landmark 8.33Bpps processing capacity. As an ideal spine solution, the SN3700 allows maximum flexibility, with port speeds spanning from 10GbE to 200GbE per port. Configuration Diagrams ====================== 1) storage2020-20220110-00029.config1.png (see SPECstorage Solution 2020 results webpage) Component Software ================== Item Name and No Component Type Version Description ---- ------------ ------------ ------------ ----------------------------------- 1 WekaFS File System 3.12.2 WekaFS is a fully-distributed, parallel file system that was written entirely from scratch to deliver the highest-performance file services by leveraging NVMe flash. The software also includes integrated tiering that seamlessly expands the namespace to and from hard disk drive (HDD) object storage, without the need for special data migration software or complex scripts; all data resides in a single namespace for easy access and management. 2 Storage Node Storage OS Ubuntu 20.04 Operating System (OS) for 6 storage servers in Dell R7515. 3 Clients Storage OS Ubuntu 20.04 Operating System (OS) for 8 clients in Dell R7525. Hardware Configuration and Tuning - Physical ============================================ +----------------------------------------------------------------------+ | Storage Server | +----------------------------------------------------------------------+ Parameter Name Value Description --------------- --------------- ---------------------------------------- Port speed 200Gb Each storage server has 4x 200GbE ethernet ports connected to the switch. MTU 9000 Jumbo frames of MTU 9000 bytes have been configured on the 200GbE connections. +----------------------------------------------------------------------+ | Clients | +----------------------------------------------------------------------+ Parameter Name Value Description --------------- --------------- ---------------------------------------- Port speed 200Gb Each client has 2x 200GbE ethernet ports connected to the switch. MTU 9000 Jumbo frames of MTU 9000 bytes have been configured on the 200GbE connections. Hardware Configuration and Tuning Notes --------------------------------------- None Software Configuration and Tuning - Physical ============================================ +----------------------------------------------------------------------+ | Clients | +----------------------------------------------------------------------+ Parameter Name Value Description --------------- --------------- ---------------------------------------- num_cores 8 WekaFS mount option to designate the number of frontend cores to allocate for the client. memory_mb 30720 WekaFS mount option to designate amount of memory to be used by the client (for huge pages). net ens3f0,ens3f1 WekaFS mount option to designate both client 200GbE network ports be used for the mount. Software Configuration and Tuning Notes --------------------------------------- The single filesystem was attached via a single mount per client. The mount string used was "sudo mount -t wekafs -o net=ens3f0,net=ens3f1 -o num_cores=8,memory_mb=30720 11.11.208.72/weka_perf /mnt/wekamount/" Service SLA Notes ----------------- None Storage and Filesystems ======================= Item Stable No Description Data Protection Storage Qty ---- ------------------------------------- ------------------ -------- ----- 1 Total of 90x Samsung PM9A3 3.84TB Yes 90 SSDs used for Weka File-System. 2 Total of 6x Micron Technology 240GB Yes 6 SATA SSD used for boot. Number of Filesystems 1 Total Capacity 188 TiB Filesystem Type WekaFS Filesystem Creation Notes ------------------------- Each storage server has 15x Samsung PM9A3 attached to it, which are dedicated to the Weka filesystem. Each storage server has 1x Micron Technology 240GB SATA SSD used as the boot drive. The storage cluster consisted of 6 storage servers with a single WekaFS filesystem created in the cluster. Storage and Filesystem Notes ---------------------------- WekaFS is a fully containerized storage OS, in this configuration 3 LXC containers containing WekaFS storage processing were deployed per storage server. Transport Configuration - Physical ================================== Item Number of No Transport Type Ports Used Notes ---- --------------- ---------- ----------------------------------------------- 1 200GbE Network 16 Each client server is connected to the switch via a dual-port 200GbE HBA. 2 200GbE Network 24 Each storage server is connected to the switch via 2x dual-port 200GbE HBA. Transport Configuration Notes ----------------------------- None Switches - Physical =================== Total Used Item Port Port No Switch Name Switch Type Count Count Notes ---- -------------------- --------------- ------ ----- ------------------------ 1 Mellanox SN3700 200GbE 64 40 2x Mellanox SN3700 switches connected together with a 600Gb LAG. Each switch has 8 ports used for client connections and 12 ports used for target server connections. Processing Elements - Physical ============================== Item No Qty Type Location Description Processing Function ---- ---- -------- -------------- ------------------------- ------------------- 1 16 CPU Client Server AMD EPYC 7702P 64-Core Each client Dell Processor R7525 has a dual socket AMD EPYC 7702P 64-Core 3.9GHz processor. 2 6 CPU Storage Server AMD EPYC 7702P 64-Core Each Dell R7515 Processor storage server has a single socket AMD EPYC 7702P 64-Core 3.9GHz processor. Processing Element Notes ------------------------ None Memory - Physical ================= Size in Number of Description GiB Instances Nonvolatile Total GiB ------------------------- ---------- ---------- ------------ ------------ 8x client servers Dell 1024 8 V 8192 R7525 with 1024GB of memory. 6x storage servers Dell 512 6 V 3072 R7515 with 512GB of memory. Grand Total Memory Gibibytes 11264 Memory Notes ------------ None Stable Storage ============== WekaFS does not use any internal memory to temporarily cache write data to the underlying storage system. All writes are commited directly to the storage disk, and protected via WekaFS Distributed Data Protection (4+2 in this case). There is no need for any RAM battery protection. In an event of a power failure a write in transit would not be acknowledged. Solution Under Test Configuration Notes ======================================= The system under test consisted of the 8 client servers and 6 storage servers. The 6 storage servers each have 2x dual-port network interfaces connected to a 200GbE switch. The 8 load generating client servers each have a dual-port network interface also connected to a 200GbE switch. Other Solution Notes ==================== None Dataflow ======== One of the 8 client servers acted as benchmark's prime client to initiate the tests. The benchmark load is distributed accross the 8 Dell R7525 client servers using a single mount point per client. Other Notes =========== None Other Report Notes ================== The solution under test was a standard WekaFS cluster in dedicated server mode. The solution will handle both large file I/O as well as small file random I/O and metadata intensive applications. No specialized tuning is required for different or mixed use workloads. None of the components used to perform the test were patched with Spectre or Meltdown patches (CVE-2017-5754, CVE-2017-5753, CVE-2017-5715). =============================================================================== Generated on Mon Jan 10 17:54:08 2022 by SpecReport Copyright (C) 2016-2022 Standard Performance Evaluation Corporation