Traducere in limba Romana:

IMT-HPC Cluster Technical Specifications

IMT HPC Cluster, built by the Romanian Company PRO SYS (www.prosys.ro/) was installed in 2015 and upgraded in 2021. The initial hardware specifications were as follows:
1x Head node equipped with 2 CPUs model Intel Xeon E5-2630LV3  and 64GB ECC DDR3 2133 MHz RAM).
1x Blade chassis SBE-710E-R75.
9x Blade servers SBI-7128RG-F, each blade equipped with 2 CPUs model
Intel Xeon E5-2670V3 and 128 GB ECC DDR3 2133 MHz RAM.
1x Storage server node with 9x240GB Enterprise SSD and 13 x 1.2TB SAS Enterprise HDD.
1x GPU node equipped with 2 CPUs model Intel Xeon E5-2670V3 and 256 GB ECC DDR3 2133 MHz RAM, one Nvidia Quadro K5200 GPU card and one Intel® Xeon Phi™ Coprocessor 7120A card. 
1x FDR infiniband switch module in Blade chassis - model SBM-IBS-F3616M.
Interconnects : gigabit ethernet for admin/external networks interconnect and  Infiniband FDR 56 Gbps  for HPC compute interconnect. 
Software specifications:
Operating system for all nodes : CentOS 7.0
File systems used:
OpenZFS /BeeGFS for data spaces (raid 10- 6.52T net capacity) 
OpenZFS /BeeGFS for scratch/fast temp data (raid 0 -1.95T net capacity)
HPC Managment Software : Bright Cluster Manager Advanced Edition version 7.0
Scheduler: SLURM
Software packages installed : COMSOL/Multiphysics, ANSYS suite, Nemo, Quantum ESPRESSO, Turbomole , SIESTA, data post processing software.
Performance: Acceptance test passed on 29 Jul 2015 with HPL Linpack -tested only with CPU's as per specification and the result was PPeak = 6.78 TeraFLOPS. double precision.

In 2021 the cluster has been upgraded with one additional node, and the memory capacity for compute nodes has been doubled to 256GB RAM per node.
Also fast storage for scratch/temp was updated to 5TB (net capacity) with fast enterprise SSD drives.
Operating system has been updated to the latest CentOS 7.9 and HPC Management Software to the latest version of  Bright Cluster Manager Advanced Edition  (9.1).
Present Ppeak is estimated (test pending) at ~8 TeraFLOPS , double precision.

No hardware failure/defects from 2015 to date. 
No filesystem crash/data loss untill present.

Last updated: November 19, 2021.

 

Project financed by UEFISCDI
PNIII, P4 Program 4 – Basic Research and Frontier, Project type: Exploratory Research Projects, ID project:
PN-III-P4-ID-PCE2020-1985, Contract no. 53 PCE din 04/01/2021.

 

Contact information

National Institute for Research and Development in Microtechnologies
IMT Bucharest
Project manager: Dr. Neculai PLUGARU
E-mail: [email protected]