MIPT’S I-SCALARE Laboratory supercomputer upgrade
Technical DataSheet MIPT’S I-SCALARE Laboratory Supercomputer
Technical Info MIPT’S I-SCALARE Laboratory Supercomputer
- Performance:83.15 TFLOPS (Peak) / 70.18 TFLOPS (LINPACK)
- Nodes / Сores (CPU + CoCPU) / Threads (CPU + CoCPU):224 / 3584 / 7168
- CPU:448x Intel® Xeon® E5-2690 (8 cores, 2.9 GHz)
- Coprocessor:Not presented
- Motherboard:Intel® Server Board S2600JF(Q)
- Total RAM of the nodes:14.3 TB (DDR3-1600, low voltage green memory)
- Total disk storage of the nodes:22.4 TB, Solid State Drives Intel® SSD
- Interconnect:InfiniBand QDR, 40 Gb/s
- Service network:2x 1GigE independent sensor and control networks
- Occupied Area:2.56 м.кв. (27.56 sq. ft.)
Russian scientists will be able to conduct larger-scale research, achieve further success in modeling of virus behavior and creating new pharmaceuticals to fight many dangerous diseases due to the peak performance of an energy-efficient supercomputer doubled to 83.14 TFLOPS. The supercomputer based on RSC Tornado advanced architecture and Intel® Xeon® E5-2690 processors is installed at I-SCALARE (Intel super computer applications laboratory for advanced research), a supercomputing technology laboratory for biomedicine, pharmacology and small-scale structures created as a part of a Russian government’s grant at Moscow Institute of Physics and Technology (MIPT).
“The main goal of I-SCALARE laboratory is solving most important problems in modern bioinformatics. Professionalism, commitment and enthusiasm shown by the team facilitates successful achievement of the goal.” Nikolay Kudryavtsev, Rector, Moscow Institute of Physics and Technology
As the number of students and teaching staff is high the lecture halls and other rooms in the University are occupied almost all the time. The continental climate in the Moscow region drives
energy costs. At the same time, the diversity of disciplines and a large number of laboratory equipment impose heavy demands on energy. Thus, a MIPT supercomputer should meet the following criteria: space and energy consumption minimization, while providing high computing power and energy efficiency, as well as low total cost of ownership (TCO).
MIPT had chosen RSC Group’s computing cluster based on RSC Tornado innovative architecture, energy efficient high-performance technology with liquid cooling of standard server boards and Intel® Xeon® E5-2600 processors. To satisfy client’s requirements for system construction, maintenance and management RSC Group proposed a new class of solutions - RSC DCmini. RSC DCmini is an all-in-one data center solution for the high performance computing segment. This is a complete and verified solution for high performance computing and cloud environments based on RSC Group’s RSC Tornado architecture developed for rapid deployment of a computing center even in case if a specially prepared server room is not available.
The solution includes all the subsystems required by a modern data center, i.e. a powerful server farm, communication networks, data storage systems, as well as power supply, cooling and fire extinguishing system subsystems. RSC DCmini is supplied with optimized HPC software stack to organize a high-performance cluster or a private cloud, as well as contains software and hardware monitoring and management subsystem. All the subsystems are placed in two standard racks with a total footprint of 2 sq. m.
Based on unique high density RSC design and standard server components of Intel x86-64 industry-standard platform (with the ability to connect accelerators), the system on the basis RSC Tornado architecture ensures a new level of performance, effectiveness and scalability.
In 2011, as a part of a contract with MIPT, RSC Group, Russia's and CIS leading fullcycle developer and integrator of next-generation supercomputing solutions based on Intel architecture and advanced liquid cooling, has developed and installed a pilot system on the basis of RSC Tornado advanced architecture and previous-generation Intel® Xeon® 5600 processors in I-SCALARE, a supercomputing technology laboratory that performs research in biomedicine, pharmacology and small-scale structures.
In 2012 the system was upgraded to the level of a powerful computing cluster that represents a complete RSC DCmini-class solution with a peak performance of 41.57 TFLOPS.
MIPT supercomputer was implemented as a part of RSC's DCmini product line, which ensured the solution's high flexibility and linear scalability. Later in 2012 the system performance is increased to 83 TFLOPS with the same system philosophy and a footprint of less than 8 sq. m. Since its creation, the computing cluster has already passed two upgrade stages, and its performance will increase more than 33 times (as of the moment of installing the first pilot system).
The upgraded cluster consists of two computing racks containing 224 nodes on the basis of two new generation Intel® Xeon® E5-2690 processors per node (in total, 448 processors with 3584 cores). The use of Intel® Xeon® E5-2600 family of best-performing processors became possible due to advanced liquid cooling, which is the basis of RSC Tornado architecture. Additionally, larger RAM capacity per node was achieved - 64GB, which totaled to 14.3TB of RAM for the whole system. Currently the cluster system at MIPT has a data storage system of 10TB and a communication network implemented on the basis of a high-speed InfiniBand QDR interface. This supercomputer system takes place in the first 10 at Top50 of Russia/CIS most powerful systems.
Bioinformatics and pharmaceutical modeling are one of the fast-growing areas with an acute need for high-performance supercomputing calculations. The main area of work at I-SCALARE is the development of problem-oriented architectures for computing systems used in biomedicine, pharmacology and small-scale structures. Several computing applied tasks related to the modeling of viruses and cell membranes, as well as interaction between proteins and external fields with cell membranes were selected as the primary goal of the laboratory. On the one hand, all these tasks have a great practical value, and on the other hand they cannot be solved with the existing computing resources. The research carried out on the basis of I-SCALARE laboratory is very important, as breakthroughs in new methods of diagnosis and medical treatment, creation of new pharmaceuticals etc. are possible only through the development of new calculation methods and platforms that take into account specific nature of biological, medical and pharmaceutical tasks.
Moscow Institute of Physics and Technology was founded in 1951 on the basis of MSU department of physics and technology (1946-1951). The institute prepares highly qualified specialists in various areas of modern science and technology.