Supercomputer SKIF-AURORA-SUSU upgrade
Technical DataSheet Supercomputer SKIF-AURORA-SUSU
Technical Info Supercomputer SKIF-AURORA-SUSU
- Performance:117 TFLOPS (Peak) / 100.4 TFLOPS (LINPACK)
- Nodes / Сores (CPU + CoCPU) / Threads (CPU + CoCPU):738 / 4428 / 8856
- CPU:Intel® Xeon® X5680 (6 cores, 3.33 GHz)
- Motherboard:Supermicro X8DTT
- Total RAM of the nodes:8.8 TB (DDR3-1333)
- Total disk storage of the nodes:108 TB, Solid State Drives Intel® SSD
- Interconnect:System Interconnect: 3D-Thorus, 60 Gb/s; Service network: InfiniBand QDR, 40 Gb/s
- Service network:3x 1GigE independent sensor and control networks, incl. SKIF-Servnet v.4
- Occupied Area:10.00 м.кв. (107.64 sq. ft.)
RSC SKIF has upgraded existing computing rack of SKIF Aurora SUSU supercomputer.
By replacing 4-core Intel® Xeon® 5500 series processors with the latest 3.33 GHz 6-core Intel® Xeon® 5600 processors (keeping all existing infrastructure intact) the performance was increased from 24 to 40.7 teraflops. Besides, the supercomputer was also expanded, so the entire computing complex consists of 2.5 racks based on 6-core 3.33 GHz Intel® Xeon® 5600 series processors, and its total performance increased by over 4 times to 117 teraflops.
The most unique achievement of the SKIF Aurora SUSU upgrade project is making its liquid cooling system universal so that it can work both with cool and hot water (depending on weather conditions).
Using liquid cooling to create the most energy efficient supercomputer systems became a global trend in the industry. This is proven by the latest Green500 list of the most energy efficient supercomputers in the world that has liquid cooled systems on top three positions for almost a year (in November 2009 and June 2010 editions). All of these three supercomputers are installed in Germany in Forschungszentrum Juelich (FZJ) research center, Regensburg University and Wuppertal University and have world's best energy efficiency of 773.38 megaflops (million floating point operations per second) per watt of consumed power.
However, using hot water instead of cold (cooled) water in liquid cooling systems has even greater potential. In September, 2010, RSC SKIF specialists have developed first technology solution in CIS to create a hot water based cooling system for supercomputers demonstrating that this method is the next step of improving energy efficiency.
Use of hot water in supercomputer liquid cooling systems enables natural heat exchange with ambient air providing free cooling effect for a long period of a calendar year. Complete removal of freon line (used for water cooling) from this cooling system greatly reduced infrastructure costs, minimizes impact on the Earth ozone layer and improves supercomputer solution reliability.
Universal liquid cooling system and a combined cooling system operation method in SKIF Aurora SUSU supercomputer enabled even greater savings of power costs. Such innovative approach enabled creation of a supercomputer that is the most energy efficient in Russia and CIS countries and one of the world's best in energy efficiency.