More Efficient Supercomputers
Supercomputer manufacturers have always vied to build the most powerful machine. Now, they routinely increase energy efficiency, as well. The most recent addition to this ongoing article looks at the current top performer, China's Tianhe-2.
Top 500 Supercomputer Sites put China's Tianhe-2 supercomputer at its #1 position in June and keeps it there in the November 2013 rankings. ", a supercomputer developed by China’s National University of Defense Technology, retained its position as the world’s No. 1 system with a performance of 33.86 petaflop/s..." This is ~1.9X the performance of the #2 computer, United States' Titan. But the Top 500 list shows that Tianhe-2, at 17.81 MW, consumes ~2.2X the electricity. "Titan is one of the most energy efficient systems on the list consuming a total of 8.21 MW and delivering 2.143 gigaflops/W." Tianhe translates as "Milky Way" in English.
The current (October 2012) contender for most powerful is the US government's Titan. Like many recent supercomputers, it strives for both compute power and energy efficiency by using conventional CPU chips working with GPU chips from consumer gaming. “'One challenge in supercomputers today is power consumption,' said Jeff Nichols, associate laboratory director for computing and computational sciences. 'Combining GPUs and CPUs in a single system requires less power than CPUs alone and is a responsible move toward lowering our carbon footprint.'" Despite this, the annual electricity bill for Titan will be $9 million.
A project begun in 2002, Supercomputing in Small Spaces (SSS) "…has evolved in two different directions: (1) a low-power, architectural approach and (2) a power-aware, software-based approach." Principal investigator Wu-chun Feng tells us that site updates have lagged, but the SSS publications page is current, including papers from 2012 Green ICT conferences.
The latest Top 500 Supercomputer Sites (June 2012) gives the top spot to the United States's Sequoia, the latest configuration of the IBM BlueGene/Q. It displaces Japan's K computer (below) from Fujitsu, which now occupies the #2 position. The BBC notes that, "The IBM supercomputer is also more energy efficient than the Fujitsu model. Sequoia consumes 7.9 megawatts compared to the K computer which uses 12.6 megawatts."
The November 2011 Top 500 Supercomputer Sites gave the top spot to Japan’s K Computer. It displaced China's Tianhe-1A, which moved to the #2 position. The Top 500 site notes that, "The K Computer is also one of the most energy efficient systems on the list."
In another example of high-performance energy efficiency that year, IEEE Spectrum reports on China's Godson-3B processor, "With a peak frequency of 1.05 gigahertz, the Godson is slower than its competitors' wares, at least one of which operates at more than 5 GHz, but the chip still turns heads with its record-breaking energy efficiency. It can execute 128 billion floating-point operations per second using just 40 watts—double or more the performance per watt of competitors."
China's Tianhe-1A claimed the title of the worlds fastest computer in 2010. It uses a mix of CPUs and GPUs to generate this performance while consuming less energy than is typical of its class. GPU manufacturer NVIDIA explains, "a 2.507 petaflop system built entirely with CPUs would consume more than 12 megawatts. Thanks to the use of GPUs in a heterogeneous computing environment, Tianhe-1A consumes only 4.04 megawatts, making it 3 times more power efficient -- the difference in power consumption is enough to provide electricity to over 5000 homes for a year."
This is one of several new approaches to supercomputer design targeting their enormous energy consumption and cooling needs.
A 2008 article in IEEE Spectrum described a Japanese supercomputer of similar power, when focused on specific tasks, to IBM's Roadrunner, then the king of the computing hill. The author says that the Japanese machine cost one-tenth of the price and consumes one-tenth of the power because of its "purpose-built" architecture. A typical top-tier supercomputer requires over 1MW of input power annually and at least that much again to cool it. This represents thousands of tons of carbon emissions per year for a site powered by fossil fuel. The long-term research viability of purpose-built supercomputers is still debated but their cost benefits and environmental value are undeniable. The first proposed application is climate modeling, which can have its own carbon footprint!
Another design for a climate simulation computer is the Green Flash. A researcher highlights the trade-off between processor speed and operating cost in multi-processor design:
American [sic] Micro Devices' Opteron processor core, for example, can easily outperform one of Tensilica's embedded processors. "Only" 1.7 million AMD Opterons would be needed to carry out the 10 petaflops required to simulate Earth's atmosphere at cloud-resolving resolution. So you might then be tempted to assemble a climate-modeling supercomputer out of standard dual-core Opteron chips. But that would be foolish. Even if you could foot the initial bill, which we estimate would be more than a billion dollars, you probably couldn't afford to run it, because it would consume almost 200 MW, costing perhaps $200 million a year for electricity. In contrast, a Tensilica-equipped Green Flash would sip power, relatively speaking, requiring only 3 MW, a level many large computer centers are already equipped to handle.
For more information about this project's power trade-offs, see section 4.2 of the US NERSC research paper.
Green Flash is just a design concept right now, while Tianhe-1A is an operating machine. One area innovators are building machines using CPUs designed for embedded applications like mobile devices is to create mega-servers. Higher processor speeds are usually associated with higher heat generation, which in turn increases the energy required to cool the equipment and worsens a supercomputing or cloud service facility's PUE. In contrast to typical CPUs, processors designed to be embedded in devices are specifically designed for low power consumption.
Images courtesy of Chinese People's Liberation Army, Oak Ridge National Laboratory