
It makes sense that supercomputer benchmarks would also need some updating as the computing landscape changes. Where we used to use a standard benchmark that just looked at raw performance, we now make use of the Passmark Performance Benchmarks, which takes a much more well-rounded look at how a system is doing, component by component, while also considering how they are linked. Given how competitive the agencies, governments and companies whose computers make the list seem to be, it’s a sure bet that using two benchmarks will be controversial, and give people ammunition to argue that they should be ranked higher.īut having benchmarked everyday nonsupercomputers for the past 15 years in the GCN Lab, I can say that benchmark technology has certainly changed.

The two together will determine how supercomputers place on the new TOP500 lists.

Dongarra explained the new benchmark measures how supercomputers are able to drive applications through their increasingly diverse makeup of CPU and GPU chips instead of just taking a raw power snapshot.ĭata Center Knowledge reports the new HPCG won't replace Linpack, but will instead be used at the same time. The alternative is a new benchmark he and Sandia National Laboratories’ Michael Heroux are developing called the High Performance Conjugate Gradient. “Yet the relevance of the Linpack as a proxy for real application performance has become very low, creating a need for an alternative.” “The Linpack benchmark is an incredibly successful metric for the high-performance computing community,” Dongarra said. "We have reached a point where designing a system for good Linpack performance can actually lead to design choices that are wrong for the real application mix, or add unnecessary components or complexity to the system," Dongarra said, according to the blog. In a post on the University of Tennessee blog, he explains why Linpack no longer works as well as it once did. Now, Dongarra shares that sentiment, too. The scientists working on supercomputer development at the Energy Department's Oak Ridge National Laboratory said much the same thing when I interviewed them earlier this year about the United States’ supercomputer development plans. The benchmark as worked well, but there are those who say that it no longer accurately represents true supercomputing power. To rate one supercomputer against another, the TOP500 list uses the Linpack benchmark, which was created by Jack Dongarra, a professor at the University of Tennessee. How long a supercomputer can stay on the list is faithfully reported by technology media outlets around the world. Universities, governments and even private companies compete to build the fastest supercomputers and earn a place on the list. The TOP500 list of the fastest supercomputers in the world has been a staple of computing for over 20 years.
