home | about | newsletters | contact | advertising | shop | radio | courses | widget | site map

Helping Normal People Get Their Geek On And Live The Digital Lifestyle

Is It Possible To Make $141,657.15 While Playing With Your PC?
» Learn More About PCMech Premium Program
Big Things Are About To Happen Here

Login: Password: Remember me

Take Benchmarks With A Grain Of Salt

Posted Mar 15, 2008 by Jason Faulkner  

When looking at benchmark numbers of any kind, always be wary of what a benchmark truly is: simulated relative tasks and not real world tasks. While there is value in a benchmark as it is a way to somewhat measure performance between different components, but keep in mind the tests the benchmark program runs may have nothing to do with what you do in real use of the component.

Personally, I’ve always believed the philosophy, that “benchmark = lie”. I’m not going to go so far as to say this is true, rather emphasize real world performance over test scores.

Think about this: suppose there is a program “Test My Graphics Card” which is the defacto standard for measuring graphics card performance. Don’t you think graphics card manufacturers would optimize their cards to score well on this program, regardless of real world performance? I’m not trying to be cynical here, rather proposing a realistic scenario.

All I am saying here, is to simply think twice before letting a benchmark score determine the worth or effectiveness of hardware or software. By no means is a benchmark the “holy grail” of performance measurement.

Posted In: Daily Tips

Got The Newsletter?

Exclusive PCMech Content. Sign up and receive our free report: 20 Tips For Becoming a Technology Power User.

NAME:
EMAIL:

PCMech Highly Recommends...

This is the "kitchen sink" e-book for computer maintenance and repair. A jam-packed 346 pages. As Monte Russel (the author) says in his e-book, "Computers have always been complex, but if a guy that grew up out in the boonies in Wyoming can fix 'em, you can also!" Monte is a 20-year veteran of the U.S. Air Force. Afterwards, he served a long career as a computer repair tech and network administrator. LEARN MORE

Best of PCMech