• must compare programs in similar (identical) environments
  • eliminate system effects ... system load, caching
• avoid data sample bias ... use likely/varied sample data
• benchmarks give a coarse view of program performance

Benchmarks are not useful as a basis for performance tuning

• they provide no (direct) information to help analyse inefficiency