I was reminded of Zed’s rant last week when my painfully intelligent cofounder with a PhD published a very interesting benchmark, that was wrong by a factor of 3. None of the 30,458 programmers who viewed his post have pointed out his mistake, so I thought it’d be worth talking about some common benchmark issues.