Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

What's wrong with using the best result? If you're concerned the code could run faster than possible: don't be :)


What if the test data is random? Could just get lucky and get a happy day scenario.


Then both versions should get that "happy day"? If you are using distinct random data for each version, then you aren't really benchmarking properly.


It doesn't say that they both use the same data sets.


If they are using different data sets, then I'd say it's an invalid benchmark.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: