Data Snooping Bias and Multiple Testing Corrections in Strategy Research

Test 100 strategies on the same data and about five will look significant by pure luck. Here is how I keep the trial count honest and answer how many backtests is too many.