Evaluating a provider honestly
Sample size and survivorship bias
4 min
Two statistical traps quietly destroy more capital than bad strategies do.
Sample size
A trader with 20 trades and a 70% win rate has shown you almost nothing — that result is well within what pure luck produces. You need a large number of trades, across varied conditions, before a record carries any statistical weight. Short, hot streaks are abundant and meaningless; flipping a coin ten times and getting eight heads does not make the coin magic.
Survivorship bias
This is the deeper trap. A copy-trading platform might host thousands of traders. Random chance alone guarantees that some will have spectacular records right now — just as, out of thousands of coin-flippers, a few will hit ten heads in a row.
The leaderboard shows you those lucky few. The thousands who blew up are quietly delisted and invisible. You are not looking at the best traders; you are looking at the luckiest survivors of a large random sample — and there is no reliable way to tell skill from luck after the fact.
What this means for you
Picking last quarter’s top copy-trader is often just buying the ticket that already won the lottery — with no reason to expect it wins again. Demand a long, large, condition-varied record, and discount any ranking that hides the failures. If you cannot see the losers, you cannot trust the winners.
This content is for educational and informational purposes only and is not investment, financial, tax or legal advice. Trading and investing carry risk, including the possible loss of capital. Any performance shown by third-party tools is hypothetical and not a promise of future results. Do your own research and consider professional advice before making any decision.