How Data Replaced Intuition in Sports
In 2003, Michael Lewis documented how the Oakland Athletics used data to challenge traditional baseball wisdom. By finding value in players others overlooked, the team proved that even a century-old industry could be fundamentally wrong about how it measured success. This discovery sparked a global movement to apply data analysis to everything from government to filmmaking, seeking to replace intuition with objective evidence.
Yet, the transition to data-driven decision-making remains difficult across many industries. When statistical models fail to predict a surprise election or a sports slump, there is a powerful urge to return to the judgment of seasoned professionals. Humans have a persistent hunger for experts who offer certainty, even when the human mind is naturally wired to resist objective data.
Daryl Morey, the general manager of the Houston Rockets, observed this resistance firsthand in professional basketball. Basketball scouts traditionally relied on face-to-face interviews and memorable anecdotes to evaluate young athletes. Morey realized that the human brain places disproportionate weight on these moving stories, which frequently mask underlying issues like a lack of discipline or hidden injuries. To combat these illusions, Morey sought to replace the traditional intuition of scouts with a rigorous, data-driven approach.
To build a better predictive tool, Morey developed a statistical model that challenged long-held basketball wisdom. His data revealed that traditional statistics were often misleading, as a player might score high points while actually hurting their team's overall efficiency. He began gathering original data to identify specific traits that actually predicted professional success. This objective lens allowed the team to find value in overlooked players, proving that an equation could often see what the human eye missed.
However, the transition was not without failure, and these errors forced Morey to confront the limitations of his own data. He realized that systematic mental errors, such as confirmation bias and the endowment effect, consistently warped the judgment of his scouts. Morey instituted strict rules to break these mental shortcuts, forcing evaluators to look past physical appearances and focus on actual playing styles. This movement demonstrated that in a world of uncertainty, the best defense against error is a constant state of skepticism toward one's own intuition.
Full summary available in the Readsome app
