My grandfather ran a precious metals shop for nearly fifty years. I spent countless hours there as a kid, watching him weigh silver coins, assess gold jewelry, and negotiate with collectors who were convinced they’d discovered undervalued treasures. The shop taught me something fundamental about markets: everyone thinks they know something others don’t. Most are wrong.
That experience sparked my fascination with money itself – not just as currency, but as a system of value transmission and information aggregation. Years later, when I encountered Bitcoin and started understanding SHA-256 hashing and cryptographic primitives, that fascination deepened into something more technical. The mathematical elegance of proof-of-work led me to cybersecurity, where I eventually earned my master’s degree. But through all of this technical evolution, one economic principle has remained constant in my thinking: markets are far more efficient at processing information than individual investors give them credit for.
The Uncomfortable Truth About Beating the Market
Eugene Fama won the Nobel Prize in Economics in 2013 for work he’d been conducting since the 1960s on what he termed the “Efficient Market Hypothesis.” The core insight is deceptively simple: in competitive markets with relatively free entry and low information costs, prices rapidly incorporate all available information. If there’s a signal suggesting future values will be high, competitive traders buy on that signal, bidding the price up until it fully reflects that information.
This doesn’t mean markets are clairvoyant or that they never make mistakes. As Fama himself emphasized in recent interviews, efficient markets is a hypothesis, not reality. The market can’t predict the future. What efficiency means is something more modest but more profound: for almost everybody, the market is efficient in the sense that they don’t have information that’s not already built into prices.
The empirical evidence supporting this framework is overwhelming. The S&P Dow Jones Indices SPIVA Scorecard – the industry standard for benchmarking active versus passive performance – delivers results that should be sobering for anyone convinced they can pick winning stocks or time the market. Over the 20-year period from 2005 to 2024, 94.1% of all domestic funds underperformed the S&P 1500 Composite Index. On a risk-adjusted basis, that number climbed to 97.3%.
Let that sink in. Of the funds that survived the full 20-year period (and less than half did), fewer than six in a hundred beat the market when adjusted for risk. These aren’t amateur traders – these are professional fund managers with teams of analysts, proprietary research, and every conceivable information advantage. If they can’t consistently beat the market, what makes individual investors think they can?
Technical Analysis and Other Comfortable Illusions
I’ll be direct: technical analysis, in my view, has been largely debunked as a reliable method for generating alpha. The efficient market hypothesis predicts exactly this outcome. If simple trading rules like “buy when the price fell yesterday” worked, competitive traders would exploit them until they stopped working. The surprising empirical result, as financial economist John Cochrane has written, is that trading rules, technical systems, and market newsletters have essentially no power beyond that of luck to forecast stock prices.
This isn’t to say price patterns never emerge or that technical traders never make money. It’s to say that whatever patterns exist are either too weak to overcome trading costs and taxes, or they disappear once enough people attempt to exploit them. Markets adapt faster than trading strategies can maintain edges.
The same logic applies to most forms of active stock picking. Morningstar research tracking hundreds of thousands of individual stock positions found that between 2013 and 2023, 90% of mutual funds picked more losing stocks than winners. The hit rate for active managers – the percentage of their holdings that outperformed their fund’s benchmark – clustered around 44% for large-cap funds. A passive index fund does no better on this metric, but it also doesn’t charge 10 times the fees attempting to.
The Case for Global Diversification
If beating the market is a fool’s errand for most investors, what’s the alternative? This is where many people make a second mistake: assuming the S&P 500 represents adequate diversification.
The S&P 500 is a collection of 500 large American companies. It’s a fine index, but it represents roughly 65% of global market capitalization while covering maybe 4% of the world’s population. Concentrating your entire equity allocation in one country – regardless of how economically dominant that country has been historically – introduces unnecessary geographic and currency risk.
I favor globally diversified funds like Vanguard Total World Stock Index (VT) because they weight holdings by global market capitalization. You’re not making a bet that the United States will outperform or underperform international markets. You’re capturing the performance of the entire investable equity universe, automatically adjusting as global capital flows and market valuations shift.
VT tracks the FTSE Global All Cap Index, which includes stocks of all sizes listed in developed and emerging markets. The fund holds nearly 10,000 securities across more than 50 countries. Its expense ratio is 0.06% – essentially a rounding error compared to the 0.64% average for actively managed equity funds. Over the 10 years through December 2024, VT’s ETF share class beat the global large-stock blend category average by 1.5 percentage points annualized, with most of that advantage coming directly from its ultralow fees.
Market-cap weighting works because the market collectively does a good job of valuing stocks over the long run. Occasionally, it increases exposure to expensive stocks when investors get excited about certain sectors or regions. But that excitement reflects real information aggregation from millions of market participants. Trying to outsmart that collective judgment consistently is what the data shows to be nearly impossible.
The Play Money Bucket
Now, does this mean I have zero exposure to individual assets? No. I maintain what I call a “play money” bucket – a small allocation to Bitcoin and select individual stocks. But this allocation is far removed from my core nest egg, which remains properly diversified in global index funds.
The play money bucket serves a psychological function as much as a financial one. It satisfies the very human desire to make active investment decisions without jeopardizing long-term wealth accumulation. If I’m wrong about Bitcoin or a particular stock thesis, the damage is contained. If I’m right, the upside is nice but not life-changing because the allocation is deliberately small.
As much as I appreciate the historical role of precious metals and worked around gold and silver for years, they don’t constitute a large percentage of my asset allocation. Gold and silver have their place in certain portfolios, particularly as inflation hedges or crisis insurance, but the empirical evidence suggests equities deliver superior long-term real returns. Commodities lack the productive capacity that drives equity returns over time – they don’t generate cash flows, they don’t innovate, they don’t compound.
The Joint Hypothesis Problem and What It Means for Investors
Fama identified what he calls the “joint hypothesis problem” – a technical but important insight. You can’t test market efficiency without also testing a model of how risk and expected returns are related. Every test of whether the market is efficient is simultaneously a test of your theory about what the “right” price should be.
This matters because it means we can never prove markets are perfectly efficient. We can only say that deviations from efficiency are difficult to identify and exploit consistently. Some anomalies have been documented – small-cap stocks and value stocks have historically delivered higher returns than the Capital Asset Pricing Model would predict. Fama and Kenneth French incorporated these findings into their famous three-factor model, arguing these premiums reflect additional risk factors rather than market inefficiency.
The practical implication is humility. Markets may not be perfectly efficient, but they’re efficient enough that the vast majority of investors are better served by accepting market returns rather than trying to beat them. The costs of attempting to beat the market – fees, taxes, trading costs, and the opportunity cost of underperformance – stack up quickly.
When Private Markets Enter the Picture
At some point, I hope to be able to afford the risk that comes with private market investments – venture capital, private equity, direct startup investments. These markets are less efficient precisely because they lack the liquidity, transparency, and competitive trading that characterize public markets. Information advantages can potentially be monetized in private markets in ways that are nearly impossible in public equities.
But private market investing requires capital you can afford to lose entirely. Lock-up periods can extend for years. Valuations are subjective and opaque. The distribution of returns is highly skewed – a small number of investments generate most of the profits while the majority lose value. Taking on that risk profile early in wealth accumulation, when the nest egg needs protection and growth, would be irresponsible.
The Boglehead philosophy – named after Vanguard founder John Bogle – emphasizes staying the course with low-cost, broadly diversified index funds through market cycles. It’s not exciting. It doesn’t generate cocktail party conversation. But it works. The compounding of market returns over decades, with costs minimized and diversification maximized, has proven to be the most reliable path to wealth accumulation for the vast majority of investors.
The Wisdom of the Crowd, Applied to Capital Allocation
My grandfather’s precious metals shop demonstrated a micro version of market efficiency. Experienced collectors would bring in coins they were certain were undervalued. My grandfather, having seen thousands of similar coins and tracking market prices daily, would make an offer reflecting the actual market clearing price. The collectors often left disappointed, convinced he simply didn’t recognize the value. In reality, the market had already incorporated whatever special characteristics they thought made their coins valuable.
Financial markets operate on the same principle, just orders of magnitude larger and faster. Millions of participants, managing trillions of dollars, constantly evaluating information and adjusting positions. The Bitcoin blockchain taught me to appreciate distributed consensus mechanisms – no single authority determines the state of the ledger, yet the system reaches agreement through competitive validation. Public markets function similarly. No central authority determines “correct” prices, yet competitive trading aggregates dispersed information into valuations that are remarkably difficult to systematically exploit.
This doesn’t mean you shouldn’t invest. It means you should invest with realistic expectations about your ability to outperform market benchmarks. It means understanding that diversification isn’t just about holding different stocks – it’s about holding different types of assets, across different geographies, at the lowest possible cost.
The Path Forward
The data is clear. The vast majority of professional fund managers fail to beat their benchmarks over meaningful time horizons, and those who do rarely repeat their success. Technical analysis lacks predictive power beyond random chance. Market timing consistently destroys value when accounting for the full cycle of entries and exits.
What works is embarrassingly simple: buy low-cost index funds providing global equity exposure, rebalance periodically, and hold through market cycles. Add bonds as you approach the point where you’ll need to draw on the capital. Keep costs minimal. Minimize taxes through appropriate account selection and holding periods. Stay the course when markets decline and when they surge.
I understand the appeal of active trading. Working in enterprise technology and cybersecurity, I appreciate the desire to apply analytical skills to generate alpha. But the honest assessment, supported by decades of research and empirical evidence, is that those skills are better applied to our careers than to beating public equity markets.
Save your risk budget for where it might actually generate asymmetric returns – private markets when you can afford the risk, or human capital investments that increase your earning potential. Let the public markets do what they do best: efficiently allocate capital and deliver equity risk premiums that compound wealth over time.
The market is smarter than you think. More importantly, it’s smarter than almost everyone thinks, including the professionals paid enormous sums to outperform it. Accepting that reality isn’t defeatist – it’s the first step toward building wealth that actually lasts.