The investor meeting started well. The founders pulled up a dashboard with graphs pointing up and to the right.
"Website traffic is up 200% quarter over quarter. We've crossed 50,000 app downloads. Our Twitter following doubled last month. The content strategy is really working."
The investor nodded, then asked a simple question: "How many people are paying you?"
A pause. "We're focused on building the user base first. Monetization comes later."
"Of those 50,000 downloads, how many opened the app this week?"
Another pause. "We're still working on retention. But the top-of-funnel metrics are really strong."
The meeting ended politely. The follow-up email never came. The founders were confused—the numbers had been so good.
The numbers had been exactly the wrong numbers.
The Comfort of Going Up
Metrics that go up feel like progress.
There's a dopamine hit in watching numbers climb. Downloads increasing. Followers growing. Pageviews multiplying. The graphs create a sense of momentum, a feeling that something is working.
The problem is that some metrics can go up while the business goes nowhere. You can have a million website visitors and no customers. A hundred thousand downloads and no retention. Thousands of followers who will never buy anything.
These aren't useless numbers—they're tracking something real. But what they're tracking often has little connection to whether anyone will pay for what you're building.
The Metrics That Feel Good vs. The Metrics That Matter
There's a rough hierarchy of startup metrics, from least to most meaningful:
Vanity metrics feel good but predict nothing: total downloads, pageviews, registered users, social followers. These can grow while your business dies. Activity metrics show engagement but not value: daily active users, session length, feature usage. Better than vanity metrics, but people can be active without finding enough value to pay. Value metrics indicate someone's getting something: activation rate, retention, return visits, feature adoption. Getting warmer—people are finding something worth coming back for. Business metrics show the thing is working: revenue, paying customers, expansion revenue, profitability. These are the metrics that determine whether you have a business.The metrics theater happens when founders optimize for the top of the hierarchy while ignoring the bottom.
Why We Do This
It's not stupidity. The pull toward vanity metrics comes from understandable places.
They're easier to move. Getting more pageviews is simpler than getting more paying customers. Running ads, posting content, doing PR—all of these can inflate top-of-funnel numbers quickly. Building something people will pay for is harder and slower. They're easier to explain. "Downloads are up 40%" is a clean story. "We're iterating on activation rate and it's complicated" is a harder one to tell. Investors, advisors, even team members often respond more enthusiastically to big simple numbers. They delay hard truths. If you're tracking the metrics that matter, you might learn uncomfortable things. People aren't retaining. No one's paying. The product isn't working. Vanity metrics let you postpone that reckoning while still feeling productive. Everyone else does it. The startup ecosystem celebrates top-of-funnel numbers. TechCrunch writes about download milestones. Twitter celebrates follower counts. It's easy to absorb the implicit message that these numbers matter.The Hidden Damage
The metrics theater isn't just a waste of time. It actively causes harm.
When you optimize for pageviews, you build for pageviews. You write clickbait content, design for shareability, chase whatever drives traffic. But none of that builds a product people will pay for. The skills and habits you develop are the wrong ones.
When you celebrate download numbers, you hire for download numbers. Marketing focuses on acquisition. Product focuses on first impressions. The hard work of retention and monetization gets deprioritized because it's not what's being measured.
When you report vanity metrics to investors, you attract investors who care about vanity metrics. The ones who would push you toward sustainable growth filter themselves out. Your cap table fills with people who'll be surprised when the business doesn't materialize from all those downloads.
The Metrics That Predict Product-Market Fit
If you're searching for product-market fit, certain metrics matter more than others.
Retention tells you if people find lasting value. Not whether they signed up—whether they came back, repeatedly, without being prompted. The shape of your retention curve predicts almost everything about your business. Activation tells you if new users find value quickly. What percentage of signups reach the moment where they understand why your product exists? If activation is low, nothing downstream matters. Revenue (or strong purchase intent) tells you if the value translates to willingness to pay. Free users who love your product but won't pay are a warning sign, not a success metric. Referrals tell you if users value the product enough to stake their reputation on it. Organic word-of-mouth is the strongest signal that something real is happening.The Dashboard Audit
There's a useful exercise: look at your current metrics dashboard and ask, for each number: "If this doubled tomorrow, would we be meaningfully closer to a sustainable business?"
For pageviews, the answer is usually no. Double the pageviews, same number of customers.
For downloads, often no. Double the downloads, but if retention is broken, you just have twice as many people churning.
For paying customers who retain? Yes. For activation rate? Probably yes. For expansion revenue from existing customers? Definitely yes.
The metrics that survive this test are the ones worth building dashboards around. The rest are distractions dressed up as data.
Making The Switch
Shifting from vanity metrics to real metrics is uncomfortable.
The numbers will be smaller. Instead of celebrating 50,000 downloads, you're staring at 200 weekly actives. Instead of a graph that goes up, you might have one that's flat or declining.
But smaller real numbers are more valuable than larger fake ones. Two hundred people who come back every week are a foundation. Fifty thousand people who downloaded once and left are just database entries.
The founders who find product-market fit tend to know their real metrics intimately. They can tell you their weekly retention rate, their activation percentage, their revenue per user. They're not guessing or hoping—they're measuring the things that determine whether the business will work.
The Honest Dashboard
The antidote to metrics theater is a dashboard you'd be uncomfortable showing—because it shows what's actually happening.
Not the numbers that make you look good. The numbers that tell you whether you're on track. The numbers that, if they don't improve, mean the business will fail.
That dashboard might be depressing right now. It might show that retention is broken, that activation is low, that revenue isn't growing. But at least you're seeing reality. And reality is the only thing you can actually fix.
Related Reading
- Fake Traction: Understanding Vanity Metrics
- Signs of Product-Market Fit
- How to Measure Product-Market Fit
- The Sean Ellis Test Explained
Ready to assess your PMF?
Take our free 5-minute assessment and get a personalized roadmap.
Start Free Assessment→