Skip to content

Stay connected w/ me.

me [at] borghei [dot] me

article9 min read

Why Most Product Metrics Dashboards Tell You What Already Happened

Most dashboards are autopsies dressed up as strategy. By the time the number moves, the decision that caused it is weeks old. What to measure instead.

Your metrics dashboard is not a product tool. It's a history document. And the fact that you look at it every Monday morning and call it data-driven decision making is one of the more expensive habits in product management.

I don't mean this as a productivity critique. I mean it literally. Revenue, DAU, churn rate, NPS. These numbers measure the output of decisions you made weeks or months ago. The campaign that ran in March. The onboarding change that shipped in February. The pricing adjustment that went live before the last board meeting. By the time those decisions register in your lagging metrics, the window for responding to them has already closed. You're not making decisions with data. You're narrating the consequences of decisions already made.

Most teams know this in the abstract. Almost none of them have built their operating rhythm around something different. The dashboard stays because the dashboard is what everyone agreed on, and changing it would require admitting that a significant portion of every weekly metrics review is theater.

The problem isn't the data. It's the question the data answers.

Here's a useful test. Take the last time a metric moved significantly, up or down, on your main dashboard. Ask yourself: what decision did that movement inform? Not what did we learn, not what story did we tell about it, but what did someone do differently because of it?

Most of the time the honest answer is: nothing. The number went up, the team felt good, they kept doing what they were doing. The number went down, there was a post-mortem, someone added a ticket to the backlog. The metric confirmed something, it didn't change anything.

That's because confirmation is not the same as decision support. A dashboard built around revenue, retention and NPS is built to confirm whether your strategy is working. That's a legitimate function. But confirmation metrics and operating metrics are different instruments, and most product teams run both jobs off the same dashboard.

A board needs confirmation metrics. They need to know the company is working. A product team needs operating metrics, signals that are early enough and specific enough to change what they do on Monday morning. When you conflate those two jobs, you get a dashboard that serves the board and misleads the team.

I've built metrics systems at Snapp with 45M+ monthly active users, at Kioosk tracking onboarding conversions on a crypto exchange where a single-day delay in KYC verification moved weekly revenue by tens of thousands of euros, and at Reviv Italy where the metric that determined whether a patient completed their treatment protocol had nothing to do with the metrics our BI tool surfaced by default. In every case, the first version of the dashboard was built around what was measurable. The useful version was built around what was actionable, which was a different list.

What "lagging" actually costs

The timing problem is more damaging than most product leaders acknowledge.

In a two-week sprint cycle, a lagging metric that reflects a four-week-old decision means the team is two full sprints behind the feedback loop. By the time they see the signal, they've already shipped two more iterations on top of the thing that wasn't working. They're not just slow to respond, they've compounded the original problem twice before they know it exists.

At PRCNX, I manage 15+ clinic locations across Italy, the UAE and Turkey. One of the things that becomes obvious when you operate at that scale is that aggregate metrics are not just slow, they're actively misleading. A 78% therapy adherence rate across the network sounds healthy. Split it by location and one clinic is at 91%, another is at 54%. The aggregate is an average of a problem and a success. If you're making resourcing decisions off the aggregate, you're ignoring the failure and crediting yourself for the success at the same time.

This is not a scale problem. Every product team that serves more than one user segment or acquisition channel is running the same risk. The aggregate retention rate, the aggregate activation rate, the aggregate NPS. These are averages that describe no actual user. The PM who is optimizing for the average is optimizing for a person who doesn't exist.

The metric worth tracking is the one that predicts, not confirms

At Snapp's Club loyalty product, the number I cared most about was not in any standard dashboard template. I called it second-purchase rate: did a user who completed their first loyalty transaction come back for a second one within fourteen days?

It was not an intuitive metric. It required a definition decision (what counts as a loyalty transaction), a time window decision (why fourteen days, not seven, not thirty) and a cohort analysis to validate that it actually predicted what we thought it predicted. That analysis took two weeks to build properly. But once we had it, the data was unambiguous: users who hit a second purchase within fourteen days of their first had a ninety-day retention rate more than three times higher than users who didn't. The metric moved two and a half months before churn did.

That's what a leading indicator is. Not a metric that feels forward-looking. Not a metric that's named something optimistic. A metric that empirically precedes the outcome you care about by enough time to do something about it.

Finding one requires looking at your cohort data with the specific goal of finding a behavioral signal that precedes your most important outcome. Most teams skip this analysis because it's not in the BI tool by default, because the definition is debatable and because you have to be willing to be wrong about the first three things you try before you find the right one. It's slower upfront than adding another column to the dashboard. It's significantly faster when you need to catch a problem before it compounds.

At Reviv, for IV therapy adherence, the leading signal wasn't what patients did at session two or three. It was whether a patient responded to our follow-up communication within forty-eight hours of session one. That single behavioral signal predicted full-protocol completion with enough accuracy that we built our entire patient engagement platform around catching and responding to that window. The 33% increase in therapy adherence didn't come from reminders or gamification. It came from identifying the right predictive signal and intervening at the right moment, which requires knowing what that moment is before the patient has already dropped off.

The three questions most dashboards don't answer

Most product metrics dashboards are organized around outputs. Here is what happened. Here is how many people did the thing. Here is whether it went up or down.

The questions that actually inform product decisions are different.

The first is: where in the journey are we losing people, and how early can we see it? Aggregate retention doesn't answer this. A funnel analysis split by acquisition channel and cohort week does. The team that knows "users from paid social who don't complete step three of onboarding in their first session almost never come back" has actionable information. The team that knows "day thirty retention is 42%" has a number for the board deck.

The second is: which users are getting value and which aren't, and what distinguishes them? This requires a definition of what value delivery looks like in your product, not engagement, not sessions, not screen time, but the specific moment where the product does what it promises. For Kioosk, it was the first successful trade. For a B2B SaaS product, it might be the first exported report, the first API call, the first team member invited. Once you have that definition, you can split your user base into people who reached it and people who didn't, and trace back what distinguishes the two groups at the point of acquisition. That's where you find the product insight. Not in aggregate MAU.

The third is: what does the behavior of my best users look like at day three, not day ninety? Retention analysis typically runs on thirty, sixty and ninety day windows. By day ninety, the difference between your retained and churned users is already baked in. The behavior that predicts which group someone ends up in usually shows up in the first week. The team that's analyzing early behavior in retained vs. churned cohorts has a chance to intervene. The team that's reading ninety-day retention is reading the outcome, not the cause.

Why the dashboard doesn't change

The reason most teams keep the wrong dashboard is not ignorance. It's that the right dashboard is harder to defend.

A leading indicator requires a model. You're saying: I believe that this metric predicts that outcome, based on this analysis. That model can be wrong. The metric can fail to predict in a new cohort. A stakeholder can challenge the causal logic. "Why fourteen days and not ten?" is a fair question and one you have to be able to answer.

A lagging indicator doesn't require a model. Revenue went up. Churn went down. Nobody challenges the definition. The metric is harder to argue with because it's describing what already happened, and what already happened is not debatable.

The consequence is a metrics culture that optimizes for defensibility over usefulness. Metrics that are hard to challenge replace metrics that are hard to calculate. The dashboard becomes a consensus document rather than an operating instrument. And the team that's running every weekly meeting off last month's confirmation metrics is making decisions based on a reality that no longer exists.

The dashboard is not neutral. What you measure shapes what you optimize for. What you optimize for shapes what you build. If your primary operating metrics are all lagging, your team is structurally set up to react, never to anticipate. Every insight arrives after the window for acting on it has closed.

That's not data-driven. That's data-documented.

If you're running a product team and want to think through what a metrics audit looks like in practice, get in touch.


This is the seventh in a weekly series on what I see in the market and hear from operators across the companies I've worked with. Next week: why operating across multiple regulatory regimes is a product design problem, not just a compliance one.