A number turns red on your dashboard. Sales look down. Conversion’s dropped. Traffic’s tanked. Your stomach lurches, and before you know it you’re firing off an urgent Slack message asking someone to “look into this now.”
Stop. Breathe. I’ve watched brilliant directors torch a whole afternoon – and sometimes a whole quarter’s strategy – chasing a number that was never actually a problem.
Here’s the truth after two decades in ecommerce: most dashboard “emergencies” aren’t emergencies at all. They’re misreadings. In this post, I’ll give you three simple questions to ask before you react. Ask them every time, and you’ll make calmer, sharper decisions – and stop solving problems that don’t exist.
Why panic is the most expensive reaction
Panic feels productive. It isn’t.
When a leader reacts to a scary number without understanding it, one of two things usually happens. Either you pour budget and energy into fixing the wrong thing, or you kill something that was actually working. Both cost you money.
I’ve seen a business slash a campaign because “the conversion rate dropped” – when that exact campaign was bringing in a flood of new, high-value customers who simply took longer to buy. The number looked bad. The reality was brilliant.
The fix isn’t to ignore your data. It’s to interrogate it properly before you act. That’s where the three questions come in.
The takeaway: a red number is a prompt to investigate, not a signal to panic.
Question 1: Is this the right metric?
Start here, always. Because half the time, the number staring back at you isn’t even measuring what you think it is.
Dashboards are packed with metrics that sound similar but tell wildly different stories. Conversion rate is a classic example. GA4 alone gives you a session-based rate and a user-based rate – and they can move in completely opposite directions while your actual sales stay perfectly healthy.
Ask yourself:
- What does this number actually measure? Sessions? Users? Events? Revenue?
- Does it reflect the outcome I care about? A dip in “add to cart” means little if your revenue’s climbing.
- Am I looking at a vanity metric or a money metric? Traffic feels great, but it doesn’t pay the bills. Sales do.
Get specific here. A drop in one metric is often just an artefact of how that metric is calculated – not a sign anything’s gone wrong in the real world.
The takeaway: before you worry about a number, make sure it’s the number that genuinely matters.
Question 2: Am I comparing like with like?
This is the one that catches out the most experienced people I know.
A number in isolation means nothing. It only has meaning next to something else – last week, last month, last year. And the moment your comparison isn’t clean, your conclusion is worthless.
Common comparison traps
- Different length periods. Comparing a 28-day month to a 31-day month? Of course the totals differ.
- Seasonality. Judging January against December in retail is madness. They’re different worlds.
- A changed measurement model. If the platform changed how it calculates something (hello again, GA4), you’re comparing apples to a completely different fruit.
- One-off events. A viral post, a Black Friday spike, a PR mention – strip these out before you draw a trend.
Here’s a real scenario. Run a clever repeat-purchase campaign this year that you didn’t run last year, and all those returning visits can dilute your session-based conversion rate. Year on year, it looks softer – even while your tills are busier than ever.
For a true read on performance, you need a clean, like-for-like view. Compare the same period, the same conditions, the same definitions. Do that, and most “drops” quietly vanish.
The takeaway: if your comparison isn’t clean, your panic isn’t justified.
Question 3: Has anything changed that could explain this?
Numbers don’t shift for no reason. Before you assume the worst, go hunting for the cause.
Nine times out of ten, there’s a perfectly logical explanation sitting in plain sight. You just have to look for it.
Where to look first
- Tracking and tags. A broken pixel or a fired-up consent banner can make sales “vanish” overnight – when they’re happening just fine.
- Site or platform changes. A recent deployment, a theme update, a checkout tweak. Did something break?
- Marketing activity. Did a campaign end? Did a budget get paused? Did a channel shift?
- External factors. Competitor pricing, a bank holiday, a heatwave, the news cycle. Retail lives in the real world.
I always tell teams: assume a technical or logical cause before you assume a genuine performance collapse. More often than not, the “crisis” is a tracking glitch or a paused ad set – a five-minute fix, not a five-alarm fire.
The takeaway: find what changed before you decide what’s broken.
Putting the three questions to work
Let’s tie it together with a quick example.
Monday morning. Your dashboard shows conversion rate down 15% week on week. The old instinct? Panic. The disciplined approach? Run the three questions.
- Is this the right metric? You’re looking at session-based conversion – but revenue’s actually up 8%. Interesting.
- Am I comparing like with like? Last week included a bank holiday spike. This week’s normal. Not a clean comparison.
- Has anything changed? You launched a retargeting campaign that’s pulling in returning visitors, inflating sessions.
Three questions. Ten minutes. And what looked like a disaster turns out to be a business in rude health. No wasted budget. No knee-jerk decisions. Just clarity.
That’s the whole point. These questions turn a panicked reaction into a confident, evidence-led decision.
Common mistakes leaders make with dashboards
Even sharp operators fall into these. Watch for them:
- Reacting to a single data point instead of a trend.
- Trusting the dashboard blindly without checking the tracking behind it.
- Chasing vanity metrics that feel good but don’t drive revenue.
- Comparing carelessly across mismatched periods or definitions.
- Acting before investigating – the most expensive habit of all.
Spot yourself in that list? Good. Awareness is the first step to better decisions.
The honest approach to data
Here’s where I’ll be straight with you, because that’s how we do things at Hot Dog Solutions.
Your data isn’t there to scare you. It’s there to guide you – but only if you read it properly. Too many agencies either bury clients in dashboards nobody understands, or panic right alongside them to look busy. Neither helps you.
We take a different view. We go into businesses and run their ecommerce operations as an extension of the team, and part of that job is telling you the truth about your numbers. If a metric’s misleading you, we’ll say so. If a “problem” is really a tracking glitch, we’ll find it and fix it. And if there is a genuine issue, we’ll show you exactly what’s going on and what to do about it.
No drama. No smoke and mirrors. Just clear, honest answers you can act on with confidence.
The bottom line
A scary number on your dashboard is an invitation to think, not a reason to panic. Before you react, run the three questions every single time:
- Is this the right metric?
- Am I comparing like with like?
- Has anything changed that could explain this?
Ask them, and you’ll stop chasing phantom problems, protect your budget, and make decisions you can actually stand behind.
If your dashboard’s telling you a story you can’t quite untangle, that’s exactly the kind of puzzle we love getting stuck into. Come and have an honest conversation with us at hotdogsolutions.com – we’ll help you see what’s really going on.
by Malachi Simons, Founder of Hot Dog Solutions.
