← Emberlern/The Data Diaries With Dee
The Ticket That Doesn't Come Back / Module 08

The metrics, and what they hide

Five lessons, about fifty-five minutes. Every support role eventually gets measured by a handful of numbers. This module is about knowing what those numbers actually capture, what they miss, and how to report an honest bad week — because a founder who only ever hears good numbers stops trusting the numbers at all.

Module 8 worksheets A metrics reference card, a metric-gaming spotter, an honest-report template, a pushback script, and the one-page weekly report template. One .docx, five pages.
Lesson 8.112 minutes

CSAT, first response time, resolution time — what each is actually measuring

Three numbers show up in nearly every support role, and each measures something narrower than it sounds like it does. Knowing the actual definition, not just the name, is what lets you use them honestly rather than being used by them.

What each one actually captures

CSAT (customer satisfaction) measures how a customer felt about one specific interaction, rated right after it — not their overall relationship with the brand, and not whether the underlying problem is actually gone. First response time measures how fast someone got any reply at all, including a holding message — not whether that reply helped. Resolution time measures how long a ticket stayed open — which can be gamed by closing a ticket early and letting the customer reopen it, making the metric look better while the actual experience got worse.

A metric that looks great and means little

First response time of two minutes, CSAT of 5 stars, on a ticket that took four separate messages and eleven minutes total to actually resolve, because the two-minute "response" was just "thanks, looking into this!" A dashboard reading this ticket sees pure success.

Keep this
  • CSAT measures one interaction's feeling, not the relationship or whether the problem's actually gone.
  • First response time measures speed of any reply, not usefulness.
  • Resolution time can be gamed by closing early — know this before trusting the number blindly.
Do this now — 5 minutes

Write one scenario where a support metric would look excellent despite the actual customer experience being mediocre.

Lesson 8.212 minutes

When chasing a metric makes the service worse

A metric is meant to be a proxy for good service, not the goal itself. The moment it's treated as the goal, the incentive quietly shifts toward whatever makes the number look good, even when that diverges from what actually helps the customer.

Recognising the divergence

If chasing first response time means sending a low-value holding message instead of taking the extra ninety seconds to actually solve the problem, the metric is now working against the customer. If chasing resolution time means closing a ticket the moment a reply is sent, before confirming it actually worked, the same thing is happening. The tell is always the same: doing something that helps the number but doesn't help the person.

Chasing the number versus solving the problem
Chasing resolution time

Closes the ticket the instant a reply is sent, without waiting to confirm the fix actually worked — the metric improves, and the customer reopens it two days later, now more frustrated than the first time.

Solving the problem

Sends the reply, then follows up once to confirm it worked before closing — resolution time looks slightly worse on paper, and the ticket actually stays resolved.

Keep this
  • A metric is a proxy for good service, not the goal itself.
  • The tell: doing something that helps the number but doesn't help the customer.
  • A number that looks slightly worse but reflects real resolution beats one that looks great and doesn't.
Do this now — 6 minutes

Write one way each of the three metrics from 8.1 could be gamed, and what actually solving the underlying problem would look like instead.

Lesson 8.311 minutes

Reporting a bad week honestly, with the reasons, not just the numbers

Every support role has a genuinely bad week eventually — a supplier problem causing a spike in complaints, a personal reason you were slower than usual, a queue that simply outgrew what one person could handle. How that week gets reported matters more, longer-term, than the numbers themselves.

What an honest bad-week report actually contains

The real numbers, not softened or hidden. The specific reason, named plainly — not excused, just explained. And what's being done about it, if anything is within your control. A founder who gets this once trusts every future report more, including the good ones.

A bad week, reported straight

"CSAT dropped to 3.8 this week from our usual 4.6. Cause: the broken-pump batch issue drove a real spike in complaints — 14 this week versus our normal 2–3. I've flagged the batch to the supplier per my note on Tuesday. Expect this to recover once the replacement stock ships."

Keep this
  • Report the real numbers, never softened.
  • Name the specific reason plainly — explained, not excused.
  • A founder who gets one honest bad-week report trusts every future report more, including the good ones.
Do this now — 5 minutes

Write a bad-week report for a made-up dip in one of the three metrics, using the worked example's shape.

Lesson 8.410 minutes

Saying no to a target that would mean doing the job badly

Occasionally a target itself is the problem — a first-response-time goal so aggressive it only leaves time for a holding message on every ticket, or a resolution-time target that pressures closing tickets before they're actually fixed. Pushing back on the target itself, with reasoning, is sometimes the right call, not a failure to hit it.

How to push back without sounding like you're making excuses

Name the specific tradeoff the target forces, propose an alternative that protects the actual outcome, and frame it around what the founder cares about — retained customers — rather than around your own workload, which reads as self-interested even when it isn't.

Pushing back on a target, with reasoning

"Hitting a 2-minute first-response target on every ticket means I can only send a holding message, not an actual answer, on the harder ones — which means customers get a fast reply and then wait longer overall for the real fix. I'd rather target under 5 minutes for a genuinely useful first reply. I think that serves customers better even though the number looks less impressive."

Keep this
  • Name the specific tradeoff the target forces, concretely.
  • Propose an alternative, don't just object.
  • Frame around what the founder actually cares about — retained customers — not your own workload.
Do this now — 5 minutes

Write a pushback message for a target you think would hurt service quality, using the worked example's shape.

Lesson 8.510 minutes

The one-page weekly report a founder actually reads

A report a founder skims in ten seconds and actually retains beats a detailed dashboard export they never open. The skill is compression: the three numbers that matter, what changed and why, and anything worth their attention — nothing else.

The shape

Numbers first, with last week's for comparison. One line on what's behind any real change. Anything worth flagging — a pattern, a risk, something good worth noting too, since an honest report includes real wins, not just problems.

A weekly report, compressed to what matters

"CSAT 4.6 (was 4.5). First response 4 min avg (was 6). Resolution 1.1 days avg (was 1.3). Nothing to flag this week — quietest week in a month. One nice note: a repeat customer mentioned in chat that the new packaging arrived undamaged, first time in a while."

Keep this
  • Numbers first, with last week's for comparison — context makes a single number meaningful.
  • One line on the reason behind any real change, not a paragraph.
  • Include real wins, not just problems — an all-problems report reads as either exaggerated or exhausting.
Do this now — 6 minutes

Write a one-page weekly report for a made-up week, using the shape above, including at least one genuine positive note.

Module 8 drillfifty minutes

A messy week of ticket data

A week's worth of raw ticket data is supplied for Bumi Naturals — timestamps, first replies, resolution times, and CSAT scores, unsorted and including a real dip caused by the broken-pump batch issue from earlier modules.

Deliver three things

  1. The real numbers — CSAT average, first response average, resolution average, computed honestly from the raw data.
  2. The honest report — explaining the dip, using 8.3's shape, with the real cause named plainly.
  3. The one-page weekly report — compressed to what a founder would actually read, using 8.5's shape.

How it is marked

  • Are the numbers actually computed correctly from the raw data? Not estimated or rounded generously.
  • Is the cause named honestly, not softened or vague? "Things were a bit slower" fails; naming the specific batch issue passes.
  • Would a founder actually read the one-pager in ten seconds and retain it? Length and compression are part of what's being marked here, not just accuracy.
What this drill is really testing

Whether you can turn messy raw data into an honest, compressed report under a real bad-week scenario — not whether you can recite what CSAT stands for.

Before module 9

You should now have: a clear-eyed read on what each metric actually measures and misses, a sense of when chasing one makes service worse, an honest bad-week report shape, a pushback script, and a compressed weekly report template. Module 9 turns to running yourself as an actual business — rates, agreements, and getting paid across borders.