Skip to content

Measuring training effectiveness starts before you teach anything

You can say how many people came and how highly they rated the day. Neither number tells you whether anybody can do something on Monday that they could not do on Friday. That is the part you were asked to deliver, and it is the part the end-of-course form never sees.

What the end-of-course form cannot tell you

A form handed out at the end measures the last twenty minutes, the biscuits and how much the room liked the trainer. It is collected before anyone has tried to use any of it, so it cannot measure use. It also arrives too late to help you: by the time you read that a section confused people, the room has gone. Questions asked during the session are a different instrument. They tell you what to reteach while there is still time to reteach it, and they leave you a before-and-after pair rather than a mood. That pair is not proof of training ROI, and this page will not pretend otherwise. It is evidence, which is more than a headcount and a score out of five.

A course that leaves you with a number

Six questions spread across one course, not asked in a block at the end. The worked example below is a session on handling customer data requests. Swap the subject matter and keep the shape, because the shape is the part that measures the learning outcomes you were asked about.

  1. Step 1Rating

    How confident are you handling one of these on your own today?

    Ask it in the first two minutes, before you teach anything. It is the easiest question in the room to answer honestly, and it is half of the pair of numbers you will show the person who paid for the day.

  2. Step 2Multiple choice

    A customer emails asking for everything we hold on them. What do you do first?

    • Forward it to your manager
    • Reply and ask them to confirm who they are
    • Log it — the clock has already started
    • Send them the export from their account page

    A baseline, deliberately unscored. It tells you which half of your material this particular room already knows, so you can spend the day on the half they do not.

  3. Step 3Quiz

    How long do we have to respond once a request lands?

    • 72 hours
    • One calendar month
    • Three months
    • There is no fixed deadline

    Asked immediately after the hardest ten minutes, while you can still fix what it finds. Write each wrong option as a mistake you have genuinely heard — a room that picks the breach-notification window here has merged two deadlines, and that is a specific thing to correct rather than a low score.

  4. Step 4Open text

    Which part of that would you struggle to explain to someone on your team?

    The quiz shows you that something did not land. This shows you what. Recognising the right option from a list of four is not the same as being able to explain it, and the gap between the two is where most training quietly fails.

  5. Step 5Ranking

    Which part of today do you most want another go at?

    • Spotting a request that does not look like one
    • Checking who you are actually talking to
    • What we can hold back, and why
    • Writing the response itself

    Near the close, when everyone has seen all of it. Ranking forces one topic to the top, which is the difference between a follow-up session with a subject and a follow-up email that says 'any questions'.

  6. Step 6Word cloud

    One thing you will do differently on Monday

    Last, in a word or two. Read it for concreteness rather than sentiment: a cloud full of 'careful', 'aware' and 'focus' means the room enjoyed the day and took nothing home, while verbs and object names mean it did.

Getting numbers an L&D sceptic will accept

Write the wrong answers first

The score tells you almost nothing; which wrong answer wins tells you everything. Make each distractor a real mistake you have heard someone make, and a failed question becomes a named misconception you can teach against next time.

Do not score anyone before you have taught them

Open with the unscored question, not the quiz. A leaderboard in the first five minutes teaches the room that answering is risky, and you will spend the rest of the day looking at very cautious data.

Leave time in the plan to reteach

If a third of the room misses the concept check and you move to the next slide anyway, you have taught them that the questions are decoration and they will stop answering properly. Leave five minutes in the plan for reteaching, and use it in front of them.

Repeat the opening question at the close

The same confidence question, worded identically, in the last two minutes. One number is an opinion; the same number twice is a change, and it costs thirty seconds to collect.

Then send it again six weeks later

Send the same two or three questions as a two-minute session a month or two later. A same-day answer partly measures the goodwill of a room that has just had lunch; the six-week answer is about the job, and it is the one a sceptical budget holder will actually read.

Say out loud that the answers are anonymous

Nobody admits confusion in front of their manager, and in most training rooms the manager is present. If people believe a wrong answer can be traced back to them, you are measuring their caution rather than their understanding.

Run this in your next course

Every question above, ready to edit. Put your own subject matter in, keep the order, and leave with a before-and-after pair instead of a rating out of five.

Create yours nowNo card, and nobody you invite needs an account.

More in this section

Sprint retros

Retro questions the quiet half of the team will actually answer

Team meetings

Make the decision in the room, not in the thread afterwards

Workshops

Brainstorming that collects ideas from the whole room, not the three people who like talking

All-hands meetings

Let the question everyone is thinking get asked without anyone having to own it

Employee training

Training feedback that names the step where the room lost you