← Case Study Interviews / all explorations
The interview room / real time
Case studies show you what someone can actually do.
Everything is in case studies. The skill of running one is not a part of interviewing. For practical purposes it is the whole of it, because it is the only instrument that reaches a person's real capability rather than their account of it.
Family one
Asynchronous, as homework
You send a brief and they come back days later with work: a memo, a model, a plan. It measures finished output and the standard someone holds themselves to when nobody is watching.
Not this pageFamily two
Real time, inside the interview
You describe a situation, they act, you respond as the world would. It measures the thing homework cannot reach: what happens in the seconds after they realise they do not know something.
This pageCase studies are almost the only real signal you get.
Ask someone how they handle a difficult client and you get a rehearsed paragraph. It will be fluent, it will be flattering, and it will tell you nothing about whether they can actually do it on a Tuesday. People are not lying. They are describing an idealised version of themselves, and after a few interviews they get good at it.
A case study removes the ability to describe. It puts a situation in front of someone and requires them to act inside it. You stop hearing an account of the work and start watching the work.
Don't tell me what you would do. Do the case study, because through that you see so many other things.
The correction that matters most
That correction is the one people slip on constantly, because it sounds like a distinction without a difference. It is not. "Tell me how you would handle a donor who is wavering" is a knowledge question, and knowledge is the smallest part of what you need to know. "I am that donor. Go." is a case study, and it also tells you whether they ask good questions, whether they can hold a room, whether they explain themselves clearly, and what they do when the ground moves.
History matters, but it matters less than it looks
A résumé is fast to read and worth reading. It tells you the size of rooms someone has been in. What it cannot tell you is whether any of it came to bear. Someone can spend fifteen years accumulating experience they never once converted into judgement, and the page looks identical either way.
So take the history quickly, from the page and the job titles, and spend the interview on what is going on today. The past is context. The case study is evidence.
"But I still need to check whether they know the subject"
Then check it with a case study too. Subject knowledge is the easiest thing in the world to turn into one, because you already know the answers.
Instead of "walk me through the fundraising methods available to a nonprofit", say: "Imagine I am a client. I want you to help me think about how I should go and fundraise." Now you are watching them find out what your situation is before recommending anything, which is the actual job, and you still get the full inventory of methods along the way.
The knowledge question gives you strictly less information than the case study, for the same minutes. There is no trade.
Three dimensions, and you need all three.
A case study is not scored out of ten. It returns three separate readings, and a strong number on one of them does not compensate for a weak number on another.
- How far. How far along in their thinking do they actually get before the time runs out? Some people are still framing the problem when the hour ends.
- How fast. The same distance covered in half the time is a different person. Thoughtful but slow is genuinely worse than thoughtful and fast, and it is easy to forgive slowness because the individual sentences sound good.
- How deep. Pick one branch and keep descending. Everybody sounds competent at the top layer. The reading is the level at which they start to falter.
The same case, three readings
Thoughtful and slowThoughtful and fast
A case study is a pyramid of boxes.
Every box has sub-boxes, and those have sub-boxes. The structure is both very wide and very deep, and you can never cover all of it. So do not try. Cover enough of one layer to see how someone thinks, then pick a single branch and descend until they run out.
That descent is the part interviewers skip, and it is the part that catches the most expensive mistake in hiring: someone who represents depth across a whole layer and only has it at the top. They are not bluffing. They genuinely know a great deal about all of it. They have just never done one of them.
The sounding · a live case study, five levels deep
The brief: a nonprofit needs to raise money. Pick how you would traverse it, then tap any box to see the question you ask there and what the two kinds of answer sound like.
Why the fifth level is the one that matters
Take a real example, and let the interviewer be the one who fails it. Ask about the fundraising methods a nonprofit can use and a smart generalist will do well: they will name each method and describe it accurately, because that is public knowledge and they are good at reading.
Now pick one and drill. And drill. And drill. Down at "a major donor who has given generously before is now telling you he is not sure whether to give again, what do you do", the generalist starts to falter, because they have never sat in that chair. They will still do something respectable: they will ask questions, which is the right instinct and is exactly what a strong first-principles problem solver does. But the questions will be the ones you would ask having never done it, rather than the two questions someone who has done it forty times asks first.
That gap is invisible at levels one through three. It is the entire reason to descend.
Tomorrow, fifty people are coming.
This is a case study for an operational role, and it is deliberately built so that a capable person cannot fail it for the wrong reason. There is no specialist knowledge in it, no trick, and nothing to know in advance. Anything that goes wrong is the candidate.
The setup, said out loud
"There are fifty people coming to our offices tomorrow for a class. I completely missed it. I have nothing ready. If you are responsible for handling it from now, what do you do?"
Short, concrete, and dated to tomorrow on purpose. Tomorrow removes the escape hatch. A situation set "next quarter" invites a plan; a situation set tomorrow demands actions.
The same empty room, two readings
- AThe room, and nothing else in it. Fifty people arrive at nine tomorrow. That is the whole brief, and it is all a non-actionable answer ever engages with.
- 1Do we have chairs?
- 2Desks, or do they bring laptops?
- 3Do we need a TV, and who moves it? The second half of that question is the interesting one: they are mapping what they are allowed to touch before touching it.
- 4Is there a budget, and how much?
- →Nearest furniture shop on the map. Go, buy, bring it back today. And they are writing all of it down while you answer.
Non-actionable
"Well, you know, we'd have to consider a few things, and think about what the right setup is..."
It is not a bad sentence. It is just not real. The event is tomorrow, and the answer is still hovering above the problem looking for altitude. Nothing in it could be executed by anyone.
Actionable
"Let's list what we need. Do we have chairs? Desks? Do we need a TV? What am I not thinking of?"
Straight into the room. Notice that the first move is a question rather than a solution, and that the last question invites you to fill a gap they know they have.
What the follow-up questions actually reveal
You answer honestly, and stay in character. No chairs, no desks. They bring their own laptops. There is one TV, in another room.
"The TV, is moving it something I can do myself, or do I need the technical team?"
That question alone is a reading. It is someone mapping the boundary of what they are allowed to touch before they touch it, which is exactly the instinct you want in a new hire who does not know the building yet.
"You can do it yourself. It's fine, you'll figure it out."
"Desks and chairs, is there anywhere inside the office to get them? Do I have a budget?"
"You have a budget."
Deliberately incomplete. Watch whether they accept a vague number or push for a real one.
"How much?"
"I don't know. How much do you need? What are you going to do?"
"I'd find the nearest furniture shop on the map, go there today, buy chairs and tables, and bring them back."
There it is. That one answer separates an enormous number of people from an enormous number of other people, and the ones on the wrong side of it are not incompetent. They simply lose their footing when the problem stops being abstract.
The library, from junior to very senior.
One case study, used unchanged across every level of seniority. That is not a shortcut, it is the point: when the brief is the same for everyone, the seniority shows up in the answer rather than in the question, and you get a directly comparable reading across candidates who are years apart.
The setup, said out loud
"We have a library as a client. We need to build them software."
Twelve words, and no more, because the sparseness is the test. Everyone has been inside a library, so you spend zero minutes explaining the domain and every minute watching them decide what to ask.
The same brief, two altitudes
- 1Library cards
- 2Borrowing a book
- 3Returning a book Everything a library needs in order to operate. Correct, complete, and entirely inside the building.
- 1Who owns this place?
- 2Is it supposed to make money, or is it a public service? Answer honestly: it should break even, and it has been losing money.
- 3How else could the space earn? Lectures, tutoring, guided visits, renting the room.
- 4And only then: what should the software be? Which of those the client will actually run changes what gets built.
How the senior conversation actually goes
"Who owns the library? Is it supposed to make money, or is it a public service? What is the goal here?"
"It's supposed to break even. It has been losing money."
This is the moment the case study earns its keep. You have just handed over the real constraint, and what they do with it in the next ten seconds is the whole assessment.
"Do we have free rein on what we can do with the place?"
"Not entirely, but there's a lot we can do. We can't hold parties there."
A boundary, not a wall. Give one so the space stays real, and so you find out whether they work inside constraints or argue with them.
"Then before software: how is the space used? Lectures, guided visits, tutoring, renting the room out in the evenings. Which of those the client will actually run changes what we need to build."
Why a library, specifically
Because everyone has been in one. The domain costs you nothing to establish, which means the entire budget of the interview goes into watching them think rather than into explaining a business.
That is the property to look for when you choose your own case. Not "interesting", not "relevant to our industry". Universally understood, so that no part of the reading is contaminated by how well you explained it. An industry-specific case study measures your briefing skills at least as much as their thinking.
Designing a case study.
There are two ways in, and which one you use depends on how much practice you have had.
The built case: design it once, then become expert in it
Write the case study out properly, with its options and its permutations mapped: what the answers can be, which follow-up each one opens, where the branches lead. Then use it repeatedly. After a dozen interviews you know the terrain so well that you stop spending attention on running it and can spend all of it on noticing.
- Choose something they cannot fail for the wrong reason. If there is any blocker in the case unrelated to the capability you are measuring, remove it. You want to know for certain that a good candidate can win here.
- Choose something universally known, so the setup costs one sentence.
- Deliver the context well. Your delivery is part of the instrument. If the framing is muddled you have measured your own briefing, not their thinking, and you will not be able to tell the difference afterwards.
- Map the permutations before you use it. A branch you have not thought about is one you will fumble live, and the candidate pays for it.
The borrowed case: take it off your own desk
Once you are comfortable, the best case studies are the ones you are living through. The mess you were dealing with at midnight last night, the client conversation that went sideways this morning. Play the client, hand them the situation, and watch.
It works because you have just been through every nuance yourself, so you can respond in character without preparation and you know precisely which moves were good ones. It is also free: no design time at all.
The one rule that separates a case study from real life
A case study is real life accelerated and squished. That compression is a privilege you have and reality does not, so use it deliberately.
You can narrate away the dead time. Instead of letting them describe calling someone five times, say "you tried to call him, he isn't picking up" and move on. You can hand over information explicitly that would have taken a week to surface.
But narrate sparingly. Let them take the actions. You respond as you believe the client would, or as the version of the client that makes the next problem harder, because you want to see whether they can solve the next one too.
The rules you say out loud, before you start.
Set these up front, in plain words. They cost thirty seconds and they change what you get for the next hour, because most of what looks like weak performance in a case study is actually somebody guessing at rules nobody told them.
The framing
"We're going to do some short case studies. You'll play the role, I'll play the client. I'll give you the situation and we'll work through it."
The pause rule
"If you're unsure at any point, feel free to stop and consult me, and we'll talk it through. That's how we work here. If you know what to do, you do it. If you don't, you come and talk to me."
Pausing costs a candidate a very small number of points, and you should say so. In the real job they get to pause, ask you, or ask a model, whenever they want. What actually causes damage is not pausing and doing the wrong thing, which is to say not realising they did not know. Someone who notices the gap can close it in an afternoon.
The skip rule
"I may stop us partway through, or skip ahead. That doesn't mean you're doing badly. It just means there's another area I want to get to, and I'm being careful with the time."
Without this, every jump you make reads to the candidate as a verdict, and they spend the rest of the hour recovering from a judgement you never made. It also frees you to move the moment you have your reading, which is the single biggest source of wasted interview time.
It's the not realising you don't know that gets you in trouble. Because if you realise you don't know, it's very easy to get the knowledge.
Why the pause rule is not a courtesy
Running it: four disciplines.
1. Do not answer for them. Hold the silence.
This is the hardest one and the most commonly broken. The pause gets uncomfortable, you fill it with a hint, and you have just destroyed the measurement. Worse, you will not notice you destroyed it: the interview will feel like it went well, because you and the candidate together produced a good answer. Silence is where you find out where they were going.
2. Notice. Deliberately, and in detail.
Notice what they say and what they do not say. Notice whether they are taking notes while you answer. Notice whether the first move is a question or an assertion. Notice the order they ask things in, which is usually a cleaner signal than the content of the questions. Record the interview, because you cannot both run a case study well and take a full record of it, and afterwards the detail is gone.
3. When they pause, teach. Then go back and re-test.
The pause rule means people will use it. When they do, give them the knowledge, genuinely: "you should ask me what we need, and then work out how you're going to get it." Then return to the case and watch whether they can use what you just handed them.
That second half is the point. The pause tells you they can spot a gap. The re-test tells you they can learn, which is the more valuable of the two and the one that almost never gets measured in an interview.
4. Move on the moment an area is safe.
Once you can see they are comfortable at a level, leave. "That's great, we're in the right direction here. I want to hop to something else. Assume he agreed with you on the major donors, and you've started the work. Now you're planning..." You are not there to have a nice conversation. Every minute spent confirming something you already know is a minute not spent finding an edge.
What "a good learner" actually means, and the trap in it
An interviewer who wants a learner usually looks for curiosity: are they asking me questions, are they interested, do they want to know. Curiosity is easy to perform and it is not the signal.
The sign of a learner is that they apply the learning. Not that they wanted it. That they took it and used it in the next five minutes, in front of you. Curious learners are common. Learn-and-apply people are the ones who compound.
Most work is not rocket science. There is simply a very large amount of it, so the job is learn, apply, learn, apply, at increasing levels. If someone cannot complete one turn of that loop inside an interview where you handed them the answer, they will not complete a hundred of them in the job.
When to go deeper, and when to stop and start over.
Any case study can be stretched into three hours, and sometimes it should be. The choice you make roughly ten minutes in is between depth and breadth, and it is decided by how they are doing rather than by your schedule.
The branch, ten minutes in
One case study in progress, about ten minutes in.
Doing well
Stay in this one case. Go deeper into the tree. Add complexity on purpose. Keep going until you find the edges.
Not doing well
End this case now and start a fresh one. Run two, three, four. Do not stop to work out why the first one failed.
Going deeper on a strong candidate
Make it harder. Deliberately. If they say the answer is to recruit ambassadors, become the client and ask how. They explain. Ask what they would say to the ambassadors exactly. Keep pressing, and while you press, play a specific character: a client who is afraid to ask.
Then watch for one thing. Do they notice that your endless questions are the symptom, and that the root cause is a client who has not been made comfortable enough to say what he actually wants? A strong candidate stops answering the questions and addresses the person asking them.
Stopping on a weak one
End the case study and start a different one. Do not investigate why the first one went badly, because you do not have the time and the answer will not change what you do next. You are answering a single question: was that once, or is it every time?
Usually you will see the same shape appear across all of them, and that consistency is the finding. Occasionally the second case goes well, and you have just saved yourself from rejecting somebody over a briefing you gave badly.
Ending a case study even when it is going well
Some case studies should be cut short precisely because they are going well. Once you have the reading for that area, there is nothing left to learn there, and the skip rule you set up front means you can leave without it landing as a rejection.
This is what the short mini case study is for. Several small ones, each covering a different capability, is often a better instrument than one long one, especially when the role is broad. Design the set to cover the areas you actually need to read, and then be ruthless about leaving each one the moment it has told you what it was going to tell you.
What you are actually measuring.
Underneath the three readings sit two separate capabilities, and they substitute for each other. Knowing which one you are looking at changes the hire.
Ten ways to solve this problem
Deep in the domain · knows 10 of 10
Invents nothing. Recalls, selects, executes. Weak problem-solving barely shows here, and often does not need to.
New to the domain · knows 0 of 10
Must invent all ten from first principles. Problem-solving is now the only thing holding the answer up, so the case study measures it directly.
- First-principles problem solving. Rare. It shows as the quality and order of the questions, not the answers. Someone with it will engage well in an area they have never touched, and you can watch them do it because the questions they ask will still be sensible ones.
- Domain experience. Common enough to buy. It shows as knowing which two questions to ask first, and as not needing to invent anything.
- Learning speed. Measured only by the teach-then-re-test move. It is the multiplier on both of the others.
Someone can be an obviously strong problem solver and still be shallow here, and both facts can be true in the same interview. The honest read on a good generalist working outside their experience is usually: strong first-principles thinker, no depth in this specific area, so several of the questions could have been better ones. Write that down as two separate findings, not one blended score.
You are not only assessing. You are also selling.
The caveat that everything above sits inside
Recruiting has two jobs running at once, and case studies only serve one of them.
The first job is learning and assessing, which is what this entire page is about. The second is making sure the role is genuinely good for the person, and making them want it. Both are live in the same hour, and the candidate is interviewing you the whole time.
An interview that is nothing but case studies is a demanding, one-directional experience. You can run it perfectly and still lose the person, and you will never find out why, because nobody tells you that part.
Do not change how you run the case studies to fix this. The instrument is the instrument, and softening it costs you the reading. Pad around it instead, with the things the other person cares about.
- Say the dual purpose out loud. "It's my job to make sure this is a good fit for you as much as for us." That one sentence reframes an interrogation as a mutual decision, and it is true.
- Leave real time for their questions. Not two minutes at the end while you are packing up.
- Ask about their history anyway, for a few minutes, even though it is not where your signal comes from. People want to talk about what they have done, and being asked is part of being taken seriously.
- Qualify honestly, including out of the role. Telling someone plainly what this job requires, and that they will struggle without it, is worth more than a smooth close. The ones who are wrong for it deselect themselves, and the ones who stay know what they signed up for.
Deciding, with the risks named out loud.
The reading you have at the end is almost never "yes" or "no". It is a shape, with strengths and specific holes in it, and the decision is what you are willing to carry.
You cannot get everything at once
Once you know what you want, you still have to prioritise, and sometimes the right hire is a stepping stone. Someone might take you one level up but not two. That is often still worth doing, and it is a different decision from settling: you are choosing which capability to buy now and which to buy later, deliberately, rather than holding out for a person who does not exist.
Name the risks, and say them to the candidate
Every hire is made with risk in it. The discipline is making the risks explicit to yourself before you decide, and then sharing them with the person, at least at senior level. It changes what the first six months are about, because both of you know where the thin ice is.
The two chairs
High volume
Running the factory of lower-end chairs: many clients, each moved forward fast, none of them gone into deeply.
Deep and bespoke
The artisanal piece: one client, gone into deeply, over a long time. Plenty of senior people are outstanding at this and have never run the factory.
A worked verdict: two and a half risks
A real senior hire, anonymised. Three concerns came out of the process, and they were not treated the same way.
Risk one: technology. Real, accepted, and named to the candidate before they joined.
Risk two: the lower-end work. Not depth, which was proven, but volume: moving many things forward quickly rather than going deep with one client. The factory rather than the artisanal chair. Also real, also accepted, also named.
The half risk: willingness to just go and do the thing. This is the one that was not accepted, and the reason it counts as a half is that it was closed before the offer rather than carried after it.
The move was to insist, before hiring, on a few specific pieces of work done as instructed. A calculator, a document, a plan. The artifacts themselves turned out not to matter much, and were barely used afterwards. That was never the point. The point was to find out whether this person would do specific things as instructed in order to move through the phases, because if they would not do it before joining they would not do it after, and the rate of learning in the first six months would have been too slow to work.
The lesson generalises. Some risks you accept and name. Some you close before the offer, with a small, real piece of work whose output you do not need. Deciding which is which is the actual hiring judgement, and it is worth writing down for yourself before you make the call.
Ask for a rich handoff
When someone else runs the first interview and you take the second, do not accept a thumbs up. Ask for five to seven minutes of unstructured voice: what they did, what was good, what was not good, what the concerns are. A written summary compresses out exactly the hesitations you need, and it is the hesitations that predict.
The run sheet
Everything above, in the order you would actually use it.
Before
- Decide the two or three capabilities this interview has to read. Nothing else gets time.
- Pick a case per capability: universally understood, no blockers, winnable by a good candidate.
- Map the permutations, or take a live situation off your own desk instead.
- Write the setup as one or two sentences and check it is unambiguous.
- Set up the recording.
Opening
- State the dual purpose: it has to be a good fit for them too.
- Explain the format: they play the role, you play the client.
- Give the pause rule, and say it costs almost nothing.
- Give the skip rule, and say a jump is not a verdict.
During
- Deliver the setup, then stop talking.
- Hold every silence. Never answer for them.
- Answer in character, honestly, incompletely where reality would be incomplete.
- Narrate only to skip dead time.
- When they pause, teach properly, then return to the case and see if they apply it.
- Going well: stay in, go deeper, add complexity, find the edge.
- Going badly: end it, start a new one, do not ask why.
- Area safe: hop, out loud, without apology.
Closing and after
- Leave real time for their questions. Ask about their history.
- Write the three readings separately: how far, how fast, how deep.
- Separate problem-solving from domain. Do not blend them into one score.
- List the risks. Mark each one accepted-and-named, or closed-before-offer.
- If someone else interviews next, send seven minutes of voice, not a verdict.
If you want to see the iterations it took to create this article, the versions that led up to it are here.