Correctly Defining the Role
Define outcomes, not job titles. Attract people ready to achieve specific results.
TL;DR
Core Insight: Don't hire for a job title. Hire for the 2 outcomes that matter most.
The 2 Variables:
- Variable 1: The Non-Negotiable - The single capability that makes everything else irrelevant. If they have this, you can teach the rest.
- Variable 2: Team Building - Can they hire and develop great people to achieve the outcome? (if applicable)
Everything else flows from these.
The Core Philosophy
- Define success in 2 variables
- Fill out the scorecard → becomes your JD, outreach, interview questions
- Assess the team to find gaps (technical, vibe, working style)
- Everything else flows from the completed scorecard
Where This Would Live
A recruitment wiki that's both public-facing and internal. Think Gumroad's old wiki.
| What It Shows | Why It Matters |
|---|---|
| What we're hiring for | Transparency attracts aligned candidates |
| Mission in depth | More than a careers page can offer |
| Role responsibilities + team members | Candidates know exactly what they're joining |
This becomes part of the talent brand. We're building roles in public, walking through our thought process. This attracts people who love how we hire.
How I Would Use This Playbook with AI
Build an internal recruiting chatbot linked to this playbook + Exa AI for sourcing.
| Benefit | Impact |
|---|---|
| Auto-update knowledge base | Team shares new insights → playbook improves |
| Cut role kickoff time by 10x | AI pre-fills scorecard from past roles + industry research |
| Free up time for the real work | Finding unfindable talent, speaking to incredible people, talent branding |
Key: Fill out the scorecard yourself using every resource available (team interviews, past JDs, industry research, internal docs). Then present it to your hiring partner for alignment. Whatever you put here becomes your outreach, becomes your pitch, flows through the entire system.
Section 1: Role Overview
| Field | Value |
|---|---|
| Position | Role title |
| Reports To | Hiring Manager name |
| New or Backfill | Is this a new role or replacing someone? |
Section 2: Vision for the Role
What would make this incredibly compelling for our ideal candidate?
Write 2-3 sentences describing why a top performer would be excited about this role. What's the opportunity? What will they build? What impact will they have?
Section 3: Single Sentence Filter
This is your 2 Variables in one sentence. If a candidate doesn't fit this, they're out.
Format: "This person could [VERB] + [OUTCOME] while [CONSTRAINT]"
Section 4: Candidate Profile
| Category | Questions to Answer |
|---|---|
| Personality Profile | What type of person thrives in this role? How do they solve problems? What's their communication style? |
| Past Experience | What have they already done that would signal they can do this? What's the proof they've done Variable 1? |
| Experience Level | Executive / Senior / Mid / Entry |
| Comp Range | What are we currently paying the team? What's the range for this role? |
Section 5: Dream Role Overview
This role will be an absolute dream from the candidate's perspective if...
Use insights from your team interviews. What do current team members love about their role? What would make someone say "I HAVE to get this job"?
Section 6: Required Skills & Responsibilities
Max 3 skills. Each skill maps to job responsibilities.
| Required Skill | How It's Applied (Responsibilities) |
|---|---|
| 1. | |
| 2. | |
| 3. |
How the Scorecard Feeds the System
Completed Job Scorecard
↓
├── Single Sentence Filter → Outreach messaging
├── Vision for Role → JD headline & pitch
├── Dream Role Overview → Selling points in interviews
├── Required Skills → Interview questions & Discovery Project
└── Comp Range → Offer negotiation guardrails
Core Philosophy: We're looking for a person that has the highest likelihood of achieving an outcome.
If we can define this persons outcome to 2 variables, this will give us a high likelihood of confidence when we interview them.
Variable 1: The Non-Negotiable
The single most important capability. If they have this, you can teach the rest.
This person has [VERB] + [OUTCOME] + [CONSTRAINT]
Questions to figure out Variable 1:
- What's the #1 outcome this person needs to achieve in 6-12 months?
- What past experience proves they can do this?
- What makes this hard here specifically? (the constraint)
- What interview question would verify they've done this?
Variable 2: Team Building (if applicable)
Can they attract and develop talent for their function?
This person can attract [ROLE] who [QUALITY]
Note: Defining a person within two variables does not mean this is a binary process. It does not mean that if someone does not have these exact variables that we would not hire them. Every conversation that you have to bring someone incredible onto your team is more about "what is the best seat for this person given that they are great?"
The Knockout Question
Ask this in every interview to validate Variable 1:
"Tell me about a time you [DID VARIABLE 1]. What were the constraints? What was the outcome?"
If Variable 2 is in play: "Tell me about someone you hired. How did you find them? What made them great?"
Remember: It is OK if they do not meet 100%. We are always asking: "What is the best seat for this human?"
Why Assess the Team?
You already have great people. Study them to understand what "great" looks like. Then hire to fill the gap, not duplicate what you have.
Step 1: Interview Current Team Members
For each person in or near the role, ask:
- What makes them great? (not just skills - their personality superpower)
- What's their day-to-day? (the new hire needs to be great at this)
- What problems are they actually solving?
- Why is this their dream role? (or what would they like to see improve to make it their dream role)
Bonus: Have the team record their answers so you can later use these as selling assets to send to candidates before interviews.
Step 2: Find the Gaps
This is about understanding where the team is strong and where there are gaps this person can fill.
Gaps can be:
- Technical - Missing skills, domain expertise, or experience with specific tools
- Vibe/Energy - Maybe the team is super serious and you need someone who can brighten the room
- Working style - Fast shippers vs deep thinkers, async vs sync communicators
Questions to ask:
- What skills does one team member have that others don't?
- What's common across all of them?
- What's missing that would complement the team?
- What personality trait would balance the current dynamic?
Important: This is an assessment, not a sole hiring criteria. You don't hire someone just because they fill a gap. But understanding the gaps helps you know what to look for.
Step 3: Compare Team Members
If you have multiple people in similar roles, pin them against each other:
| Aspect | Team Member A | Team Member B |
|---|---|---|
| Technical Strength | ||
| Superpower | ||
| Gap |
Questions that actually reveal gaps:
- What problems does the team struggle with that nobody is great at solving?
- When the team gets stuck, what type of person would unblock them?
- What's the thing everyone avoids because nobody owns it?
- What expertise would make the team 2x faster?
- What personality trait is missing from the current dynamic?
The Talent Density Rule
Every hire should raise the bar. At minimum, they should be just as good as the people on your current team. But you want to strive to hire people that are better. Over time, you're hiring better and better people. That's how you build a world class team.
Completed Scorecard: ML Engineer
Role Overview:
| Field | Value |
|---|---|
| Position | ML Engineer |
| Reports To | Tanay (CEO) / Sahaj (CTO) |
| New or Backfill | New role - expanding the team |
Vision for the Role:
Build the ML system that powers millions of users writing faster than ever. You'll work on on-device speech recognition, pushing the limits of latency and accuracy. This is the core technology that makes Wispr Flow magical.
Single Sentence Filter:
This person has shipped on-device speech recognition with sub-500ms latency to production users.
Candidate Profile:
-
On-device shipping - Has deployed models to constrained devices (phones, not cloud). Knows the difference between notebook accuracy and production accuracy.
-
Latency obsession - Understands sub-500ms is the bar. Thinks in P50 vs P99. Has debugged why some users see 1200ms while others see 400ms.
-
Accuracy/Speed navigation - Has made the hard tradeoff. Knows when to sacrifice 2% accuracy for 100ms. Understands distillation, quantization, pruning.
-
User outcome focus - Measures success by zero edit rate, not WER benchmarks. Knows "good WER" and "users don't have to edit" are different things.
-
Privacy-first mindset - Defaults to on-device. Understands why cloud is not an option. Has worked within memory and compute constraints.
-
Edge case hunter - Obsesses over the last mile (99% → 99.9%). Knows the 8 accuracy killers: accents, background noise, code-switching, domain vocabulary, short utterances, name recognition, speech understanding, incoherent outputs.
Dream Role Overview:
- You own the full stack (on-device, not cloud). No waiting on other teams.
- Clear success metric: zero edit rate. You know exactly when you've won.
- Sub-500ms latency is the bar. Real engineering constraints, not vanity benchmarks.
- Your improvements ship to millions of users. You'll feel the impact in days, not quarters.
- Work directly with founders. No layers of management between you and decisions.
Required Skills & Responsibilities:
| Required Skill | How It's Applied |
|---|---|
| 1. On-device ML deployment | Ship models to iOS/Mac with sub-500ms latency |
| 2. Speech recognition expertise | Improve accuracy while maintaining speed |
| 3. Production debugging | Debug P99 latency spikes and edge case accuracy issues |
Knockout Questions:
| Question | What It Proves |
|---|---|
| "What is the difference between good WER and users not having to edit?" | User-focus |
| "When have you sacrificed accuracy for speed?" | Latency experience |
| "Hardest on-device constraint you have worked around?" | Device experience |
| "How do you debug accuracy issues in production?" | Shipped to real users |
Business Goal:
Build the ML system that powers millions of users writing faster than ever. Zero edit rate is the north star.
This completed scorecard feeds into: JD, outreach messaging, interview questions, and discovery project criteria.