Hiring an impact evaluator is one of the highest-stakes decisions a nonprofit makes—get it wrong, and you'll waste budget, time, and credibility with donors. The right evaluator translates your mission into measurable outcomes; the wrong one delivers a binder full of data nobody uses. Here are the questions that separate capable partners from expensive mistakes.
Does the Evaluator Have Sector Experience?
Impact evaluation isn't generic consulting. An evaluator who's strong in healthcare outcomes measurement may flounder with youth mentorship programs or conservation initiatives. Ask specifically about their portfolio: Have they evaluated organizations like yours? How many similar theories of change have they tested?
A evaluator experienced in your subsector understands the nuances of your logic model and can benchmark your results against realistic comparables. They'll also know which metrics actually matter to your funder base—not just which ones are easy to collect.
What's Their Methodology Philosophy?
Some evaluators default to randomized controlled trials. Others favor mixed-methods approaches or participatory evaluation. Neither is universally "best," but they cost vastly different amounts and answer different questions.
Ask them directly: What designs have they used in the past year, and why? If they push a single methodology regardless of your context, that's a red flag. A strong evaluator asks you first—what decisions do you need to make?—before proposing methods.
How Will They Handle Attribution vs. Contribution?
This is where nonprofit evaluation gets real. If your program participants improve, how much of that improvement is actually your program's doing versus external factors (family support, school quality, economic conditions)?
Real evaluators know this is hard and expensive to prove rigorously. Ask how they'd approach this for your specific outcomes. Expect answers like "we'll use a comparison group" or "we'll employ contribution analysis with theory of change validation"—not vague promises that they'll "prove impact."
What Are the Realistic Costs and Timeline?
Impact evaluations range from $15,000 to $150,000+, depending on complexity, sample size, and rigor level. A formative evaluation tracking early outcomes costs far less than a summative evaluation with a comparison group.
Get a detailed scope of work with line-item pricing. Ask:
- What's included in their fee? (Data collection, analysis, reporting, dissemination?)
- How many evaluation cycles are they planning?
- What happens if you need mid-course corrections?
- Are there costs beyond the main contract (data management, external reviewers, visualization)?
A reputable evaluator gives you a range upfront and explains the cost drivers transparently.
Will They Build Organizational Capacity, or Just Hand You a Report?
Some evaluators treat evaluation as a one-time audit. Others build your internal team's ability to measure and learn continuously. The second approach costs more initially but pays dividends.
Ask whether they'll train your staff, create reusable data collection tools, or help you establish monitoring systems. If sustainability matters to you—and it should—prioritize evaluators who invest in capacity-building alongside external validation.
How Will They Support Actual Use of Findings?
The graveyard of nonprofit impact evaluation is full of beautifully written reports that nobody read. Ask the evaluator: How do you ensure findings actually change decisions?
Look for evaluators who plan stakeholder engagement meetings, help you communicate results to different audiences, and build dissemination into the contract. Ask about their experience presenting to boards, major donors, and program teams.
Do They Have Relevant Certifications or Affiliations?
While not strictly necessary, memberships in professional networks like the American Evaluation Association (AEA) or specialized groups (e.g., Nonprofit Impact Evaluation Network) suggest engagement with current standards and peer review.
Ask about certifications, peer consultation practices, and how they stay current with evaluation methodology. Strong evaluators can also reference other funders or organizations they've worked with.
What's Your Communication Style Going to Look Like?
Evaluation is collaborative. You need an evaluator who explains technical concepts in language your board understands, responds to questions promptly, and flags issues early—not on the last day before a report deadline.
Schedule a real conversation with the evaluator lead before hiring. Do they listen more than they pitch? Are they curious about your constraints and context?
Frequently Asked Questions
Q: How long does a typical impact evaluation take? Most evaluations span 12–24 months, though rapid/formative assessments can be completed in 3–6 months. Timeline depends on your sample size, outcome measurement period, and whether you're waiting for behavioral changes to materialize.
Q: Should we hire a local evaluator or a national firm? Local evaluators often cost less and understand your community context deeply; national firms bring standardized methodologies and may have specific sector expertise. Consider which matters more for your questions.
Q: What's the minimum budget for a credible evaluation? Below $10,000, expect a basic process evaluation or short-term outcome snapshot. Meaningful impact evaluation with a comparison group typically starts around $25,000–$35,000 for smaller nonprofits.
Use Mercoly to compare and connect with vetted impact evaluators who match your methodology needs, budget, and sector experience.