Show Impact
Explainer · for charity comms teams

Stories or statistics? It depends who’s reading

A fundraising experiment with more than 21,000 donors found that adding hard evidence of impact made no difference on average. Underneath that average, it pushed two groups of donors in opposite directions. Here’s what that means for how charities report their impact.

01 · The experiment

Same appeal, one extra paragraph

The US charity Freedom from Hunger worked with economists Dean Karlan and Daniel Wood to test its direct-mail appeal on 21,643 past donors. Everyone got a letter with the same emotional story about one person the charity had helped. Half of the letters also included a paragraph describing rigorous scientific evidence (a randomised trial) that the charity’s programme worked.

Letter A
The story: one beneficiary, her situation and how the charity helped.
Letter B
The story, plus evidence: a paragraph on what a randomised trial found about the programme’s impact.
02 · The result

No change on average, and two groups moving in opposite directions

Overall, the evidence paragraph didn’t change whether people gave or how much. But when the researchers split donors by how much they had given before, the picture changed. Larger past donors were more likely to give, and gave more. Smaller past donors were less likely to give.

Effect of adding impact evidence to the appeal
Direction of the effect by donor group. Arrows show direction only and are not to scale.
Source: Karlan & Wood, “The effect of effectiveness: donor response to aid effectiveness in a direct mail fundraising experiment”, NBER Working Paper 20047, later published in the Journal of Behavioral and Experimental Economics; J-PAL evaluation summary.
03 · Why

People give for different reasons

The researchers’ explanation draws on a long-standing idea in the economics of giving: there are two broad motives for donating, and evidence speaks to only one of them.

Giving to make a difference

Deliberate and focused on results. These donors want to know their money works, and evidence makes them more confident. In the study, they looked like the larger past donors.

Giving because it feels right

Intuitive and emotional, the “warm glow” of helping. Detailed analysis can cool that feeling. In the study, they looked like the smaller past donors.

Irish data points the same way for everyday donors. In the Charities Regulator’s 2024 survey, a personal interest or connection was by far the biggest influence on which charities people support.

Strongest influence on which charities people choose to support
Share of adults in Ireland naming a personal interest or connection (health, children, family, friends, pets)
Source: Charities Regulator Public Survey 2024–25 (Ipsos B&A). Next highest influence in 2024: news and media stories (12%).

The same survey shows that once people are deciding, they want evidence. Greater transparency about how donations are used, and evidence of what charities have achieved, are the changes people say would most increase their trust.

04 · What it means

Match the evidence to the reader

The lesson isn’t to drop the data. Different audiences need the impact story told in a different order.

AudienceLead withBack it up withBest format
Public appealOne person’s storyOne simple, concrete numberSocial post, appeal letter, video
Regular supportersWhat their giving made possible“Where your €1 goes” and a yearly totalThank-you email, one-page update
Major donors & corporatesOutcomes and cost per outcomeHow you know: method and trendImpact summary, short deck
Funders & the StateOutcomes against agreed targetsData quality, comparisons, lessonsDashboard, annual impact section
05 · The pattern

Story first, one number, then the door to more

An annual report or impact page can serve both kinds of donor at once if it’s layered. Put the human story on the surface, then one clear number, then a link to the detail for the reader who wants it.

When Mary’s husband died, the evenings were the hardest. Now a volunteer calls every Tuesday, and she’s back at the community lunch.Illustrative example: a fictional supporter story
1,240

older people received weekly calls in 2025, and 8 in 10 said they felt less lonely after three months.

See how we measure this →(On a real impact page, this links to your methods.)

Illustrative figures for a fictional charity.

Want your impact reporting to work for every reader?

I help Irish charities build layered impact reporting: the story, the number and the evidence behind it.

Get in touch

Sources