Chapter 7: Assessing Results, Impact Claims, and Public Communications
Nonprofits often communicate their accomplishments through annual reports, fundraising appeals, websites, newsletters, media interviews, grant reports, photographs, videos, and social media. These communications may describe how many people were served, how much money was raised, how many resources were distributed, which communities were reached, and what long-term changes occurred.
Such information can help donors, volunteers, sponsors, and community partners understand a nonprofit’s work. However, numbers and stories need context. Before accepting a nonprofit impact claim at face value, supporters should examine what is being measured, which period the claim covers, how the information was collected, and whether the available evidence reasonably supports the conclusion.
Understand the Different Types of Claims
A goal describes what a nonprofit hopes to accomplish. For example, an organization may aim to improve employment opportunities for young adults. A goal communicates direction, but it does not establish that the desired result has already occurred.
An activity is something the organization does, such as holding employment workshops, providing career counseling, or connecting participants with local employers.
An output is a direct, countable product of that activity. Examples might include conducting 25 workshops, providing 500 counseling sessions, distributing 1,000 career guides, or enrolling 200 participants.
An outcome is a change experienced by participants or communities. Examples could include improved job-search skills, increased interview opportunities, employment obtained, higher income, or greater job retention.
Impact generally refers to broader or longer-term change attributable, at least in part, to the organization’s work. Establishing impact can be difficult because many outside factors may contribute to a result. An independently evaluated impact claim has been examined by a qualified outside evaluator using an identified method. Even then, the evaluation’s scope, assumptions, data, and limitations should be considered.
These terms are sometimes used interchangeably in public communications. Supporters should therefore focus on what a claim actually demonstrates rather than relying only on the label attached to it.
Ask What the Numbers Represent
A statement such as “we helped 10,000 people” may sound impressive, but it raises reasonable questions. Does the figure represent 10,000 different individuals, 10,000 service interactions, website visitors, event attendees, meals distributed, or households reached? Were the individuals served directly by the nonprofit or through partner organizations?
When reviewing nonprofit results, look for:
- A clear reporting period
- A definition of who or what was counted
- The geographic area covered
- The program or activity included
- The method used to collect the information
- Whether repeat participants were counted more than once
- Whether the result was achieved directly or through partners
- A comparison with a stated target, earlier period, or relevant baseline
The same principle applies to financial claims. If a nonprofit announces that it “raised $1 million,” determine whether that amount represents cash received, pledges, event revenue before expenses, grants awarded, donated goods, or the combined value of several forms of support.
Lack of detail does not automatically mean that a claim is misleading. A social media post may summarize information that is explained more fully elsewhere. Nevertheless, important claims should have enough context for readers to understand what they mean.
Consider the Quality of Supporting Evidence
Supporting evidence can take many forms, including attendance records, service logs, surveys, follow-up interviews, financial records, program assessments, beneficiary feedback, partner reports, academic research, or independent evaluations. The appropriate evidence depends on the organization’s size, resources, mission, and type of work.
A small volunteer-led nonprofit should not necessarily be expected to commission an expensive scientific study. It may reasonably rely on participation records, documented services, feedback, and practical observations. A large organization making broad claims about long-term social change may be expected to provide more developed measurement methods.
Supporters should also consider whether the claimed result can reasonably be attributed to the nonprofit. For example, a scholarship organization may show that recipients graduated from college, but many factors could have contributed to those graduations. A careful organization might state that it “supported 100 students who graduated” rather than claiming that it “caused 100 students to graduate.”
Treat Public Recognition as Context, Not Conclusive Proof
Testimonials can illustrate individual experiences, but a few positive stories do not prove that every participant had the same experience. Awards may recognize a particular achievement under specified criteria, but they do not guarantee overall organizational effectiveness. Media appearances can increase visibility without independently validating every statement made.
Partnerships may demonstrate relationships or cooperation, but the presence of a respected organization’s logo does not necessarily mean that it audited, certified, or endorsed the nonprofit. Photographs can show that an event or activity occurred, but they may not establish the scale, quality, or long-term results of the program.
Similarly, social media followers, likes, comments, shares, and video views measure attention or engagement. They do not necessarily demonstrate that services were effective, funds were used appropriately, or lasting community change occurred.
These forms of communication can still provide useful context. They simply should be considered alongside clearer information about programs, finances, governance, measurement methods, and results.
Credible Communication Includes Limitations
Responsible nonprofits do not need to claim perfection. They can explain that a program is new, the available sample is small, long-term results are not yet known, participant follow-up was incomplete, or outside factors influenced outcomes. They may distinguish preliminary findings from established conclusions and correct earlier information when better data becomes available.
Honest uncertainty can strengthen credibility. A nonprofit that clearly explains what it knows, what it does not yet know, and how it plans to improve its measurement demonstrates accountability without overstating its achievements.
Assessing nonprofit impact is not about rejecting every claim that lacks independent evaluation. It is about interpreting public communications proportionately and carefully. By examining definitions, time periods, measurement methods, evidence, context, and limitations, supporters can better understand what an organization has accomplished—and make more informed decisions about donating, volunteering, sponsoring, or providing other support.
Leave a Reply