CIVIC TOOLKIT / 16 / Evaluating results
What Would Have Happened Without the Program?
Original educational commentary with AI narration and illustrated examples. Examples are hypothetical unless explicitly identified otherwise. This is not a news report.
The explanation
A before-and-after improvement does not answer the whole evaluation question.
Imagine travel time on a repaired road falls from thirty minutes to twenty-four. That sounds like a six-minute benefit. But suppose similar nearby routes improved by four minutes because seasonal traffic eased. The repair's contribution may be smaller than the full before-and-after change.
That comparison is only a starting point. Routes may differ, and other changes may affect them differently. A careful evaluation explains why its comparison is credible and what uncertainty remains.
Ask for a baseline and a plausible alternative scenario. Our view is that a program should not receive all the credit for improvements that would likely have happened anyway. The travel times here are invented.
| Scenario | Value |
|---|---|
| Repaired route | 6 |
| Comparison | 4 |
Try the comparison yourself
List factors that could affect both repaired and unrepaired roads. Then list factors that affect only one. Explain why a comparison group needs more than a similar name on a map.
This article uses original hypothetical examples, arithmetic, and editorial reasoning. It makes no claim about a named community, official, or current dataset.
Found an error? Send the page title and the correction. Read our editorial approach.