Replication data for: When Does Rigorous Impact Evaluation Make a Difference? The Case of the Millennium Villages (doi:10.7910/DVN/28146)

View:

Part 1: Document Description
Part 2: Study Description
Part 5: Other Study-Related Materials
Entire Codebook

Document Description

Citation

Title:

Replication data for: When Does Rigorous Impact Evaluation Make a Difference? The Case of the Millennium Villages

Identification Number:

doi:10.7910/DVN/28146

Distributor:

Harvard Dataverse

Date of Distribution:

2014-12-12

Version:

1

Bibliographic Citation:

Clemens, Michael A.; Demombynes, Gabriel, 2014, "Replication data for: When Does Rigorous Impact Evaluation Make a Difference? The Case of the Millennium Villages", https://doi.org/10.7910/DVN/28146, Harvard Dataverse, V1

Study Description

Citation

Title:

Replication data for: When Does Rigorous Impact Evaluation Make a Difference? The Case of the Millennium Villages

Identification Number:

doi:10.7910/DVN/28146

Authoring Entity:

Clemens, Michael A. (Center for Global Development)

Demombynes, Gabriel (World Bank)

Producer:

Center for Global Development

Date of Production:

2010-10

Distributor:

Harvard Dataverse

Distributor:

Harvard Dataverse Network

Access Authority:

Michael Clemens

Date of Deposit:

2014-12-11

Date of Distribution:

2010-10

Holdings Information:

https://doi.org/10.7910/DVN/28146

Study Scope

Keywords:

impact evaluation, Millennium Villages

Abstract:

When is the rigorous impact evaluation of development projects a luxury, and when a necessity? We study one high-profile case: the Millennium Villages Project (MVP), an experimental and intensive package intervention to spark sustained local economic development in rural Africa. We illustrate the benefits of rigorous impact evaluation in this setting by showing that estimates of the project’s effects depend heavily on the evaluation method. Comparing trends at the MVP intervention sites in Kenya, Ghana, and Nigeria to trends in the surrounding areas yields much more modest estimates of the project’s effects than the before-versus-after comparisons published thus far by the MVP. Neither approach constitutes a rigorous impact evaluation of the MVP, which is impossible to perform due to weaknesses in the evaluation design of the project’s initial phase. These weaknesses include the subjective choice of intervention sites, the subjective choice of comparison sites, the lack of baseline data on comparison sites, the small sample size, and the short time horizon. We describe how the next wave of the intervention could be designed to allow proper evaluation of the MVP’s impact at little additional cost.

Geographic Coverage:

Africa

Methodology and Processing

Sources Statement

Data Access

Notes:

<a href="http://creativecommons.org/publicdomain/zero/1.0">CC0 1.0</a>

Other Study Description Materials

Related Publications

Citation

Title:

Michael A. Clemens and Gabriel Demombynes. 2010. “When Does Rigorous Impact Evaluation Make a Difference? The Case of the Millennium Villages.” CGD Working Paper 174. Washington, D.C.: Center for Global Development. http://www.cgdev.org/content/publications/detail/1424496

Bibliographic Citation:

Michael A. Clemens and Gabriel Demombynes. 2010. “When Does Rigorous Impact Evaluation Make a Difference? The Case of the Millennium Villages.” CGD Working Paper 174. Washington, D.C.: Center for Global Development. http://www.cgdev.org/content/publications/detail/1424496

Other Study-Related Materials

Label:

Ghana_MVP_Analysis.zip

Text:

Stata code and instructions for replicating the Ghana/MVP comparison graphs and tables.

Notes:

application/zip

Other Study-Related Materials

Label:

Kenya_MVP_Analysis.zip

Text:

Stata code and instructions for replicating the Kenya/MVP comparison graphs and tables.

Notes:

application/zip

Other Study-Related Materials

Label:

Nigeria_MVP_Analysis.zip

Text:

Stata code and instructions for replicating the Nigeria/MVP comparison graphs and tables.

Notes:

application/zip