Report

Review of M4P evaluation methods and approaches

Report of a review commissioned by DFID

Tim Ruffer Elise Wach
Published by
Itad

This review compiles information about the scope and purpose of M4P programme evaluations and analyses evaluation trends, strengths, and weaknesses.

For this report, 32 M4P programme reviews and evaluations, M&E frameworks and programme reports were analysed, and a range of individuals in the field were consulted. The nature of the M4P approach and the complexity of the markets within which it operates present a number of challenges for evaluation. Evaluation approaches that address these challenges are needed to avoid inaccurate estimations of impact. A number of general weaknesses with M4P evaluations are identified, particularly relating to: consideration of systemic, sustainable changes in market systems; data quality; triangulation practices; use of theories of change; consistency in units for facilitating accurate aggregation; and consideration of unintended negative effects. The report includes recommendations for best practice in relation to M4P evaluation methods (how), timing (when), responsibilities (who), and level of analysis (what).

Useful for:

Anyone interested in the current state of M4P programme evaluations, in particular M&E practitioners seeking analysis of challenges, recommendations on best practice and links to further resources.