Monitoring & Evaluation Metrics that Matter

Summary:

The CC-IFS3 team worked with intersectoral partners to develop a monitoring and evaluation framework that will guide the program.  On this page, we:

1) Outline how our Monitoring and Evaluation Framework was developed.

2) Present the Monitoring and Evaluation Framework that will guide our program.

 

Overview:

Linked to the team’s past research (www.ihacc.ca), we conducted research that aimed to characterize the limitations and opportunities for community-based adaptation (CBA) research in diverse Indigenous settings according to different stakeholder perspectives, as well as to provide insight into the ways research can influence adaptation processes and outcomes in diverse Indigenous settings.

The research team conducted a series of literature reviews and developed a monitoring and evaluation (M&E) framework for CBA research:

  • The literature reviews pertaining to the current state of CBA research in Indigenous contexts, and the limitations and opportunities for CBA research and adaptation in low-income countries are outlined a published journal article (click here to access the article).
  • The M&E principles and indicators for CBA research are summarized in an article that is currently under peer-review.

Herein, we summarize the intersectoral methods used to build the M&E framework, and the resulting M&E framework that will guide the CC-IFS3 program.

 

Methodology: Creating our M&E Framework

We drew from four complementary approaches to evaluation: outcome mapping, theory of change, most significant change, and developmental evaluation.

To create an evaluation framework, data collection was carried out between February and November 2015 in Montreal, Guelph, and Iqaluit (Canada), Kampala and Kanungu district (Uganda), as well as Lima and the Loreto region (Peru).

Methods, including 114 semi-structured interviews and 23 focus groups, were utilized with the wide range of participants and stakeholders, including community members, researchers, and institutional collaborators. A detailed codebook was developed and data were analyzed according to the Mayring approach to qualitative analysis, which uses a systematic approach guided by theory to analyze qualitative text. Multiple sources of data were used to triangulate the data for this study, including interviews, focus groups, peer-reviewed literature, grey literature, and follow-up discussions with team members and other researchers to discuss emerging findings. Preliminary results were also presented for results validation with all Batwa chairpersons in Uganda, all community members in Peru, institutional collaborators in Iqaluit, Peru, and Uganda, and other key team members.

Results: The M&E Framework that will guide CC-IFS3


cba-me-framework