Skip to main content
News

Terms of Reference for Evaluation of Inclusive Citizenship Education Program in Lebanon

By February 14, 2023April 3rd, 2023No Comments

With this Terms of Reference, Adyan is inviting proposals to design and deliver an evaluation of the Alwan program from its inception up until and including the ongoing cohort. Thus the evaluation requires both a backward-looking study and a forward-looking quasi-experimental evaluation.

We expect the impact evaluation to commence with collaboratively designing the evaluation methodology, using the Evaluability Assessment Report as a key starting point. A key question would be the feasibility/relevance of reconstructing a baseline. The Evaluability Assessment suggested the development of an interim baseline against which the future trajectory of the program can be assessed.

The next step would be to refine and finalize the program theory of change, which was developed during and following the Evaluability Assessment.

We expect the evaluation to assess the extent to which the Alwan program has made, and is making, an impact on the attitudes, behavior, skills, and lives of participants, including former and current students, educators, partner schools, and communities (over the past 13 years, the Alwan program has reached a total of 67 High-Schools, 208 educators and 4,716 graduates).

The issue of causality and attribution needs to be fully examined. This will add valuable evidence-based statements on the impact of the program.

We also expect the evaluation to propose methods for a strengthened M&E framework, to continually strengthen the evidence base about the long-term outcomes of the program. In addition, we expect the impact evaluation to involve stakeholder mapping, and to propose methods for improved engagement/reaching new stakeholders.

We also expect the evaluation to involve tailored capacity building of core members of the Adyan and Alwan team, including on designing and managing a relevant and appropriate theory of change, log frame, and M&E framework.

This should include training on how to evaluate changes in behavior and values, both online and offline, and how to avoid confirmation bias. It should also include training on writing appropriate survey questions, the types of data most relevant to the program, and the mechanisms that need to be used to gather and analyze them in appropriate formats.

This will help the team to identify the most appropriate tools to capture any evidence of impact, which at the moment is largely recorded through anecdotal data.

Evaluation outputs would include an inception, mid-term and final report, and audio-visual materials that can be used as a communications tool to explain key findings. All communication and outputs will be in English. Workshops will be conducted in English, or with translation into Arabic for participants as required.

Key Impact Evaluation Details:
Program budget: Between €100,000 – 150,000 Euros
Evaluation duration: May 2021 – October 2023 (30 months)
Location: Lebanon (participating schools are based in all regions)

Leave a Reply