Terms of Reference for Evaluation of Inclusive Citizenship Education Programme in Lebanon
With this Terms of Reference, Adyan is inviting proposals to design and deliver an evaluation of the Alwan programme from its inception up until and including the ongoing cohort. Thus the evaluation requires both a backward-looking study and a forward-looking quasi-experimental evaluation.
We expect the impact evaluation to commence with collaboratively designing the evaluation methodology, using the Evaluability Assessment Report as key starting point. A key question would be the feasibility/relevance of reconstructing a baseline. The Evaluability Assessment suggested the development of an interim baseline against which the future trajectory of the programme can be assessed.
Next step would be to refine and finalise the programme theory of change, which was developed during and following the Evaluability Assessment.
We expect the evaluation to assess the extent to which the Alwan programme has made, and is making, an impact on the attitudes, behaviour, skills and lives of participants, including former and current students, educators, partner schools and communities (over the past 13 years, the Alwan program has reached a total of 67 High-Schools, 208 educators and 4,716 graduates).
The issue of causality and attribution need to be fully examined. This will add valuable evidence-based statements on the impact of the programme.
We also expect the evaluation to propose methods for a strengthened M&E framework, to continually strengthen the evidence base about the long-term outcomes of the programme. In addition, we expect the impact evaluation to involve a stakeholder mapping, and to propose methods for improved engagement/reaching new stakeholders.
We also expect the evaluation to involve tailored capacity building of core members of the Adyan and Alwan team, including on designing and managing a relevant and appropriate theory of change, logframe and M&E framework.
This should include training on how to evaluate changes in behaviour and values, both online and offline, and how to avoid confirmation bias. It should also include training on writing appropriate survey questions, the types of data most relevant to the programme, and the mechanisms that need to be used to gather and analyse them in appropriate formats. This will help the team to identify the most appropriate tools to capture any evidence of impact, which at the moment is largely recorded through anecdotal data.
Evaluation outputs would include an inception, mid-term and final report, and audio-visual materials that can be used as a communications tool to explain key findings. All communication and outputs will be in English. Workshops will be conducted in English, or with translation into Arabic for participants as required.
Key Impact Evaluation Details:
Programme budget: Between €100,000 – 150,000 Euros
Evaluation duration: May 2021 – October 2023 (30 months)
Location: Lebanon (participating schools are based in all regions)