Final Evaluation of Project:
"Collaboration for Change: transforming
lives and minds for equal citizenship"

FINAL EVALUATION

TERMS OF REFERENCE (TOR)

 ‘Collaboration for Change: transforming lives and minds for equal citizenship’

(March 2016 to August 2018)

An international development organization working on Gender Equality (GE) is supporting local partners in two districts of Pakistan (Islamabad and Rawalpindi) to mainstream women leadership and advocate for their participation in Public lives. It reaches out to influential government representatives, through local partners to raise awareness and sensitise them to encourage women leadership by involving them in decision making processes. In addition, it involves faith actors to encourage women leadership through sermons.

1. Context and Project Description

A two-and-a-half-year project (from 1^st March 2016 to 31^st August 2018) titled “‘Collaboration for Change: transforming lives and minds for equal citizenship’” is being implemented by two local partners.

The project has contributed to training 200 potential women leaders in leadership skills including security, communication skills, personal safety, public speaking, stress management, voice training, legal literacy etc., through a women’s leadership initiative. The project also involved men by working closely with the relatives of women leaders and other male supporters to encourage women to be active in public life.

The project has engaged young people to stimulate debate to challenge restrictions on women lives, like use of public transport, political and economic participation and other stereotypes. The research and advocacy component has strengthened the practical application of affirmative action measures for marginalised women, i.e., a job quota policy for women especially belonging to minority.

The overall objective of the project is to contribute to the realisation of equal citizenship through active participation of women in public and private life, and promote their leadership potential in line with the constitutional provision that mandates non-discrimination based on sex.

Specific Objective 1: To ensure development of women leaders essential for sustainable development of the country and to develop a model of women’s meaningful participation in the public sphere particularly in politics, in public service and the media by strengthening their leadership role in urban areas of Rawalpindi and Islamabad (twin cities).

Specific Objective 2: To change the duty bearers’ and citizens’ attitudes towards women’s roles in society, by challenging the negative portrayal of women and dominant forms of masculinity through print and electronic media and to proactively engage duty bearers and young men and boys to demonstrate and promote sustainable change.  

Location of Project: Rawalpindi and Islamabad.

2. Purpose of the Final Evaluation

To assess project’s design and implementation of innovative methods, and overall progress with emphasis on results, and achievements focusing to:

• Provide all parties involved in project an understanding of achievements, challenges and successes;
• The extent possible, assess whether the project has had any positive or negative impact for the targeted communities, intended or unintended changes on policy level in public and private sectors and in communities;
• Assess learning from this project to capture opportunities and innovations that may be sustainable in terms of planning and implementing similar projects in the future;
• Assess whether the project was optimally implemented with regards to effective use of available resources;
• Assess level of coordination between funding partners, local partners and target groups and other stakeholders involved.

 

 

 

3. Scope of Work

The evaluation should focus on relevance, effectiveness, efficiency, sustainability and impact. Addressing the evaluation purpose will require that the consultant provide answers to following specific questions – which could be refined in inception phase of the evaluation:

Relevance:

• Have local partners taken advantage of available knowledge and experience within targeted community groups (men, women, boys and girls); among stakeholders/structures such as the Union Councils, representatives of Local Government, religious leaders, school children and youth that can be replicated in other projects.
• Consider the project’s intended and actual expected results and assess whether these have practical relevance, and to what extent are activities and outputs aligned with national and provincial level GBV-related registration?
• How does strategy used in the project fit into provincial and national development plans, if such exist, to combat GBV?
• To what extent does the project approach is aligned with or complement GBV work being done by other CSOs operating in the target areas?

 

Effectiveness:

• To what extent have the project objectives been achieved?
• What were the possible major factors or constraints influencing achievements or non- achievements of the overall goal and the objectives of project?
• Were the monitoring processes, methods and routines efficient? What alternative designs would have been preferable to the one chosen, then those should be presented and promoted

 

Efficiency:

• Assess cost- efficiency of project by comparing allocated resources with results achieved. The evaluation should present a measured opinion on whether results obtained justified costs incurred.
• To what extent management of funding organization and local partners influenced efficiency, any possible strengths and weaknesses in funding organization’s management routines and administrative procedures implemented effectively by the local partners.
• Give a measured opinion on impact of the project on target communities. Has the project measured, either directly or indirectly, its achievements during the project’s planed duration?
• To what extent were the local partners able to undertake the project efficiency?
• Examine delivery of project’s expected results in terms of quality and quantity. Were they delivered in a timely manner? To what extent did factors outside the control of the project design and management affected project implementation and attainment of objectives?
• Has funding partner of the project utilised other available resources and available networks to continue the implementation of the project.

 

Sustainability:

• Is the project phase out strategy adequate to ensure institutions sustainability for example, community structures, and how they could expand the activities beyond the support from the funding partners?
• To what extent can the benefits of the project continue after the funding ends?
• Are there any major factors influencing achievements or non-achievements of project sustainability?
• Suggest measures to improve work of funding and implementing partners in future projects considering lessons learnt from the past experience.
• What has been funding organization’s added value in sustainability of the project?

 

 

 

Impact:

• What is the impact of the project on the participants? Is there evidence that the project is having a wider impact (Positive/negative, intended or unintended)?
• Have the women groups engaged in entrepreneurial skills development trainings taken practical steps towards networking and linkages.

 

Risk Management:

• To what extent did the project has dealt effectively with all matters related to risk management and consider what risks were involved in producing the expected results?
• Were there any major factors (security, dominant social norms, resistance, etc.) influencing the achievement or non-achievement of the objectives?

 

Cross-cutting themes:

• Review project from a gender perspective and consider whether all aspects of funding partners’ policy relating to gender equality/mainstreaming in development programs adequately used in project.
• Consider whether project contributed to implementation of women friendly policies, e.g., job quota for women especially minority women in Punjab.
• To what extent was the do no harm approach integrated into programming?
• Consider if project contributes to good governance in the country, either at federal or provincial levels.

 

Finance:

• Consider whether all matters related to financial management, including procurement procedures for goods and services and possible concerns relating to a zero tolerance to corruption policy of applicant, have been adequately observed when the project was implemented.
• What was the added value of the organization under this project?
• Consider all aspects related to the project’s cost effectiveness and evaluate whether alternative implementing methods could have been applied to increase the cost effectiveness.

 

4. Methodology:

• Sources of information and methodology to be employed: The contracting organization shall provide necessary documentation to the Consultant, and work out a programme for coordination at the field.

5. Implementation of the Evaluation:

• Composition of the Consultant Evaluation Team: The contracting organization will hire local consultant (s) having sufficient knowledge/experience in the field of gender based violence and women empowerment work in Pakistan in addition experience in finance and administration will be a plus point.
• Terms and Conditions: The contracting organization will offer a lump sum amount for the whole consultancy with the break up as per signed contract. If required, travel and logistical arrangements will be made by the consultants themselves within the consultancy fee as per the rule and policies of contracting organization.
• Division of responsibility between the consultant/team, the contracting organization and the local partners: The consultant is expected to recommend scope for improvements at institutional as well as the programmatic level. The team shall be encouraged to apply a participatory and inclusive approach throughout their evaluation work. The consultant will arrange division of labour between themselves, but the team leader will be responsible for production of the report. The consultants will partly work in Islamabad and partly travel to and visit the field offices and geographic areas of interventions of the local partners. The consultants will be encouraged to arrange for their office facilities and work independently and away from the contracting organization and local partners’ offices. The consultants will need to make all arrangements for travel, meetings and other practical matters related to logistics and working contacts on their own and with minimal assistance from funding organization. The consultant (s) team members will be using their own personal computers and other relevant equipment for the assignment.

 

5. Reporting

The consultant shall be responsible for:

• Desk study, include inception report,field work including meetings with the funding organization, partners and beneficiaries including education institution.
• Submit draft report simultaneously to the funding organization for comments on factual issues and for clarifications;
• Consolidate comments received from the funding organization and submit final report within the timeframe agreed. The final approved report shall be submitted in hard copy as well as in electronic format by September 19^th, 2018.
• Debriefing the funding organization and local partners upon completion of work, if required.

 

Description of required report format:

- Executive Summary

- Overall evaluation methods, their appropriateness and evaluation constraints faced, if any.

- Clearly identified findings

- Clearly identified conclusions

- Lessons learnt

- Recommendations

- Appropriate Annexes –i.e. any literature consulted, data collection instruments, the ToR, list of interviewees and any additional information required.

 

• The report shall be submitted in 2 hard copies and in electronic form.

 

The report shall be in English with maximum limit of 18 pages, i.e., 2-page executive summary, 16 pages report according to the above-mentioned format. The annexes should contain references and information about any literature consulted, data collection instruments, project LFA with end of project evaluation value entered, funding organization’s GBV programme Results Framework, the ToRs, and list of interviewees and any additional information required.

6. Budget

The detailed budget and terms and conditions for the consultant will be separately spelt out in the respective contract. The contracting organization shall make the payments as agreed in the contract with consultant including deduction of taxes. Preferably 50% of the payment will be given at signing of the contract, while 25% on completion of field activities and rest of the 25% on approval of the report. The contracting organization will cover consultancy fees and other related expenses in PKR for the entire evaluation study.

7. Skills and Qualifications of the Consultant or Firm/Organization

The selection of the consultant/firm will be based on the quality of their proposal (including, methodologies, tools, quantifications, and time schedule), their financial offer, the relevant educational background and experience of consultant, their familiarity with GBV and women’s empowerment approaches and program related topics. In addition, the consultant should have the following qualifications:

• At least five years’ experience of conducting project baselines, evaluations and researches, particularly related to GBV and women’s empowerment/leadership programmes as well as evaluation of researches is required.
•  Qualitative data entry and analysis skills (consultants with previous experience of using statistical analysis software will be preferred)
• Ability to respond to comments and questions in a timely and appropriate manner
• Ability to write high quality, clear, concise reports in English

 

8. Consultancy process and timeline

Interested consultancy firms should submit detailed technical and financial proposals covering:

• Capacity statement
• Demonstrated understanding of the terms of reference
• Proposed methodology
• A detailed work plan
• A financial proposal detailing consultant’s fees, data collection and administrative costs
• CV of principal consultant and team members
• Electronic copies of two recently concluded similar assignments by the consultant
• Two references of recent clients with contact details of the referees

 

Tasks/outputs	Max. days of work required	Deadlines
Orientation meeting between funding organization, local partners and selected consultant to discuss scope of work, tools, and methodologies of evaluation	1	3rd September
Desk review an inception report to be reviewed and eventually approved by the Organization Head.	2	4th-5th September
Tools development and testing	3	6th – 10th September
Data collection and entry	7	11th – 19th September
Data analysis and first draft of end of project evaluation report submitted	12	20th September – 5th October
Second draft of evaluation report submitted	5	8th – 12th October
Funding organization’s staff comment on the draft end of project evaluation report	6	15th – 22nd October
Submission of final project evaluation report with funding organization	5	23rd – 29th October
Total days	41 days

 

9. Communication  

Send EOI and proposals at following email address not later than 1400hrs August 30th, 2018: ( [email protected])