STTA-Evaluation Specialist

Terms of Reference

STTA-Evaluation Specialist
Pakistan Capacity Development Services-Small Business Set Aside (PCDS-SB)

A.    Background of the Project

USAID's Pakistan Capacity Development Services -Small Business Set Aside (PCDS-SB) project is implemented by International Business Initiatives (IBI). It will seek to work with USAID’s indirect partners on issues and priorities related to Public Financial Management (PFM). The project will provide need-based technical assistance, capacity development services, and limited IT support to mitigate fiduciary risks facing major GOP entities.

PCDS-SB, a three-year project, will work with key federal (Islamabad) and provincial (Khyber Pakhtunkhwa and Sindh) GOP and non-governmental entities to address their critical fiduciary risks resutling from PFM policy and implementation gaps. The goal is to mitigte fiduciary risks at the highest/policy levels so that its impact is passed onto all other entities.

B.     Assignment Objective

The purpose of this assignment is to conduct a diagnostic study in Khyber Pakhtunkhwa to gauge major procuring entities’ understanding of KPPRA’s current rules, extent to which they are implemented or conformed to and shortcomings therein and their preparedness to implement a digitized procurement system.

C.    Scope of the Assignment

The consultant will conduct a diagnostic study for the KP Public Procurement Authority (KPPPRA). The study shall be executed at two levels. At level one, the study will involve minimum of seven major government entities at the provincial headquarter. These entities will include, but will not necessarily be limited to, (i) Communication & Works (C&W), (ii) Irrigation, (iii) Local Government, Elections & Rural Development, (iv) Health, (v) Elementary & Secondary Education, and, (vi) Energy & Power Departments. Seventh entity to be made part of this survey shall be USAID’s Infrastructure Project in KP which is also required to conform to KPPRA’s procurement rules. At level two, line departments of the aforementioned entities in four geographically spread-out districts shall be involved. The districts shall include; (1) Swat in north (2) Mansehra in east (3) Nowshra in west, and (4) Kohat in south.

The study aims to employ two-tiered approach to ensure fair representation of the sample and generalizability of the finding at province level to support decision-making. Seven departments at the provincial headquarters and four geographically spread-out districts will provide a better representation of the study results. These strategically significant districts, located at distant points, have unique demographic characteristics based on their population, topography, economic, and political participation and share in annual development budget of the province.

D.    Methodology

This would be an evaluation and will therefore employ a mixed method approach. It will be initiated with the review of relevant literature which will lead to development and finalization of the quantitative and qualitative data collection tools. The tools will include, (1) survey questionnaire, (2) Focus Group Discussion (FGD) guide, and (3) Key Informant Interview (KII) questions. The tools, developed, pre-tested and contextualized by the STTA shall be reviewed and approved by PCDS-SB and KPPRA before they are used to collect data at pre-selected locations.

At the provincial headquarter, six to eight key staff members from each of the seven entities shall be identified and given the survey questionnaire to fill it out. While the questionnaire will be helpful in collecting quantitative data, minimum of seven FGDs shall be conducted to capture qualitative aspects related to the survey objective. Each FGD shall be attended by 8 – 12 staff of each entity. They may or may not be those that will have already filled-out the survey questionnaire. However, like the respondents of the survey questionnaire, they should all be from different units/sections, not from a single unit/section of each entity. The purpose of the FGDs shall be to dive deep into the qualitative issues and get the individual survey findings validated. Additionally, 14 KIIs will be conducted with 2 senior officials of each entity. The KIIs will finally help in triangulating the data gathered at the questionnaire and FGD stages. The FGDs and KIIs shall be semi-structured, as pre-written interview questions and discussion guides shall be administered.

At the district level, four to six key staff members from (i) finance, (ii) C&W, (iii) health, (iv) education, (v) agriculture/irrigation, and (vi) local government departments shall be identified and given the survey questionnaire to fill it out. Minimum of three FGDs shall be conducted which should be attended by 8 – 12 staff of two entities (4 – 6 from each entity). Seven KIIs will be conducted with one senior official of each entity and the district figurehead who is usually a deputy commissioner. S/he or her/his designated officer shall be interviewed.

E. Required Qualifications

a.         Education

University degree in social sciences or equivalent with experience of conducting researches for public and private sectors of Pakistan. Knowledge of federal and provincial public procurement regulations will be an added advantage. 

b.        Professional Experience

At least five years of experience in social researches and evaluations (using quasi-experimental designs) as an independent researcher.

c.         Languages

       For this position fluency in spoken English and Urdu is essential; ability to communicate in Pushto language will be an advantage.

E.2. Skills

a.         The candidate must be able to foster cooperation among a diversity of public officials and relevant stakeholders

b.        Excellent writing and analytical skills are required

c.         Excellent computer skills are required in the complete Microsoft Office (Word, Excel, PowerPoint/Visio). Knowledge of statistical packages for data analysis will be an advantage.

E.3. Abilities

a.    Planning and Organization

Ability to identify priority activities and assignments, allocation of appropriate amount of time and resources for completing work on-time.

b.   Communication and Analytical Skills

Excellent communication and analytical skills in English and Urdu are required (Pashtu would be an advantage).

c.    Critical Thinking and Open-Mindedness

Ability to ask questions to clarify, and exhibit interest in having two-way communication; demonstrate openness in sharing information and keeping people informed.

d.   Teamwork

Ability to work collaboratively with colleagues to achieve the assignment’s objectives; ability to solicit inputs by genuinely valuing others' ideas and expertise; willingness to learn from others, and ability to work in a multi-cultural, multi-ethnic environment. Capacity to work with transparency; capacity to build trust in colleagues.

F.     Special Conditions

Consultant will be required to:

1)      ensure compliance with the PCDS-SB, KPPRA and USAID’s polices regarding confidentiality of information.

2)      observe due diligence in her/his performance of required duties during the course of implementation of this time-bound assignment.

3)      hand over all hard/softcopies of the data relevant to this assignment to PCDS-SB. All such data should be stored on external memory device.

4)      Ensure that all data relevant to this assignment is not used for purposes other than this assignment.

G.    Assignment Deliverables and Payments Schedule