Process Evaluation
 

Process

Audience

Methodology & Tools

Indicators

Development of Research Design

Not Applicable.

Research Analyst responsible for ensuring design is cost-effective, methodologically rigorous, and practically feasible. Evaluation conducted post development.

·    Representativeness of sampling fractions

·    Expenditure per respondent

·    Availability of inputs for sampling frame e.g. voter lists

·    Effectiveness of selection, wording & formatting of questions in research instruments
 

Conduct of Survey and FGDs

Respondents defined in Research Design

Reports of spot checks conducted by Research Analyst, logs maintained by Field Supervisors, and adherence to Research Action Plan. Evaluation conducted during conduct of survey.
 

·    Inter-rater reliability tests (% of correlation)

·    Effectiveness of issue resolution

·    On-schedule execution of Action Plan

Processing and Analysis of Data

Not Applicable.

Research Analyst responsible for assessing validity of findings, degree of concurrence between qualitative and quantitative findings, whether research questions were answered as definitively as possible and to present Preliminary Report to USIP and incorporating feedback. Evaluation conducted at the interim stage.
 

·    Validity of analytic model (e.g. goodness of fit, autocorrelation, Omitted Variable Bias, Margin of Error, etc.)

·    Irreconcilable Contradictions between survey and FGD results

·    Degree to which research questions answered

·    Feedback from USIP 

Dissemination of Findings

Government policymakers, civil society, media, academia and international donors.

Research Analyst will prepare Seminar Reports for each Dissemination Seminar which will detail proceedings and key policy implications and recommendations emerging from the discussion.
 

·  Number of downloads from GINI website

·  Attendance (rate and composition) at Seminars

·  Number of questions, comments, issues raised by participants at Seminars

Impact Evaluation (To be undertaken after the grant period by the Manager Research, GINI)
 

Impacts

Audience

Tools & Methodologies

Indicators

Improved knowledge of how misgovernance affects radicalization, the supply-side factors responsible for this misgovernance, and what policies can mitigate both sides of the problem
 

Government policy makers

Review of publicly available policy documents and plans that cite research findings or reflect policy actions recommended by research reports

Number of public policies and planning documents that cite research findings

Evidence of how their focus areas are linked to radicalization and national security to enhance the legitimacy and relevance of their activities

Civil Society, particularly research and advocacy institutes

Review of civil society publications including activity and progress reports, event reports, policy briefs, research articles, informational booklets/leaflets that cite research findings
 

Number of civil society publications that cite research findings

Coverage to include fact-based, objective, and policy-oriented research on the misgovernance-radicalization nexus

Media actors including print and broadcast reporters, commentators, and anchors.

Review of newspapers, governance focused periodicals, TV talk-shows and news-reports that cite research findings or cover events where research is presented
 

Number of instances where research findings  are referred is covered by print and broadcast media

Research that fills key knowledge gaps in existing literature, identifies further areas for research, and could potentially serve as curricular material for courses on security, governance, and other disciplines
 

Academia including research and teaching personnel 

Review of research papers in national and international journals or other periodicals that cite research findings

Number of research publications that cite research findings

Donors can prioritize decisions on grant design, grantee selection, focus areas, etc. on ground realities

International donor community including IFIs, multilateral and bilateral donors

Review of donor programme and policy documents, grant documents (e.g. Requests for Proposals), social communication literature, etc. that cite research findings
 

Number of donor documents that cite research findings