Ilo evaluation

Number of SCORE partners (on-line database) (20-12-2015)

	Bolivia	China	Colombia	Ghana	India	Indonesia	Peru	South Africa	Vietnam	Total
Government	4	242	14	34	15	20	6	3	31	369
Employer's organisations	4	36	7	10	24	15	13	3	40	152
Trade Unions	4	31	2	2	43	19	1		7	109
Other		39		8	3	1			13	64
										694

ANNEX 12 Evaluation Matrix

Areas in light green are proposed focus areas in the evaluation matrix. The areas in grey are excluded from investigation. The areas in white will be assessed through a “light” assessment (mainly desk-study). This is suggested to enable the consultants to dedicate sufficient attention and time to the most important issues indicated by ILO fort his evaluation.

Evaluation Criteria	Evaluation Question	Indicators / Markers for qualitative analysis	Sources of Verification	Research Instruments
Relevance and strategic fit of the intervention	Are the objectives of phase II consistent with beneficiaries’ requirements, country needs (considering different income-levels of project countries), global priorities and partners’ and donors’ policies?	National tri-partite partners’ appreciation of SCORE project relevance Existence and quality needs assessments, context & sector analyses Degree of fine-tuning & tailoring SCORE objectives to country context Degree of fine-tuning & tailoring of SCORE objectives to sector context Degree of mainstreaming & integration gender concerns in SCORE project and modules Degree match SCORE objectives with objectives SECO & NORAD	National (regional or sectoral) stakeholders SCORE Prodoc Country strategies and planning documents Needs Assessments & context Analyses SECO & NORAD strategies	Interviews Desk Study
	Is SCORE linked to national and ILO’s development frameworks (UNDAF, DWCPs, P&B)?	Inclusion/link of SCORE in DWCP of respective country Inclusion of SCORE in P&B of respective country Link with Outcome 3.3 in P&B Inclusion of SCORE in UNDAF of respective country	SCORE Prodoc DWCP and P&B UNDAF	Desk Study
Validity of intervention design	Are the project strategy, objectives and assumptions appropriate for achieving planned results?	Theory of change, consistency in design of strategy and intervention logic (choice of project activities related to objectives), incl. underlying assumptions and mitigation measures Extent to which planned activities are contributing to objectives	SCORE Prodoc Country strategies and planning documents ToC’s (Smart sheets) Context analyses	Desk-Study Interviews
	Is the project’s logical framework based on assumptions/ hypotheses that are underpinned by evidence that they work and are they documented?	Effectiveness of mitigation measures in relation to assumptions Existence and role that context analyses played in the design of strategy and intervention logic Extent to which changes in context resulted in adaptation of strategy and/or project activities	SCORE Prodoc Country strategies and planning documents ToC’s (Smart sheets) Context analyses	Desk-Study
	Do the additional strategy documents (gender, lead buyer, communication strategies) add value?	Appreciation of ILO staff, implementing partners and sub-contracted service providers of additional strategy documents Degree of mainstreaming and integration of gender, lead buyer and communication strategies in overall strategy and project activities in countries Implementation and measured outputs and outcomes concerning gender equality, lead buyer and communication strategies	SCORE Prodoc Strategy documents	Desk-Study Interviews
	Does the project contribute to core ILO issues such as labour standards, tripartism, and social dialogue?	Number of SMEs with Enterprise Improvement Teams consisting of managers and workers and number of jointly identified improvement projects Improved implementation of ILO labour standards at company level Tripartite partners’ appreciation of the SCORE project and their collaboration in- and outside N and/or G TAG meetings Appreciation of dialogue and outcomes of by managers and employees at company level	National tri-partite stakeholders Service providers Enterprise owners Workers	Interviews Focus groups Survey
	Did the project design and the gender action plans developed for phase II adequately consider the gender dimension of the planned interventions?	Existence and quality of gender assessment at the international and national project level Extent to which gender dimension is integrated in project document, country strategies and gender action plans Integration of gender dimension in selection of sectors, target group, training and consultations Quality and consistency of M&E reporting on gender aspect; number of actions taken in case adjustments were needed Project performance on gender aspect on output and outcome level	SCORE Prodoc Country strategies and planning documents Gender action plans Tri-partite stakeholders Business owners Workers	Interviews Focus group meeting Company walkthrough Gender assessment
	To what extent are output and outcome indicators gender-sensitive?	The number and kind of gender-indicators in planning documents The extent to which SCORE countries report effectively on gender-indicators	SCORE Prodoc Country strategies and planning documents Gender action plans	Desk Study
	How well has the project complemented other ILO projects in the country?	Inclusion/link of SCORE activities in DWCP and other ILO projects in countries	Tri-partite stakeholders DWCP, P&B and SCORE Prodoc	Interviews Desk-study
	Can the project do more to promote trade unions in SMEs?	This question does not refer to indicators and will be answered in the chapters of conclusions and recommendations.
	What else can the project do to promote more and better jobs in SMEs?	This question does not refer to indicators and will be answered in the chapters of conclusions and recommendations.
	What lessons can be learned for the design of future projects?	This question does not refer to indicators and will be answered in the chapters of conclusions and recommendations.