Layout 1

540 Toolkit to Combat Trafficking in Persons

Tool 10.1 Overview of monitoring and evaluation

Overview

This tool briefly describes both monitoring and evaluation, and the distinction

between the two.

What is monitoring?

Monitoring is a continuing function that uses systematic collection of data on specific indi-

cators to provide the management and the main stakeholders of an ongoing intervention

with indications of the extent of achievement of objectives and progress in the use of

allocated funds.

Indicators

An indicator is a quantitative or qualitative variable that allows changes produced by an

intervention relative to what was planned to be measured. It provides a reasonably simple

and reliable basis for assessing achievement, change or performance. An indicator is

preferably numerical and can be measured over time to show changes. Indicators, which

are determined during the planning phase of a project, usually have the following

components:

1. What is to be measured? (What is going to change? E.g., participants reporting

higher school attendance of girls in a village)

2. Unit of measurement to be used (to describe the change, e.g., percentage)

3. Pre-programme status (sometimes called the “baseline”, e.g., 40 per cent in 2007)

4. Size, magnitude or dimension of intended change (e.g., 75 per cent in 2008)

5. Quality or standard of the change to be achieved (e.g., improvement such that girls

obtain higher grades)

6. Target populations(s) (e.g., girls vulnerable to trafficking from villages in southern

district)

7. Time frame (e.g., January 2008 to January 2009)

541

chapter 10 Monitoring and evaluation

What is evaluation?

Evaluation is the systematic and objective assessment of ongoing and/or completed projects,

programmes or policies, in respect of their:

앫 Design

앫 Implementation

앫 Results

The criteria applied in the evaluation are:

앫 Objectives

앫 Efficiency

앫 Effectiveness

앫 Impact

앫 Sustainability

Evaluation emphasizes the assessment of outcomes and impact rather than the delivery of

outputs.

See the Evaluation Quality Standards available at:

www.oecd.org/document/29/0,3343,en_2649_34435_16557149_1_1_

1_1,00.html

Norms for evaluation

United Nations Evaluation Group

In April 2005, the United Nations Evaluation Group issued norms and standards with a

view to the harmonization of evaluation in the United Nations system. The United Nations

Evaluation Group norms seek to facilitate system-wide collaboration on evaluation, by

ensuring that evaluation within the United Nations system abides by agreed-upon basic

principles:

앫 Intentionality (intent to use evaluation findings)

앫 Impartiality

앫 Independence

앫 Evaluability

앫 Quality

앫 Competence

542 Toolkit to Combat Trafficking in Persons

앫 Transparency and consultation

앫 Evaluation ethics

앫 Follow-up

앫 Contribution to knowledge building

The United Nations Evaluation Group norms and standards are

available in Chinese, English, French, Russian and Spanish at:

www.uneval.org

Monitoring Evaluation

Timing Monitoring is a continuing Evaluation assesses the

function that takes place entire project cycle.

throughout the implementation

of a project/programme.

Depth and Monitoring is a regular part Evaluation reviews the

purpose of project or programme achievements of the project/

management. It focuses on programme and considers

the implementation of the whether the plan was the

project, comparing what is best one to achieve the

delivered with what was outcomes.

planned.

Evaluation measures

achievements, as well as

positive/ negative and

intended/ unintended

effects.

Evaluation looks for lessons

to be learned from both

success and lack of success,

and also looks for best

practices which can be

applied elsewhere.

Who conducts it Monitoring is usually done Evaluation is best conducted

by people directly involved by an independent outsider

in implementing the project/ who can be impartial in

programme. consulting with project/

programme staff.

Relationship Data collected and insights gained in the course of monitoring

between are then fed into and used by the evaluation process.

monitoring

and evaluation

Distinguishing between monitoring and evaluation

543

chapter 10 Monitoring and evaluation

Recommended resources

There are various organizations and resources dedicated to the harmonization and improve-

ment of monitoring and evaluation. Many of these may offer lessons with respect to the

monitoring and evaluation of anti-trafficking programmes. The following is just a small selec-

tion of the resources available.

How to Build M&E Systems to Support Better Government

Keith Mackay, World Bank Independent Evaluation Group, 2007

A resource designed particularly for Governments in developing countries seeking to

strengthen their monitoring and evaluation systems, this publication includes promising mon-

itoring and evaluation system practice, as well as diagnostic guides, examples of evaluations

and other tools for strengthening the monitoring and evaluation systems of Governments.

The efforts to build monitoring and evaluation systems of Chile, Colombia and Australia,

in particular, are considered, and Africa is given attention as a special case.

The report can be downloaded in English at:

www.worldbank.org/ieg/ecd/better_government.html

Monitoring and Evaluation: Some Tools, Methods and Approaches

World Bank Independent Evaluation Group, 2004

This booklet provides an overview of monitoring and evaluation tools, methods and

approaches, including data collection methods, analytical frameworks and types of evalua-

tion and review. The purpose, use, advantages and disadvantages, costs, skill requirements,

time requirements and key references are provided for:

앫 Performance indicators

앫 The logical framework approach

앫 Theory-based evaluation

앫 Formal surveys

앫 Rapid appraisal methods

앫 Participatory methods

앫 Public expenditure tracking surveys

앫 Impact evaluation

앫 Cost-benefit and cost-effectiveness analysis

The booklet is available in Arabic, English, French, Portuguese, Russian

and Spanish, at:

www.worldbank.org/ieg/ecd/me_tools_and_approaches.html

544 Toolkit to Combat Trafficking in Persons

Network on Development Evaluation of the

evelopment Assistance Committee

The Network on Development Evaluation is a subsidiary body of the Development

Assistance Committee supported by the secretariat of the Organization for Economic

Cooperation and Development. Its purpose is to increase the effectiveness of international

development programmes by supporting their independent evaluation. The network offers

a range of publications and documents (including best practice, guidance documents and

manuals to facilitate monitoring and evaluation), as well as a glossary of key terms in

evaluation, in Chinese, English, French, Italian, Japanese, Portuguese, Russian and Spanish.

The glossary of terms is available at:

www.oecd.org/findDocument/0,2350,en_2649_34435_1_119678_1_1_

1,00.html

Publications and documents of the Network on Development

Evaluation are available at:

www.oecd.org/findDocument/0,3354,en_2649_34435_1_1_1_1_1,00.html

Evaluation Cooperation Group

The Evaluation Cooperation Group was founded by heads of evaluation in multilateral devel-

opment banks to strengthen evaluation, share lessons, disseminate information, harmonize

performance indicators and evaluation methodologies, enhance collaboration between mul-

tilateral development banks and bilateral and multilateral development organizations, and

facilitate the involvement of borrowing member States in evaluation and build their evalu-

ation capacity.

The members of the Evaluation Cooperation Group are the evaluation entities of the African

Development Bank, the Asian Development Bank, the European Bank for Reconstruction

and Development, the European Investment Bank, the Inter-American Development Bank,

the International Monetary Fund and the World Bank. The United Nations Evaluation

Group and the Evaluation Network of the Development Assistance Committee of the

Organization for Economic Cooperation and Development are observer members.

More information about the Evaluation Cooperation Group, as well

as links to members and resources can be found at:

https://wpqp1.adb.org/QuickPlace/ecg/Main.nsf/h_Toc/73ffb29010478ff

348257290000f43a6

545

chapter 10 Monitoring and evaluation

United Nations Evaluation Group

The United Nations Evaluation Group has issued Norms and Standards (see above) that

provide a reference for strengthening, professionalizing and improving the quality of evalu-

ation in the United Nations system. These norms reflect respect for rights, international

values and principles, universality and neutrality, and international cooperation.

The United Nations Evaluation Group Norms and Standards are

available in Chinese, English, French, Russian and Spanish at:

www.uneval.org

Other recommended resources

Government of Australia, Australian Agency for International

Develop ment, AusGuideline 3.3 The Logical Framework Approach

(2005), www.ausaid.gov.au/ausguide/pdf/ausguideline3.3.pdf

European Commission Humanitarian Aid Department, Aid Delivery

Methods, vol. 1, Project Cycle Management Guidelines (2004),

http://europa.eu/europeaid/multimedia/publications/publications/

manuals-tools/t101_en.htm

Search for Common Ground, Designing for Results: Integrating

Monitoring and Evaluation in Conflict Transformation Programs

(2006), www.sfcg.org/documents/manualpart1.pdf

Swedish International Development Cooperation Agency (Sida):

www.sida.se/?d=121&language=en_us

USAID: