Professional Documents
Culture Documents
Competency
Framework
June 2016
Evaluation
Competency
Framework
June 2016
This publication was developed by the United Nations Evaluation Group
(UNEG). The analysis and recommendations of this document do not necessarily
reflect the views of the United Nations or the United Nations Member States.
Suggested citation:
United Nations Evaluation Group (2016). Evaluation Competency Framework.
New York: UNEG.
© 2016 UNEG
EVALUATION COMPETENCY FRAMEWORK
CONTENTS
SECTION 1. BACKGROUND. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
1
EVALUATION COMPETENCY FRAMEWORK
SECTION 1. BACKGROUND
Further, this guidance document recognizes that evaluation users consist of a broad range of
stakeholders and stakeholder groups. Today, the evaluation community aims for evaluations to be
widely used by, for example, decision makers, parliamentarians and civil society leaders in programme
countries. While this guidance document does not highlight competencies that are specific to users,
it nonetheless recognizes the importance of competencies related to evaluation use, such as ability to
engage in evaluative thinking.
Efforts have been made to simplify the evaluation competencies, while ensuring that they remain
sufficiently specific so that they can be clearly applied within the United Nations system. This
document provides potential usages of the competencies (with annexed examples for reference)
and common and specific competencies for evaluators, evaluation unit heads and commissioners
of evaluation. The competencies are intended to ensure that United Nations agencies have skilled
evaluation staff who are able to conduct or manage high-quality evaluations, particularly those
concerned with progress made on the Sustainable Development Goals (SDGs).
The United Nations evaluation competencies were revised in light of the changing global context
and in light of the revised United Nations Norms and Standards for Evaluation.2 Furthermore, the
revised United Nations competencies mutually reinforce the newly adopted United Nations norm on
professionalism:3
1 In 2005, UNEG commissioned its Evaluation Capacities Development Task Force to prepare a competency profile
of evaluators within the United Nations system.
2 United Nations Evaluation Group, 2016, United Nations Norms and Standards for Evaluation. Available at: http://
www.unevaluation.org/2016-Norms-and-Standards
3 Ibid., Norm 10: Professionalism.
2
EVALUATION COMPETENCY FRAMEWORK
What are competencies?
Competencies can be defined as “clusters of related knowledge, skills, abilities and other requirements
necessary for successful job performance.”4 Every position has its own set of competencies. In identifying
competency requirements, it is important that the degree of mastery is related to the level of position in
terms of level of responsibility, complexity and autonomy (i.e. it is unrealistic to expect junior and senior
officers to possess the same level of competencies).
The context
Recognizing that evaluation is essential for advancing development and enabling change in the context
of the SDGs, and further recognizing the need for evaluation to distinguish itself as a profession, it
is imperative that UNEG continues to develop national evaluation capacities and to strengthen the
strategies and mechanisms of evaluation in the United Nations system.
The UNEG professionalization stream of work has several goals, including making a stronger
difference in beneficiaries’ lives; producing high-quality evaluations; fostering competent evaluators,
commissioners, managers and users of evaluation; and instilling credible and distinct evaluation
functions in the United Nations system.
Consideration of all of the above contextual factors provides the rationale for the revision of the
evaluation competencies for the United Nations system.
4 United Nations Evaluation Group, 2008, Core Competencies for Evaluators of the United Nations System, p.5.
5 In 2014, UNEG commissioned its Professionalization of Evaluation Group to revise the competency framework and
to conceptualize a professionalization framework.
3
EVALUATION COMPETENCY FRAMEWORK
Currently, there is no central United Nations mechanism for formal recognition of evaluation
competencies. A number of voluntary organizations for professional evaluation have developed formal
mechanisms, which are at varying levels of implementation (e.g. the Canadian Evaluation Society,
European Evaluation Society, Japanese Evaluation Society, Italian Association for Evaluators and
the Thailand Evaluation Network); some voluntary organizations are in the process of developing
competency frameworks (e.g. the International Development Evaluation Association and the South
4
EVALUATION COMPETENCY FRAMEWORK
African Monitoring and Evaluation Association). The International Organization for Cooperation
in Evaluation is currently exploring the possibility for the development of global competencies and a
global credentialing system.
United Nations agencies could support these efforts by encouraging evaluators to obtain such
credentials through the voluntary organization for professional evaluation with which they are
affiliated (if such a process exists). Through this revision, UNEG is strengthening its contribution to
the development of global competencies and participating with the International Organization for
Cooperation in Evaluation Professionalization Working Group. Due to global inconsistencies in the
availability of such formal processes, credentialing should not be a requirement for hiring evaluators
or engaging evaluation consultants within the United Nations System. However, if such credentialing
becomes globally available, consideration should be given to making it a requirement for evaluators
who are senior and intermediate officers, with more junior officers being required to obtain it within
three to four years of employment.
5
EVALUATION COMPETENCY FRAMEWORK
SECTION 3: EVALUATION
COMPETENCIES
This section is organized by competency, indicating expectations for different levels of evaluators,
evaluation unit heads and commissioners. The competencies are intentionally stated as abilities and
skills and not as a list of actions or tasks.
It is based on the assumption that evaluators must have the requisite professional foundations and
technical skills in order to ensure that evaluation design and processes are consistent with ethical
requirements, that evaluations meet the appropriate UNEG norms and standards, that evaluations are
managed efficiently and that findings are communicated clearly in a manner appropriate for
the audience.
However, although evaluators have the greatest responsibility for the quality and credibility of
evaluations, evaluation unit heads and commissioners also play key roles. The roles of evaluation users
are also important, as users are involved in identifying the need for evaluations, securing finances and
in promoting the use of information from evaluations into evidence-based programming in order to
improve achievements towards the SDGs.
However, it is the evaluators who must have the professional foundations and technical skills to
ensure that evaluation design and processes are consistent with ethical requirements, meet standards
and are managed efficiently. Evaluators must also have the professional foundations and technical
skills to ensure that evaluation findings are communicated clearly in a manner appropriate for
the audience.
The following pages provide the competencies associated with the five domains:
• Professional Foundations
• Technical Evaluation Skills
• Management Skills
• Interpersonal Skills
• Promoting a Culture of Learning for Evaluation
6
EVALUATION COMPETENCY FRAMEWORK
Professional Technical Management Interpersonal Promoting a
Foundations Evaluation Skills Skills Skills Culture of
• Ethics and Integrity • Quality Standards • Work Planning • Communication Learning for
• Evaluation Norms • Evaluation Purpose • Coordination and Skills Evaluation
and Standards and Design Supervision • Facilitation Skills • Integration of
Evaluation in Policy
• Knowledge Base • Evaluation • Adapting the • Negotiation Skills
and Programming
Approaches, Evaluation to Fit
• Human Rights and • Knowledge
Methods and Data Circumstances • Utilization-focused
Gender Equality Sharing Skills
Analysis
• Reflective Practice
• Reporting Findings,
Conclusions and
Recommendations
Skill levels
Although United Nations agencies use a variety of terms to describe different levels of evaluator
positions, this competency framework uses ‘Senior Officer’, ‘Intermediate Officer’ and ‘Officer’ to
indicate three distinct levels with different expectations depending on level of responsibility, complexity
and autonomy. Required competencies for Evaluation Unit Heads and Commissioners are also
included. Each United Nations agency will need to determine its equivalents for each level.
At an overall level, definitions of the different levels used in this document are:
Senior Officer
• Possesses prolonged and extensive knowledge and experience through the practice of a
particular competency;
• Demonstrates high levels of autonomy and integrity;
• Has demonstrated experience to work in highly complex contexts and to take a lead role;
• Is widely recognized across the organization as a source of knowledge and skills of the competency;
and
• Acts as a mentor, adviser and role model for the competency.
7
EVALUATION COMPETENCY FRAMEWORK
Intermediate Officer
• Has thorough knowledge and experience of a competency gained through training and practice;
• Exercises independent judgement and appropriate application of the competency;
• Applies the competency consistently across the organization to facilitate desired outcomes; and
• Shares knowledge of the competency with others.
Officer
• Has knowledge of the competency through education, training and practice; and
• Is capable in using the competency consistently, but may require advice and guidance on using
advanced aspects of the competency to deal with more complex situations and contexts.
Has knowledge about Has excellent, up-to- Has solid knowledge Has knowledge of
ethical guidelines, is able date knowledge and of evaluation ethics evaluation ethics and
to understand the ethical is able to consistently and is able to apply is able to apply this in
guidelines’ implications for apply this knowledge in this knowledge in most simple evaluations
evaluation processes and all evaluations evaluations
communicates this to others Is able to ensure that Is able to ensure that
Is able to ensure the protec- ethics are incorporated ethics are incorpo-
tion and confidentiality of into evaluation pro- rated into evaluation
evaluation subjects, includ- cesses and is able to processes
ing that the evaluation will uphold ethics under
not place the individual/ pressure
organization in harm
Is able to promote the inde- Is able to maintain Is able to maintain Is able to identify
pendence and impartiality independence and independence and challenges to
of evaluation processes impartiality under impartiality under independence and
pressure pressure impartiality and seek
appropriate advice
Has knowledge about the Has excellent knowl- Has solid knowledge Is able to support the
UNEG Norms and Standards edge about UNEG about UNEG Norms incorporation of the
for Evaluation and seeks to Norms and Standards and Standards for appropriate UNEG
apply them consistently, for Evaluation, can com- Evaluation and applies Norms and Standards
ensuring that the appropri- municate the essentials them appropriately, for Evaluation into
ate standards are incorpo- of the norms and stan- seeking advice where evaluation design and
rated into evaluation design dards to others and appropriate implementation
and implementation applies them consis-
tently in all settings
8
EVALUATION COMPETENCY FRAMEWORK
TABLE 1: PROFESSIONAL FOUNDATIONS (continued)
Has a solid understanding of Is able to critically anal- Understands current Is aware of current
evaluation theory and prac- yse current issues in issues in evaluation issues in evaluation
tice in the context of United evaluation practice and practice and theory practice and theory
Nations evaluation practice, theory Has solid understand- Has understanding
including the aims, processes Has excellent under- ing of humanitarian of humanitarian and
and intended results of standing of humani- and global geopolitical global geopolitical
evaluation tarian and global issues as they relate issues as they relate
Has knowledge of humani- geopolitical issues as to the evaluation to the evaluation
tarian and global geopoliti- they relate to the evalu- mandate mandate
cal issues as they relate to ation mandate Understands and Understands and
the evaluation mandate Understands and ap- applies the param- applies the param-
Is able to understand the plies the parameters of eters of social science eters of social science
issues concerning the evalu- social science research research in moderately research in simple
ability of the SDGs in complex evaluations complex evaluations evaluations
Has knowledge of United Has excellent knowl- Has solid knowledge of Has knowledge of
Nations and own agency’s edge of human rights human rights and gen- human rights and gen-
policies related to human and gender equality der equality and is able der equality and is able
rights and gender equal- and is able to ensure to ensure that evalua- to ensure that evalua-
ity and consistently uses that evaluation design, tion design, questions tion design, questions
methods and approaches questions and analysis and analysis incorpo- and analysis incorpo-
that support human rights incorporate this knowl- rate this knowledge in rate this knowledge in
and gender equality, includ- edge into all settings most settings simple settings
ing analysis of underlying
inequalities
Reflective practices
Supports the professional Provides mentoring to Provides peer support Pursues mentoring
development of other evaluators, drawing on and mentoring to opportunities in order
evaluators own experiences and evaluators, drawing on to develop own com-
self-reflection own experience and petencies and skills
Contributes to global self-reflection
evaluation practices,
including through gen-
eration of knowledge
and guidance for UNEG
9
EVALUATION COMPETENCY FRAMEWORK
Is able to identify evaluation Has excellent abilities to Has solid ability to identify Has knowledge of
needs from various stake- identify and analyse the and analyse the existing identifying evalu-
holders and has knowledge existing evidence base evidence base ation needs and of
of the importance of under- and to identify needs for Recognizes the impor- analysing existing
standing contextual factors evaluative work tance of a contextual evidence
and their possible implica- Consistently applies a perspective
tions on the evaluation and contextual perspective
its findings and ensures that this is
Is able to analyse the exist- integrated into the analy-
ing evidence base and iden- sis of evaluation needs
tify requirements to collect
additional evidence
Is able to work with stake- Has excellent knowledge Has solid knowledge of Has knowledge of
holders to understand and of various types of theo- various types of theo- theories of change
identify the components of ries of change and logic ries of change and logic and logic models
a theory of change or logic models and is able use a models and is able apply and is able to
model in order to demon- systems approach in order an understanding of sys- facilitate develop-
strate the theoretical under- to identify, recreate and tems thinking in order to ment of theories of
pinnings of the programme facilitate the development identify and facilitate the change and logic
or policy and in order to of theories of change and development of theories models for simple
facilitate evaluative think- logic models for complex of change and logic mod- programmes
ing among stakeholders programmes, policies or els for moderately com-
initiatives and in order to plex programmes and
facilitate evaluative think- policies and in order to
ing among stakeholders facilitate evaluative think-
ing among stakeholders
10
EVALUATION COMPETENCY FRAMEWORK
TABLE 2: TECHNICAL EVALUATION SKILLS (continued)
Comprehends the Has excellent understand- Has solid understanding Has under-
importance of upholding ing of and demonstrates of and is able to establish standing of and
high standards of quality for experience in ensuring the relevant evaluation understands the
evaluation by applying the that the relevant evalu- quality assurance importance of
UNEG Norms and Standards ation quality assurance mechanisms for evaluation quality
for Evaluation mechanisms are in place upholding high-quality assurance mecha-
and is able to uphold the standards nisms for uphold-
standards under pressure ing high-quality
standards
Is able to work with relevant Has excellent ability to Has solid experience in Has the knowledge
stakeholders in order to develop high-quality developing high-quality and ability to
identify the purposes of terms of references for terms of references for develop terms of
the evaluation, looking at complex evaluations moderately complex references and
who will use the findings Demonstrates an ability evaluations, including to facilitate the
and what types of decisions to prioritize and focus clear and focused development
will be made based on the evaluation questions evaluation questions of evaluation
findings questions
Is able to understand and Has excellent knowledge Has solid knowledge of Has knowledge
make use of best practices of elaborating designs elaborating evaluation of appropriate
in evaluation design and to for complex evaluations, designs for moderately evaluation designs
identify technically and cul- drawing on existing complex evaluations,
turally appropriate design best practices as well as modifying existing
for evaluations based on developing innovative designs to fit the context
the purpose of the evalu- approaches
ation and the data and
resources available, ascer-
taining the strengths and
limitations of the design
Is able to understand and Demonstrates excellent Has solid knowledge Has knowledge
apply qualitative and knowledge and the ability and the ability to apply a of a range of
quantitative data collection to apply and interpret range of evaluation data evaluation data
methods and analyses a range of evaluation collection and analysis collection and
Is able to identify, collect methods and approaches, methods, and is able to analysis methods
and analyse primary and both quantitative and use methods appropriate Has knowledge
secondary sources of qualitative for the given context of multiple and
data, ensuring accuracy, Ensures that appropriate Recognizes the mixed methods
neutrality and fairness evaluation data collection importance of multiple
with the ability to identify and analysis methods are and mixed methods
methods that address used
the needs of diverse Understands and ensures
constituencies and the appropriate use
communities of multiple and mixed
methods
11
EVALUATION COMPETENCY FRAMEWORK
Understands the importance Has excellent knowledge Has solid knowledge and Has knowledge
of data reliability to make and confidently analy- experience in analysing of how to analyse
explicit possible biases and ses data from diverse data from diverse sources data from diverse
delimitations that are affect- sources, identifying and identifying key sources
ing the evaluation analyses key trends and gaps in trends Understands the
Shows sensitivity to, and information Is able to validate data importance of data
reflects on possible risks of Is able to ensure that accuracy and data quality being accurate, of
discrimination and other data and information and to ensure that data high quality and
ethical concerns during data used in evaluations are collection and analysis analysed from an
collection appropriate, accurate, have been conducted ethical perspective
of high quality and col- ethically
lected and analysed from
an ethical perspective
Understands the impor- Demonstrates extensive Has solid knowledge Has knowledge of
tance of data being analysed analytical skills to elabo- of and experience in analytical work and
and interpreted systemati- rate credible findings analytical work and in how to elaborate
cally and logically, based on where evidence can elaborating credible find- credible findings
described assumptions and be traced through the ings placed within their
with unintended results analysis into findings, context
identified which are placed within
Has analytical skills to elabo- their context
rate credible findings and to Uses analytical skills to
synthesize data synthesize data where
Places the analysis and find- relevant
ings within its context Identifies unintended
results
Is able to clearly report cred- Has excellent ability in Has solid ability in report- Has knowledge and
ible conclusions related to reporting highly credible ing credible conclu- ability in report-
findings and substantiated conclusions substanti- sions substantiated by ing evaluation
by evidence and recommen- ated by evidence evidence conclusions
dations that flow logically Demonstrates the abil- Has the ability to develop Is aware of the
from the conclusions ity to develop clear, clear, realistic and feasible importance of the
Understands the value of realistic and feasible recommendations and use of findings to
clear, realistic and feasible recommendations, and understands the impor- inform future pro-
recommendations targeted proactively contributes tance of using findings to gramme and policy
at the intended users to dissemination in order inform future programme decisions
Has knowledge about to ensure the use of and policy decisions
and is able to support the findings to inform future
dissemination and use of programme and policy
evaluation findings to feed decisions
into programme and policy
decisions
12
EVALUATION COMPETENCY FRAMEWORK
Competencies for Evaluation Unit Heads
Evaluation Unit Heads should have technical skills and knowledge similar to a Senior Officer. In
addition, Evaluation Unit Heads should be responsible for insuring that there is a quality assurance
system put in place for evaluations. An appropriate quality assurance mechanism looks at evaluation
processes and at products, and is typically invoked at the design and finalization stages of an evaluation.
Evaluation Unit Heads should also have excellent knowledge of emerging global issues and evaluation
trends that impact on the work of their office and the skills necessary to advance the technical skills of
the evaluation profession within the United Nations and with the larger evaluation community.
Work planning
Is able to determine the Has an excellent abil- Has a solid ability to Has an ability to
scope of an evaluation ity to determine the determine the scope determine the scope
and develop strategies, scope of an evaluation of an evaluation and to of an evaluation and
policies and plans to sup- and to develop mecha- develop mechanisms to to develop mecha-
port timely and effective nisms to implement the implement the evaluation nisms to implement
implementation evaluation Has a solid ability to the evaluation
Is able to budget and man- Has an excellent ability develop a realistic work Has an ability to
age the financial aspects of to develop a realistic plan for a moderately develop a realistic
evaluation resources work plan for a complex complex evaluation, to work plan for simple
evaluation, to adjust the adjust the work plan as evaluations and to
work plan as needed needed and to effectively create and monitor
and to effectively over- manage the budgeting an evaluation budget
see the budgeting and and the use of evaluation plan
the use of evaluation resources
resources
13
EVALUATION COMPETENCY FRAMEWORK
Is able to manage and Has an excellent ability Has a solid ability to Has knowledge of
supervise the work of an to coordinate and super- coordinate and supervise coordinating evalu-
evaluation team and evalu- vise complex evaluation evaluation processes ation processes and
ation processes in order to processes in order to establish relevant stakeholder
ensure evaluation timeli- Establishes relevant relevant stakeholder groups
ness and quality management and gov- groups and to manage Understands the
Demonstrates people and ernance stakeholder these in order to ensure importance of risk
relationship management groups and consults engagement management
skills to ensure effective and manages these to Has solid knowledge
work and the meeting of ensure engagement of assessing risk and of
deadlines Demonstrates an ability building and applying
Identifies and practices risk to establish and assess contingency plans where
management risk and to build and relevant
Is able to identify conflicts Has excellent and Has solid ability to iden- Understands the
and issues and to develop demonstrable abilities tify and manage conflicts importance of identi-
problem-solving strategies to identify and manage Has well-developed con- fying and managing
Has conflict resolution conflicts flict resolution skills and conflicts
skills and is able to analyse Has highly developed solid skills in drawing Is beginning to
and articulate the lessons conflict resolution skills out lessons learned from develop conflict
learned and excellent skills in challenging situations resolution skills and
drawing out lessons skills in drawing
learned from challeng- out lessons learned
ing situations from challenging
situations
Is able to ensure that evalu- Has excellent Has a solid understand- Has understanding
ations are implemented understanding of ing of and knows how of and knows how to
in a manner that respects and knows how to to respect local customs, respect local customs,
local customs, religious respect local customs, religious beliefs and religious beliefs and
beliefs and practices, gen- religious beliefs and practices, gender roles practices, gender
der roles, and ethnicities practices, gender roles and ethnicities, while roles and ethnicities,
while maintaining sensitiv- and ethnicities, while maintaining sensitivity to while maintaining
ity to disability and age maintaining sensitivity disability and age sensitivity to disabil-
to disability and age ity and age
14
EVALUATION COMPETENCY FRAMEWORK
Competencies for Evaluation Unit Heads
Evaluation Unit Heads should have management skills at the same level as a Senior Officer. In addi-
tion, Evaluation Unit Heads should have the skills to coordinate, supervise, network and provide support
to evaluators through mentoring, coaching and promoting a positive work environment and a deeper
understanding of how to foster learning in order to improve the effectiveness of the evaluation function.
Evaluation Unit Heads, in their role as overall manager, should also be able to define and adapt an
evaluation to support and align with the SDGs and to cultivate effective relationships with Member
States, donors and programme managers.
Is able to articulate clear Has high ability and dem- Has solid knowledge Has knowledge and
results and play key roles in onstrates excellent com- and the ability to com- understanding of
brokering the acceptance munication skills, including municate and present the importance of
and understanding of evalu- to present results in a clear results in a clear and articulating clear
ation findings and user-friendly way as user-friendly way as well and user-friendly
Writes clearly and concisely well as to write up evalua- as to write up evalua- presentations and
and can communicate tion reports tion reports reports
complex technical evalua- Is effective in engaging Is effective at asking Has the ability to ask
tion concepts and results in and communicating with probing questions and probing questions
ways that non-experts can senior management and actively listening to and actively listen to
easily understand stakeholders responses responses
Is able to adapt communica- Is excellent at asking prob-
tion to different audiences ing questions and actively
Has the ability to actively listening to responses
listen to others and encour- Is able to mentor others in
ages comprehensive developing these skills
responses from evaluation
participants
Is able to communicate
the needs of others, build-
ing strong cross-functional
alliances
15
EVALUATION COMPETENCY FRAMEWORK
Facilitation skills
Has the ability to employ Demonstrates excellent Has solid facilitation Has knowledge
mechanisms to engage meeting and facilita- skills that engage stake- on how to engage
users and beneficiaries in tion skills that engage holders and support stakeholders and
evaluation processes using stakeholders and support dialogue support dialogue
techniques that support dialogue
open and honest dialogue
Is able to integrate diverse Has excellent ability and Has solid ability to Has knowledge on
perspectives and deal with works collaboratively to ad- address challenging how to address chal-
challenging dynamics dress challenging dynamics, dynamics and to ensure lenging dynamics
to address controversial is- that diverse perspec- and to ensure that
sues, to ensure understand- tives are integrated into diverse perspectives
ing and clarity of issues the evaluation are integrated into
and to ensure that diverse the evaluation
perspectives are integrated
into the evaluation
Negotiation skills
Is able to assist evaluation Has excellent ability to Has solid ability to Is able to negotiate
commissioners and users in negotiate evaluation priori- negotiate evaluation evaluation priorities
setting evaluation priorities ties within the resources priorities within the within the resources
and methods that are con- available resources available available
sistent with the purposes Demonstrates excellent Ensures effective and
of the evaluation and the negotiation skills to ensure high-quality evalua-
resources available effective and high-quality tion processes without
Is able to negotiate condi- evaluation processes with- compromising ethical
tions and circumstances that out compromising ethical conduct
are conducive to effective conduct
and high-quality evaluation
processes without compro-
mising ethical conduct
Knowledge-sharing skills
Is able to develop a com- Demonstrates strong abil- Has solid knowledge- Has knowledge of
munication plan that shares ity to develop and imple- sharing skills and an developing and
the knowledge gained ment communication ability to develop and implementing com-
through the evaluation in plans to ensure appropri- implement communica- munication plans
order to ensure appropriate ate dissemination tion plans Is able to build
dissemination of evalua- Supports others in their Is able to build networks networks and
tion findings to all relevant development of communi- and use these to dis- share evaluation
stakeholders cation plans seminate evaluation knowledge
Is able to build networks Excellent ability to build findings
and partnerships with vari- and use networks to Is able to engage with
ous stakeholders in order to disseminate evaluation senior stakeholders for
leverage greater results and findings evaluation knowledge-
use of evaluations sharing purposes
Demonstrates effective
engagement with senior
stakeholders, such as
executive boards and senior
executives within the orga-
nization in order to advance
evaluation results and use
16
EVALUATION COMPETENCY FRAMEWORK
Competencies for Evaluation Unit Heads
Evaluation Unit Heads should have the same communication, facilitation and interpersonal skills as
that of a Senior Officer and should be able to use those skills at senior management and executive
meetings. Evaluation Unit Heads should be able to promote and cultivate effective communication, an
organizational learning culture and the widespread use of evaluation results both internally and externally.
Is able to communicate to Has excellent knowledge Has solid knowledge of Understands the
stakeholders the value of of and ability to demon- and ability to commu- value of evaluation
evaluation as a vital compo- strate to stakeholders the nicate to stakeholders to policy and pro-
nent of policy and program- value of evaluation for the value of evaluation gramming in the
ming in the achievement of policy and programming to policy and program- achievement of the
the SDGs in the achievement of the ming in the achieve- SDGs
SDGs ment of the SDGs
Is able to support stakehold- Has excellent knowledge Has solid knowledge of Has knowledge
ers in integrating evaluation of policy and programme policy and programme of policy and pro-
into policy and programme monitoring, evaluation monitoring and evalua- gramme monitor-
development and manage- and mechanisms to pro- tion and mechanisms to ing and evaluation
ment through knowledge of mote learning within promote learning within and mechanisms to
learning organizations organizations organizations promote learning
within organizations
Is able to consistently pro- Has excellent knowledge Has solid knowledge Understands the
mote the engagement of of utilization-focused of utilization-focused value of utilization-
users and beneficiaries in evaluations and demon- evaluations and the focused evaluations
evaluation processes in strates excellent ability to ability to promote the and evaluative
order to promote evaluative promote the engagement engagement of users thinking
thinking and the wide use of of users and evaluative and evaluative thinking
evaluation findings thinking
17
EVALUATION COMPETENCY FRAMEWORK
18
EVALUATION COMPETENCY FRAMEWORK
ANNEX A: DEFINITIONS OF ROLES
Although the distinction among these roles is important for the UNEG evaluation competency
framework, the reality in the United Nations system is that some roles are overlapping. For example,
the evaluation commissioner may also often be the evaluation manager; an Evaluation Unit Head
may also be an evaluator; and an evaluator may also be an evaluation manager. The Joint Inspection
Unit’s Analysis of the Evaluation Functions in the United Nations System6 benchmarked the diversity
of evaluation function arrangements, including the organization of roles related to evaluation. An
evaluator who is in a position where there is a hybrid role would need to have the core evaluation
competencies plus the competencies associated with any other roles.
Evaluator
An evaluator is anyone who is directly involved in planning and conducting an evaluation, including
researchers, team leaders and team members. The work of an evaluator includes elaborating the
evaluation design, proposing the evaluation approach and method, developing the inception report,
collecting and analysing data, interpreting evaluation findings, drawing appropriate conclusions,
making recommendations and communicating evaluation findings through reports, presentations or
other means of dissemination.
The evaluation unit head is responsible for supporting evaluators in carrying out their work and
ensuring excellent performance. The work of an evaluation unit head includes recruiting and hiring
evaluators, conducting performance appraisals, supporting professional development plans and
reviewing the work carried out by evaluators.
Evaluation Commissioner
The evaluation commissioner is the person often associated with the programme who arranges for the
evaluation to occur, whether through internal resources or the hiring of external consultants. The work of
an evaluation commissioner includes determining the programmes to be evaluated, ensuring the evalu-
ation purposes meet the needs of those responsible for implementing the programme, ensuring that the
evaluation is consistent with United Nations policies and engaging evaluators to carry out the evaluation.
6 United Nations Joint Inspection Unit, 2014, Analysis of the Evaluation Function in the United Nations System, JIU/
REP/2014/6. Available at: https://www.unjiu.org/en/reports-notes/JIU%20Products/JIU_REP_2014_6_English.pdf
19
EVALUATION COMPETENCY FRAMEWORK
Commissioners of evaluation are often the liaison between the programme and the evaluators.
Commissioners are well-positioned to support a positive attitude towards the evaluation and to support
the use of credible findings. As such, they need knowledge of the evaluation process, familiarity with
the technical skills required to conduct an evaluation, awareness of the value of evaluation and excellent
facilitation and negotiation skills. It is assumed that a commissioner of an evaluation would have the
competencies equivalent to an officer, or in some instances, an intermediate officer.
Evaluation Manager
The evaluation manager’s responsibilities include ensuring quality assurance processes, using internal
resources and hiring external consultants. The role of evaluation management may be subsumed by
other roles, such as that of an evaluator, evaluation commissioner or the evaluation unit head, for
example, depending on organizational context and arrangements.
The evaluation manager needs skills similar to those required for general project management.
However, evaluation requires such skills to be distinct and adjusted to the specific evaluation context. It
is assumed that an evaluation manager would have the competencies equivalent to an officer, or in some
instances, an intermediate officer.
Evaluation Users
Users of evaluation can be distinguished between three main types:7
I.
Individuals or groups who have decision authority over the programme, including
policymakers, funders, advisory boards, parliamentarians and civil society leaders in
programme countries.
In the United Nations context, this user group is composed of senior management, governing
bodies, donors and partner governments. This group is responsible for responding to evaluation
recommendations, and is ultimately responsible for their implementation.
II. I ndividuals or groups who have direct responsibility for the programme, including
programme developers, administrators in the organization implementing the programme,
programme managers and direct service staff.
In the United Nations context, this user group is composed of programme staff. This group
is responsible for supporting evaluation processes and for taking action to implement the
recommendations approved by senior decision-makers. Evaluation users are not expected to have core
evaluation competencies. It is the responsibility of evaluators to guide evaluation users.
III. Individuals or groups for whom the programme was designed, often referred to as the target
population or programme users. Any changes to programmes or initiatives resulting from the
evaluation will impact these people or groups.
When an open participatory approach is used, programme beneficiaries can use an evaluation to
advocate for change.
7 UNEG, 2015, Evaluation Use in the United Nations System, UNEG SO2 Group.
20
EVALUATION COMPETENCY FRAMEWORK
ANNEX B: EXAMPLE OF USE
IN A JOB DESCRIPTION
Job Profile: Intermediate Evaluation Officer
Responsibilities and Functions
1. Conduct and/or manage evaluations that are impartial, independent and credible and that meet
professional standards
• Carry out evaluations of projects, programmes and policies;
• Supervise evaluations conducted by staff members and consultants;
• Apply high professional standards in line with evaluation policy and the UNEG Norms and
Standards for Evaluation;
• Apply evaluation quantitative and qualitative data collection and analysis tools, techniques and
approaches;
• Keep abreast of developments in the area of evaluation; and
• Cooperate with other United Nations evaluation units and professional evaluation bodies.
2. Promote evaluations that are useful and ensure that evaluation findings and recommendations are
followed up
• Report to management on evaluation findings and recommendations;
• Organize meetings, workshops and other discussion fora in order to establish a dialogue on
evaluation results, recommendations and lessons learned;
• Ensure that evaluation results are taken into account in the continued implementation of
projects and programmes and in the design and appraisal of new projects and programmes; and
• Ensure that project and programme managers respond to recommendations and monitor the
follow-up on evaluations.
The Evaluation Officer will perform other related duties and assignments as and when required.
21
EVALUATION COMPETENCY FRAMEWORK
Required Competencies
Essential:
Knowledge of the United Nations system, particularly:
• Gender equality within the United Nations context and how to incorporate it into all aspects of work;
• Human rights within the United Nations context and how to incorporate it into all aspects of work;
• Application of evaluation norms and standards; and
• Evaluation ethics and their consistent application and maintaining evaluation impartiality and
independence.
Technical evaluation skills, particularly:
• The ability to identify evaluation needs and to recognize the importance of a contextual perspective;
• The knowledge and experience of elaborating evaluation designs, including clear and focused
evaluation questions; and
• The knowledge of and ability to apply a range of evaluation data collection and analysis methods,
using multiple and mixed methods.
Management skills, particularly:
• The ability to determine the evaluation scope, develop a realistic work plan and create mechanisms
to implement the evaluation;
• The ability to coordinate and supervise evaluation processes and to establish and manage relevant
stakeholder groups; and
• The knowledge of assessing risk and building and applying contingency plans where relevant.
Interpersonal skills, particularly:
• Facilitation skills that engage users and support dialogue;
• Knowledge-sharing skills and an ability to develop and implement communication plans; and
• The ability to build and use networks in order to disseminate evaluation findings.
• Promoting a culture of learning for evaluation, including:
• Knowledge of programme monitoring and evaluation and mechanisms to promote learning within
organizations.
Desirable:
• Knowledge of and ability to communicate the value of evaluation to programme managers in the
achievement of the SDGs;
• Understanding of and ability to establish the relevant evaluation quality assurance mechanisms by
applying UNEG norms and standards;
• The pursuit of professional networks and self-development in order to enhance competencies and
skills; and
• The provision of peer support and mentoring to evaluators that draws on own experiences and self-
reflection.
22
EVALUATION COMPETENCY FRAMEWORK
ANNEX C: EXAMPLE OF USE IN LEARNING
AND DEVELOPMENT
Please complete the following table by checking the level of competency for each factor. In the
Remarks section, indicate what the implications are in terms of your work and your personal career
goals. For more information, please refer to the UNEG Core Evaluation Competencies (2016). The
assessment should be based on what is expected at your position and level.
Occa- Consist-
Needs Needs sionally ently
substantial some Meets exceeds exceeds
improve- improve- expecta- expecta- expecta-
Evaluation Competencies ment ment tions tions tions Remarks
Professional Foundations
Reflective practices
23
EVALUATION COMPETENCY FRAMEWORK
Occa- Consist-
Needs Needs sionally ently
substantial some Meets exceeds exceeds
improve- improve- expecta- expecta- expecta-
Evaluation Competencies ment ment tions tions tions Remarks
Management Skills
Work planning
Interpersonal Skills
Facilitation skills
Negotiation skills
Knowledge-sharing skills
Using utilization-focused
approaches
24
EVALUATION COMPETENCY FRAMEWORK
Professional Development Planning Tool
Name:
Date:
Completed by:
Career Goals
1.
2.
3.
Priority Development Goal Ways to Address Goal By When Indicators that Goal has been Met
Date:
25
EVALUATION COMPETENCY FRAMEWORK
26
The United Nations Evaluation Group (UNEG) is a professional
network that brings together the units responsible for
evaluation in the UN system including the specialized
agencies, funds, programmes and affiliated organizations.
UNEG currently has 47 members and three observers. UNEG
aims to promote the independence, credibility and usefulness
of the evaluation function and evaluation across the UN
system, to advocate for the importance of evaluation for
learning, decision-making and accountability, and to support
the evaluation community in the UN system and beyond.
@un_evaluation
Facebook “f ” Logo CMYK / .ai Facebook “f ” Logo CMYK / .ai
www.facebook.com/unevaluation
www.youtube.com/UNEvaluationGroup