UNICEF works in some of the world’s toughest places, to reach the world’s most disadvantaged children. To save their lives. To defend their rights. To help them fulfill their potential. 

Across 190 countries and territories, we work for every child, everywhere, every day, to build a better world for everyone. 

And we never give up. 

For every child, hope. 

Vacancy Announcement: Consultant

Consultancy Title: Updating the Synthesis Report on the Inclusion of Disability in UNICEF Evaluations (2026-2023) – Team Leader Consultant

Section/Division/Duty Station: Evaluation Office, New York HQ

Duration: 1 October 2024 to 28 February 2025

Home/ Office Based: NYHQ 

About UNICEF

If you are a committed, creative professional and are passionate about making a lasting difference for children, the world's leading children's rights organization would like to hear from you. For 70 years, UNICEF has been working on the ground in 190 countries and territories to promote children's survival, protection and development. UNICEF supports child health and nutrition, good water and sanitation, quality basic education for all boys and girls, and the protection of children from violence, exploitation, and AIDS. UNICEF is funded entirely by the voluntary contributions of individuals, businesses, foundations and governments. 

BACKGROUND

Purpose of Activity/Assignment: 

Background

The adoption of the Convention on the Rights of Persons with Disabilities (CRPD) in 2006, now ratified by 164 State Parties1, marked a paradigm shift in how disability is perceived and addressed globally. The CRPD emphasizes the rights of persons with disabilities to full and effective participation in society on an equal basis with others. This landmark treaty has significantly influenced policy-making, and program implementation across various sectors, including child rights and welfare, catalyzing global efforts to promote disability inclusion.

UNICEF, at the forefront of this movement, has demonstrated an ongoing commitment to disability inclusion, developing tools and guidance to support disability-inclusive programming since the early stages. The organization's influential 2013 State of the World's Children report, "Children with Disabilities: From Exclusion to Inclusion2," brought global attention to the challenges faced by children with disabilities and called for their full inclusion in society. The report significantly impacted Member States, implementing partners, and donors, leading to substantial growth in UNICEF's disability-inclusive programming portfolio.

UNICEF's commitment to disability rights has evolved further in its 2022-2025 Strategic Plan3, which adopts a more transformative and intersectional approach to addressing inequality and discrimination. This shift aims to tackle the underlying drivers of exclusion by transforming structures and norms. Recognizing that children with disabilities remain among the most marginalized and invisible members of society, UNICEF is now integrating disability rights across all its operations, including support for families, parents, and caregivers of children with disabilities in both development and humanitarian contexts. The Strategic Plan sets ambitious targets for disability inclusion and mandates the integration of disability considerations across all UNICEF programs and operations.

In 2019, the United Nations launched the Disability Inclusion Strategy (UNDIS), a comprehensive framework designed to guide the UN system in strengthening its approach to disability inclusion. As part of the UN family, UNICEF has aligned its efforts with UNDIS, working to ensure that the rights of persons with disabilities are fully realized across all its programmatic and operational areas. UNDIS Indicator 10, which focuses on evaluation, is particularly relevant to this synthesis. Evaluation plays a crucial role in assessing the level of disability inclusion within the scope of the United Nations activities. Enhancing disability inclusion in evaluations will enable the UN system to enhance organizational accountability and knowledge, contributing to the implementation of the Convention on the Rights of Persons with Disabilities (CRPD) and the attainment of the Sustainable Development Goals (SDGs), including the fundamental commitment to ensuring that no one is left behind.

In response to the UNDIS requirements, UNICEF conducted an initial synthesis to identify gaps in disability inclusion within its evaluation practices. This synthesis served as a crucial step in understanding the organization's baseline and areas for improvement. Prior to developing its guidance, UNICEF undertook a meta-synthesis of the inclusion of disability in evaluations from 2016 to 2021, aiming to create awareness and inform the organization on the progress made towards achieving the standards set by UNDIS.

Building on this work, UNICEF has since developed new guidance on disability inclusion in evaluation, aiming to strengthen the organization's capacity to assess and improve its disability-inclusive programming. The current update of the synthesis report is necessitated by the need to capture recent developments in UNICEF's approach to disability inclusion and to identify remaining gaps. This updated synthesis will cover the period from 2016 to 2023, extending the previous synthesis that ended in 2021. The current terms of reference are for updating this original meta-synthesis, extending the coverage period and expanding the areas covered in the synthesis .

By examining this extended period, the report will provide a comprehensive overview of UNICEF's progress in mainstreaming disability inclusion in its evaluations and, by extension, its programs and operations. The updated meta-synthesis will play a crucial role in refining UNICEF's approach to disability-inclusive evaluations, thereby strengthening its overall commitment to disability rights and inclusion across all areas of its work.

Purpose and Objectives

The primary purpose of updating the synthesis report is to provide a comprehensive and up-to-date analysis of how disability inclusion is addressed in UNICEF evaluations. This update will serve as a critical tool for assessing progress, identifying best practices, and highlighting areas that require further attention and improvement.

Specific objectives of the updated synthesis report include:

1 Awareness Raising: To increase awareness among UNICEF staff, partners, and stakeholders about the importance of disability inclusion in evaluations and the current state of practice within the organization.

2 Foundation for Follow-up: To provide a solid foundation for subsequent follow-up actions, including the development of targeted capacity-building initiatives, refinement of evaluation guidelines, and improvement of disability-inclusive programming.

3 State of Play Description: To describe the "state of play" within UNICEF in terms of disability inclusion in evaluations, offering a clear picture of progress made since the previous synthesis and identifying trends, patterns, and gaps across different program areas and regions.

4 Best Practice Identification: To identify and showcase best practices in disability-inclusive evaluation within UNICEF, providing examples that can be replicated or adapted across the organization.

5 Gap Analysis: To conduct a thorough gap analysis, highlighting areas where disability inclusion in evaluations needs strengthening, and providing recommendations for improvement.

Synthesis Guiding Questions

How has the inclusion of disability considerations in UNICEF evaluations evolved from 2021 to 2023, particularly in light of the newly developed guidance on disability inclusion in evaluation?

What exemplary practices and innovative approaches have emerged in UNICEF evaluations that enhance disability inclusion across different organizational levels (headquarters, regional offices, and country programmes)?

To what extent do UNICEF evaluations address the six key elements of disability inclusion as outlined in the assessment framework (ToR attention, team knowledge, evaluation questions, stakeholder involvement, findings and evidence, conclusions and recommendations)?

How do evaluations reflect UNICEF's shift towards a more transformative and intersectional approach to addressing inequality and discrimination, as outlined in the 2022-2025 Strategic Plan?

How do evaluations integrate disability rights considerations across different UNICEF operations, including support for families, parents, and caregivers of children with disabilities in both development and humanitarian contexts?

What gaps remain in UNICEF's approach to disability-inclusive evaluations, and what recommendations can be made to address these gaps?

Scope of Work:

4.1 Scope

The updated synthesis report will cover UNICEF evaluations conducted between 2026 and 2023. This extended timeframe will allow for a comprehensive analysis of trends and developments in disability inclusion practices within UNICEF evaluations.

The scope of the synthesis will include:

- All types of evaluations conducted by UNICEF during the specified period, including program evaluations, thematic evaluations, country-level evaluations, and global evaluations.

- Evaluation of disability inclusion across all UNICEF program areas, including but not limited to health, education, child protection, WASH and social inclusion.

- Analysis of disability inclusion practices in evaluations across all UNICEF regions, allowing for comparative insights and identification of region-specific trends or challenges.

- Examination of both centralized and decentralized evaluations to provide a comprehensive picture of disability inclusion practices across different levels of the organization.

4.2 Methodology

The synthesis will employ a mixed-methods approach, combining quantitative and qualitative analysis techniques. The methodology will include the following components:

1 Semi-automatic Pipeline for Analyzing Evaluation Reports:

Development of a robust semi-automatic pipeline to efficiently process and analyze a large volume of evaluation reports.

Utilization of natural language processing (NLP) techniques to identify and extract relevant information related to disability inclusion.6

2 Bulk PDF-to-Text Conversion:

Implementation of a reliable PDF-to-text conversion process to ensure accurate extraction of textual data from evaluation reports.

Quality checks to verify the integrity of converted text and address any conversion errors.

3 Rule-Based Methods for Identifying Relevant Sections:

Development of rule-based algorithms to identify sections within evaluation reports that are most likely to contain information on disability inclusion.

Refinement of rules based on initial testing to improve accuracy and reduce false positives.

4 Advanced Text Mining:

Application of advanced text mining techniques, including topic modeling and sentiment analysis, to extract meaningful insights from the evaluation reports.

Use of machine learning algorithms to identify patterns and trends in disability inclusion across multiple reports.

5 Semi-Automatic Data Extraction:

Development of a semi-automatic data extraction process to pull relevant quantitative and qualitative data from the reports.

Implementation of a human-in-the-loop approach to verify and refine extracted data, ensuring accuracy and contextual understanding.

6 Manual Review and Analysis:

Complementary manual review of a subset of reports to validate the automated findings and capture nuanced information that may be missed by automated processes.

In-depth qualitative analysis of selected reports to provide rich, contextual insights into disability inclusion practices.

4.3 Assessment Framework 

The assessment of disability inclusion in UNICEF evaluations will be based on six key elements:

1 Evaluation TORs pay adequate attention to disability inclusion:

Assessment of whether and how disability inclusion is incorporated into evaluation Terms of Reference.

Examination of the prominence given to disability-related issues in the evaluation scope and objectives.

2 Evaluation teams have knowledge and/or experience of disability inclusion:

Review of the composition of evaluation teams, focusing on the inclusion of members with expertise in disability rights and inclusion.

Assessment of any capacity building or orientation provided to evaluation teams on disability inclusion.

3 Evaluation questions cover different aspects of disability inclusion:

Analysis of evaluation questions to determine the breadth and depth of inquiry into disability inclusion.

Assessment of whether questions address both programmatic and operational aspects of disability inclusion.

4 Evaluation stakeholder mapping and data collection methods involve persons with disabilities and their representative organizations:

Examination of stakeholder mapping processes to ensure the inclusion of persons with disabilities and Disabled People's Organizations (DPOs).

Assessment of data collection methods for accessibility and inclusivity.

5 Evaluation findings and analysis provide data and evidence on disability inclusion:

Review of evaluation findings to determine the extent and quality of data and evidence presented on disability inclusion.

Assessment of how disability-disaggregated data is collected, analyzed, and presented in evaluation reports.

6 Conclusions and/or recommendations of evaluation reflect their findings on disability inclusion:

Analysis of evaluation conclusions and recommendations to ensure they adequately reflect and address disability inclusion findings.

Assessment of the actionability and relevance of disability-related recommendations.

Terms of Reference / Deliverables

1 Inception Report / Approach Paper:

Detailed methodology for the synthesis, including data collection and analysis methods.

- Draft assessment framework based on the six elements of disability inclusion.

- Proposed structure for the final report.

1. Study Inception report finalized - November 2024

2 Summary Note on Preliminary Findings:

- Brief overview of initial findings from the analysis of evaluation reports.

- Identification of key trends and patterns in disability inclusion.

2 Data collection and Summary Note on Preliminary Findings - December 2024

3 PowerPoint Presentation of Preliminary Findings:

- Visual presentation of key findings, trends, and initial recommendations.

- To be presented to the Reference Group for feedback and discussion.

3 Power Presentation and Draft Report - January 2025

4 Full Updated Synthesis Report:

Comprehensive report detailing the findings of the synthesis, including:

-  Executive summary

-  Introduction and background

-  Methodology

-  Findings organized by the six elements of disability inclusion

-  Analysis of trends and patterns

-  Best practices and case studies

-  Gaps and challenges

-  Recommendations for improving disability inclusion in evaluations

-  Conclusions

4 Final Report - February 2025

Qualifications

Education

An advanced university degree (Master’s or higher) in Evaluation, Public Policy, Social Policy, Economics, or a relevant field across the social sciences (PhD preferred);

A minimum of eight years of professional experience in conducting or supporting the synthesis of evaluation results, systematic reviews and/or rapid academic reviews or evidence gap maps related to development cooperation, humanitarian assistance, social sciences, or institutional effectiveness;

Knowledge/Expertise/Skills required:

Experience synthesizing corporate evaluations, thematic evaluations, and/or impact evaluations, ideally related to development effectiveness and/or or child rights;

Experience developing and executing methodologies for evaluation synthesis, including narrative or thematic synthesis of quantitative and qualitative data and the creation of criteria to select and sample evaluations or social research products;

Previous experience related to UNICEF’s work is an asset;

In-depth knowledge of qualitative (and quantitative data collection and analytical methods;

Access to, and experience in using Systematic Review software (e.g., EPPI-Reviewer, RevMa, Covidence) and quantitative (e.g., STATA) and qualitative (e.g., NVivo) analysis software ;

Strong understanding of the UN system, UN reform processes, UN programming at a country level and the Sustainable Development Goals is preferred;

Knowledge of UNEG Norms and Standards for Evaluation and the UNEG Ethical Guidelines for Evaluation is desirable;

Strong communication and interpersonal skills, with the ability to communicate effectively with stakeholders from different backgrounds;

Excellent report writing skills, being able to write clear and concise analytical reports to strict deadlines; and

Fluency in English is required.

Responsibilities:

Overall leadership of the synthesis process

Development and refinement of the methodology

Quality assurance of all deliverables

Lead author of the synthesis report

Presentation of findings to stakeholders

Requirements: 

Completed profile in UNICEF's e-Recruitment system and

Upload copy of academic credentials

Financial proposal that will include/ reflect :

• the costs per each deliverable and the total lump-sum for the whole assignment (in US$) to undertake the terms of reference.
• travel costs and daily subsistence allowance, if internationally recruited or travel is required as per TOR.
• Any other estimated costs: visa, health insurance, and living costs as applicable.
• Indicate your availability

Any emergent / unforeseen duty travel and related expenses will be covered by UNICEF.

At the time the contract is awarded, the selected candidate must have in place current health insurance coverage.

Payment of professional fees will be based on submission of agreed satisfactory deliverables. UNICEF reserves the right to withhold payment in case the deliverables submitted are not up to the required standard or in case of delays in submitting the deliverables on the part of the consultant.

U.S. Visa information:

With the exception of the US Citizens, G4 Visa and Green Card holders, should the selected candidate and his/her household members reside in the United States under a different visa, the consultant and his/her household members are required to change their visa status to G4, and the consultant’s household members (spouse) will require an Employment Authorization Card (EAD) to be able to work, even if he/she was authorized to work under the visa held prior to switching to G4.  

Only shortlisted candidates will be contacted and advance to the next stage of the selection process

For every Child, you demonstrate…

UNICEF’s core values of Commitment, Diversity and Integrity and core competencies in Communication, Working with People and Drive for Results. View our competency framework at: Here

UNICEF offers reasonable accommodation for consultants/individual contractors with disabilities. This may include, for example, accessible software, travel assistance for missions or personal attendants. We encourage you to disclose your disability during your application in case you need reasonable accommodation during the selection process and afterwards in your assignment. 

UNICEF has a zero-tolerance policy on conduct that is incompatible with the aims and objectives of the United Nations and UNICEF, including sexual exploitation and abuse, sexual harassment, abuse of authority and discrimination. UNICEF also adheres to strict child safeguarding principles. All selected candidates will be expected to adhere to these standards and principles and will therefore undergo rigorous reference and background checks. Background checks will include the verification of academic credential(s) and employment history. Selected candidates may be required to provide additional information to conduct a background check.