Vacancy Announcement Details
MBPJ CFCI Evaluation Consultant, Kuala Lumpur, Malaysia, 9 weeks
30 May 2023
UNICEF
Purpose: To conduct the evaluation of the implementation of MBPJ’s CFCI Plan of Action (PoA)
Objective(s):
- To conduct the evaluation of the implementation of the CFCI Plan of Action in accordance with the CFCI Global Guidelines (2018)
- To give recommendation for the Plan of Action for the next round of CFCI.
Required Conceptual approach to Evaluation
The evaluation of the implementation of the CFCI Action Plan should be carried out at the end of the CFCI cycle to assess the degree to which the local council was able to achieve the results and targets established in the Plan of Action and whether it meets the minimum criteria following the global CFCI guidance. The evaluation also intends to capture intended and unintended effects and investigates the reasons why certain aspects of the implementation have or have not been implemented as planned. It is recommended that evaluation of CFCI should follow the two evaluation criteria:
- Relevance: Are MBPJ doing the right thing? How important is the relevance or significance of the intervention regarding local requirements and priorities?
- Effectiveness: Are the objectives of the interventions being achieved?
Even though the impact criteria as such is not included, the evaluation should assess whether the activities carried out under the action plan started to make a change in the lives of children. As the implementation time was only one year, only initial changes and potential for impact can be assessed. Tools and analysis should also consider this lend.
The Evaluation will adopt the three global criteria for UNICEF-recognized Child Friendly City are:
- Demonstrated results for children within the scope of the Plan of Action
- Meaningful and inclusive child participation within the scope of the Plan of Action
- Demonstrated dedication to eliminating discrimination against children and young people in policies and actions within the scope of the Plan of Action.
The methodology should be suitable to address the objective of the evaluation and should seek to include a mixed method approach based on a review on the documentations, interviews with the key stakeholders (both rights holders and duty bearers) and observation, where applicable. This information should be captured in an evaluation matrix which also identify the indicators, the criteria, data sources and the analytics methods to be used to address the potential for or early impact and the progress made towards the agreed objectives and indicators in the Plan of Action. It is important to note that the evaluation criteria need to be developed with clear passing criteria and thresholds to quantify progress need to be defined at the inception stage of the evaluation, as these were not included in the plan of action itself. These need to be discussed and validated with both MBPJ and UNICEF.
Time scope: The evaluation should cover the period when the CFCI PoA was approved to its completion.
UNICEF will share with the selected consultant the selected Evaluation Committee members and the committee’s terms of reference. The role of the committee would help strengthen the legitimacy of the recognition (and possible rejection), will reduce the risk of having potential conflicts of interest and will be the key validation group on the evaluation findings. The committee should comprise members of civil society, academia, relevant professionals, representative of MBPJ and representative of UNICEF Malaysia Office, provided there is a balanced political representation and no conflicts of interest. The involvement of children/youth people in the process would be an asset and strengthen its effectiveness and legitimacy.
Note: It is advised that the selected consultant refers to the Child Friendly Cities Initiative Handbook (2018) as its PoA was developed based on this guideline. MBPJ final Plan of Action with the M&E framework will be shared with the selected consultant.
While the evaluation’s unit of analysis is the Plan of Action and recognition of MBPJ as a Child Friendly City depends on implementation of this PoA, MBPJ is the first city in Malaysia to be part of the CFCI. As such, the evaluation is expected to also provide comments and recommendations beyond the evaluation of the implementation of the plan of action. Ideally, a reflection on the PoA itself, how well it aligns with the CFCI global guidance, how ambitious it is in the goal of advancing child rights (within the scope of action of a local council in Malaysia). This will help shape upcoming plans of action of other cities that are starting their CFCI journey in Malaysia.
Finally, recommendations on which areas of the Plan of Action could be strengthened and continued in the future and which areas could be considered to be included in the future will help shape the future of MBPJs work on and with children.
The consultants are expected to refer to the following documents:
- Child Friendly Cities Initiative Handbook (2018)
- UNICEF’s Guidance Note: The Child Friendly Cities Initiative (2022)
- UNICEF’s Enhancing subnational and local governance to accelerate results for children (2022)
- UNICEF’s Procedure on ethical standards in research, evaluation, data collection and analysis (2021)
- UNICEF’s Guidance Note: Child Participation in Local Governance
- UNICEF’s Guidance on Consultations with Young People (2022)
SCOPE OF WORK
The development of the evaluation will proceed as follows:
- Development of the Inception report (IR) including the evaluation methodology, the development of the evaluation criteria for achieving the CFCI recognition, outline of the evaluation matrix and the outline of the report (including the manner the recommendation would be presented). If children are included (to review child participation) in the data collection, then ethical approval needs to be obtained.
- Evaluation of MBPJ’s implementation of CFCI Plan of Action and writing of the evaluation report, executive summary and a powerpoint.
- Recommendation to recognize MBPJ as CFCI or if needed, to be recognized under certain categories based on evaluation results and consultation with Evaluation Committee
- Develop recommendations based on the findings for the next CFCI cycle, both on content as well as structure of the PoA and its M&E framework
Further details available on the UNICEF website. Application deadline 4th June.