Full Stack Data Engineer/Scientist for Monitoring and Reporting System Development, Ukraine, 8 months (Work from home)
Remote | Ukraine
- Organization: UNICEF - United Nations Children’s Fund
- Location: Remote | Ukraine
- Grade: Level not specified - Level not specified
-
Occupational Groups:
- Engineering
- Statistics
- Communication and Public Information
- Information Technology and Computer Science
- Monitoring and Evaluation
- Scientist and Researcher
- Documentation and Information Management
- Closing Date: 2024-11-14
The consultant will design and implement a robust Monitoring and Reporting System. This includes developing a user-friendly data collection system, supporting the creation of data warehouse with efficient ETL processes, and ensuring data quality and transformation for validation. The consultant will establish user roles and an approval chain, configure real-time data access for analytical tools, and integrate existing products (eTools, TPM, AAP, etc) into a comprehensive insights-generative system. Additionally, the consultant will provide training, documentation, and support, facilitating a data-driven approach to reporting and decision-making for UNICEF Ukraine.
UNICEF works in some of the world’s toughest places, to reach the world’s most disadvantaged children. To save their lives. To defend their rights. To help them fulfill their potential.
Across 190 countries and territories, we work for every child, everywhere, every day, to build a better world for everyone.
And we never give up.
For every child, hope
How can you make a difference?
Background:
UNICEF Ukraine is approaching the start of its new Programe Cooperation in January 2025, which will place a strong emphasis on integrating the various components of the response, such as humanitarian action, recovery, and the nexus. To support this, UCO has designed a new monitoring system that integrates information on the progress of these components.
A key element for the success of this monitoring system is the automation of data collection and improvements in data consolidation, quality assurance, and analysis. This will require the implementation of advanced information management techniques, as well as the development of data infrastructure to support the system and handle large volumes of data. This includes not only high-frequency monitoring indicators but also long-term indicators and even qualitative information.
The current information system relies on the 5W tool to collect high-frequency indicators. The system is well-structured and operates efficiently; however, there is a need to advance the automation of data validation and quality assurance processes. This 5W tool is mainly being used for monitoring the humanitarian component of UNICEF's response. Therefore, integrating other data sources for monitoring medium- and long-term outcome indicators requires the establishment of a more sophisticated data model. To achieve this, it is essential to develop the appropriate infrastructure using existing tools and corporate platforms within UNICEF such as eTools Modules (Field Monitoring, FMM Action Point, Partnership, etc.), Third-Party Monitoring activities, and Accountability to Affected Population Mechanisms, while also facilitating the integration of external data sources even information on the vulnerability of individuals.
The integration of information from corporate platforms with high-frequency data and long-term indicators is something new for UNICEF and given that the start of the new Cooperation Programme is approaching, additional capacity is required to design certain components of the system, particularly those aimed at integrating data into the appropriate infrastructure, as well as automating quality assurance and analysis processes.
This additional support also demands high-level expertise in integrating various types of quantitative and qualitative data from multiple sources using existing data collection and reporting systems through APIs and connections. The objective is to develop integrated tools that effectively deliver insights for program implementation and address current gaps in the data flow.
Therefore, additional technical support and consultancy are needed to successfully implement a robust and integrated technical solution for UNICEF Ukraine's digitalized Monitoring and Reporting System. This will ensure a rigorous data flow and reporting process. Such support will promote consistency and coherence in reporting while effectively showcasing UCO’s results.
Purpose of Activity/Assignment:
Objective:
Under the guidance of the Chief of Planning, Monitoring, and Reporting for UNICEF Ukraine, the consultant will design and implement a robust Monitoring and Reporting System. This includes developing a user-friendly data collection system, supporting the creation of data warehouse with efficient ETL processes, and ensuring data quality and transformation for validation.
The consultant will establish user roles and an approval chain, configure real-time data access for analytical tools, and integrate existing products (eTools, TPM, AAP, etc) into a comprehensive insights-generative system. Additionally, the consultant will provide training, documentation, and support, facilitating a data-driven approach to reporting and decision-making for UNICEF Ukraine.
Main Duties and Responsibilities:
1. The consultant will support the technical implementation of the Data Monitoring and Reporting System for Ukraine Country Office. The initial phase of this task requires engagement of the consultant to understand existing dataflow for 5W reporting system.
- Participate in consultations regarding UNICEF data architecture.
- Review existing tools and internal capacities.
- Suggest the data model of data consolidation.
2. Support the development of the monitoring system using programming languages such as Python, CSS, Java Script, and HTML.
- Analyze the current 5W mechanism based on XLSM format (Excel) and VBA macros for data validation. The consultant is required to recommend the most suitable format (such as CSV, JSON, etc.) or optimize the use of the existing format.
- Coordinate with PMR to manage actions and revisions across various parts of the system, ensuring consistency and coherence throughout.
- Integration and automation of the existing data collection tool, data flow and data validation, improving the quality assurance process.
- Design and implement ETL processes that integrate data from various sources, ensuring seamless data flow and accessibility.
- Document and specify the transformation rules necessary to convert raw data into actionable insights, ensuring data is properly formatted.
3. Designing/Implementing Data Warehouse using Azure infrastructure
- Support the development of architecture that supports data integration, storage, and data retrieval.
- Implement data quality standards and governance practices to ensure the accuracy, consistency, and reliability of the data stored in the warehouse.
- Establish and maintain user access controls and security measures to protect sensitive data and ensure compliance with relevant regulations.
4. Data validation design
- After submitting data in the system, the product should highlight key technical issues to users.
- Comprehensive logic for highlighting inappropriate inputs.
5. Create User Roles and Chain of approval for data management.
- Data quality validation workflow for different users.
6. Real-Time data analytics and visualization in PowerBI
- Design and develop visualizations that effectively communicate insights and trends to users.
7. Conducting a pretest of the monitoring system reporting
- Support the implementation of a pilot to test the system.
- Collect feedback from engaged stakeholders.
8. Create SOPs. The consultant is expected to develop comprehensive guidelines for each component of the product.
Work assignment overview:
Deliverable |
Deadline |
# of w/days |
Analyze the current 5W mechanism and optimize the use of the existing format. |
15-Dic-24 |
15 |
Implement data warehouse using MS Azure services and create scripts for advanced data quality validations |
10-Jan-25 |
20 |
Create the data model and first integration of the existing data collection tools through ETL. |
31-Jan-25 |
15 |
Establish final ETL process that integrate data from various sources, such as data from eTools, AAP, etc and pilot the system. |
15-Feb-25 |
10 |
Create the real-time data validation process and design the user roles mechanism for approval and data management. |
15-march-25 |
20 |
Implement the real-time data visualization using Power BI. |
10-April-25 |
15 |
Complete trainings for the new monitoring system |
15-May-25 |
10 |
Prepare a back-up mechanism to store and update a copy of the product. |
30-may-25 |
5 |
Support Migration from SharePoint/ OneDrive based XLSM-from to proposed version. |
15-Jun-25 |
15 |
Develop SOPs for system maintenance and guidelines for each aspect of system. |
15-July-25 |
20 |
Sub-total: |
145 |
Please provide an all-inclusive financial proposal including travels to carry out the deliverables listed above.
To qualify as an advocate for every child you will have…
Education: An advanced, post-graduate University degree (Master's degree or higher) in one of the following fields is required: data science, data engineering, data architecture other related computer science and engineering field.
Professional experience:
- At least 8 years of work experience in data science, data engineering or a related field. Demonstrated expertise in designing and implementing end-to-end data pipelines and architectures.
- Extensive experience with ETL processes, data integration, and database management, including proficiency in SQL and NoSQL technologies.
- Proven track record of working with cloud platforms (MS Azure). Microsoft's Azure Data Engineer Associate certification is an asset.
- Strong understanding of data governorate and quality assurance practices to ensure data integrity and compliance.
- Extensive experience in data wrangling, statistical analysis, and data visualization using tools such as Python and PowerBI.
- Experience in UI/UX design, focusing on developing user-centred designs for complex applications and systems for data entering systems, using CSS, Java Script, HTML.
Languages:
- English: Proficient/Native [C2].
- Ukrainian: is an advantage.
Skills and competencies:
- Strong analytical, organizational skills and conceptual thinking. Ability to work under pressure, manage multiple tasks and commitment to work to tight timeframe and meet deadlines.
- Must be familiar / experienced with the following computer skills: Python, CSS, Java Script, HTML, Azure (Databricks, Data Factory, etc.), ETL, Power BI, PyCharm.
- Excellent communication and presentation skills.
For every Child, you demonstrate…
UNICEF's values of Care, Respect, Integrity, Trust, Accountability, and Sustainability (CRITAS).
To view our competency framework, please visit here.
UNICEF is here to serve the world’s most disadvantaged children and our global workforce must reflect the diversity of those children. The UNICEF family is committed to include everyone, irrespective of their race/ethnicity, age, disability, gender identity, sexual orientation, religion, nationality, socio-economic background, or any other personal characteristic.
UNICEF offers reasonable accommodation for consultants/individual contractors with disabilities. This may include, for example, accessible software, travel assistance for missions or personal attendants. We encourage you to disclose your disability during your application in case you need reasonable accommodation during the selection process and afterwards in your assignment.
UNICEF has a zero-tolerance policy on conduct that is incompatible with the aims and objectives of the United Nations and UNICEF, including sexual exploitation and abuse, sexual harassment, abuse of authority and discrimination. UNICEF also adheres to strict child safeguarding principles. All selected candidates will be expected to adhere to these standards and principles and will therefore undergo rigorous reference and background checks. Background checks will include the verification of academic credential(s) and employment history. Selected candidates may be required to provide additional information to conduct a background check.
Remarks:
Only shortlisted candidates will be contacted and advance to the next stage of the selection process.
Individuals engaged under a consultancy or individual contract will not be considered “staff members” under the Staff Regulations and Rules of the United Nations and UNICEF’s policies and procedures, and will not be entitled to benefits provided therein (such as leave entitlements and medical insurance coverage). Their conditions of service will be governed by their contract and the General Conditions of Contracts for the Services of Consultants and Individual Contractors. Consultants and individual contractors are responsible for determining their tax liabilities and for the payment of any taxes and/or duties, in accordance with local or other applicable laws.
The selected candidate is solely responsible to ensure that the visa (applicable) and health insurance required to perform the duties of the contract are valid for the entire period of the contract. Selected candidates are subject to confirmation of fully-vaccinated status against SARS-CoV-2 (Covid-19) with a World Health Organization (WHO)-endorsed vaccine, which must be met prior to taking up the assignment. It does not apply to consultants who will work remotely and are not expected to work on or visit UNICEF premises, programme delivery locations or directly interact with communities UNICEF works with, nor to travel to perform functions for UNICEF for the duration of their consultancy contracts.
Applications from non-qualifying applicants will most likely be discarded by the recruiting manager.