Data Engineer

Data Engineer

Description

Do you want to build a career that is truly worthwhile? The World Bank Group is a unique global partnership of five institutions driven by a bold vision to create a world free of poverty on a livable planet. As one of the largest sources of funding and knowledge for developing countries, we help solve the world’s greatest development challenges. When you join the World Bank Group, you become part of a dynamic, diverse organization with 189 member countries and more than 120 offices worldwide. We work with public and private sector partners, invest in groundbreaking projects, and use data, research, and technology to bring tangible and transformative changes around the globe. For more information, visit www.worldbank.org.

VPU Context: The Development Economics Vice Presidency (DEC) is the World Bank’s central reservoir of fresh insights into the most pressing challenges of development. It is led by the Chief Economist and Senior Vice President of the World Bank Group, who advises the President and senior managers, serves as the community leader for the WBG’s economists, and helps to keep the institution in the forefront of thinking about development policy. DEC constitutes one of the world’s largest teams of economists focused on policy solutions for developing economies.

Unit Context: The mission of the Office of the World Bank Chief Statistician and Director of the Development Data Group (DECDG) is to put data to work for development. DECDG provides technical expertise and support both internally and to countries with a range of data and statistics priorities, including development indicators, methods, standards, and tools for data work; support for data governance; and promotion of better use and management of development data.  DECDG prizes innovation and partnership, validating and incorporating new technologies, working closely with partners, and serving as an interface to the global development data community.

Expanding and modernizing development data production, management and governance in support of the World Bank Knowledge Compact, ensuring World Bank is a “data bank” is critical to our mission. To address this, the Data Management & Services team is leading Data360, the Bank’s central development data production and dissemination framework to improve accessibility, management and dissemination of the WBG’s own data assets; and production of high quality statistical indicators and data products to help improve development outcomes.

To advance this work, DECDG seeks an experienced Data Engineer and Architect to lead the design and implementation of the Data360 data production and dissemination system.

Duties and accountabilities:  
Duties will include, but not be limited to, the following: 
•Develop and implement robust technical and business processes for ingestion, production, management, and dissemination of statistical and geospatial data, ensuring alignment with the WBG Development Data Quality Policy.
•Architect and implement the Data360 framework for “self-service” production and publishing of development indicators across the organization at scale, including integration with existing platforms such as .Stat Suite, World Bank Data Catalog and Metadata Editor.
•Design and implement reusable functions, packages and libraries to support robust, automated data pipelines that extract, transform, validate and load information in multiple information systems using Python or R.
•Develop CI/CD processes and policies for managing code repositories, issue tracking and pipeline orchestration for DECDG-managed data processes. 
•Assess, recommend, and implement capabilities related to metadata, data lineage, data management and data quality improvement efforts. 
•Provide guidance and mentoring to other team members on good data engineering practices in Python and R, metadata and data management techniques and methodologies. 
•Actively collaborate with business data stewards and task teams to implement various data projects and initiatives including leading data management efforts for key data platforms, such as the Global Food & Nutrition Security Dashboard, and their alignment with Data360 frameworks.
•Serve as a liaison between Business and Information Technology departments to ensure that data related business requirements for governing data are clearly defined, communicated, well understood and considered as part of solution planning and implementation.
•Stay updated with and transfer knowledge and practice around the latest data management methods and best practices in data governance. 

Selection Criteria

The selected candidate shall be able to show / demonstrate:
•Master’s degree in computer or data science, statistics, mathematics, or a related field.
•At least, five years of relevant professional experience in data engineering, with demonstrated experience architecting and leading development of large-scale end-to-end data solutions, including data extraction, production, and dissemination of statistical datasets and indicators and geospatial data.
•Hands-on experience building production-grade ETL pipelines using Databricks, Azure data lake, Unity Catalog and similar technologies.
•Extensive familiarity with the WBG Data360 framework, platform and solutions and proven experience working within the World Bank Group’s ITS ecosystem, with an understanding of development workflows, environment constraints, and challenges related to CI/CD.
•Solid experience working with data governance and data management concepts within a development data/statistical data context including demonstrated familiarity with SDMX and international metadata standards such as DDI, ISO19139/19115 and WBG time series metadata schemas.
•Strong knowledge and experience in Agile Project Management methodologies and practical experience developing production-grade products using CI/CD workflows including utilization of version control frameworks such as Git and GitHub for managing projects and CI/CD.
•Demonstrated expertise in Python and R, including development and publication of production-ready, reusable R and/or Python packages.
•Excellent communication skills including the ability to understand and convey stakeholder requirements to inform technical solutions; and expertise in documenting solutions for technical audiences.
•Advanced analytical, problem-solving, negotiation, and organizational skills with demonstrated ability to multi-task, organize, prioritize, and meet deadlines. 
•Collaborative team player who is quality- and detail-oriented, solution focused and able to work independently with some level of ambiguity while juggling multiple demands.

WBG Culture Attributes:

1. Sense of urgency: Anticipate and quickly respond to the needs of internal and external stakeholders.
2. Thoughtful risk-taking: Challenge the status quo and push boundaries to achieve greater impact.
3. Empowerment and accountability: Empower yourself and others to act and hold each other accountable for results.

World Bank Group Core Competencies

The World Bank Group offers comprehensive benefits, including a retirement plan; medical, life and disability insurance; and paid leave, including parental leave, as well as reasonable accommodations for individuals with disabilities.

We are proud to be an equal opportunity and inclusive employer with a dedicated and committed workforce, and do not discriminate based on gender, gender identity, religion, race, ethnicity, sexual orientation, or disability.

Learn more about working at the World Bank and IFC including our values and inspiring stories.