Junior Data Engineer
Contribute to building data pipelines and ensuring data quality
Overview
Contribute to building data pipelines and ensuring data quality
You have:
- A Bachelor's degree in computer engineering, computer science, statistics or related area is required.
- A minimum of 1 year of professional work experience in programming in one of the following scripting languages: Python or Scala is required.
- Knowledge of data pipeline and workflow management tools is required.
- Knowledge of relational databases is required.
- Knowledge of Selenium and web scraping libraries is desirable.
- Hands on experience with Linux is desirable.
- Experience with data pipeline and workflow management tools is desirable.
- Hands on experience with Microsoft Azure is desirable.
- Fluency in English is required.
- Fluency in Arabic is desirable.
Contract
This is a Consultancy contract. More about Consultancy contracts.
Result of Service
The IC is expected to provide appropriated work packages and deliverables that contribute to some of the most relevant ICTS flagship products namely Manara as well as other relevant project and operational needs that may arise.
Work Location
UN-House ESCWA / Hybrid
Expected duration
6 Months
Duties and Responsibilities
Background: In line with ESCWA’s ICTS department’s objectives to expand and enhance ESCWA’s technological capabilities and establish a Data Ecosystem as a prominent resource for the Arab Region, the department is actively engaged in various initiatives and projects encompassing data management, data pipelines, data visualization, pre-processing, Machine Learning and optimization. In this context, ICTS is seeking skilled technical professionals to support the implementation of these projects, while simultaneously strengthening ESCWA’s technological knowledge and capacity. This job vacancy is for a Data Engineer who will be responsible for contributing to building data pipelines to streamline the data acquisition of multiple datasets, ensuring high level of data quality and focusing on providing high availability of data. Duties and Responsibilities: Under the overall guidance of the Chief, ICTS, and direct supervision by the unit head of the Data Engineering team, the Junior Data Engineer will be responsible for the following duties: • Ingest data from different types of sources (APIs, pdf files, SQL…) • Create and maintain optimal data pipeline architecture • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. • Building the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, data scraping…. • Build complete pipelines from data ingestion until delivery • Implement data quality and data checking procedures into the pipelines • Perform other duties as required
Qualifications/special skills
A Bachelor's degree in computer engineering, computer science, statistics or related area is required. All candidates must submit a copy of the required educational degree. Incomplete applications will not be reviewed. A minimum of 1 year of professional work experience in programming in one of the following scripting languages: Python or scala is required. Knowledge of data pipeline and workflow management tools is required. Knowledge of relational databases is required. Knowledge of Selenium and web scraping libraries is desirable. Hands on experience with Linux is desirable. Experience with data pipeline and workflow management tools is desirable. Hands on experience with Microsoft Azure is desirable.
Languages
English and French are the working languages of the United Nations Secretariat; and Arabic is a working language of ESCWA. For this position, fluency in English is required, and fluency in Arabic is desirable. Note: “Fluency” equals a rating of ‘fluent’ in all four areas (speak, read, write, and understand) and “Knowledge of” equals a rating of ‘confident’ in two of the four areas.
Additional Information
Recruitment for this position is on a local basis. The incumbent is required to have the legal right to live and work in the specified working location.
No Fee
THE UNITED NATIONS DOES NOT CHARGE A FEE AT ANY STAGE OF THE RECRUITMENT PROCESS (APPLICATION, INTERVIEW MEETING, PROCESSING, OR TRAINING). THE UNITED NATIONS DOES NOT CONCERN ITSELF WITH INFORMATION ON APPLICANTS’ BANK ACCOUNTS.
Potential interview questions
| Describe a time when you had to ingest data from multiple sources. What challenges did you face? | The interviewer wants to understand your hands-on experience with data ingestion processes. | Discuss specific examples, the sources used, and how you overcame challenges. |
| How do you ensure data quality in your pipelines? | Data quality is critical; this question assesses your approach to maintaining high data standards. | Pro members can see the explanation. |
| Can you provide an example of an optimization you've made in a data pipeline? | Pro members can see the explanation. | Pro members can see the explanation. |
| What tools and languages do you prefer for data scraping, and why? | Pro members can see the explanation. | Pro members can see the explanation. |
| Explain a situation where you automated a manual process. What was the outcome? | Pro members can see the explanation. | Pro members can see the explanation. |