Data Engineer
Support the development and optimization of data systems.
Overview
Support the development and optimization of data systems.
You have:
- Designing and deploying large-scale data systems, with demonstrated consultancy or technical leadership roles is required.
- Proven experience with Python, SQL, cloud environments (Azure, AWS, or GCP), container orchestration (Kubernetes), and DevOps automation is required.
- Excellent analytical, problem-solving, and communication skills is required.
- Strong familiarity with semantic modeling, knowledge graphs, and AI/ML integration for data systems is desirable.
Contract
This is a UNV International Expert contract. This kind of contract is known as International UN Volunteer. It is normally internationally recruited only. More about UNV International Expert contracts.
This Assignment falls under a Special Programme Initiative where Expertise Differential is equivalent to 20% of the Monthly Living Allowance.
Benefits package:
• Monthly Volunteer Living Allowance (VLA) USD 2,861.04 • Monthly Expertise Differential USD 572.2 • Family Allowance: 250 USD (in case one dependent joins the duty station) • Annual and learning leaves; • Medical and life Insurance • Free access to different learning platforms. For more information on UN Volunteer benefits, entitlements and support, please visit: https://www.unv.org/volunteer-your-country-conditions-service
Under the supervision of the Chief of the Decision-Support and Data Science Division and in close collaboration with the data science and digital development teams, the Data Engineer (Consultant) will support the development and optimization of data systems and architectures to support strategic data initiatives. The objective of this consultancy is to provide technical expertise in the design, implementation, and optimization of data pipelines, cloud-based infrastructure, and knowledge graph frameworks that enable scalable and intelligent data products for high-level decision support.
Within the delegated authority and under the supervision of Chief of the Decision-Support and Data Science Division (DSDSD) or his/her designated mandated representative(s), the UNV Data Engineer will be responsible for independently performing the following:
Data Engineering Infrastructure • Implement robust and scalable ETL/ELT pipelines using Python, R, or Spark for processing structured and unstructured datasets across sectors. • Implement technical activities in support of the development of data lake architecture, integrating multiple sources into a unified data environment for analytics and AI workflows. • Develop guidelines for metadata-driven systems, ensuring lineage, traceability, and semantic enrichment.
API Development & System Integration • Implement RESTful APIs and backend services using Python, C#, or Node.js to ensure secure, performant data access and integration with external and internal platforms. • Implement the integration of cloud services (Azure) with internal data systems and external partner APIs for real-time data exchange.
DevOps and CI/CD Enablement • Automate CI/CD pipelines using GitHub Actions, Docker, and Kubernetes, ensuring efficient delivery, testing, and deployment processes. • Implement DevOps best practices to support continuous innovation, scalability, and system monitoring.
Semantic Data Modeling & Graph Technologies • Implement knowledge graphs and ontologies using Neo4j or equivalent tools, embedding NLP pipelines and SDG classifications to power semantic search and policy simulations. • Develop custom ontologies and metadata standards tailored to thematic data domains relevant to the organization’s mandate.
Data Infrastructure Optimization • Optimization of databases (e.g., SQL Server, Redis, Solr) and data pipelines for enterprise-scale analytics and reporting. • Implement performance tuning and data partitioning strategies for high-throughput environments.
AI/ML Data Enablement and Technical Administration Support • Set up and maintain environments for interactive analytics and modeling (e.g., Jupyter, Zeppelin), supporting AI/ML experimentation and visualization pipelines. • Provide training and documentation to enhance the capacity of internal teams to leverage data pipelines and APIs effectively.
Adaptability and flexibility Judgement and decision-making Planning and organising Professionalism Self-management
designing and deploying large-scale data systems, with demonstrated consultancy or technical leadership roles is required.
Proven experience with Python, SQL, cloud environments (Azure, AWS, or GCP), container orchestration (Kubernetes), and DevOps automation is required.
Excellent analytical, problem-solving, and communication skills is required.
Strong familiarity with semantic modeling, knowledge graphs, and AI/ML integration for data systems is desirable.
The UN Security System in Lebanon is divided into two UN area of operation. One is the southern area of the country which lies to the south of Litani River (SLR) under the responsibility of the peace keeping force (UNIFIL) according to the UN resolution 1701/2006. The rest of the country is called North Litani River (NLR). Rafik Hariri International airport is located in the southern suburbs of Beirut, less than 10km away from downtown.
A taxi from the airport to downtown Beirut can be anywhere between $20-$30 and make sure to agree on the price before stepping in the taxi. All public transportation vehicles in Lebanon have a red license plate. For transportation within Beirut, you have 3 options: “Service” car (taxi off the street with a lower cost than the private taxi), private taxi or minibus. However, only Taxis are securely advised to use as a mean of transportation. Lebanon has a Mediterranean climate - hot and dry in summer (June to August), cool and rainy in winter (December to February). In summer humidity is very high along the coast and daytime temperatures average 30°C, with night temperatures not much lower. Winter is mild, with daytime temperatures averaging 15°C. In the mountains, summer days are moderately hot (26°C on average) and the nights cool. Winters are cold, with snowfall above 1300m.
The minimum lease duration in Lebanon is generally one year, where tenants usually have to pay a minimum of 6 months’ rent in advance and in some cases even one year. In addition, an amount of one-month rent is usually required by the landlord as a security deposit in case of property damage. Additionally, tenants who sign a one -year contract has the right to hold onto the property for three consecutive years. Thereafter, the landlord is entitled to end the contract, or to renegotiate. For rental contracts with a diplomatic clause, individuals have the right to terminate the lease before the end of the agreement. In the event of early termination of the lease, the landlord shall reimburse the tenant the monetary value of the remaining months of the contract. Your rental amount will most probably not cover electricity, telephone, Internet, or cable television service. These are all additional charges, which you should consider when calculating your monthly budget. In addition to the rent, expect to pay common charges for the building, which cover the electricity of the common areas of the building, fees for the concierge and fuel for the generator. This is subject to negotiation with landlord. Doctors and hospitals often expect immediate cash payment for services. Staff can use credit card or cash, Lebanese Pounds and USD, to pay for the services. Also, Cigna is well recognized in hospitals, listed in the next section, in case of emergency. Most hospitals are well equipped, and doctors are generally well qualified. Also, most medical staff speak both French and English.
Upon arrival, you may purchase a SIM card from any of the two main cell phone providers in the country: Touch and Alfa. Although you might find it challenging to find fast Internet in Lebanon, there are many internet providers in Lebanon that offer DSL (Digital Subscriber Line) and wireless internet services. The standard DSL monthly subscription prices vary depending on the speed and the monthly consumption (in GB) you select.
list of banks in Lebanon: www.bdl.gov.lb/downloads/download/82/en
For meetings and official activities taking place in Lebanon, normal business attire is expected. During the rainy season, the pavements can become a bit slippery and so, if walking to and from the Office ensure you have shoes with a decent grip.It is considerably colder in the mountains and in the north, so remember to bring warm clothes in winter. Sturdy shoes may also be required if going to the field and to informal settlements as these can get very muddy.
Potential interview questions
| Describe your experience in implementing ETL pipelines using Python or R. | This assesses your practical experience in data processing and your ability to handle various data formats. | Provide specific examples of projects where you set up these pipelines. |
| How do you ensure the security of APIs you develop? | This evaluates your understanding of securing data access and integrity. | Pro members can see the explanation. |
| Can you explain a time when you optimized a data pipeline? What steps did you take? | Pro members can see the explanation. | Pro members can see the explanation. |
| What are some best practices you follow in DevOps? | Pro members can see the explanation. | Pro members can see the explanation. |
| Have you worked with knowledge graphs? Can you share your approach? | Pro members can see the explanation. | Pro members can see the explanation. |
| Describe your experience in cloud environments and which ones you prefer. | Pro members can see the explanation. | Pro members can see the explanation. |
| How do you approach problem-solving when data issues arise in your projects? | Pro members can see the explanation. | Pro members can see the explanation. |
| What tools have you used for container orchestration? | Pro members can see the explanation. | Pro members can see the explanation. |