Data Engineer

Founded in 2002, Webb Fontaine is a global trade technology company headquartered in Dubai, with projects spanning the Middle East, Africa, Asia, South America and beyond. We partner with governments worldwide, providing cutting-edge solutions to boost their revenue by streamlining trade and logistics operations across the entire trade spectrum.

At Webb Fontaine, we're crafting a legacy of innovation with a mission to transform the landscape of trade through technology. This wouldn't be possible without our team of exceptional individuals who are at the core of our success.

As a Data Engineer at Webb Fontaine, you will play a key role in designing, developing, and maintaining scalable data infrastructure to support the company's data-driven products and services. You will work closely with data scientists, software engineers, and product teams to ensure the reliable flow, transformation, and accessibility of data across platforms.

Key Responsibilities

• Design, build, and maintain ETL/ELT pipelines using Apache Spark to process data from diverse sources, including databases, APIs, streaming platforms, file systems, and cloud storage. Ensure pipelines can handle both batch and real-time data processing while maintaining data quality and consistency.
• Prepare processed data for business intelligence tools and dashboard creation, working closely with the business stakeholders to understand reporting requirements.
• Create aggregated tables optimized for fast query performance.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and 'big data' technologies.
• Create big data tools for analytics and data scientist team members that assist them with advanced analytics projects, scalable ad-hoc analysis, and automated reporting.
• Create testable and high-quality software with minimal risks.
• Actively participate in the project's full cycle – architecture, design, and implementation.
• Effectively communicate with team members in diverse locations.
  

• Experience with big data technologies: Hadoop ecosystem, Spark, Hive, Kafka
• Proven experience of 3 years in data engineering and associated areas
• Experience with containerization technologies (Docker, Kubernetes)
• Experience with the integration of data from multiple data sources
• Experience with object-oriented/object function scripting languages – Java or Scala
• Proficient in designing efficient and robust ETL workflows
• Strong analytical skills with the ability to pay attention to detail and accuracy
• Knowledge of industry trends, best practices, and new technologies, and the ability to apply trends to architectural needs
• Fluency in English
  

• Orchestration services: Airflow
  
• SQL and NoSQL: PostgreSQL, Oracle, Hive, Trino
  
• Experience with cloud techs AWS, GCP, Azure
  
• Linux
  
• Python, Ansible
  
• Tableau and Metabase
  
• Table formats: Iceberg, Delta Lake, or Apache Hudi
  

• Equal opportunity advocacy: We promote equality, creating a diverse and inclusive environment.
• Competitive compensation: Enjoy a competitive salary that rewards your contributions.
• Health and Wellness: We provide comprehensive medical coverage.
• Global collaboration: Join a world-class team with a global presence and international clients.
• Investment in you: We invest in your growth and development, valuing our employees as top talent.
• Work-life balance: We ensure a healthy work-life balance for your well-being.
• Training support: We offer a comprehensive learning and development program.
• Personalised approach: We prioritise personal connections and caring for you beyond your professional role.

We offer benefits tailored to each location, considering the specific regulations and conditions of each country. These will be discussed with candidates during the selection process.