Data Engineering Leader

We are innovative tech specialists, uniting human expertise with AI to create scalable digital solutions. With over 7,400 professionals worldwide, we've built partnerships with more than 1,000 clients during our 30 years of history.

We are seeking a Data Engineering Leader with extensive hands-on experience in Data Architecture and Engineering to serve as a technical contributor within our team. This role primarily focuses on working with Australian clients and the broader APAC region.

1. Design, build, and maintain scalable data pipelines using Microsoft Fabric, Azure Data Factory, and related Azure services to support ingestion, transformation, and curation of data.
2. Collaborate with architects, analysts, data modellers, and business stakeholders to deliver robust data solutions.
3. Participate in solution design and technical discussions to ensure scalable and secure data workflows.
4. Implement performance-optimized and secure data workflows, ensuring compliance with governance and quality standards.
5. Create and maintain clear, accurate, and up-to-date technical documentation for data assets, pipelines, and processes.
6. Engage effectively with technical and non-technical team members to ensure shared understanding of requirements and delivery expectations.
7. Translate business and analytical requirements into technical solutions leveraging Microsoft Fabric components and Azure services.
8. Ensure a stable development environment, following CI/CD best practices, monitoring pipeline performance, and addressing issues promptly.

1. Proven experience of more than 6 years in data engineering, data warehousing, and analytics projects, covering data ingestion, transformation, curation, and delivery.
2. Strong knowledge of modern data file formats such as Delta Tables, Apache Iceberg, and Parquet.
3. Proficiency in Python, Spark, Azure Data Factory, and other relevant data transformation tools and frameworks.
4. Expertise in data modelling across conceptual, logical, and physical layers, with knowledge of Dimensional Modelling and Data Vault 2.0 methodologies.
5. Experience with cloud data services, preferably within the Microsoft ecosystem, with exposure to AWS or GCP as an advantage.
6. Hands-on experience with Microsoft Fabric, Databricks, and/or Snowflake.
7. Skilled in data pipeline orchestration using Azure Data Factory and related frameworks.
8. Experience with CI/CD pipelines and DevOps practices for automated deployment and integration workflows.
9. Proficiency in Infrastructure as Code (IaC) tools such as Terraform or Bicep.
10. Solid understanding of data governance, data management practices, and security considerations for cloud data platforms.
11. Competence in database performance tuning, optimization, and advanced SQL development.
12. Knowledge of design patterns, clean architecture, and clean coding principles for scalable data solutions.
13. Familiarity with testing methodologies in data engineering, including unit, integration, and end-to-end testing.

We're a global digital specialist with a strong track record of delivering digital solutions. We focus on strategy, research, data science, design, and engineering to accelerate business impact. We value diversity and foster an inclusive work environment.

This is a full-time opportunity with a competitive salary and benefits package. We offer opportunities for professional growth and development. If you're passionate about data and technology, apply now.