Senior Data Engineer

We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions. With over 7,400 CI&Ters worldwide, we’ve built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality. We are seeking a Senior Data Engineer with extensive hands-on experience in Data Architecture and Engineering to serve as a technical contributor within our team. This role primarily focuses on working with Australian clients and the broader APAC region. As a Senior Data Engineer, you will be responsible for designing, building, and deploying cutting-edge data solutions while contributing to establishing our data practice in Australia. Key Accountabilities Design, build, and maintain scalable data pipelines using Microsoft Fabric, Azure Data Factory, and related Azure services to support ingestion, transformation, and curation of data. Collaborate with architects, analysts, data modellers, and business stakeholders to deliver robust data solutions. Participate in solution design and technical discussions to ensure scalable and secure data workflows. Implement performance-optimized and secure data workflows, ensuring compliance with governance and quality standards. Create and maintain clear, accurate, and up-to-date technical documentation for data assets, pipelines, and processes. Engage effectively with technical and non-technical team members to ensure shared understanding of requirements and delivery expectations. Translate business and analytical requirements into technical solutions leveraging Microsoft Fabric components and Azure services. Ensure a stable development environment, following CI/CD best practices, monitoring pipeline performance, and addressing issues promptly. Knowledge and Experience Proven experience of more than 6 years in data engineering, data warehousing, and analytics projects, covering data ingestion, transformation, curation, and delivery. Strong knowledge of modern data file formats such as Delta Tables, Apache Iceberg, and Parquet. Proficiency in Python, Spark, Azure Data Factory, and other relevant data transformation tools and frameworks. Expertise in data modelling across conceptual, logical, and physical layers, with knowledge of Dimensional Modelling and Data Vault 2.0 methodologies. Experience with cloud data services, preferably within the Microsoft ecosystem, with exposure to AWS or GCP as an advantage. Hands-on experience with Microsoft Fabric, Databricks, and/or Snowflake. Skilled in data pipeline orchestration using Azure Data Factory and related frameworks. Experience with CI/CD pipelines and DevOps practices for automated deployment and integration workflows. Proficiency in Infrastructure as Code (IaC) tools such as Terraform or Bicep. Solid understanding of data governance, data management practices, and security considerations for cloud data platforms. Competence in database performance tuning, optimization, and advanced SQL development. Knowledge of design patterns, clean architecture, and clean coding principles for scalable data solutions. Familiarity with testing methodologies in data engineering, including unit, integration, and end-to-end testing. Personal Attributes Mentorship: Ability to mentor and share knowledge with junior team members. Consulting Mindset: Adaptability in diverse situations and managing changing priorities. Communication: Strong skills in communicating clearly with team members and clients. Understanding of non-functional requirements, including performance, security, and data privacy. Passion for Data: Enthusiasm for working with data, coding, and problem-solving. Innovative Spirit: Drive to continuously improve and innovate pipelines and dashboards. AI Enthusiast: Interest in AI technologies such as Generative AI for self-augmentation and performance improvement. About us We’re global digital specialists with a 29-year track record of delivering scalable digital solutions. With over 6,000 professionals worldwide, we focus on strategy, research, data science, design, and engineering to accelerate business impact. We value diversity and foster an inclusive, safe work environment, encouraging applications from underrepresented groups. #J-18808-Ljbffr