Data DevOps Engineer

We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions. With over 7,400 CI&Ters worldwide, we have built partnerships with more than 1,000 clients over 30 years. Artificial Intelligence is our reality.

We are seeking a Data DevOps Engineer with extensive hands-on experience in Data Architecture and Engineering to serve as a technical contributor within our team. This role primarily focuses on working with Australian clients and the broader APAC region. As a Senior Data Engineer, you will be responsible for designing, building, and deploying cutting-edge data solutions while helping to establish our data practice in Australia.

1. Design, implement, and maintain automated deployment pipelines for Microsoft Fabric, Azure Data Factory, and related Azure services, ensuring consistent and reliable delivery across environments.
2. Develop and manage Infrastructure as Code (IaC) using Terraform (or equivalent) to provision, configure, and manage Azure resources.
3. Collaborate with architects, developers, and data engineering teams to integrate DevOps practices into the data platform delivery process.
4. Optimize CI/CD workflows for data pipelines, semantic models, and infrastructure for faster, reliable releases.
5. Implement environment configuration management and governance to ensure compliance with standards, security, and performance requirements.
6. Monitor, troubleshoot, and improve deployment processes, proactively resolving issues impacting delivery or platform stability.
7. Maintain technical documentation for DevOps processes, IaC configurations, and deployment standards.
8. Support cross-team collaboration by providing guidance on branching strategies, release management, and deployment best practices.
9. Ensure operational readiness through post-deployment validation, performance checks, and testing.

• Proven experience in data platform DevOps, including automation of deployment pipelines for Azure-based data solutions.
• Strong proficiency in Azure DevOps for CI/CD pipeline management.
• Hands-on expertise with IaC tools such as Terraform for provisioning and managing Azure resources.
• Experience deploying and managing components in Microsoft Fabric, Azure Data Factory, and related services.
• Familiarity with data formats like Delta Tables, Apache Iceberg, and Parquet.
• Proficiency in Python and Shell scripting for automation and monitoring.
• Knowledge of data modeling principles and enterprise data platform practices.
• Experience with cloud data services within Microsoft ecosystem, with exposure to AWS or GCP an advantage.
• Understanding of data pipeline orchestration and best practices for ETL/ELT deployment.
• Solid grasp of data governance, security, and compliance for cloud data solutions.
• Knowledge of design patterns, clean architecture, and best coding practices for automation scripts.
• Experience with testing strategies within DevOps environments.

• Mentorship: Ability to mentor junior team members.
• Consulting Mindset: Adaptability and positive attitude in changing situations.
• Communication: Clear and effective communication skills.
• Understanding of non-functional requirements like performance and security.
• Passion for Data: Enthusiasm for coding, experimenting, and problem-solving.
• Innovative Spirit: Drive to improve and innovate pipelines and dashboards.
• AI Enthusiast: Interest in AI technologies such as Generative AI.

About us: We're global digital specialists, here to Collaborate, Innovate and Transform business into the future. We bring a 29-year track record of accelerating business impact through scalable digital solutions. With over 6,000 professionals worldwide in strategy, research, data science, design, and engineering, we aim to unlock growth, enhance customer experience, and improve operational efficiency.

We value diversity and inclusion, fostering a safe work environment and encouraging applications from diverse and underrepresented groups.