Data Architect Specialist

We are a team of data transformation specialists, leveraging human expertise with AI to create scalable tech solutions. With a global presence, we've built partnerships with numerous clients during our years of history.

We're seeking a Senior Data Engineer with extensive hands-on experience in Data Architecture and Engineering to serve as a technical contributor within our team. This role focuses on working with clients in the APAC region. As a Senior Data Engineer, you will design, build, and deploy cutting-edge data solutions while contributing to establishing our data practice in Australia.

1. Design, build, and maintain scalable data pipelines using Microsoft Fabric and related Azure services to support ingestion, transformation, and curation of data.
2. Collaborate with architects, analysts, data modellers, and stakeholders to deliver robust data solutions.
3. Participate in solution design and technical discussions to ensure scalable and secure data workflows.
4. Implement performance-optimized and secure data workflows, ensuring compliance with governance and quality standards.
5. Create and maintain clear, accurate, and up-to-date technical documentation for data assets, pipelines, and processes.
6. Engage effectively with technical and non-technical team members to ensure shared understanding of requirements and delivery expectations.
7. Translate business and analytical requirements into technical solutions leveraging Microsoft Fabric components and Azure services.
8. Ensure a stable development environment, following CI/CD best practices, monitoring pipeline performance, and addressing issues promptly.

1. Proven experience of more than 6 years in data engineering, data warehousing, and analytics projects, covering data ingestion, transformation, curation, and delivery.
2. Strong knowledge of modern data file formats such as Delta Tables and Parquet.
3. Proficiency in Python, Spark, and other relevant data transformation tools and frameworks.
4. Expertise in data modelling across conceptual, logical, and physical layers, with knowledge of Dimensional Modelling methodologies.
5. Experience with cloud data services, preferably within the Microsoft ecosystem.
6. Hands-on experience with Microsoft Fabric, Databricks, and/or Snowflake.
7. Skilled in data pipeline orchestration using Azure Data Factory and related frameworks.
8. Experience with CI/CD pipelines and DevOps practices for automated deployment and integration workflows.
9. Proficiency in Infrastructure as Code (IaC) tools such as Terraform or Bicep.
10. Solid understanding of data governance, data management practices, and security considerations for cloud data platforms.
11. Competence in database performance tuning, optimization, and advanced SQL development.
12. Knowledge of design patterns, clean architecture, and clean coding principles for scalable data solutions.
13. Familiarity with testing methodologies in data engineering, including unit, integration, and end-to-end testing.

1. Mentorship: Ability to mentor and share knowledge with junior team members.
2. Consulting Mindset: Adaptability in diverse situations and managing changing priorities.
3. Communication: Strong skills in communicating clearly with team members and clients.
4. Understanding of non-functional requirements, including performance, security, and data privacy.
5. Passion for Data: Enthusiasm for working with data, coding, and problem-solving.
6. Innovative Spirit: Drive to continuously improve and innovate pipelines and dashboards.
7. AI Enthusiast: Interest in AI technologies for self-augmentation and performance improvement.

This is an excellent opportunity to work with cutting-edge data solutions, collaborate with experienced professionals, and contribute to the growth of our data practice in Australia.