Data QA Engineer

Overview

We are looking for an experienced Tester to join our team and contribute to the successful implementation of a Microsoft Fabric-based data lakehouse for a leading water utilities company in the Philippines. In this role, you will be responsible for ensuring that the data lakehouse solution is thoroughly tested for functionality, performance, security, and regulatory compliance.

You will work closely with data engineers, data architects, business analysts, and other stakeholders to validate data pipelines, integration points, and end-to-end data flows, ensuring the system meets all business requirements and industry standards. You will play a key role in ensuring the quality and reliability of the solution in a dynamic and complex data environment.

The Role.

Key Responsibilities:

• Develop and execute comprehensive test plans for the Microsoft Fabric-based data lakehouse solution, focusing on functional testing, integration testing, performance testing, and security testing.
• Work closely with data engineers and cloud architects to understand the data flow and the requirements for validating data accuracy, consistency, and quality throughout the lakehouse platform.
• Test and validate ETL/ELT data pipelines, ensuring that data from various sources such as SAP IS-U, SCADA, IoT sensors, and billing systems is accurately ingested, transformed, and stored in the lakehouse.
• Verify that the data processing and data storage processes are optimized for performance, scalability, and accuracy within the cloud infrastructure (primarily Microsoft Azure services like Azure Synapse Analytics, Azure Data Lake, and Power BI).
• Perform end-to-end system testing to validate that the integration of multiple systems (such as SAP IS-U, SCADA, and IoT data) works seamlessly in the lakehouse architecture.
• Conduct regression testing to ensure that changes, updates, or new features do not negatively impact existing data processes or business workflows.
• Document test cases, test results, and defects in a structured manner, ensuring clear communication of issues and progress to development and project management teams.
• Ensure that data quality and data integrity requirements are met, particularly for regulatory compliance in the water utilities sector (e.g., Philippine Data Privacy Act, MWSS).
• Perform security testing to validate that the data lakehouse platform adheres to security best practices and safeguards sensitive utility data.
• Collaborate with DevOps and cloud teams to ensure testing is automated where applicable and integrated into the CI/CD pipelines.
• Participate in user acceptance testing (UAT) to validate that the solution meets business requirements and provides the expected value to stakeholders.
• Continuously monitor testing results and report defects, risks, and issues to the project management team, ensuring they are addressed promptly

The Expertise.

Required Qualifications:

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
• 4+ years of experience in software testing, with a focus on data engineering solutions or cloud-based data platforms.
• Proven experience in testing data integration pipelines, ETL/ELT processes, and data workflows in cloud environments, particularly within Microsoft Azure.
• Experience in testing data lakehouse architectures, with a strong understanding of data quality, data integrity, and data governance concepts.
• Familiarity with Microsoft Fabric, Azure Data Lake, Azure Synapse Analytics, and Power BI.
• Solid understanding of test automation frameworks and tools, with experience in integrating tests into CI/CD pipelines.
• Experience in testing regulatory compliance (e.g., Data Privacy Act) and ensuring solutions meet industry standards for data security and privacy.
• Experience with manual testing, as well as performance testing (e.g., load, stress, and scalability testing) and security testing.
• Strong knowledge of SQL for validating data integrity and running queries to validate the accuracy of data within the lakehouse.
• Strong communication skills, with the ability to document test plans, test cases, and issues clearly and effectively.

Preferred Qualifications:

• Experience with data pipeline testing tools such as Apache Airflow, Azure Data Factory, or Databricks.
• Familiarity with cloud testing tools for Azure, such as Azure DevOps or Azure Test Plans.
• Knowledge of performance testing tools such as JMeter, LoadRunner, or Azure Load Testing.
• Experience in regulatory compliance testing in the utilities sector, particularly with respect to water utilities or critical infrastructure.
• Familiarity with Agile methodologies and experience working in Agile teams.
• ISTQB or similar software testing certifications are a plus.
• Excellent attention to detail, with the ability to spot data inconsistencies, defects, and performance bottlenecks.
• Strong analytical and problem-solving skills to quickly identify issues and work with development teams to resolve them.
• Ability to work collaboratively in a cross-functional team environment, including developers, business analysts, data engineers, and project managers.
• Strong communication skills, both written and verbal, with the ability to document findings clearly and explain complex issues to non-technical stakeholders.
• Ability to prioritize and manage multiple tasks effectively in a fast-paced, dynamic environment.
• Strong critical thinking and adaptability to handle complex testing challenges in cloud-based environments.

About us.

Thakral One is a consulting and technology services company headquartered in Singapore, with a pan-Asian presence. We focus primarily around technology-driven consulting, adoption of value-added bespoke solutions, enabling enhanced decision support through data analytics, and embracing possibilities in the cloud. We are heavily inclined towards building capabilities collaboratively with clients and believe strongly in improving grounded and practical outcomes. This approach is possible through our partnership with leading global technology providers and internal R&D teams. Our clients come from Financial Services, Banking, Telco, Government, Healthcare, and Consumer-oriented organisations.

Employment type: Contract