Data Engineer

The Data Engineer is responsible for developing, maintaining, and optimizing data pipelines and data quality processes to ensure accuracy, integrity, and reliability of enterprise data. The role involves performing in-depth data analysis, collaborating with database developers and stakeholders to improve data collection and storage, and producing data analysis reports that support informed business decision-making.

Job Accountabilities1. Data Quality Management

• Develop and maintain data quality reports on large-scale datasets based on defined rules and thresholds set by Data Owners or Data Stewards
• Execute data queries to identify data inconsistencies, coding issues, and exceptions
• Provide actionable recommendations for data cleansing and remediation
• Evaluate system performance and data architecture, assessing their impact on data quality
• Present data analysis findings to management to support business decisions and prioritize system improvements
• Document data processes and maintain accurate data records
• Ensure adherence to best practices in data analysis, validation, and collection

• Stay updated on industry trends and advancements in data engineering and data quality management

• Data Management and Governance

• Provide regular updates, metrics, and reports related to Enterprise Data Management and Data and AI Governance initiatives

• Collaborate with cross-functional teams to support data governance standards and frameworks

• Compliance and Risk Management

• Ensure all company policies, procedures, and standards related to data management and compliance are followed

• Maintain awareness of compliance responsibilities related to data handling and reporting

• Proactively identify, escalate, and report compliance-related issues to appropriate stakeholders

• Other Responsibilities

• Perform other related tasks and responsibilities as assigned

Job Specifications

Education

• Bachelor's degree in Statistics, Mathematics, Computer Science, Information Technology, Information Management, or a related field

Technical Knowledge and Experience

• Hands-on experience with big data technologies such as Hadoop, Spark, Kafka, or similar
• Strong experience with relational and NoSQL databases, including PostgreSQL and Cassandra
• Experience with data pipeline and workflow orchestration tools such as Airflow, Azkaban, or Luigi
• Practical experience with AWS cloud services including EC2, EMR, RDS, and Redshift
• Experience with stream-processing frameworks such as Spark Streaming or Storm
• Proficiency in object-oriented or functional programming languages such as Python, Java, Scala, or C++

Skills Critical to Job Success

• Strong foundation in statistical methods and data analysis techniques
• Experience using statistical and data analysis tools such as MS Excel, SAS, or SPSS
• Exceptional analytical and problem-solving skills
• Strong understanding of data engineering and data quality best practices
• Excellent communication and stakeholder management skills

Years of Relevant Work Experience

• At least 5 years of experience in data analysis or data engineering
• Minimum of 1 year of hands-on experience in a data quality–focused role
• Experience working with multicultural, enterprise-level, or regional teams is an advantage

Job Types: Full-time, Fixed term

Contract length: 18 months

Pay: Up to Php95,000.00 per month

Application Question(s):

• Are you amenable to work 100% onsite around BGC, Taguig City?
• How much is your asking salary?

Education:

• Bachelor's (Required)

Experience:

• big data tools: 3 years (Required)
• relational SQL and NoSQL databases: 3 years (Required)
• data pipeline and workflow management tools: 3 years (Required)
• AWS cloud services: 3 years (Required)
• data analysis: 5 years (Required)