Data Engineer
2 weeks ago
Job Description
A Data Engineer designs data products and data pipelines that are resilient to change, modular, flexible, scalable, reusable, and cost effective. Utilizes software engineering principles to deploy and maintain fully automated data transformation pipelines that combine a large variety of storage and computation technologies to handle a distribution of data types and volumes in support of data architecture design.
As a Data Engineer, you will:
- Design, develop, and maintain data pipelines and ETL processes using Microsoft Azure services (e.g., Azure Data Factory, Azure Synapse, Azure Databricks, Azure Fabric).
- Utilize Azure data storage accounts for organizing and maintaining data pipeline outputs. (e.g., Azure Data Lake Storage Gen 2 & Azure Blob storage).
- Collaborate with data scientists, data analysts, data architects and other stakeholders to understand data requirements and deliver high-quality data solutions.
- Optimize data pipelines in the Azure environment for performance, scalability, and reliability.
- Ensure data quality and integrity through data validation techniques and frameworks.
- Develop and maintain documentation for data processes, configurations, and best practices.
- Monitor and troubleshoot data pipeline issues to ensure timely resolution.
- Stay current with industry trends and emerging technologies to ensure our data solutions remain cutting-edge.
- Manage the CI/CD process for deploying and maintaining data solutions.
Requirements:
- Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent experience) and able to demonstrate high proficiency in programming fundamentals.
- Proven experience (3+ years) as a Data Engineer or similar role dealing with data and ETL processes.
- Strong knowledge of Microsoft Azure services, including Azure Data Factory, Azure Synapse, Azure Databricks, Azure Blob Storage and Azure Data Lake Gen 2.
- Experience utilizing SQL DML to query modern RDBMS in an efficient manner (e.g., SQL Server, PostgreSQL).
- Strong understanding of Software Engineering principles and how they apply to Data Engineering (e.g., CI/CD, version control, testing).
- Experience with big data technologies (e.g., Spark).
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration skills.
Preferred Qualifications:
- Learning agility
- Technical Leadership
- Consulting and managing business needs
- Strong experience in Python is preferred but experience in other languages such as Scala, Java, C#, etc. is accepted.
- Experience building spark applications utilizing PySpark.
- Experience with file formats such as Parquet, Delta, Avro.
- Experience efficiently querying API endpoints as a data source.
- Understanding of the Azure environment and related services such as subscriptions, resource groups, etc.
- Understanding of Git workflows in software development.
- Using Azure DevOps pipeline and repositories to deploy and maintain solutions.
- Understanding of Ansible and how to use it in Azure DevOps pipelines.
-
Data Engineer
1 week ago
Makati City, National Capital Region, Philippines PM Consulting Full time ₱900,000 - ₱1,200,000 per yearWe are looking for a highly skilled Data Engineer to design, build, and maintain robust data systems and pipelines that transform raw data into actionable insights. The ideal candidate has deep experience in data engineering, cloud technologies (Azure, Databricks), and advanced SQL and Python programming.You'll be working closely with cross-functional teams...
-
Data Engineer
2 weeks ago
Makati City, National Capital Region, Philippines Strategic Staffing Solutions Full time ₱800,000 - ₱1,600,000 per yearPosition:Cyber Data EngineerLocation:Ayala, Makati CityWork Setup:Hybrid (2 Days Onsite / 3 Days Remote)Schedule:Day ShiftEmployment Type:Full-TimeRole OverviewWe are seeking aCyber Data Engineerwho will apply software engineering principles to design, deploy, and maintain fully automated data transformation pipelines. This role focuses on leveraging various...
-
Data Engineer
1 week ago
Makati City, National Capital Region, Philippines Private Advertiser Full time ₱1,500,000 - ₱2,500,000 per yearBachelor's degree in Computer Science, Information Technology, Engineering, or a related fieldAt least 5 years of experience in data engineering, ETL/ELT development, or database managementProficient in designing and maintaining data pipelines using SQL, Python, or similar technologies, with strong knowledge of data modeling and warehousing...
-
Data Engineer
2 weeks ago
Makati City, National Capital Region, Philippines OpenMed Inc. Full time ₱1,200,000 - ₱2,400,000 per yearThe Data Engineer at Carenet Health is responsible for building and maintaining the data solutions that power our business intelligence and analytics initiatives. This role focuses on designing reliable data pipelines, integrating data from multiple sources, and ensuring accuracy, security, and accessibility across our enterprise data platforms. By...
-
Data Engineer
2 weeks ago
Makati City, National Capital Region, Philippines Booth & Partners Full time ₱1,200,000 - ₱2,400,000 per yearJob DescriptionAs a Data Engineer joining Advanced Analytics practice, you'll help clients scale their data solutions and make data-driven decisions while driving enterprise-level innovation. You'll work closely with the client to understand both their business processes and analytics needs to design and build data pipelines and cloud data solutions. You'll...
-
Data Engineer
2 weeks ago
Makati City, National Capital Region, Philippines Booth and Partners Pte Ltd Full time ₱1,500,000 - ₱2,500,000 per yearAs a Data Engineer joining Advanced Analytics practice, you'll help clients scale their data solutions and make data-driven decisions while driving enterprise-level innovation. You'll work closely with the client to understand both their business processes and analytics needs to design and build data pipelines and cloud data solutions. You'll have the...
-
data engineer
2 weeks ago
Makati City, National Capital Region, Philippines a9fdccbd-f5cd-4795-a9ca-e2a76df32b01 Full time ₱600,000 - ₱1,200,000 per year5-7 years of experience in data engineering field or ETL.Extensive knowledge of database query languages (i.e. SQL), database design, optimizing queries, internals knowledge of query planning.With expereience in data analysis techniques and tools (e.g., advanced SQL, Python with Pandas, Excel for large datasets.Familiarity with cloud-based data platforms and...
-
Data Engineering Architect
2 weeks ago
Makati City, National Capital Region, Philippines Kayana Solutions Inc. Full timeWho We Are:At Kayana, we're shaping the future of technology by unlocking opportunities and driving progress at an accelerated pace. We push boundaries, expand horizons, and build on our legacy—supported by some of the country's most esteemed conglomerates and powered by the synergies of the MVP Group.Our mission is clear: to create abundant opportunities...
-
Data Engineer
2 weeks ago
Makati City, National Capital Region, Philippines Epic Healthcare Staffing Shared Services, Inc. Full time ₱900,000 - ₱1,200,000 per yearJOB SUMMARYEpic Staffing Group is seeking a Data Engineer to design, build, and optimize modern data architecture on Microsoft Fabric. This role will leverage expertise in SQL, Python, API integrations, and cloud-based data infrastructure to deliver scalable, automated, and reliable solutions that enhance reporting, improve data accessibility, and support...
-
Azure Data Engineer
2 weeks ago
Makati City, National Capital Region, Philippines Innovatz Global Full time ₱600,000 - ₱1,200,000 per yearCompany DescriptionInnovatz Global is a leading Management Consulting and Technology Services company headquartered in Malaysia, with a strong presence across the U.S., China, India, Australia, Korea, Hong Kong, Singapore, Thailand, Philippines, Indonesia, and Vietnam. With a skilled workforce of over 500 experts, including SMEs, Project Managers, and...