Data Engineer

4 days ago

Makati City, National Capital Region, Philippines Publicis Sapient Full time ₱1,800,000 - ₱2,500,000 per year

Job Description

A Data Engineer designs data products and data pipelines that are resilient to change, modular, flexible, scalable, reusable, and cost effective. Utilizes software engineering principles to deploy and maintain fully automated data transformation pipelines that combine a large variety of storage and computation technologies to handle a distribution of data types and volumes in support of data architecture design.

As a Data Engineer, you will:

  • Design, develop, and maintain data pipelines and ETL processes using Microsoft Azure services (e.g., Azure Data Factory, Azure Synapse, Azure Databricks, Azure Fabric).
  • Utilize Azure data storage accounts for organizing and maintaining data pipeline outputs. (e.g., Azure Data Lake Storage Gen 2 & Azure Blob storage).
  • Collaborate with data scientists, data analysts, data architects and other stakeholders to understand data requirements and deliver high-quality data solutions.
  • Optimize data pipelines in the Azure environment for performance, scalability, and reliability.
  • Ensure data quality and integrity through data validation techniques and frameworks.
  • Develop and maintain documentation for data processes, configurations, and best practices.
  • Monitor and troubleshoot data pipeline issues to ensure timely resolution.
  • Stay current with industry trends and emerging technologies to ensure our data solutions remain cutting-edge.
  • Manage the CI/CD process for deploying and maintaining data solutions.

Requirements:

  • Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent experience) and able to demonstrate high proficiency in programming fundamentals.
  • Proven experience (3+ years) as a Data Engineer or similar role dealing with data and ETL processes.
  • Strong knowledge of Microsoft Azure services, including Azure Data Factory, Azure Synapse, Azure Databricks, Azure Blob Storage and Azure Data Lake Gen 2.
  • Experience utilizing SQL DML to query modern RDBMS in an efficient manner (e.g., SQL Server, PostgreSQL).
  • Strong understanding of Software Engineering principles and how they apply to Data Engineering (e.g., CI/CD, version control, testing).
  • Experience with big data technologies (e.g., Spark).
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and collaboration skills.

Preferred Qualifications:

  • Learning agility
  • Technical Leadership
  • Consulting and managing business needs
  • Strong experience in Python is preferred but experience in other languages such as Scala, Java, C#, etc. is accepted.
  • Experience building spark applications utilizing PySpark.
  • Experience with file formats such as Parquet, Delta, Avro.
  • Experience efficiently querying API endpoints as a data source.
  • Understanding of the Azure environment and related services such as subscriptions, resource groups, etc.
  • Understanding of Git workflows in software development.
  • Using Azure DevOps pipeline and repositories to deploy and maintain solutions.
  • Understanding of Ansible and how to use it in Azure DevOps pipelines.

  • Data Engineer

    2 weeks ago

    Makati City, National Capital Region, Philippines Global Coordination Center Full time ₱1,200,000 - ₱2,400,000 per year

    Data EngineerLocation: One Ayala, Makati CityA Data Engineer at Global Coordination Center Limited focuses on building and maintaining data pipelines, ensuring data quality, and enabling data accessibility for analytics. They work with various technologies like SQL, Python, and cloud platforms to manage data ingestion, transformation, and storage. The role...

  • Data Engineer

    2 days ago

    Makati City, National Capital Region, Philippines PM Consulting Full time ₱900,000 - ₱1,200,000 per year

    We are looking for a highly skilled Data Engineer to design, build, and maintain robust data systems and pipelines that transform raw data into actionable insights. The ideal candidate has deep experience in data engineering, cloud technologies (Azure, Databricks), and advanced SQL and Python programming.You'll be working closely with cross-functional teams...

  • Data Engineer

    2 weeks ago

    Makati City, National Capital Region, Philippines NA+1 Full time ₱900,000 - ₱1,200,000 per year

    We are looking for a Data Engineer to join our Team.Qualifications:Minimum Experience:At least 2 years of hands-on experience as a Data EngineerMust-Have Skills:Strong background in Data Lake , Databricks , and Data FactoryProficiency in PowerBI and SQL scriptingExcellent communication skillsPreferred Skills:Experience in creating data pipelines ...

  • Data Engineer

    7 days ago

    Makati City, National Capital Region, Philippines Icon Executive Asia Full time ₱600,000 - ₱1,200,000 per year

    We are seeking a skilled and experienced Data Engineer to join our team and take responsibility for developing and governing our Data Platform. You will oversee the implementation and management of our solution on Azure Data Platform, with a strong focus on Azure services and technologies.The ideal candidate will have extensive knowledge of Azure Data...

  • Data Engineer

    6 days ago

    Makati City, National Capital Region, Philippines Strategic Staffing Solutions Full time ₱800,000 - ₱1,600,000 per year

    Position:Cyber Data EngineerLocation:Ayala, Makati CityWork Setup:Hybrid (2 Days Onsite / 3 Days Remote)Schedule:Day ShiftEmployment Type:Full-TimeRole OverviewWe are seeking aCyber Data Engineerwho will apply software engineering principles to design, deploy, and maintain fully automated data transformation pipelines. This role focuses on leveraging various...

  • Data Engineer

    2 weeks ago

    Makati City, National Capital Region, Philippines NA1 Full time ₱900,000 - ₱1,200,000 per year

    Role DescriptionThis is a full-time hybrid role for a Data Engineer located in Makati/BGC, . The Data Engineer will be responsible for designing, developing, and maintaining data pipelines, data architectures, and data systems. Day-to-day tasks include Extract Transform Load (ETL) processes, data modeling, data warehousing, and data analytics. The role also...

  • Data Engineer

    2 weeks ago

    Makati City, National Capital Region, Philippines NISPI Full time ₱1,440,000 - ₱1,800,000 per year

    A Data Engineer is a data professional who uses their expertise in data engineering and programming to build systems that collect, manage and convert raw data into usable information for business analysts.ResponsibilitiesAs a Data EngineerAnalyze and organize raw dataBuild data systems and pipelinesEvaluate business needs and objectivesInterpret trends and...

  • Data Engineer

    5 days ago

    Makati City, National Capital Region, Philippines OpenMed Inc. Full time ₱1,200,000 - ₱2,400,000 per year

    The Data Engineer at Carenet Health is responsible for building and maintaining the data solutions that power our business intelligence and analytics initiatives. This role focuses on designing reliable data pipelines, integrating data from multiple sources, and ensuring accuracy, security, and accessibility across our enterprise data platforms. By...

  • Data Engineer

    2 days ago

    Makati City, National Capital Region, Philippines Pointwest Squad Inc Full time ₱900,000 - ₱1,200,000 per year

    Work Location: Makati OfficeContract Duration: 6-12 months with possibility of extension/absorption depending on your performanceWork Set-up: Hybrid (2-3x onsite/week)Responsibilities● Design and develop data pipelines that will ingest the data from the respective sourcesystems into the data warehouse● Support and optimize existing data pipelines to...

  • Data Engineer

    7 hours ago

    Makati City, National Capital Region, Philippines Private Advertiser Full time ₱1,500,000 - ₱2,500,000 per year

    Bachelor's degree in Computer Science, Information Technology, Engineering, or a related fieldAt least 5 years of experience in data engineering, ETL/ELT development, or database managementProficient in designing and maintaining data pipelines using SQL, Python, or similar technologies, with strong knowledge of data modeling and warehousing...