Data Engineer

10 hours ago

Taguig, National Capital Region, Philippines YONDU INC. Full time $90,000 - $120,000 per year

A Data Engineer specializing in Azure Databricks is responsible for designing, developing, implementing, and maintaining scalable and robust data solutions within the Microsoft Azure ecosystem, with a strong focus on Databricks.

Key Responsibilities:

  • Data Pipeline Development:

Design, build, and maintain scalable data pipelines and ETL/ELT processes using Azure Databricks, Azure Data Factory, Azure Synapse Analytics, and other Azure data services.
- Big Data Processing:

Develop and optimize data transformation workflows using PySpark, Scala, and SQL on Databricks, handling large volumes of structured and unstructured data.
- Data Lakehouse Implementation:

Implement and manage Delta Lake and Databricks Delta tables for building efficient data lakehouse architectures.
- Collaboration:

Work closely with data scientists, analysts, and other engineers to understand data requirements and deliver solutions that support data-driven decision-making.
- Performance Optimization:

Optimize Databricks clusters and data processing workflows for performance, cost efficiency, and resource utilization.
- Data Quality and Governance:

Ensure data quality, integrity, and compliance with data privacy regulations throughout the data engineering process, including implementing data security and governance best practices (e.g., Unity Catalog, Azure Purview).
- Monitoring and Maintenance:

Monitor data pipeline performance, troubleshoot issues, and perform necessary maintenance and updates.
- Documentation:

Document data pipeline processes, technical specifications, and architectural designs.

Required Skills and Qualifications:

  • Technical Expertise:

  • Proficiency in Azure Databricks and Apache Spark.

  • Strong programming skills in Python (PySpark), Scala, and SQL.
  • Experience with Azure data services such as Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage.
  • Understanding of data warehousing, data lakes, and data lakehouse concepts.
  • Experience with big data technologies and ETL/ELT processes.
  • Cloud Platform Knowledge:

In-depth knowledge of Microsoft Azure cloud platform.
- Problem-Solving:

Excellent analytical and problem-solving skills for debugging and optimizing data solutions.
- Communication and Collaboration:

Strong communication and teamwork skills to collaborate effectively with cross-functional teams.
- Relevant Certifications (Optional but beneficial):

Microsoft Azure Data Engineer Associate (DP-203), Databricks Certified Associate Developer for Apache Spark, Databricks Certified Professional Data Engineer.

  • PH - Engineering Consultant (Data Engineering)

    4 weeks ago

    Taguig, National Capital Region, Philippines Thinking Machines Data Science Full time

    Working at Thinking MachinesThinking Machines is a technology consultancy building AI & data platforms to solve high-impact problems for our clients. Our vision is a future where data-driven decision-making is a norm and where AI is used to support humans in making excellent decisions. To do that, we create data cultures, one organization at a time.We're a...

  • Data Engineer

    3 weeks ago

    Taguig, National Capital Region, Philippines Yondu, Inc. Full time

    GENERAL RESPONSIBILITIES:The Data Engineer will focus on using various methods to design and implement an overall data infrastructure that will support current and future business needs. The data engineer is also tasked in creating data pipelines that transform raw data for analytical and operational processes.

  • Data Engineer

    4 weeks ago

    Taguig, National Capital Region, Philippines GSS PH Full time

    "Must have requirements:- At least 1-3 years experience with Data Engineering/Processing- Experienced with Javascript programming, Python, and SQL- Hands on experience with Big Data or Cloud Data tools (Databricks, Hadoop, Azure Data Factory, AWS, PySpark)- Exposure with Big Data or Cloud Data projectsGood to have:- Exposure with AI or Machine Learning-...

  • Data Engineer

    9 hours ago

    Taguig, National Capital Region, Philippines Ascendion Full time $104,000 - $130,878 per year

    About the role Ascendion is seeking a talented Data Engineer with expertise in Databricks to join our innovative team. As a Data Engineer (Databricks), you will play a crucial role in designing, implementing, and maintaining scalable and efficient data pipelines to power our data-driven initiatives. This is a full-time position based in Bonifacio Global...

  • Data Engineer

    6 days ago

    Taguig, National Capital Region, Philippines Globe Telecom Full time

    OverviewJoin to apply for the Data Engineer role at Globe TelecomThe Data Engineer is responsible for designing, building, and maintaining automated data pipelines across multi-platform environments. This role ensures the integration, storage, and cleansing of data to support the organization's data strategy. The Data Engineering Manager drives compliance...

  • Data Engineer

    3 days ago

    Taguig, National Capital Region, Philippines Xurpas Enterprise, Inc Full time

    BenefitsUpon regularization 30 paid leaves per yearUpon regularization HMO for you PLUS 1 dependent worth P150,000Role SummaryYou will be responsible for designing, developing, and maintaining data solutions for data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL...

  • Data Engineer

    9 hours ago

    Taguig, National Capital Region, Philippines Focus Global Inc Full time $90,000 - $120,000 per year

    As aData Engineerat Focus Global Inc., you will be responsible for creating the technology and data architecture that moves and translates data used to inform critical strategic and real-time decisions. You will work with internal partners across engineering, product, business and marketing teams to translate business needs into technical solutions - three...

  • Data Engineer

    10 hours ago

    Taguig, National Capital Region, Philippines SolarWinds Full time ₱840,000 per year

    Overview:We are seeking a skilled Data Engineer to contribute to our data infrastructure and pipeline development. This role is ideal for a professional with solid SQL Server experience who is ready to take on more complex projects and begin developing leadership skills. The successful candidate will work independently on data engineering tasks while...

  • Data Engineer

    10 hours ago

    Taguig, National Capital Region, Philippines Seven Seven Global Services Inc Full time ₱600,000 - ₱1,000,000 per year

    Job Description Job Description:Design and develop data pipelines that will ingest the data from the respective source systems into the data warehouse Support and optimize existing data pipelines to ensure that the downstream SLAs are met Responsible in attending agile ceremonies as part of the Agile Tribe set-up and delivering the different demands...

  • Data Engineer

    6 days ago

    Taguig, National Capital Region, Philippines Xurpas Enterprise Full time

    Data Engineer (Databricks) role at Xurpas EnterpriseLocation: Uptown Bonifacio 2, Taguig CityWork Setup: Hybrid (2x a week onsite)Job Type: Full Time / Project BasedOverviewAs a Data Platform Engineer, you will assist with the blueprint and design of the data platform components, collaborating with Integration Architects and Data Architects to ensure...