Data Pipeline Architect

7 days ago

Makati City, National Capital Region, Philippines beBeeData Full time ₱800,000 - ₱1,000,000
Job Overview

This role is responsible for designing, building, and managing the orchestration framework for data pipelines using Google Cloud Composer.

The ideal candidate will have expertise in authoring complex DAGs in Python, implementing sophisticated dependency management, triggers, and scheduling logic.

  • They will serve as a subject matter expert on DAG authoring best practices, including idempotency, task modularity, backfilling, and performance tuning.

A key responsibility of this role is to develop a comprehensive monitoring and alerting strategy for orchestrated pipelines to proactively identify and resolve issues.

Additionally, they will establish and enforce CI/CD processes for deploying and testing DAGs to ensure operational stability.

Collaboration with ingestion and transformation engineers is essential to understand pipeline dependencies and integrate their workflows into the master orchestration plan.

The individual will own the operational health of the data platform, managing retries, handling failures, and communicating pipeline status to stakeholders.

  • Data Pipeline Specialist

    2 weeks ago

    Makati City, National Capital Region, Philippines beBeeData Full time ₱800,000 - ₱1,200,000

    Job Title: Data Pipeline SpecialistThe role involves designing, developing and maintaining data pipelines using Microsoft Azure services.About the RoleWe are looking for an experienced Data Engineer who can develop and maintain data pipelines and ETL processes using Microsoft Azure services (e.g., Azure Data Factory, Synapse, Databricks).You will be...

  • Chief Data Pipeline Architect

    1 day ago

    Makati City, National Capital Region, Philippines beBeeDataEngineer Full time ₱1,500,000 - ₱2,000,000

    Job OverviewWe are seeking a seasoned professional to spearhead the development and operational management of a cutting-edge data warehouse project.Key Responsibilities:Design, build, and maintain the complete orchestration framework for all data pipelines using Google Cloud Composer.Author complex, dynamic, and maintainable DAGs in Python, implementing...

  • Data Pipeline Specialist

    2 days ago

    Caloocan City, National Capital Region, Philippines beBeeDataEngineer Full time ₱800,000 - ₱1,200,000

    About the RoleSeeking a skilled professional to design and implement data pipelines ingesting SAP data using various tools.The ideal candidate will have experience with Qlik Replicate and Qlik Compose for SAP data extraction, as well as strong understanding of SSIS and Azure Data Factory. Familiarity with SAP data structures and business processes is also...

  • Big Data Architect

    2 days ago

    Makati City, National Capital Region, Philippines beBeeDataEngineer Full time $90,000 - $125,000

    Job SummaryWe are seeking a highly skilled Big Data Architect to join our team. As a key member of our data engineering group, you will design and implement scalable data pipelines ingesting large datasets from SAP systems using Qlik Replicate, Qlik Compose, and SSIS.In this role, you will work closely with data architects to develop efficient and accurate...

  • Data Architect

    2 days ago

    Quezon City, National Capital Region, Philippines beBeeDataEngineering Full time ₱450,000 - ₱600,000

    Data Engineering Role OverviewThe role of a Data Engineer is pivotal in designing and implementing data pipelines to extract, transform, and load SAP data using cutting-edge technologies like Qlik Replicate, Qlik Compose, and SSIS.Working closely with data architects, the ideal candidate will ensure efficient and accurate SAP data consolidation, developing...

  • Chief Data Architect

    1 day ago

    Makati City, National Capital Region, Philippines beBeeDataEngineer Full time ₱1,500,000 - ₱2,500,000

    Job OverviewWe are seeking a highly skilled Data Engineer to drive innovation in cybersecurity, software development and big data technology as part of our award-winning IT team.You will play a critical role as part of a global agile team and collaborate with Solution Architects, BI Developers, Data Analysts and stakeholders to understand their data...

  • Chief Data Pipeline Architect

    1 week ago

    Quezon City, National Capital Region, Philippines beBeeDataEngineer Full time ₱1,100,000 - ₱1,650,000

    Job Overview:We are seeking a highly skilled and experienced Data Engineer to assemble complex data sets, improve internal processes through automation, and optimize data infrastructure for scalability and efficiency.Key Responsibilities:Design and develop scalable data pipelines and systems that meet business requirements.Assemble large, complex data sets...

  • Senior Data Pipeline Specialist

    2 weeks ago

    Quezon City, National Capital Region, Philippines beBeeDataEngineer Full time ₱900,000 - ₱1,200,000

    Job DescriptionWe are seeking a skilled Data Engineer to build data pipelines that transport data from various sources to our data lake and/or data warehouse.The ideal candidate will have expertise in designing, developing, and managing data pipelines, as well as experience with cloud services, data analytics tools, and visualization software.Key...

  • Cloud Data Solutions Architect

    2 weeks ago

    Makati City, National Capital Region, Philippines beBeeDataEngineer Full time ₱600,000 - ₱800,000

    We are seeking a skilled Data Architect to design and implement robust data pipelines using Azure services.The ideal candidate will have a strong understanding of data engineering principles, cloud architecture, and experience with Azure Databricks, Data Lake, and Data Factory.Design and implement data pipelines using Azure servicesCollaborate with...

  • Senior Data Architect

    2 weeks ago

    Makati City, National Capital Region, Philippines beBeeDataEngineer Full time ₱900,000 - ₱1,200,000

    We are seeking a seasoned Data Engineer to join our team. This role will design data products and data pipelines that are resilient to change, modular, flexible, scalable, reusable, and cost-effective.Job DescriptionA Data Engineer designs data products and data pipelines that are resilient to change, modular, flexible, scalable, reusable, and...