Azure Data Engineer

3 days ago

Manila, National Capital Region, Philippines New York Global Consultants Inc. (NYGCI) Full time ₱1,500,000 - ₱2,500,000 per year

Position: Azure Data Engineer

Location: Remote

Employment Type: Full Time

Work Shift: Regular

A Data Engineer designs data products and data pipelines that are resilient to change, modular, flexible, scalable, reusable, and cost effective. Utilizes software engineering principles to deploy and maintain fully automated data transformation pipelines that combine a large variety of storage and computation technologies to handle a distribution of data types and volumes in support of data architecture design.

As a Data Engineer, you will:

  • Design, develop, and maintain data pipelines and ETL processes using Microsoft Azure services (e.g., Azure Data Factory, Azure Synapse, Azure Databricks, Azure Fabric).
  • Utilize Azure data storage accounts for organizing and maintaining data pipeline outputs.  (e.g., Azure Data Lake Storage Gen 2 & Azure Blob storage).
  • Collaborate with data scientists, data analysts, data architects and other stakeholders to understand data requirements and deliver high-quality data solutions.
  • Optimize data pipelines in the Azure environment for performance, scalability, and reliability.
  • Ensure data quality and integrity through data validation techniques and frameworks.
  • Develop and maintain documentation for data processes, configurations, and best practices.
  • Monitor and troubleshoot data pipeline issues to ensure timely resolution.
  • Stay current with industry trends and emerging technologies to ensure our data solutions remain cutting-edge.
  • Manage the CI/CD process for deploying and maintaining data solutions.

Requirements:

  • Bachelor's degree in computer science, Engineering, or a related field (or equivalent experience) and able to demonstrate high proficiency in programming fundamentals.
  • Proven experience (3+ years) as a Data Engineer or similar role dealing with data and ETL processes.
  • Strong knowledge of Microsoft Azure services, including Azure Data Factory, Azure Synapse, Azure Databricks, Azure Blob Storage and Azure Data Lake Gen 2.
  • Experience utilizing SQL DML to query modern RDBMS in an efficient manner (e.g., SQL Server, PostgreSQL).
  • Strong understanding of Software Engineering principles and how they apply to Data Engineering (e.g., CI/CD, version control, testing).
  • Experience with big data technologies (e.g., Spark).
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and collaboration skills.

Preferred Qualifications:

  • Learning agility
  • Technical Leadership
  • Consulting and managing business needs
  • Strong experience in Python is preferred but experience in other languages such as Scala, Java, C#, etc. is accepted.
  • Experience building spark applications utilizing PySpark.
  • Experience with file formats such as Parquet, Delta, Avro.
  • Experience efficiently querying API endpoints as a data source.
  • Understanding of the Azure environment and related services such as subscriptions, resource groups, etc.
  • Understanding of Git workflows in software development.
  • Using Azure DevOps pipeline and repositories to deploy and maintain solutions.
  • Understanding of Ansible and how to use it in Azure DevOps pipelines.

  • Azure Data Engineer

    1 week ago

    Manila, National Capital Region, Philippines NYGC Services, Inc. Full time ₱1,200,000 - ₱2,400,000 per year

    Position: Azure Data EngineerWork Mode: WFHEmployment Type: Full TimeWork Arrangement: Regular Shift"A Data Engineer designs data products and data pipelines that are resilient to change, modular, flexible, scalable, reusable, and cost effective. Utilizes software engineering principles to deploy and maintain fully automated data transformation pipelines...

  • Azure Data Engineer

    2 weeks ago

    Manila, National Capital Region, Philippines DXC Technology Full time

    Get AI-powered advice on this job and more exclusive features.Direct message the job poster from DXC TechnologyDXC Technology is a Fortune 500 Global IT Services Leader and is ranked at 152. Our more than 130,000 people in 70-plus countries are entrusted by our customers to deliver what matters most. We use the power of technology to deliver mission critical...

  • Azure Software Engineer – Integration

    1 week ago

    Manila, National Capital Region, Philippines NYGC Services, Inc. Full time $70,000 - $120,000 per year

    Job DescriptionProject Role: Azure Software Engineer – IntegrationLocation: Makati CityWork setup: HybridSummary: The role involves designing, developing, testing, and maintaining API & Integration solutions using Microsoft Azure Integration Services. The developer will collaborate with cross-functional teams to gather requirements, optimize performance,...

  • Microsoft Azure Engineer

    19 hours ago

    Manila, National Capital Region, Philippines TQA Full time ₱1,200,000 - ₱2,400,000 per year

    About TQA Headquartered in Texas, USA, we're an international technology services and consultancy, partnering with enterprises across North America and Europe to deliver next-generation results through emerging technologies. With delivery centers in Romania, the Philippines, and LATAM, and offices in Austin, Alabama, Cardiff, and London, we are expanding...

  • Azure API

    2 weeks ago

    Manila, National Capital Region, Philippines CLPS Global Full time $104,000 - $130,878 per year

    Role: AZURE-API, Microsoft Azure Integration. Net, CICDYears of Exp: 7 +Location: Philippines Makati City, ManilaHybrid RoleJD:The role involves designing developing testing and maintaining API Integration solutions using Microsoft Azure Integration Services The developer will collaborate with crossfunctional teams to gather requirements optimize performance...

  • Data Engineer

    3 weeks ago

    Manila, National Capital Region, Philippines Aurecon Full time

    OverviewJoin to apply for the Data Engineer role at Aurecon.The Data Engineer role is responsible for designing, implementing, optimising, and managing the data infrastructure framework with an emphasis on security and reliability, and meet the needs of reporting solutions that drive decision-making and improve performance across the business. This role will...

  • Data Engineer

    1 week ago

    Manila, National Capital Region, Philippines Alpha Zetta Ptd Ltd Full time $104,000 - $130,878 per year

    About Who You will Be Working WithData Engineer (Remote – Philippines)Join a small, innovative Australian-based team building a data-driven digital bank. You will work on modern Snowflake data platforms, using dbt, Azure, Python, and SQL to transform and map complex banking data into scalable, high-quality pipelines for analytics and reporting.Key...

  • Data Engineering Head

    3 weeks ago

    Manila, National Capital Region, Philippines CMC Energy and Infrastructure Asia, Inc. Full time

    Job SummaryThe Data Engineering Unit Head will be responsible for leading the design, development, and optimization of the bank's enterprise data infrastructure. This includes building high-performance, scalable, and secure data pipelines and platforms that power advanced analytics, business intelligence, and regulatory reporting.The role requires deep...

  • Data Engineering Head

    2 weeks ago

    Manila, National Capital Region, Philippines CMC Energy and Infrastructure Asia, Inc. Full time

    Job Summary The Data Engineering Unit Head will be responsible for leading the design, development, and optimization of the bank's enterprise data infrastructure. This includes building high-performance, scalable, and secure data pipelines and platforms that power advanced analytics, business intelligence, and regulatory reporting. The role requires deep...

  • Azure Cloud Professional

    2 weeks ago

    Manila, National Capital Region, Philippines beBeeData Full time ₱2,000,000 - ₱2,500,000

    Cloud Engineering ExpertThe primary goal of our cloud-native systems is to thrive in the cloud ecosystem.Deliver high-level design and technical solutions for data engineering projects.Effectively prioritize tasks and develop data model designs, analytics-focused data warehousing, and data integration/management leveraging cloud technologies to enhance...