Azure Data Engineer/ AWS Data Engineer

2 weeks ago


Manila, National Capital Region, Philippines HR India Solutions Full time

Role & responsibilities

Must have skills: Python, pyspark, SQL, Cloud (AWS,AZURE, GCP) ETL tool, API Integration, Implementation, Job Scheduling tool

Total Experience: 4 + years

Relevant Experience: 3+ Years(Python, Pyspark, SQL, Cloud)

ONLY IMMEDIATE JOINERS

Bachelor's degree in Computer Science, Information Systems, or a related field.

  • Minimum 4 years of relevant experience in data engineering, including strong experience with
    SQL, Python and PySpark.
  • Strong Experience in any ETL tool like Informatica, DataStage, Alteryx, Talend, etc.
  • Expertise in writing complex SQL and PL SQL queries.
  • Proficiency in at least one of the cloud technologies: Azure, AWS, or GCP.
  • Experience in API integration- REST API would be a big plus
  • Experience in any job scheduling tool e.g. Control M, Autosys, Airflow Luigi would be a big plus
  • Experience in complex ETL mappings, CI CD pipelines, dev ops and deployment tools e.g. Docker,
    Jenkins etc. would be a big plus
  • At-least 2 full life cycle implementations experience from conceptualization, design, architecture
    to delivery

Strong hands-on experience on AWS or Azure (E.g. Amazon Athena, Amazon EMR, Amazon
Redshift, Amazon Kinesis, Amazon Elasticsearch Service, AWS Glue, Quick sight, Azure
Synapse, Azure Data Lake Storage, Azure Data Factory, Azure Databricks, Power BI)

Solid understanding of data modeling concepts and experience with data warehousing and
dimensional modeling.

  • Guide architectural choices using various cloud services and solution methodologies.
  • Understand existing architecture and develop plans to support the growth in the cloud adoption.
  • Must understand networking, security, design principles and best practices in cloud.
  • Perform POC's on tools and provide recommendations to solve specific business needs

Preferred candidate profile

Perks and benefits


#J-18808-Ljbffr

  • Manila, National Capital Region, Philippines Symphoni Hr Full time

    Responsibilities: Design, develop, and optimize data pipelines and ETL processes using PySpark or Scala to extract, transform, and load large volumes of structured and unstructured data from diverse sources. Implement data ingestion, processing, and storage solutions on AWS / Azure cloud platform, leveraging services such as AWS / Azure Databricks, Azure...

  • Data Engineer

    2 weeks ago


    Manila, National Capital Region, Philippines Onebyzero Full time

    Manila, Philippines | Posted on 03/07/2024 State/Province National Capital Region (Manila) Country Philippines Job Description The ability to design, implement, and optimize large-scale data and analytics solutions on Snowflake Data Engineering Implementing ETL pipelines within and outside of a data warehouse using Python and Snowflake SnowSQL ...

  • Data Engineer

    3 days ago


    Manila, National Capital Region, Philippines Malayan Insurance Co., Inc. (MICO) Full time

    The Data Engineer is responsible for designing, building, and maintaining the data architecture and infrastructure that supports data-driven applications and systems.This includes creation & management of data pipelines that transform and transport data from various sources to data warehouses or other target systems; ensure data quality, security, and...

  • Data Engineer

    4 weeks ago


    Manila, National Capital Region, Philippines Deloitte SEA Full time

    Data Engineer (Azure) Consultant for Deloitte Consulting Philippines Delivery CenterAre you ready to unlock your potential?At Deloitte, our mission is to create a meaningful impact for our clients, our team, and the communities we engage with.We believe in the power of being a positive force for change, and our WorldImpact initiatives are dedicated to...

  • Data Engineer

    1 month ago


    Manila, National Capital Region, Philippines Deloitte SEA Full time

    Data Engineer (Azure) Consultant for Deloitte Consulting Philippines Delivery CenterAre you ready to unlock your potential?At Deloitte, our mission is to create a meaningful impact for our clients, our team, and the communities we engage with.We believe in the power of being a positive force for change, and our WorldImpact initiatives are dedicated to...

  • Data Engineer

    2 weeks ago


    Manila, National Capital Region, Philippines Deloitte SEA Full time

    Data Engineer (Azure) Consultant for Deloitte Consulting Philippines Delivery CenterAre you ready to unlock your potential?At Deloitte, our mission is to create a meaningful impact for our clients, our team, and the communities we engage with.We believe in the power of being a positive force for change, and our WorldImpact initiatives are dedicated to...

  • Data Engineer

    2 weeks ago


    Manila, National Capital Region, Philippines Michael Page Philippines Full time

    About Our Client The company is a leading business in the retail sector, focused on growth and expansion. Job Description Design, develop, and support data pipelines, warehouses, data models, and reporting systems to tackle marketing impact, performance analysis and new campaign opportunities.Troubleshoot existing data setups to uncover data transformation...

  • Data Engineer

    4 weeks ago


    Manila, National Capital Region, Philippines Michael Page Philippines Full time

    About Our Client The company is a leading business in the retail sector, focused on growth and expansion. Job Description Design, develop, and support data pipelines, warehouses, data models, and reporting systems to tackle marketing impact, performance analysis and new campaign opportunities.Troubleshoot existing data setups to uncover data transformation...

  • Data Engineer

    2 weeks ago


    Manila, National Capital Region, Philippines Michael Page Full time

    About Our Client The company is a leading business in the retail sector, focused on growth and expansion. Job DescriptionDesign, develop, and support data pipelines, warehouses, data models, and reporting systems to tackle marketing impact, performance analysis and new campaign opportunities.Troubleshoot existing data setups to uncover data transformation...

  • Data Engineer

    2 weeks ago


    Manila, National Capital Region, Philippines Onebyzero Full time

    Manila, Philippines | Posted on 01/13/2024 State/Province National Capital Region (Manila) Country Philippines Job Description Data Collection & Integration: Extract, load, and transform data from various sources into our data platforms. Collaborate with source system owners to understand data structures and nuances. Database Design & Maintenance: Help...

  • Data Engineer

    2 weeks ago


    Manila, National Capital Region, Philippines GECO Asia Pte Ltd Full time

    We are looking for a skilled Data Engineer to join our team and help design and maintain robust data pipelines and systems. Responsibilities:Collaborate with business units to understand data needs and translate them into scalable AWS solutions.Design, develop, and maintain data pipelines using AWS services (Glue, S3, Lambda, RedShift, etc.).Implement data...

  • Project Engineer

    2 weeks ago


    Manila, National Capital Region, Philippines The Chemical Engineer Full time

    ABOUT UNILEVERUnilever is the place where you can bring your purpose to life with the work that you do – creating a better business and a better world. You will work on brands that are loved and improve the lives of our consumers and the communities around us. You will lead innovations, big and small, that will make our business win and grow. You will...

  • Sr. Data Engineer

    2 weeks ago


    Manila, National Capital Region, Philippines Michael Page Full time

    About Our Client The company is a bank with a global footprint, and a leader in the digital banking space. Job DescriptionDesign, architect, and maintain secure data platforms such as setting up data storage solutions like SQL databasesImplement and optimize workflows, ETL/ELT processes and pipelinesDeliver flexibility for data consumption by designing...


  • Manila, National Capital Region, Philippines Neksjob Philippines Full time

    Data Engineering Analyst Location: Taguig City Qualification: Bachelor's degree in Computer Science, Engineering, or similar Minimum of 1 to 2 years' experience in core software development environment(s) Minimum of 1year experience of enterprise search platforms (Solr, Lucene, Google, Elasticsearch) Agile Methodologies Certification (e.g. CSM) Basic...


  • Manila, National Capital Region, Philippines Monroe Consulting Group Full time

    The executive search firm Monroe Consulting Group Philippines is recruiting on behalf of a high-growth regulatory-approved online training and certification company with offices in the USA, Pakistan, and Manila. About the role Our respected client is seeking a Data Warehouse Engineer with expertise in gathering business requirements, creating comprehensive...

  • Lead Data Engineer

    2 weeks ago


    Manila, National Capital Region, Philippines Eclaro Business Solutions Incorporated Full time

    Lead Data Engineer Receive a Warm Welcome with Our Joining BonusWork details: Full onsite, Night shift 9PM-6AM, Full time roleDuties/Responsibilities:Design and maintain a scalable and secure Azure data warehouse. Build data pipelines: Create and manage data integration processes, including data extraction, transformation, and loading (ETL) from various...

  • Data Engineer

    2 weeks ago


    Manila, National Capital Region, Philippines INTEGRATION APPLIANCE, INC. Full time

    We are seeking a talented and motivated Data Engineer with a background in Data Science to join our team. The ideal candidate will have a solid foundation in data engineering principles and practices, along with a passion for data analysis, machine learning, and problem-solving. What you will do: Develop and implement data pipelines and ETL processes to...

  • Data Engineer

    2 months ago


    Manila, National Capital Region, Philippines Michael Page Philippines Full time

    About Our Client One of the largest FMCG company in the country. Job Description Design, develop and manage data pipelines and orchestrate data integration that meets business requirementsIdentify, design and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalabilityWork...

  • Azure Engineer

    2 weeks ago


    Manila, National Capital Region, Philippines HyLogic Full time

    Hylogic is at the heart of redefining the SCM landscape for the Fortune 500 'giants', with a primary focus on the FMCG industry. At HyLogic we are looking for Azure Engineer/MS SQL DBA to join our team in the Philippines .We are looking for highly skilled Azure Engineer/ MS SQL DBA specialists to join our Data Integration SRE Team. As part of our team, you...

  • Lead Data Engineer

    2 weeks ago


    Manila, National Capital Region, Philippines Eclaro Full time

    Mathematics, Statistics & Information Sciences (Science & Technology) Design and maintain a scalable and secure Azure data warehouse.Build data pipelines: Create and manage data integration processes, including data extraction, transformation, and loading (ETL) from various sources into the data warehouse.Develop and implement data management strategies to...