AWS / Azure Data Engineer

2 weeks ago


Manila, National Capital Region, Philippines Symphoni Hr Full time

Responsibilities:

  • Design, develop, and optimize data pipelines and ETL processes using PySpark or Scala to extract, transform, and load large volumes of structured and unstructured data from diverse sources.
  • Implement data ingestion, processing, and storage solutions on AWS / Azure cloud platform, leveraging services such as AWS / Azure Databricks, Azure Data Lake Storage, and Azure Synapse Analytics.
  • Develop and maintain data models, schemas, and metadata to support efficient data access, query performance, and analytics requirements.
  • Monitor pipeline performance, troubleshoot issues, and optimize data processing workflows for scalability, reliability, and cost-effectiveness.
  • Implement data security and compliance measures to protect sensitive information and ensure regulatory compliance.

Requirement

  • Proven experience as a Data Engineer, with expertise in building and optimizing data pipelines using PySpark, Scala, and Apache Spark.
  • Hands-on experience with cloud platforms (AWS / Azure)
  • Strong programming skills in Python and Scala, with experience in software development, version control, and CI/CD practices.
  • Familiarity with data warehousing concepts, dimensional modeling, and relational databases (e.g., SQL Server, PostgreSQL, MySQL).
  • Experience with big data technologies and frameworks (e.g., Hadoop, Hive, HBase) is a plus.

#J-18808-Ljbffr

  • Manila, National Capital Region, Philippines HR India Solutions Full time

    Role & responsibilities Must have skills: Python, pyspark, SQL, Cloud (AWS,AZURE, GCP) ETL tool, API Integration, Implementation, Job Scheduling toolTotal Experience: 4 + years Relevant Experience: 3+ Years(Python, Pyspark, SQL, Cloud) ONLY IMMEDIATE JOINERS Bachelor's degree in Computer Science, Information Systems, or a related field. Minimum 4 years of...

  • Azure Architect

    2 weeks ago


    Manila, National Capital Region, Philippines Mount Talent Consulting Full time

    Role & responsibilities Cloud Architect with experience in Azure ADF, Databricks, PySpark Responsible for designing and implementing secure, scalable, and highly available cloud-based solutions and estimation on AWS and Azure Cloud Experince in Azure Databricks and ADF, Azure Synapse and PySpark Experience with integration of different data sources with...

  • Data Engineer

    2 weeks ago


    Manila, National Capital Region, Philippines Onebyzero Full time

    Manila, Philippines | Posted on 03/07/2024 State/Province National Capital Region (Manila) Country Philippines Job Description The ability to design, implement, and optimize large-scale data and analytics solutions on Snowflake Data Engineering Implementing ETL pipelines within and outside of a data warehouse using Python and Snowflake SnowSQL ...

  • Data Engineer

    4 weeks ago


    Manila, National Capital Region, Philippines Deloitte SEA Full time

    Data Engineer (Azure) Consultant for Deloitte Consulting Philippines Delivery CenterAre you ready to unlock your potential?At Deloitte, our mission is to create a meaningful impact for our clients, our team, and the communities we engage with.We believe in the power of being a positive force for change, and our WorldImpact initiatives are dedicated to...

  • Data Engineer

    1 month ago


    Manila, National Capital Region, Philippines Deloitte SEA Full time

    Data Engineer (Azure) Consultant for Deloitte Consulting Philippines Delivery CenterAre you ready to unlock your potential?At Deloitte, our mission is to create a meaningful impact for our clients, our team, and the communities we engage with.We believe in the power of being a positive force for change, and our WorldImpact initiatives are dedicated to...

  • Data Engineer

    2 weeks ago


    Manila, National Capital Region, Philippines Deloitte SEA Full time

    Data Engineer (Azure) Consultant for Deloitte Consulting Philippines Delivery CenterAre you ready to unlock your potential?At Deloitte, our mission is to create a meaningful impact for our clients, our team, and the communities we engage with.We believe in the power of being a positive force for change, and our WorldImpact initiatives are dedicated to...

  • Azure Engineer

    2 weeks ago


    Manila, National Capital Region, Philippines HyLogic Full time

    Hylogic is at the heart of redefining the SCM landscape for the Fortune 500 'giants', with a primary focus on the FMCG industry. At HyLogic we are looking for Azure Engineer/MS SQL DBA to join our team in the Philippines .We are looking for highly skilled Azure Engineer/ MS SQL DBA specialists to join our Data Integration SRE Team. As part of our team, you...

  • Data Engineer

    4 days ago


    Manila, National Capital Region, Philippines Malayan Insurance Co., Inc. (MICO) Full time

    The Data Engineer is responsible for designing, building, and maintaining the data architecture and infrastructure that supports data-driven applications and systems.This includes creation & management of data pipelines that transform and transport data from various sources to data warehouses or other target systems; ensure data quality, security, and...

  • AWS MLOps Engineer

    2 weeks ago


    Manila, National Capital Region, Philippines Onebyzero Full time

    Manila, Philippines | Posted on 04/16/2024 We are seeking a highly skilled AWS MLOps Engineer to join our dynamic team. The ideal candidate will be responsible for managing and optimizing machine learning workflows on AWS, ensuring the effective deployment, scalability, and maintenance of our machine learning models. Key Responsibilities: Design and...

  • Data Engineer

    2 weeks ago


    Manila, National Capital Region, Philippines Michael Page Philippines Full time

    About Our Client The company is a leading business in the retail sector, focused on growth and expansion. Job Description Design, develop, and support data pipelines, warehouses, data models, and reporting systems to tackle marketing impact, performance analysis and new campaign opportunities.Troubleshoot existing data setups to uncover data transformation...

  • Data Engineer

    4 weeks ago


    Manila, National Capital Region, Philippines Michael Page Philippines Full time

    About Our Client The company is a leading business in the retail sector, focused on growth and expansion. Job Description Design, develop, and support data pipelines, warehouses, data models, and reporting systems to tackle marketing impact, performance analysis and new campaign opportunities.Troubleshoot existing data setups to uncover data transformation...

  • Data Engineer

    2 weeks ago


    Manila, National Capital Region, Philippines Onebyzero Full time

    Manila, Philippines | Posted on 01/13/2024 State/Province National Capital Region (Manila) Country Philippines Job Description Data Collection & Integration: Extract, load, and transform data from various sources into our data platforms. Collaborate with source system owners to understand data structures and nuances. Database Design & Maintenance: Help...

  • Data Engineer

    2 weeks ago


    Manila, National Capital Region, Philippines Michael Page Full time

    About Our Client The company is a leading business in the retail sector, focused on growth and expansion. Job DescriptionDesign, develop, and support data pipelines, warehouses, data models, and reporting systems to tackle marketing impact, performance analysis and new campaign opportunities.Troubleshoot existing data setups to uncover data transformation...


  • Manila, National Capital Region, Philippines Neksjob Philippines Full time

    Data Engineering Analyst Location: Taguig City Qualification: Bachelor's degree in Computer Science, Engineering, or similar Minimum of 1 to 2 years' experience in core software development environment(s) Minimum of 1year experience of enterprise search platforms (Solr, Lucene, Google, Elasticsearch) Agile Methodologies Certification (e.g. CSM) Basic...

  • Data Engineer

    2 weeks ago


    Manila, National Capital Region, Philippines GECO Asia Pte Ltd Full time

    We are looking for a skilled Data Engineer to join our team and help design and maintain robust data pipelines and systems. Responsibilities:Collaborate with business units to understand data needs and translate them into scalable AWS solutions.Design, develop, and maintain data pipelines using AWS services (Glue, S3, Lambda, RedShift, etc.).Implement data...

  • Sr. Data Engineer

    2 weeks ago


    Manila, National Capital Region, Philippines Michael Page Full time

    About Our Client The company is a bank with a global footprint, and a leader in the digital banking space. Job DescriptionDesign, architect, and maintain secure data platforms such as setting up data storage solutions like SQL databasesImplement and optimize workflows, ETL/ELT processes and pipelinesDeliver flexibility for data consumption by designing...

  • Cloud Engineer

    2 weeks ago


    Manila, National Capital Region, Philippines Adventus Pte Ltd Full time

    Infrastructure Services – Infrastructure / Design, develop, and deploy modular cloud-based systems Develop and maintain cloud solutions in accordance with best practices Ensure efficient functioning of data storage and process functions in accordance with company security policies and best practices in cloud security Identify, analyze, and resolve...

  • Cloud DevOps Engineer

    2 weeks ago


    Manila, National Capital Region, Philippines TrendMicro Full time

    As the number of cyberattacks and digital threats continue to grow, our world needs more passionate and innovative individuals who seek to be trailblazers in and shapers of the rapidly evolving cybersecurity landscape. At Trend Micro, we offer tremendous opportunities that will challenge and equip you to become engineered to do good in whatever path you...

  • Lead Data Engineer

    2 weeks ago


    Manila, National Capital Region, Philippines Eclaro Business Solutions Incorporated Full time

    Lead Data Engineer Receive a Warm Welcome with Our Joining BonusWork details: Full onsite, Night shift 9PM-6AM, Full time roleDuties/Responsibilities:Design and maintain a scalable and secure Azure data warehouse. Build data pipelines: Create and manage data integration processes, including data extraction, transformation, and loading (ETL) from various...


  • Manila, National Capital Region, Philippines Monroe Consulting Group Full time

    The executive search firm Monroe Consulting Group Philippines is recruiting on behalf of a high-growth regulatory-approved online training and certification company with offices in the USA, Pakistan, and Manila. About the role Our respected client is seeking a Data Warehouse Engineer with expertise in gathering business requirements, creating comprehensive...