Data Engineer-Big Data

3 weeks ago


Quezon City Manila, Philippines IBM Solutions Delivery Full time
Introduction
At IBM, work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've never thought possible. Are you ready to lead in this new era of technology and solve some of the world's most challenging problems If so, lets talk.

Your Role and Responsibilities
Develops applications on Big Data and Cognitive technologies including API development. Expected to have traditional Application Development background along with knowledge of Analytics libraries, open-source Natural Language Processing, statistical and big data computing libraries. Strong technical abilities to understand, design, write and debug complex code. Skills include Python, Spark, Kafka, IBM BigInsights, Hadoop, NoSQL, HBase, HIVE, PIG, C++, SQL, Linux, Java, EAI, SOA, CEP, HDFS, ETL

PH_DIGhotjobs

Required Technical and Professional Expertise
  • Development experience in Big Data software development technologies such as Python, Hadoop, Hive or Spark.
  • Proficient background in Unix or Linux programming language.
  • Good understanding in SQL and RDBMS. Good at modeling data for relational, analytical and big data workload.
  • Provide support for deployed data applications and other data consumers by identifying data problems and guiding issue resolution with partner Data Engineers and source data providers


Preferred Technical and Professional Expertise
  • Must Have skill in Big Data tools such as Python, Hadoop, Hive or Spark
  • Proven background in SQL, Unix/Linux and ETL process


  • Quezon City, Philippines Nityo Infotech Full time

    Qualifications:Primary Skill: Python Other skills: Domino Lab Nifi / Kafka Jupiter Lab / Data LabOther Skills:Experience with Domino Lab for collaborative data science work, including version control, experiment tracking, and model deployment.Strong understanding of Apache NiFi for data ingestion, routing, and transformation, along with experience in...


  • Quezon City, Philippines Nityo Infotech Full time

    Qualifications: Primary Skill: Python Other skills: Domino Lab Nifi / Kafka Jupiter Lab / Data Lab Other Skills: Experience with Domino Lab for collaborative data science work, including version control, experiment tracking, and model deployment. Strong understanding of Apache NiFi for data ingestion, routing, and transformation, along with experience...


  • Quezon City, Philippines Nityo Infotech Full time

    Qualifications: Primary Skill: Python Other skills: Domino Lab Nifi / Kafka Jupiter Lab / Data Lab Other Skills: Experience with Domino Lab for collaborative data science work, including version control, experiment tracking, and model deployment. Strong understanding of Apache NiFi for data ingestion, routing, and transformation, along with experience...

  • Data Engineer

    4 weeks ago


    Manila, Philippines US Fair Group Full time

    We USA Fair Group Inc. Located in New York City are searching for an accountable, multitalented data engineer and IT Technician to facilitate the operations of our data scientists in the Philippines . The data engineer will be responsible for employing machine learning techniques to create and sustain structures that allow for the analysis of data while...

  • Data Engineer

    3 weeks ago


    Manila, National Capital Region, Philippines US Fair Group Full time

    We USA Fair Group Inc. Located in New York City are searching for an accountable, multitalented data engineer and IT Technician to facilitate the operations of our data scientists in the Philippines . The data engineer will be responsible for employing machine learning techniques to create and sustain structures that allow for the analysis of data while...

  • Cloud Data Engineer

    2 weeks ago


    Metro Manila / NCR, Philippines Eclaro Business Solutions Incorporated Full time

    Responsibilities • Create and maintain optimal data pipeline architecture. • Assemble large, complex data sets that meet functional / non-functional business requirements. • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc....

  • Azure Data Engineer

    4 weeks ago


    Manila, Philippines Collabera Digital Full time

    Tips: Provide a summary of the role, what success in the position looks like, and how this role fits into the organization overall.Responsibilities• Design, create and maintain efficient and reliable data pipelines from data sources ofvarying nature (streaming, batch processing, etc.) to identified data storage targets.• Work in close relationship with...


  • Quezon City, Philippines Octal Philippines Incorporated Full time

    Octal Philippines Inc. is a leading IT solutions company seeking a skilled and experienced individual to join our team as a Data Engineer with expertise in Data Warehouse. As a Data Engineer - Data Warehouse, you will be responsible for designing, developing, and maintaining data warehouse solutions to support the company's data needs. This is an excellent...

  • Azure Data Engineer

    2 weeks ago


    Philippines, Manila Collabera Digital Full time

    Tips: Provide a summary of the role, what success in the position looks like, and how this role fits into the organization overall.Responsibilities• Design, create and maintain efficient and reliable data pipelines from data sources ofvarying nature (streaming, batch processing, etc.) to identified data storage targets.• Work in close relationship with...

  • Data engineers

    2 weeks ago


    Taguig City, Philippines DXC Technology Full time

    Job Description:Job Description:Designs and develops Data and Analytics solutionsPerforms data analysis, data architecture, data engineering activitiesDesigns and builds data ingestion pipelines; develops data transformation, cleansing and preparation processesDesigns and builds data storage solutions including database objects and data structuresTakes...


  • Philippines, Quezon City Octal Philippines Incorporated Full time

    Octal Philippines Inc. is a leading IT solutions company seeking a skilled and experienced individual to join our team as a Data Engineer with expertise in Data Warehouse. As a Data Engineer - Data Warehouse, you will be responsible for designing, developing, and maintaining data warehouse solutions to support the company's data needs. This is an excellent...

  • Data Engineer

    2 weeks ago


    Quezon City, Philippines Arch Capital Services LLC Full time

    Strategic Analytics is a growing team at Arch. The team develops innovative predictive models and analytical tools to improve profitability and growth. This position will help support the data engineering needs across a growing portfolio of high-profile analytics projects by developing complex data structures and pipelines leveraging a diverse set of tools...

  • Data Engineer

    2 weeks ago


    Quezon City, Philippines Eclaro Full time

    Job Description: The team develops innovative predictive models and analytical tools to improve profitability and growth. This position will help support the data engineering needs across a growing portfolio of high-profile analytics projects by developing complex data structures and pipelines leveraging a diverse set of tools and languages. This includes...

  • Data Engineer

    3 weeks ago


    Quezon City, Philippines Eclaro Full time

    Job Description: The team develops innovative predictive models and analytical tools to improve profitability and growth. This position will help support the data engineering needs across a growing portfolio of high-profile analytics projects by developing complex data structures and pipelines leveraging a diverse set of tools and languages. This includes...

  • Data Engineer

    4 weeks ago


    Quezon City, Philippines Manpower Core Group Inc. Full time

    Work closely with predictive modelers to assemble large, complex data sets that help solve business problems and increase profitability Perform data manipulation and transformation using SQL and Python Identify, design, and implement internal process improvements: automating manual processes and optimizing data pipelines Discover and explore new sources...

  • Data Engineer

    2 weeks ago


    Quezon City, Philippines Arch Capital Services LLC Full time

    Strategic Analytics is a growing team at Arch. The team develops innovative predictive models and analytical tools to improve profitability and growth. This position will help support the data engineering needs across a growing portfolio of high-profile analytics projects by developing complex data structures and pipelines leveraging a diverse set of tools...

  • Data Engineer

    3 weeks ago


    Quezon City, Philippines Manpower Core Group Inc. Full time

    Work closely with predictive modelers to assemble large, complex data sets that help solve business problems and increase profitability Perform data manipulation and transformation using SQL and Python Identify, design, and implement internal process improvements: automating manual processes and optimizing data pipelines Discover and explore new...

  • Data Engineer

    3 weeks ago


    Quezon City, Philippines Manpower Core Group Inc. Full time

    Work closely with predictive modelers to assemble large, complex data sets that help solve business problems and increase profitability Perform data manipulation and transformation using SQL and Python Identify, design, and implement internal process improvements: automating manual processes and optimizing data pipelines Discover and explore new...

  • Data Engineer

    3 weeks ago


    Manila, Philippines Gamma Interactive Inc Full time

    Duties And Responsibilities:Maintain and back up the Database Enhance and maintain Database performance Ensure system data integrity Design and provide data sets and develop algorithms useful to the business Build and Integrate data between multiple systems Use data to discover tasks that can be automated Deliver reports and updates relevant to stakeholders'...

  • Data Engineer

    2 weeks ago


    Metro Manila / NCR, Philippines Eclaro Business Solutions Incorporated Full time

    We are currently seeking a highly skilled Data Engineer to join our team. The ideal candidate will have a strong background in backend or data engineering, with expertise in the following key technologies: Experience in Data Lake (Warehouse) Proficiency in AWS services such as Redshift, Glue, and Quicksight Advanced knowledge of Python for data manipulation...