Data Engineer

23 hours ago

Taguig, National Capital Region, Philippines Hunter's Hub, Inc. Full time
Qualifications:
Preferred skills and experience include:

• Bachelor's degree in maths, statistics computer science, information management, finance or economics

• At least 3 years' experience integrating data into analytical platforms using patterns like API, files, XML, json, flatfiles, Hadoop file formats, and Cloud file formats.

• Experience in ingestion technologies (e.g. sqoop, nifi, flume), processing technologies (Spark/Scala) and storage (e.g. HDFS, HBase, Hive) are essential

• Experience in designing and building data pipelines using Cloud platform solutions and native tools.

• Experience in Python, JVM-compatible languages, use of CICD tools like Jenkins, Bitbucket, Nexus, Sonarqube

• Experience in data profiling, source-target mappings, ETL development, SQL optimisation, testing and implementation.

• Expertise in streaming frameworks (Kafka/Spark Streaming/Storm) essential

• Experience managing structured and unstructured data types

• Experience in requirements engineering, solution architecture, design, and development / deployment

• Experience in creating big data or analytics IT solution

• Track record of implementing databases and data access middleware and high-volume batch and (near) real-time processing

Job Description:

• Implement request for ingestion, creation, and preparation of data sources

• Develop and execute jobs to import data periodically/ (near) real-time from an external source

• Setup a streaming data source to ingest data into the platform

• Delivers data sourcing approach and data sets for analysis, with activities including data staging, ETL, data quality, and archiving

• Design a solution architecture on both On-premises and Cloud platforms to meet business, technical and user requirements

• Profile source data and validate fit-for-purpose

• Works with Delivery lead and Solution Architect to agree pragmatic means of data provision to support use cases

• Understands and documents end user usage models and requirements

  • PH - Data Engineer

    3 days ago

    Taguig, National Capital Region, Philippines Thinking Machines Data Science Full time

    Working at Thinking MachinesThinking Machines is a technology consultancy building AI & data platforms to solve high-impact problems for our clients. Our vision is a future where data-driven decision-making is a norm and where AI is used to support humans in making excellent decisions. To do that, we create data cultures, one organization at a time.We're a...

  • Data Engineer

    1 day ago

    Taguig, National Capital Region, Philippines Manpower Core Group Inc. Full time

    Must have requirements:- At least 1-3 years experience with Data Engineering/Processing- Experienced with programming (Javascript or Python)- Experience with SQL- Exposure with Big Data or Cloud Data projectsGood to have:- Experience with data engineering trainings or bootcamps- Exposure with AI or Machine Learning

  • Data Engineer

    3 weeks ago

    Taguig, National Capital Region, Philippines Xurpas Enterprise, Inc Full time

    BenefitsUpon regularization 30 paid leaves per yearUpon regularization HMO for you PLUS 1 dependent worth P150,000Role SummaryYou will be responsible for designing, developing, and maintaining data solutions for data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL...

  • PH - Data Strategy Consultant

    3 days ago

    Taguig, National Capital Region, Philippines Thinking Machines Data Science Full time

    Working at Thinking MachinesThinking Machines is a technology consultancy building AI & data platforms to solve high-impact problems for our clients. Our vision is a future where data-driven decision-making is a norm and where AI is used to support humans in making excellent decisions. To do that, we create data cultures, one organization at a time.We're a...

  • Data Engineering Professional

    2 weeks ago

    Taguig, National Capital Region, Philippines beBee Careers Full time

    Data Engineer Role OverviewThis is an exciting opportunity to take on a Data Engineer role in a dynamic environment.We are seeking a highly skilled professional to join our team as a Data Engineer. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Your primary focus will be on developing and...

  • Data Engineering Expert

    1 week ago

    Taguig, National Capital Region, Philippines beBee Careers Full time

    Job Title: Data Engineering ExpertWe are seeking an experienced Data Engineering Analyst to join our team. As a key member of the data engineering team, you will play a vital role in designing and developing robust and scalable data pipelines.Key Responsibilities:Assist in data engineering tasks, including data processing, transformation, and...

  • Data Engineering Expert

    1 week ago

    Taguig, National Capital Region, Philippines beBee Careers Full time

    Data Quality Engineer Job DescriptionWe are looking for a highly skilled Data Quality Engineer to join our team. The ideal candidate will have a strong background in data engineering and experience working with relational databases.The Data Quality Engineer will be responsible for resolving data quality issues, creating and managing data solutions, and...

  • Data Engineering Specialist

    1 week ago

    Taguig, National Capital Region, Philippines beBee Careers Full time

    Key Responsibilities:Manage data engineering projects and tasks to ensure timely completion and alignment with scope.Collaborate with team members to develop and maintain data pipelines and infrastructure.Work with other teams to understand and address data requirements.Contribute to efforts focused on data quality and security.Essential Skills and...

  • Data Engineering Specialist

    1 week ago

    Taguig, National Capital Region, Philippines beBee Careers Full time

    Data Engineer RoleEy is seeking a highly skilled data engineer to join their team. The ideal candidate will have expertise in developing data ingestion, processing, and analytical pipelines for big data, relational databases, NoSQL and data warehouse solutions.

  • Data Engineering Specialist

    5 days ago

    Taguig, National Capital Region, Philippines beBee Careers Full time

    Job Title: Data Engineering Specialist The role of a Data Engineer is to design, develop, and maintain data solutions using the Databricks Unified Data Analytics Platform. This involves creating efficient data pipelines, ensuring high data quality, and implementing ETL processes to manage data migration and deployment across various systems.