Big Data Engineer

3 days ago

Manila, National Capital Region, Philippines KMC Solutions Full time

The purpose of this job is to provide technical expertise for research, development and modification of extract, transform, load processes and jobs in support of a Big Data infrastructure of our client.

Responsibilities:

  1. Research, develop, document, and modify Big Data Lake processes and jobs per data architecture and modeling requirements; collaborate with Data and Analytics data strategists and data scientists
  2. Collaborate with business stakeholders to understand data needs including data velocity, veracity, and access patterns
  3. Provide technical expertise to implement Data and Analytics specifications
  4. Serve on cross-functional project teams and provide the data and big data perspective on executing key deliverables
  5. Troubleshoot complex, escalated issues including connection, failed jobs, application errors, server alerts and space thresholds within predefined service level agreements (SLAs)
  6. Proactively maintain and tune all code according to Big Data and EDW best practices to prevent issues
  7. Review and ensure appropriate documentation for all new development and modifications of the Big Data Lake processes and jobs
  8. Perform code and process reviews and oversee testing for solutions developed, and ensure integrity and security of institutional data
  9. Educate business stakeholders on the usage and benefits of the EDW, Big Data Lake and related technologies
  10. Mentor and guide less experienced team members and provide feedback on project work
  11. Model behaviors that support the company's common purpose; ensure guests and team members are supported at the highest level
  12. Ensure all activities are in compliance with rules, regulations, policies, and procedures
  13. Complete other duties as assigned

Qualifications:

  • Bachelor's degree in computer science, engineering, information technology, or related field, required.
  • Minimum five years of technology operations experience required.

Specialized Knowledge:

  • Strong SQL knowledge and skills required
  • Strong knowledge of Relational Databases like Oracle, Postgres or SQL Server required
  • Strong knowledge of relational modeling and features including triggers, stored procedures, and constraints required
  • Experience with Apache Spark or Spark-streaming, Message Queue technologies and Python required
  • Strong knowledge of enterprise data warehouse (EDW) data models with a focus on Star Schema data modeling techniques required
  • Strong knowledge of Amazon Web Services (AWS) or similar Cloud Big Data platform preferred

Competencies:

  • Excellent analytical skills and the ability to identify solutions to complex data problems
  • Ability to provide excellent customer service
  • Excellent written and verbal communication skills
  • Willingness to learn and embrace new technologies
  • Ability to mentor and motivate a diverse team; ensure team and individual accountability and performance standards are met
  • Ability to prioritize, multitask and manage multiple projects successfully in a fast-paced and dynamic environment
  • Strong organizational skills with attention to detail
  • Ability to communicate and interact effectively with different levels of the organization to negotiate, problem solve, complete projects and influence decision making
  • Self-motivated with ability to work both independently and within teams in order to establish and meet deadlines, goals, and objectives
#J-18808-Ljbffr

  • Big Data Engineer

    1 day ago

    Manila, National Capital Region, Philippines TeleTech Holdings, Inc. Full time

    Big Data Engineer PositionWe are seeking an experienced Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, building, and managing large-scale data systems that support our business needs.Responsibilities:Design and implement big data architectures using GCP capabilities.Develop and maintain data models,...

  • Big Data Engineer

    3 days ago

    Manila, National Capital Region, Philippines Sysgen RPO, Inc. Full time

    Sysgen RPO, Inc. is seeking a highly skilled Big Data Engineer to join our team.About the RoleThis is an exciting opportunity for an experienced professional to design and implement big data solutions using Azure services. As a key member of our team, you will work closely with cross-functional teams of engineers to ensure that our data platforms are...

  • Cloud Big Data Engineer

    3 days ago

    Manila, National Capital Region, Philippines KMC Solutions Full time

    About Our TeamWe are a dynamic team of professionals dedicated to delivering high-quality solutions using big data technologies.We are looking for an experienced big data engineer to join our team and contribute to the design, development, and maintenance of our big data infrastructure.The ideal candidate will have a strong background in data engineering,...

  • Junior Big Data Engineer

    3 days ago

    Manila, National Capital Region, Philippines Rising Tide Digital, Inc. Full time

    Rising Tide Digital, Inc. is hiring a Junior Big Data Engineer to join our team!The ideal candidate will have a solid foundation in ETL and SQL, with experience in working with big data technologies such as Redshift. Familiarity with the AWS platform and its data services is also highly desirable.We're looking for someone who can work independently, handle...

  • Big Data Engineer

    1 week ago

    Manila, National Capital Region, Philippines FIRSTMAC OPERATIONS CENTER PTY LTD-PHILIPPINE BRANCH Full time

    POSITION PURPOSE: The big data team is responsible for developing, monitoring and maintaining the data warehouse and the integration of business development tools to enable a more strategic, tactical and operational business. Big data technologies include AWS hosted databases and components such as Postgres and Redshift DB's, AWS Data Pipelines, Lambda...

  • Talend Big Data Developer

    1 day ago

    Manila, National Capital Region, Philippines Neksjob Corporation Full time

    Job OverviewData solutions are the backbone of any successful organization. As a Data Engineer at Neksjob Corporation, you will be responsible for designing and developing data pipelines that extract, transform, and load data across systems. Your typical day will involve ensuring data quality, implementing ETL processes, and collaborating with...

  • Big Data Specialist

    5 days ago

    Manila, National Capital Region, Philippines Avature Full time

    Join our team of expert Data Engineers and contribute to the development of innovative big data solutions that drive business success.What You Will DoYou will work closely with our clients to understand their data needs and develop customized solutions to address them. As a Data Engineer at Avature, you will be responsible for:Data Modeling: Create data...

  • Big Data Analytics Specialist

    3 days ago

    Manila, National Capital Region, Philippines KMC Solutions Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team at KMC Solutions.As a key member of our data infrastructure team, you will be responsible for designing, developing, and maintaining large-scale data systems that support our business operations.Your primary focus will be on providing technical expertise in extract, transform,...

  • We are Looking for Talend Big Data

    2 weeks ago

    Manila, National Capital Region, Philippines Neksjob Corporation Full time

    Job Overview:As a Data Engineer, you will be responsible for designing, developing, and maintaining data solutions for data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across systems.Roles & Responsibilities:Expected to be an...

  • Big Data Solutions Developer

    7 days ago

    Manila, National Capital Region, Philippines Dsanalytics Full time

    We are seeking a highly skilled and experienced Senior Data Service Engineer to join our team at DataSpark. In this role, you will work closely with our clients to design and implement data-driven solutions that meet their business needs.You will possess a strong background in data engineering, with expertise in big data technologies, cloud-based data...

  • We are Looking for Talend Big Data

    2 days ago

    Manila, National Capital Region, Philippines Neksjob Corporation Full time

    Job Overview:As a Data Engineer, you will be responsible for designing, developing, and maintaining data solutions for data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across systems.Roles & Responsibilities:Expected to be an...

  • Big Data Architect

    4 days ago

    Manila, National Capital Region, Philippines VISEO Full time

    We are seeking a highly experienced Big Data Architect to lead the development of our data integration solutions. As a key member of our team, you will be responsible for designing and developing robust data integration solutions using Talend and IBM DataStage.Key ResponsibilitiesDesign and develop ETL processes using Talend and IBM DataStageCreate and...

  • Big Data Architect

    3 days ago

    Manila, National Capital Region, Philippines Private Advertiser Full time

    About the RoleWe are looking for a talented Big Data Architect to join our dynamic team at Private Advertiser.Key Responsibilities:Design and implement scalable data platforms using big data technologies.Build and maintain secure infrastructure for large datasets.Create efficient ETL pipelines using Python, SQL, and AWS services.Develop business intelligence...

  • Big Data Architect

    4 days ago

    Manila, National Capital Region, Philippines Pointwest Full time

    Pointwest is seeking a highly skilled Cloud Data Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining large-scale data processing systems on the cloud.The ideal candidate will have expertise in data modeling techniques, including RDBMS and NOSQL. They should also possess strong proficiency in RDBMS...

  • Big Data Solutions Expert

    3 days ago

    Manila, National Capital Region, Philippines Avature Full time

    We are seeking a talented Cloud and AI Engineer to join our team at IBM Consulting.About the RoleDevelop, maintain, evaluate, and test big data solutions using cutting-edge technologies.Collaborate with cross-functional teams to design and implement innovative solutions that meet clients' business needs.Stay up-to-date with the latest advancements in cloud...

  • Senior Data Engineer

    1 day ago

    Manila, National Capital Region, Philippines Neksjob Corporation Full time

    About Neksjob CorporationNeksjob Corporation is a leading provider of innovative data solutions. We are committed to delivering high-quality data engineering services that meet the evolving needs of our clients. As a Data Engineer at Neksjob Corporation, you will have the opportunity to work on challenging projects and collaborate with a talented team of...

  • Big Data Architect

    2 days ago

    Manila, National Capital Region, Philippines Outsourced Full time

    As a Big Data Architect, you will play a crucial role in designing and implementing scalable data architectures to support our learning platforms and analytics needs. You will be responsible for developing and maintaining logical, physical, and conceptual data models to ensure data consistency, quality, and scalability across multiple platforms and business...

  • Big Data Engineer Leader

    3 days ago

    Manila, National Capital Region, Philippines Celon Group Limited Full time

    Celon Group Limited seeks a senior-level Data Engineer to lead the design, development, and maintenance of its data infrastructure using Microsoft technologies.The ideal candidate will have expertise in developing and implementing complex ETL processes, building scalable data pipelines, and designing robust data warehouses and data lakes.Responsibilities...

  • Data Engineer

    3 days ago

    Manila, National Capital Region, Philippines Private Advertiser Full time

    Radix HR is on the hunt for a talented Data Engineer to join our dynamic teamIf you thrive on turning complex data into actionable insights and love building robust data pipelines, this opportunity is for you. As a Data Engineer, you'll play a crucial role in designing, implementing, and maintaining scalable data solutions that drive business intelligence...

  • Data Scientist and Engineer

    4 days ago

    Manila, National Capital Region, Philippines TeleTech Holdings, Inc. Full time

    Job DescriptionAs a Data Engineer, you will be responsible for designing, building, and managing data systems that support the collection, storage, and processing of large datasets. This includes developing and maintaining data pipelines, integrating data from various sources, designing data models, and optimizing databases.The ideal candidate will have...