Big Data Engineer

7 days ago

Manila, National Capital Region, Philippines FIRSTMAC OPERATIONS CENTER PTY LTD-PHILIPPINE BRANCH Full time

POSITION PURPOSE: The big data team is responsible for developing, monitoring and maintaining the data warehouse and the integration of business development tools to enable a more strategic, tactical and operational business. Big data technologies include AWS hosted databases and components such as Postgres and Redshift DB's, AWS Data Pipelines, Lambda functions and Python code to deliver scalable solutions to the business.

KEY RESPONSIBILITIES:

  • Designing and implementing the architecture of ETL using PySpark and SQL language in AWS Glue.
  • Designing and developing transactional and analytical data structures.
  • Aligning the Data technical capabilities to business objectives.
  • Developing reporting solutions to support Business Intelligence, including resolving problems related to data analysis and reporting services.
  • Establishing and maintaining policies, operational procedures, and associated documentation for user interaction with the database environment.
  • Following Firstmac standards and best practice for the deployment of AWS components and code using source code controls such as BitBucket, and utilizing DevOps tools (e.g., Terraform), apps, and CLI as appropriate.
  • Recommending improvements to existing approaches and practices within Data Governance forums and other appropriate meetings.

TECHNICAL SKILLS:

  • Python 3+ including Virtual environments, PIP, Pypy, Package development, Boto3, sqlalchemy, Pytest
  • ETL / ELT experience with SQL & Python within a big data environment.
  • Experience with SQL and NoSQL databases
  • Excellent coding skills, source control management (ie git) across programming languages with a strong focus on unit and integration testing
  • SQL (ANSI, TSQL, PL/pgSQL)
  • Experience in deploying AWS components remotely using AWS CLI Ability to perform database modelling and design, develop, debug, troubleshoot database objects, stored procedures and functions
  • Knowledgeable on LINUX with the ability to program shell scripts
  • Experience in developing and maintaining software solutions within the AWS ecosystem (S3, Redshift, DynamoDB).

JOB QUALIFICATIONS:

  • With at least 3-5 years of work experience and familiarity with the entire software development life cycle and facilitating agile practices and methodology
  • Graduate of Bachelor's Degree in Computer Science, Computer Engineering, Information Technology or related fields

KEY COMPETENCIES:

  • Reporting and Analysis: Understanding of constructing, designing, and reporting using Power BI and a dimensional data warehouse.
  • Communication: Proficient in communicating insights from Reports and Analysis to the business.
  • Numeric and Data Analytics Skills: Prior experience implementing and utilizing analytics with BI tools such as Power BI, Python, and MongoDB data.
  • Database Skills: Experience in working with databases and analysing insights preferably with Athena, Redshift, MongoDB.

IMPORTANT NOTE:

  • 100mbps minimum internet speed.
  • An ideal work space set-up for optimized work productivity is a given.
  • Company asset (laptop) will provided upon hiring.

Interested parties may apply direct to Jobstreet. Interviews to be done online remotely by video call with Human Resources.

#J-18808-Ljbffr

  • Big Data Engineer

    23 hours ago

    Manila, National Capital Region, Philippines Sysgen RPO, Inc. Full time

    Sysgen RPO, Inc. is seeking a highly skilled Big Data Engineer to join our team.About the RoleThis is an exciting opportunity for an experienced professional to design and implement big data solutions using Azure services. As a key member of our team, you will work closely with cross-functional teams of engineers to ensure that our data platforms are...

  • Cloud Big Data Engineer

    23 hours ago

    Manila, National Capital Region, Philippines KMC Solutions Full time

    About Our TeamWe are a dynamic team of professionals dedicated to delivering high-quality solutions using big data technologies.We are looking for an experienced big data engineer to join our team and contribute to the design, development, and maintenance of our big data infrastructure.The ideal candidate will have a strong background in data engineering,...

  • Big Data Engineer Lead

    7 days ago

    Manila, National Capital Region, Philippines Manpower Outsourcing Services, Inc. Full time

    About the Role:The Big Data Engineer Lead position at Manpower Outsourcing Services, Inc. is designed for individuals who can drive innovation and excellence in data engineering. You'll be responsible for architecting, building, and maintaining large-scale data systems that meet the needs of our business.Main Tasks:Design and develop robust data processing...

  • Big Data Engineer

    1 day ago

    Manila, National Capital Region, Philippines KMC Solutions Full time

    The purpose of this job is to provide technical expertise for research, development and modification of extract, transform, load processes and jobs in support of a Big Data infrastructure of our client.Responsibilities:Research, develop, document, and modify Big Data Lake processes and jobs per data architecture and modeling requirements; collaborate with...

  • Junior Big Data Engineer

    23 hours ago

    Manila, National Capital Region, Philippines Rising Tide Digital, Inc. Full time

    Rising Tide Digital, Inc. is hiring a Junior Big Data Engineer to join our team!The ideal candidate will have a solid foundation in ETL and SQL, with experience in working with big data technologies such as Redshift. Familiarity with the AWS platform and its data services is also highly desirable.We're looking for someone who can work independently, handle...

  • Big Data Architect

    7 days ago

    Manila, National Capital Region, Philippines I2S BusinessSolutions Inc. Full time

    Data Driven Innovations with I2S Business Solutions Inc.We are seeking an experienced Big Data Architect to join our team at I2S Business Solutions Inc. As a Big Data Architect, you will play a critical role in designing and implementing scalable big data solutions on Microsoft Azure.Responsibilities:Design and implement data architectures using Azure Data...

  • Big Data Engineer Leader

    1 week ago

    Manila, National Capital Region, Philippines Singlife Philippines Full time

    Singlife Philippines is a leading provider of innovative financial solutions that help people manage, grow and protect their money. We are seeking a highly skilled Data Engineer to join our team.Job Summary:The Data Engineer will be responsible for designing, building and maintaining data pipelines, optimizing data flow, and supporting data initiatives. This...

  • Big Data Specialist

    3 days ago

    Manila, National Capital Region, Philippines Avature Full time

    Join our team of expert Data Engineers and contribute to the development of innovative big data solutions that drive business success.What You Will DoYou will work closely with our clients to understand their data needs and develop customized solutions to address them. As a Data Engineer at Avature, you will be responsible for:Data Modeling: Create data...

  • Big Data Analytics Specialist

    23 hours ago

    Manila, National Capital Region, Philippines KMC Solutions Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team at KMC Solutions.As a key member of our data infrastructure team, you will be responsible for designing, developing, and maintaining large-scale data systems that support our business operations.Your primary focus will be on providing technical expertise in extract, transform,...

  • We are Looking for Talend Big Data

    2 weeks ago

    Manila, National Capital Region, Philippines Neksjob Corporation Full time

    Job Overview:As a Data Engineer, you will be responsible for designing, developing, and maintaining data solutions for data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across systems.Roles & Responsibilities:Expected to be an...

  • Big Data Solutions Developer

    5 days ago

    Manila, National Capital Region, Philippines Dsanalytics Full time

    We are seeking a highly skilled and experienced Senior Data Service Engineer to join our team at DataSpark. In this role, you will work closely with our clients to design and implement data-driven solutions that meet their business needs.You will possess a strong background in data engineering, with expertise in big data technologies, cloud-based data...

  • Big Data Specialist

    7 days ago

    Manila, National Capital Region, Philippines FIRSTMAC OPERATIONS CENTER PTY LTD-PHILIPPINE BRANCH Full time

    Job DescriptionWe are looking for a highly skilled Big Data Specialist to join our team at the Firstmac Operations Center Pty Ltd - Philippine Branch. As a key member of our big data team, you will be responsible for developing, monitoring and maintaining the data warehouse and the integration of business development tools to enable a more strategic,...

  • Big Data Architect

    2 days ago

    Manila, National Capital Region, Philippines VISEO Full time

    We are seeking a highly experienced Big Data Architect to lead the development of our data integration solutions. As a key member of our team, you will be responsible for designing and developing robust data integration solutions using Talend and IBM DataStage.Key ResponsibilitiesDesign and develop ETL processes using Talend and IBM DataStageCreate and...

  • Big Data Architect

    22 hours ago

    Manila, National Capital Region, Philippines Private Advertiser Full time

    About the RoleWe are looking for a talented Big Data Architect to join our dynamic team at Private Advertiser.Key Responsibilities:Design and implement scalable data platforms using big data technologies.Build and maintain secure infrastructure for large datasets.Create efficient ETL pipelines using Python, SQL, and AWS services.Develop business intelligence...

  • Big Data Team Lead

    7 days ago

    Manila, National Capital Region, Philippines Home Credit Philippines Full time

    What You'll Do:Manage daily activities of Big Data Scrum Team.Collaborate with stakeholders, Product Owner, and Head of IT Delivery to align priority initiatives and deliverables.Collaborate with Business Analyst and architect for initiative solution design.Ensure the team delivers assigned tasks on schedule, following agile best practices.Cooperate with...

  • Big Data Developer

    7 days ago

    Manila, National Capital Region, Philippines IDEMIA Group Full time

    IDEMIA Group is committed to delivering cutting-edge innovation that reaches the highest technological standards. We believe that our diversity is a key driver of innovation and performance, and we welcome individuals from all walks of life.About the JobWe're seeking an experienced Data Engineer to join our team. This individual will be responsible for...

  • Big Data Engineer

    7 days ago

    Manila, National Capital Region, Philippines ERNI Full time

    As a Data Engineer at ERNI, you'll be part of a dynamic team that drives innovation through software engineering and IT. With over 800 employees worldwide, we offer a unique opportunity to collaborate with global clients and shape the future of data engineering.We're looking for an experienced Data Engineer to join our team and take on key responsibilities...

  • Big Data Architect

    2 days ago

    Manila, National Capital Region, Philippines Pointwest Full time

    Pointwest is seeking a highly skilled Cloud Data Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining large-scale data processing systems on the cloud.The ideal candidate will have expertise in data modeling techniques, including RDBMS and NOSQL. They should also possess strong proficiency in RDBMS...

  • Big Data Solutions Expert

    2 days ago

    Manila, National Capital Region, Philippines Avature Full time

    We are seeking a talented Cloud and AI Engineer to join our team at IBM Consulting.About the RoleDevelop, maintain, evaluate, and test big data solutions using cutting-edge technologies.Collaborate with cross-functional teams to design and implement innovative solutions that meet clients' business needs.Stay up-to-date with the latest advancements in cloud...

  • Big Data Architect

    13 hours ago

    Manila, National Capital Region, Philippines Outsourced Full time

    As a Big Data Architect, you will play a crucial role in designing and implementing scalable data architectures to support our learning platforms and analytics needs. You will be responsible for developing and maintaining logical, physical, and conceptual data models to ensure data consistency, quality, and scalability across multiple platforms and business...