Big Data Engineer

4 weeks ago


Manila, National Capital Region, Philippines FIRSTMAC OPERATIONS CENTER PTY LTD-PHILIPPINE BRANCH Full time

POSITION PURPOSE: The big data team is responsible for developing, monitoring and maintaining the data warehouse and the integration of business development tools to enable a more strategic, tactical and operational business. Big data technologies include AWS hosted databases and components such as Postgres and Redshift DB's, AWS Data Pipelines, Lambda functions and Python code to deliver scalable solutions to the business.

KEY RESPONSIBILITIES:

Designing and implementing the architecture of ETL using PySpark and SQL language in AWS Glue.Designing and developing transactional and analytical data structures.Aligning the Data technical capabilities to business objectives.Developing reporting solutions to support Business Intelligence, including resolving problems related to data analysis and reporting services.Establishing and maintaining policies, operational procedures, and associated documentation for user interaction with the database environment.Following Firstmac standards and best practice for the deployment of AWS components and code using source code controls such as BitBucket, and utilizing DevOps tools (e.g., Terraform), apps, and CLI as appropriate.Recommending improvements to existing approaches and practices within Data Governance forums and other appropriate meetings. TECHNICAL SKILLS:Python 3+ including Virtual environments, PIP, Pypy, Package development, Boto3, sqlalchemy, PytestETL / ELT experience with SQL & Python within a big data environment.Experience with SQL and NoSQL databasesExcellent coding skills, source control management (ie git) across programming languages with a strong focus on unit and integration testingSQL (ANSI, TSQL, PL/pgSQL)Experience in deploying AWS components remotely using AWS CLI Ability to perform database modelling and design, develop, debug, troubleshoot database objects, stored procedures and functionsKnowledgeable on LINUX with the ability to program shell scriptsExperience in developing and maintaining software solutions within the AWS ecosystem (S3, Redshift, DynamoDB). JOB QUALIFICATIONS:With at least 3-5 years of work experience and familiarity with the entire software development life cycle and facilitating agile practices and methodologyGraduate of Bachelor's Degree in Computer Science, Computer Engineering, Information Technology or related fields KEY COMPETENCIES: Reporting and Analysis: Understanding of constructing, designing, and reporting using Power BI and a dimensional data warehouse.Communication: Proficient in communicating insights from Reports and Analysis to the business.Numeric and Data Analytics Skills: Prior experience implementing and utilizing analytics with BI tools such as Power BI, Python, and MongoDB data.Database Skills: Experience in working with databases and analysing insights preferably with Athena, Redshift, MongoDB. IMPORTANT NOTE:100mbps minimum internet speed.An ideal work space set-up for optimized work productivity is a given.Company asset (laptop) will provided upon hiring. Interested parties may apply direct to Jobstreet. Interviews to be done online remotely by video call with Human Resources.
  • Big Data Engineer

    1 day ago


    Manila, National Capital Region, Philippines Neksjob Corporation Full time

    Job Title: Big Data EngineerNeksjob Corporation is seeking a highly skilled Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining data solutions for data generation, collection, and processing using Google BigQuery.Key Responsibilities:Design and develop data...

  • Big Data Engineer

    11 hours ago


    Manila, National Capital Region, Philippines Neksjob Corporation Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Neksjob Corporation.Job SummaryThe successful candidate will be responsible for designing, developing, and maintaining data solutions for data generation, collection, and processing using Google BigQuery.Key ResponsibilitiesDesign and develop data solutions for...

  • Data Engineer

    5 months ago


    Manila, National Capital Region, Philippines US Fair Group Full time

    We USA Fair Group Inc. Located in New York City are searching for an accountable, multitalented data engineer and IT Technician to facilitate the operations of our data scientists in the Philippines . The data engineer will be responsible for employing machine learning techniques to create and sustain structures that allow for the analysis of data while...

  • Cloud Data Engineer

    4 weeks ago


    Manila, National Capital Region, Philippines Tenet Global Business Center, Inc. Full time

    The Data Engineer is primarily responsible for participating in the design, development, and implementation of solutions for the data warehouse. The primary focus of the data warehouse includes data and analytics that support business operations including Clinical, Hospital Performance, and Corporate functions. This role is cloud facing and requires...


  • Manila, National Capital Region, Philippines Globe Telecom Full time

    **Data Engineer: Building Scalable Data Pipelines** Create and maintain scalable, maintainable, and reliable data pipelines that process large quantities of structured and unstructured data. Unify streaming and batch processing modes into one cohesive framework of processing, including monitoring and alerting that fit into a unified and reliable Big Data...

  • Data Engineer

    4 weeks ago


    Manila, National Capital Region, Philippines Fujitsu Philippines Global Delivery Center Full time

    Fujitsu is the #1 IT Service Company in Japan and is ranked 7th globally. It has 80 years of rich history.Fujitsu's Global Delivery Center in the Philippines is known as WeServ Systems International Inc. We are a subsidiary of Fujitsu Phils, Inc -- one of the country's leading ICT companies. WeServ was established in 1993 and has been operating in the...


  • Manila, National Capital Region, Philippines Tenet Global Business Center, Inc. Full time

    A Data Operations Support Specialist plays a pivotal role in ensuring the smooth and efficient operation of data processing systems, encompassing Google Dataflow, Google Cloud Big Query, Google Composer, and IBM DataStage. This multifaceted role involves monitoring, troubleshooting, optimizing data pipelines, ensuring data quality, and providing technical...


  • Manila, National Capital Region, Philippines Globe Telecom Full time

    At Globe, our goal is to create a wonderful world for our people, business, and nation. By uniting people of passion who believe they can make a difference, we are confident that we can achieve this goal. Job Description Create and maintain scalable, maintainable and reliable pipeline that proces very large quantities of structured and unstructured...

  • Data Engineer

    1 month ago


    Manila, National Capital Region, Philippines Eclaro Business Solutions, Inc Full time

    Role Title: Data EngineerECLARO: A quick SummaryECLARO is an award-winning professional services firm headquartered in New York City and operating in the U.S., Canada, UK, Ireland, Australia and the Philippines. We are dedicated to a singular purpose: providing the Right People to meet every client's needs and solve business challenges through strategic...

  • Data Engineer

    1 day ago


    Manila, National Capital Region, Philippines JK Network Services Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at JK Network Services.Job Summary:As a Data Engineer, you will be responsible for designing and developing data-driven solutions to support business growth and decision-making.Key Responsibilities:Design and develop data warehouses and data lakesDevelop ETL processes to...

  • Data Engineer

    5 days ago


    Manila, National Capital Region, Philippines YONDU INC. Full time

    Summary: Data Engineer responsible for designing and implementing data engineering, ingestion, and curation functions on multi-cloud environments. The Data Engineer is a key role in our organization, responsible for designing and implementing data engineering, ingestion, and curation functions on multi-cloud environments. This includes supporting reporting...

  • Data Engineering

    1 week ago


    Manila, National Capital Region, Philippines Globe Telecom Full time

    **Data Engineer Job Description** We are seeking a highly skilled Data Engineer to design, develop, and maintain robust data platforms for operational use cases, ensuring data accuracy, accessibility, and security. **Job Responsibilities:** • Design and implement scalable, reusable data pipelines, defining frameworks, and leading data-related projects...

  • Data Science Manager

    4 weeks ago


    Manila, National Capital Region, Philippines China Banking Corporation (CBC) Full time

    As a Data Science Manager, it is an important role in driving data-driven decision making and leveraging advanced analytics and machine learning techniques to solve complex business problems. Working closely with the Data Science Department Head, the role may lead a team of data scientists and collaborate with various stakeholders to deliver impactful data...


  • Manila, National Capital Region, Philippines Ekkremis SOlutions Inc. Full time

    Data Quality EngineerEkkremis Solutions Inc. is seeking a highly skilled Data Quality Engineer to join our team. As a Data Quality Engineer, you will be responsible for ensuring the accuracy, completeness, and consistency of our enterprise data.Key Responsibilities:Develop and implement data testing strategies in collaboration with business subject matter...

  • Data Engineer

    11 hours ago


    Manila, National Capital Region, Philippines JK Network Services Full time

    Job Title: Data Engineer AnalystWe are seeking a highly skilled Data Engineer Analyst to join our team at JK Network Services.Job Summary:As a Data Engineer Analyst, you will be responsible for designing and developing dashboards, providing technical documentation, and creating data architecture diagrams.Responsibilities:Design and develop data visualization...

  • Data Engineer

    11 hours ago


    Manila, National Capital Region, Philippines Manpower Core Group Inc. Full time

    Job Title: Data EngineerAt Manpower Core Group Inc., we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing and implementing data solutions that drive business growth and improvement.Key Responsibilities:Conduct customer discovery meetings to determine reporting requirements and...

  • Data Engineer

    2 weeks ago


    Manila, National Capital Region, Philippines Deloitte SEA Full time

    Deloitte is seeking a Data Engineer (Azure) Consultant to provide high-level design and technical solutions for Cloud Engineering team. At Deloitte, our purpose is to make an impact that matters for our clients, our people, and the communities we serve. We strive to advise clients on how to deliver purpose-led growth and embed more equitable, inclusive, and...

  • Data Engineer

    11 hours ago


    Manila, National Capital Region, Philippines JK Network Services Full time

    Job Title: Data Analyst EngineerAt JK Network Services, we are seeking a highly skilled Data Analyst Engineer to join our team. As a key member of our data engineering team, you will be responsible for analyzing and interpreting complex data sets to inform business decisions.Key Responsibilities:Assess industry trends and create reports to forecast future...

  • Data Engineer

    3 weeks ago


    Manila, National Capital Region, Philippines iScale Solutions, Inc. Full time

    Responsibilities: Build the data pipeline and have an optimal ETL process to populate a reporting optimized database using Microsoft Azure Monitor and manage data pipelines, ensuring data accuracy and stability Design the architecture, build, and deploy the data platform that provide intuitive analytics across the business Design and grow the data platform...

  • Data Engineer

    4 weeks ago


    Manila, National Capital Region, Philippines AVENSYS CONSULTING INC. Full time

    Avensys is a reputed global IT professional services company headquartered in Singapore. Our service spectrum includes enterprise solution consulting, business intelligence, business process automation and managed services. Given our decade of success, we have evolved to become one of the top trusted providers in Singapore and service a client base across...