Big Data Engineer

2 weeks ago


Metro Manila Philippines Activefence Full time

Description

We are seeking a Senior Big Data Engineer with a strong background in managing structured and unstructured data pipelines, who thrives in a fast-paced AI-focused environment. You will be instrumental in building and scaling our data lake architecture, supporting a system designed to fuel intelligent AI agents for data collection, labeling, and analytical reasoning. This includes integrating vector databases and optimizing for retrieval-augmented generation (RAG) workflows deployed on AWS Bedrock and other AI stacks.

Responsibilities
  • Design and implement scalable ingestion pipelines for structured/unstructured data using AWS and Databricks Unity Catalog.
  • Build and maintain high-throughput ETL/ELT pipelines with Apache Airflow and Databricks.
  • Architect and manage data modeling, storage, and indexing strategies in PostgreSQL and RDS, ensuring compatibility with AI retrieval systems.
  • Integrate and manage vector databases to support fast semantic and embedding-based search in RAG pipelines.
  • Collaborate with AI engineers to ensure seamless compatibility with LangGraph and LangSmith agent systems.
  • Implement robust data validation, lineage, and governance systems using Unity Catalog.
  • Optimize performance across distributed compute environments (Databricks, EC2).
  • Deploy and maintain Lambda-based microservices for scalable, real-time data ingestion and enrichment.
Requirements
  • 5+ years working with big data systems in production environments.
  • Proven expertise with Databricks, Unity Catalog, and Apache Spark.
  • Proficiency in Airflow, AWS stack (Lambda, EC2, RDS), and cloud-based data lake architectures.
  • Strong SQL and database design skills (PostgreSQL preferred).
Preferred Qualifications
  • Experience with AI agent pipelines or large-scale ML model support.
  • Working knowledge of vector databases (Chroma, Pinecone, FAISS).
  • Solid understanding of data lifecycle management in ML/AI contexts.
  • Bonus: Familiarity with LangGraph, LangSmith, LangChain, or similar agent orchestration tools.
  • Emphasis on data observability, security, and lineage tracking.
  • Hands-on with RAG architecture, including vector storage and semantic retrieval.
  • Exposure to AWS Bedrock and model deployment orchestration.
About ActiveFence

ActiveFence is the leading provider of security and safety solutions for online experiences, safeguarding more than 3 billion users, top foundation models, and the world’s largest enterprises and tech platforms every day.

As a trusted ally to major technology firms and Fortune 500 brands that build user-generated and GenAI products, ActiveFence empowers security, AI, and policy teams with low-latency Real-Time Guardrails and a continuous Red Teaming program that pressure-tests systems with adversarial prompts and emerging threat techniques. Powered by deep threat intelligence, unmatched harmful-content detection, and coverage of 117+ languages, ActiveFence enables organizations to deliver engaging and trustworthy experiences at global scale while operating safely and responsibly across all threat landscapes.

#J-18808-Ljbffr
  • Big Data Engineer

    2 weeks ago


    , , Philippines ActiveFence Full time

    Big Data Engineer Intelligence Philippines Associate Full-time Description We are seeking a Senior Big Data Engineer with a strong background in managing structured and unstructured data pipelines, who thrives in a fast-paced AI-focused environment. You will be instrumental in building and scaling our data lake architecture, supporting a system designed...

  • Big Data Engineer

    3 weeks ago


    Manila, National Capital Region, Philippines Activefence Full time

    DescriptionWe are seeking a Senior Big Data Engineer with a strong background in managing structured and unstructured data pipelines, who thrives in a fast-paced AI-focused environment. You will be instrumental in building and scaling our data lake architecture, supporting a system designed to fuel intelligent AI agents for data collection, labeling, and...

  • Data Engineer

    24 hours ago


    , Metro Manila, Philippines HRTX Full time

    Overview A Data Engineer designs, builds, and maintains scalable data systems and pipelines to collect, store, and process large volumes of data from various sources. They ensure data quality, security, and governance, and collaborate with other teams to make data analytics-ready. Qualifications At least 1-3 years experience with Data Engineering/Processing...

  • Data Engineers

    2 weeks ago


    , Metro Manila, Philippines Samsung Southeast Asia & Oceania Full time

    Join to apply for the Data Engineers role at Samsung Southeast Asia & Oceania 2 days ago Be among the first 25 applicants Join to apply for the Data Engineers role at Samsung Southeast Asia & Oceania Position SummaryWe are looking for world class server software engineers with Big Data Engineering and Data Analysis experience to join our technology...

  • Data Engineer

    24 hours ago


    , Metro Manila, Philippines Tenet Global Business Center, Inc. Full time

    Work Arrangement: Night shift work schedule Hybrid work setup Benefits: 15% Night differential 20 Paid Time Off (PTO) per year Annual Appraisal Annual Incentive Hybrid Work Arrangement HMO with FREE dependents Group life insurance The Data Engineer is primarily responsible for participating in the design, development, and implementation of...

  • PH - Data Engineer

    2 weeks ago


    , , Philippines Thinking Machines Data Science Full time

    Working at Thinking Machines Thinking Machines is a technology consultancy building AI & data platforms to solve high-impact problems for our clients. Our vision is a future where data-driven decision-making is a norm and where AI is used to support humans in making excellent decisions. To do that, we create data cultures, one organization at a time. We’re...

  • Big Data Analyst

    23 hours ago


    , Metro Manila, Philippines Buscojobs Full time

    Role and Responsibilities Performs data analysis and provides guidance to clients. Works with various IQVIA internal departments to validate and/or correct data and database issues. Ensures resolutions and inquiry responses are meeting Service Level Agreement guidelines. Performs weekly proactive analysis of key client markets and promoted products to...

  • Data Engineer

    4 days ago


    Manila, National Capital Region, Philippines Tenet Global Business Center, Inc. Full time ₱1,200,000 - ₱2,400,000 per year

    Work Arrangement:Night shift work scheduleHybrid work setupBenefits:15% Night differential20 Paid Time Off (PTO) per yearAnnual AppraisalAnnual IncentiveHybrid Work ArrangementHMO with FREE dependentsGroup life insuranceThe Data Engineer is primarily responsible for participating in the design, development, and implementation of solutions for the data...

  • Senior Data Engineer

    2 weeks ago


    , Metro Manila, Philippines Ethixbase360 Full time

    Join to apply for the Senior Data Engineer role at Ethixbase360 2 months ago Be among the first 25 applicants Join to apply for the Senior Data Engineer role at Ethixbase360 Get AI-powered advice on this job and more exclusive features. The CompanyOur Mission is to empower our clients to be catalysts of ethical change, while delivering better business...

  • Data Engineer

    23 hours ago


    , Bulacan, Philippines Motolite Full time

    JOB RESPONSIBILITIES Design, build, and maintain scalable data pipelines to collect, process, and store structured and unstructured data. Develop and manage ETL (Extract, Transform, and Load) processes to prepare data for analytics, and machine learning models. Perform web scraping and data mining to extract data from various online sources and APIs....