Lead Data Engineer

2 days ago

Philippines MicroSourcing Full time $90,000 - $120,000 per year
Job Description Discover your 100% YOU with MicroSourcing

Position: Lead Data Engineer
Location: 1880 Eastwood, Quezon City
Work setup & shift: WFH | Night shift

Why join MicroSourcing

Youu0027ll have:
  • Competitive Rewards: Enjoy above-market compensation, healthcare coverage on day one, plus one or more dependents, paid time-off with cash conversion, group life insurance, and performance bonuses
  • A Collaborative Spirit: Contribute to a positive and engaging work environment by participating in company-sponsored events and activities.
  • Work-Life Harmony: Enjoy the balance between work and life that suits you with flexible work arrangements.
  • Career Growth: Take advantage of opportunities for continuous learning and career advancement.
  • Inclusive Teamwork: Be part of a team that celebrates diversity and fosters an inclusive culture.
Your Role:
As a Position, you will:
  • Architect, build, and maintain large-scale data pipelines using Airflow and AWS services (e.g., Glue, S3, ECS).
  • Design and implement ETL solutions for processing large and complex datasets from various sources.
  • Develop data models supporting both analytical reporting and machine learning workloads.
  • Build pipelines for LLM training and retrieval-augmented generation (RAG) systems.
  • Implement and manage vector databases (e.g., FAISS, Pinecone, Weaviate) and scalable retrieval architectures.
  • Collaborate with engineers, data scientists, and product teams to deliver integrated data solutions.
  • Establish and enforce best practices for data quality, pipeline testing, and deployment processes.
  • Optimize data processing pipelines for cost-efficiency, scalability, and performance.
  • Mentor and guide junior data engineers on infrastructure, best practices, and technical strategy.
  • Document data models, pipelines, schemas, and data lineage to ensure clarity and maintainability.
What You Need:
Non-negotiables
  • 5+ years of data engineering experience, including at least 2 years in a leadership role.
  • Advanced proficiency in Python and data processing libraries.
  • Extensive experience with AWS data services (Glue, S3, CloudWatch, ECS, IAM).
  • Strong expertise in Airflow for workflow orchestration and DAG development.
  • Proven experience designing and building ETL pipelines for large-scale data processing.
  • Proficiency in SQL and database design for analytics workloads.
  • Solid understanding of data modeling, schema design, and both real-time and batch processing architectures.
  • Knowledge of data security and compliance requirements.
  • Strong communication skills for documentation, team collaboration, and technical discussions.
  • Proficiency in Mac or Linux development environments.
  • Ability to collaborate during US Eastern Time (10 AM - 6 PM) core hours.
Preferred skills/expertise
  • Experience building pipelines for LLM training and RAG applications.
  • Familiarity with vector databases, embedding generation, and retrieval architectures.
  • Experience with streaming technologies (e.g., Kafka, Kinesis).
  • Familiarity with Docker, Kubernetes, and container orchestration.
  • Knowledge of Terraform, CloudFormation, or similar infrastructure-as-code tools.
  • Background in advertising technology, marketing analytics, or similar domains.
  • Experience designing systems for ISO 27001, SOC 2, NIST 800-53, or HIPAA compliance.
  • AWS certifications (e.g., Data Analytics, Database, Machine Learning).
  • Knowledge of graph databases, semantic technologies, and data governance frameworks.
  • Strong foundation in first principles and strategic technical thinking.
  • Advanced degree in Computer Science, Data Engineering, or related field.
-

About MicroSourcing

With over 9,000 professionals across 13 delivery centers, MicroSourcing is the pioneer and largest offshore provider of managed services in the Philippines.

Our commitment to 100% YOU

MicroSourcing firmly believes that our companyu0027s strength lies in our peopleu0027s diversity and talent. We are proud to foster an inclusive culture that embraces individuals of all races, genders, ethnicities, abilities, and backgrounds. We provide space for everyone, embracing different perspectives, and making room for opportunities for each individual to thrive.

At MicroSourcing, equality is not merely a slogan - itu0027s our commitment. Our way of life. Here, we donu0027t just accept your unique authentic self - we celebrate it, valuing every individualu0027s contribution to our collective success and growth. Join us in celebrating YOU and your 100%

For more information, visit

.Terms & conditions apply

  • Data Engineer

    2 days ago

    Philippines Globe Telecom Full time $80,000 - $120,000 per year

    At Globe, our goal is to create a wonderful world for our people, business, and nation. By uniting people of passion who believe they can make a difference, we are confident that we can achieve this goal.Job DescriptionThe Data Engineering is responsible for the designing, building, and maintaining automated data pipelines across multi-platform environments....

  • Market Expansion Partner – Lead Man Engineering Machinery

    2 days ago

    Philippines Lead Man Engineering Machinery Co., Ltd. Full time $50,000 - $100,000 per year

    Market Expansion Partner – Lead Man Engineering Machinery2 days ago | Be among the first 25 applicantsExpand Your Business with a Leading Machinery Brand Lead Man Engineering Machinery Co., Ltd. is a globally recognized manufacturer of premium excavators, skid steer loaders, and attachments for the construction, agriculture, and mining industries. As we...

  • Data Engineering Manager

    2 days ago

    Philippines Netskope Full time $120,000 - $150,000 per year

    About NetskopeToday, there's more data and users outside the enterprise than inside, causing the network perimeter as we know it to dissolve. We realized a new perimeter was needed, one that is built in the cloud and follows and protects data wherever it goes, so we started Netskope to redefine Cloud, Network and Data Security. Since 2012, we have...

  • Lead Data Analyst

    2 days ago

    Philippines Theoria Medical Full time $90,000 - $120,000 per year

    Company OverviewTheoria Medical is a comprehensive medical group and technology company dedicated to serving patients across the care continuum with an emphasis on post-acute care and primary care. Theoria serves facilities across the United States with a multitude of services to improve the quality of care delivered, refine facility processes, and enhance...

  • Data Engineer

    2 days ago

    Philippines DXC Technology Full time $80,000 - $100,000 per year

    1 day ago Be among the first 25 applicants As a Data Engineer, you will be instrumental in helping our customers gain insights and value from their data by designing, building, implementing, and managing the technical solutions and data platforms that enable data delivery and consumption. You should have a good understanding of customer requirements,...

  • Data Engineer

    2 days ago

    Philippines TATE ASIA Full time $40,000 - $80,000 per year

    Summary:Our client is a leading food and beverage group with a growing presence across Southeast Asia. Guided by strong values, it focuses on delivering quality products, fostering innovation, and building sustainable growth while creating enjoyable experiences for consumers.Role & Responsibilities:Design, develop and manage data pipelines and orchestrate...

  • Data Engineer

    2 days ago

    Philippines ConnectOS Full time $80,000 - $120,000 per year

    Schedule: 7 am to 4 pmLocation: Hybrid/Office-basedWhat We're Looking ForMust-Have Skills:Minimum 2 years' experience in data engineering using Microsoft Fabric and legacy SQL Server environmentsStrong SQL expertise for complex data transformation across Fabric and traditional platformsExperience with Python or PySpark for data pipeline development and...

  • AWS Data Engineer

    2 days ago

    Philippines Deloitte Full time $80,000 - $100,000 per year

    Job Description Title: Cloud (Data Engineer) Senior Consultant based in Deloitte Consulting Philippines Delivery Center Are you ready to unleash your potential At Deloitte, our purpose is to make an impact that matters for our clients, our people, and the communities we serve. We believe we have a responsibility to be a force for good, and WorldImpact is our...

  • Senior Data Engineer

    2 days ago

    Philippines Dev Partners Full time $80,000 - $100,000 per year

    Now Hiring: Senior Data Engineer (100% Remote) We are looking for a highly skilled Senior Data Engineer with strong expertise in Microsoft Business Central to join our team and help drive data integration, modeling, and analytics capabilities across the organization. As a Senior Data Engineer, you will be responsible for: 🗸 Design, build, and maintain...

  • Azure Data Engineer

    2 days ago

    Philippines Nordic Consulting Full time $90,000 - $120,000 per year

    Make a difference. Be happy. Grow your career.Azure Data EngineerPermanent WFH set upPosition SummaryThe Azure Data Engineer is a critical technical role within Nordic's growing Data Services team, responsible for designing, developing, and maintaining enterprise-grade data pipelines and analytics solutions using the Microsoft Azure platform. This role...