Data Engineer

2 days ago

manila, metro manila, Philippines Hammerjack Pty Ltd Full-time ₱1.30/year

About Penbrothers

Penbrothers is an HR & remote talent management partner and one of the fastest-growing companies in the Philippines. We provide talented Filipinos with global opportunities in high-growth startups and dynamic companies, from the comfort of their own homes.

About the Role

We are looking for a Data Engineer to design and build our data infrastructure on Google Cloud Platform, following a Medallion (Bronze, Silver, Gold) architecture. This role will own the pipelines, transformation logic, and governance layer that turn raw data from our core business systems into clean, trusted, analytics-ready datasets — and will be expected to work at a modern pace by using AI coding tools as a core part of the development workflow.

What You'll Do:

  • Design, build, and maintain scalable ELT/ETL pipelines across the Bronze (raw), Silver (cleansed/conformed), and Gold (business-ready) layers of our BigQuery-based Medallion architecture.
  • Own ingestion patterns from core business systems (e.g., CRM, ATS, helpdesk, ERP/finance platforms) into the Bronze layer, using batch loads and, where needed, streaming ingestion (Cloud Storage, BigQuery, APIs, etc.)
  • Build, test, and maintain dbt models (staging → intermediate → marts) that transform Bronze data into governed Silver and Gold datasets, with documentation and automated tests for every model.
  • Implement data quality controls: schema drift detection, deduplication, null/referential checks, and quarantine/error-handling routines across all layers.
  • Use Dataplex / Data Catalog to classify, tag, and govern datasets, and to maintain data lineage and metadata documentation for audit and compliance purposes.
  • Write and maintain Python-based pipeline code (Cloud Functions, Cloud Run jobs, Airflow/Cloud Composer DAGs), using AI coding assistants to accelerate development, while still applying sound engineering judgment, testing, and peer review to anything AI-generated.
  • Orchestrate, schedule, and monitor pipeline dependencies and SLAs, and respond to pipeline failures or data incidents.
  • Partner with BI/Analytics and business stakeholders to define and design the Gold-layer data models that power dashboards, KPIs, and self-serve reporting.
  • Build and maintain CI/CD pipelines for data workflows (Cloud Build / GitHub Actions) and manage BigQuery datasets, IAM, and infrastructure using version-controlled, infrastructure-as-code practices (e.g., Terraform).
  • Monitor and optimize BigQuery cost and performance (partitioning, clustering, slot/reservation usage, query tuning).
  • Apply data governance, access control, and data-boundary safeguards appropriate to a multi-client environment where data segregation and compliance matter.
  • Document data models, pipeline architecture, and operational runbooks; contribute to team engineering standards and code review practices.

What You Bring:

  • 2+ years of hands-on experience in data engineering, building and operating production data pipelines.
  • Strong proficiency in SQL and Python, with demonstrated experience designing ETL/ELT pipelines.
  • Demonstrated, active use of AI coding assistants (e.g., Claude, GitHub Copilot, Cursor) for writing, debugging, and optimizing Python and SQL code — able to prompt effectively and critically review AI-generated output rather than accepting it blindly.
  • Solid grounding in data modeling concepts: dimensional modeling, star schema design, slowly changing dimensions, etc.
  • Knowledge of Data Visualization tools like Looker, Looker Studio, Power BI, or a similar Data Viz tool.
  • Strong analytical and troubleshooting skills; comfortable resolving ambiguity across multiple source systems.
  • Strong English communication skills, both written and verbal, for cross-functional collaboration.

Nice to have:

  • Hands-on experience with the Google Cloud Platform data stack: BigQuery, Cloud Storage, Dataplex/Data Catalog, Pub/Sub, Cloud Composer (Airflow), and Cloud Functions or Cloud Run.
  • Experience integrating SaaS platforms (e.g., HubSpot, NetSuite, Zoho, Salesforce) into a cloud data warehouse.
  • Experience with version control and CI/CD for data workflows (Git, BitBucket, or Cloud Build).
  • Experience with data quality/testing tooling (dbt tests, GCP Dataplex, or similar).
  • Direct experience implementing or working within a Medallion (Bronze/Silver/Gold) or comparable layered data architecture.
  • Practical, production experience with dbt (Core or Cloud) — model layering, testing, documentation, and Git-based workflows.
  • Working knowledge of data governance, access control, and metadata/lineage management.
  • Exposure to streaming/event-driven data pipelines (Pub/Sub, Dataflow).
  • Terra