Python Data Engineer

6 days ago

Taguig, National Capital Region, Philippines Yondu, Inc. Full time ₱70,000 - ₱120,000 per year

A Data Engineer with Python and Azure Databricks is responsible for designing, building, and maintaining scalable and robust data pipelines and data solutions within the Azure ecosystem, leveraging Databricks and Python for development.

Key Responsibilities:

  • Data Pipeline Development:
  • Design, develop, and maintain efficient and scalable ETL/ELT processes using Azure Databricks, PySpark, and Python to ingest, transform, and load data from various sources into data lakes, data warehouses, or other analytical systems.
  • Azure Databricks Expertise:
  • Utilize Databricks features, including Delta Lake, notebooks, and optimized Spark clusters, to build and manage data processing workflows.
  • Data Integration:
  • Integrate data from diverse sources such as relational databases, APIs, cloud storage, and streaming platforms, ensuring data quality and consistency.
  • Performance Optimization:
  • Optimize data pipelines and processing workflows for performance, efficiency, and cost-effectiveness within the Azure environment.
  • Data Governance & Security:
  • Implement data quality checks, ensure data security and compliance with relevant regulations, and manage access controls.
  • Collaboration:
  • Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver tailored solutions that support business needs.
  • Troubleshooting & Support:
  • Monitor data pipeline performance, troubleshoot issues, and provide ongoing support and maintenance for data solutions.
  • Documentation:
  • Create and maintain technical documentation, including data models, pipeline designs, and best practices.

Required Skills and Qualifications:

  • Programming Proficiency:
     Strong expertise in Python and PySpark.
  • Azure Platform Knowledge:
     In-depth understanding of Azure services relevant to data engineering, including Azure Databricks, Azure Data Lake Storage, Azure Data Factory, and potentially Azure Synapse Analytics.
  • Big Data Technologies:
     Experience with Apache Spark and distributed computing concepts.
  • Data Warehousing & ETL:
     Solid understanding of data warehousing principles, data modeling, and ETL/ELT processes.
  • SQL Skills:
     Proficiency in SQL for data manipulation and querying.
  • Problem-Solving:
     Excellent analytical and problem-solving skills to address complex data challenges.
  • Communication:
     Strong communication and collaboration skills to interact effectively with technical and non-technical stakeholders.

Preferred Qualifications (Optional):

  • Relevant certifications (e.g., Databricks Certified Data Engineer Associate/Professional, Microsoft Certified: Azure Data Engineer Associate).
  • Experience with other data tools or platforms (e.g., Apache Kafka, Snowflake, Power BI).
  • Familiarity with Agile development methodologies.

  • Senior Azure Data Engineer

    18 hours ago

    Taguig, National Capital Region, Philippines Go-Get Data Consultancy Full time ₱1,080,000 - ₱1,800,000 per year

    Job Title: Senior Azure Data EngineerPosition ID: J Category: Software Development/ EngineeringLocation: Taguig CityWork set up: Hybrid (3 days/week onsite)Salary: PHP 90, ,000Work schedule: Mid to Night-ShiftExperience required: 5+ yearsNon-negotiables:• 5+ years Azure Data Engineer with at least 1 year of experience in both Databricks and PySpark•...

  • Ai Engineer Python

    2 weeks ago

    Taguig, National Capital Region, Philippines YONDU INC. Full time

    QualificationAn AI Engineer with hands-on experience in LangGraph, LangChain, Python, and Retrieval-Augmented Generation (RAG) to design and implement advanced AI solutions.The role involves building and orchestrating multi-agent workflows, developing custom pipelines for AI applications, and integrating GenAI capabilities into production systemsJob...

  • Data Engineer

    6 days ago

    Taguig, National Capital Region, Philippines Eastvantage Full time ₱900,000 - ₱1,200,000 per year

    We're Hiring: Data Engineer We are seeking a skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have hands-on experience in designing, building, and maintaining data pipelines, ensuring seamless data flow for analytics and reporting. If you're passionate about data architecture and helping organizations make data-driven...

  • Junior Data Engineer

    6 days ago

    Taguig, National Capital Region, Philippines Creathink Solutions Full time ₱900,000 - ₱1,200,000 per year

    Junior Data Engineer Location: Metro Manila or Metro Cebu (Hybrid) Contract Type: Project BasedLanguage Requirement: Strong proficiency in English preferredPosition OverviewWe are seeking a Junior Data Engineer to join our growing data team. The successful candidate will assist in building and maintaining data pipelines using modern tools and frameworks...

  • ETL Data Engineer – AWS

    5 days ago

    Taguig, National Capital Region, Philippines Eastvantage Full time ₱900,000 - ₱1,200,000 per year

    We're Hiring: ETL Data Engineer – AWS & Python Specialist We are seeking an experienced ETL Data Engineer to design, develop, and maintain robust data pipelines using AWS cloud services and Python. The ideal candidate will have expertise in extracting, transforming, and loading large datasets while ensuring data quality, performance, and scalability...

  • AI Data Engineer

    1 week ago

    Taguig, National Capital Region, Philippines Globe Telecom Full time ₱1,200,000 - ₱2,400,000 per year

    At Globe, our goal is to create a wonderful world for our people, business, and nation. By uniting people of passion who believe they can make a difference, we are confident that we can achieve this goal.Job DescriptionWe are seeking an AI Data Engineer with specialized expertise in Databricks and comprehensive experience implementing bronze, silver, and...

  • Data Engineer

    3 days ago

    Taguig, National Capital Region, Philippines Satellite Office Full time $80,000 - $120,000 per year

    We are looking for a skilled Data Engineer to design, build, and manage our data infrastructure. You will be responsible for constructing robust data pipelines that collect, process, and store data from various sources, enabling data-driven decision-making for our business units. Experience with modern cloud data platforms is highly valued. Key...

  • Data Engineer

    4 days ago

    Taguig, National Capital Region, Philippines ACMobility Full time ₱900,000 - ₱1,200,000 per year

    About the RoleWe are seeking a highly skilledData Engineerto join our team. The successful candidate will be responsible for designing, building, and maintaining scalable data pipelines, ensuring data integrity, security, and availability, and enabling data-driven decision-making across the organization. This role is anindividual contributor positionwith...

  • Python Developer

    4 days ago

    Taguig, National Capital Region, Philippines BEWAHARVEST Full time ₱40,000 - ₱70,000 per year

    Role: Python DeveloperLocation: Taguig (On-site)Shift: Day ShiftSalary Range: ₱40,000 – ₱70,000We're looking for a Python Developer with at least 5 years of hands-on experience in Data Science and Python programming to join our teamRequirements•Expertise in Python (DAS and Data Science)•Minimum of 5 years' relevant experience•Strong analytical...

  • Data Engineer

    6 days ago

    Taguig, National Capital Region, Philippines Rising Tide Digital, Inc. Full time ₱1,200,000 - ₱2,400,000 per year

    Analysis and profiling in preparation for data ingestion to data lakeDevelop, maintain, and monitor ETL/ELT jobsAnalysis and preparation of data models for the data warehouseDevelop, maintain, and monitor SQL queriesAnalysis and preparation of descriptive, prescriptive, or predictive analyticsDocument, optimized and maintain existing data...