Python Data Engineer

5 days ago

Taguig, National Capital Region, Philippines Yondu, Inc. Full time ₱70,000 - ₱120,000 per year

A Data Engineer with Python and Azure Databricks is responsible for designing, building, and maintaining scalable and robust data pipelines and data solutions within the Azure ecosystem, leveraging Databricks and Python for development.

Key Responsibilities:

  • Data Pipeline Development:
  • Design, develop, and maintain efficient and scalable ETL/ELT processes using Azure Databricks, PySpark, and Python to ingest, transform, and load data from various sources into data lakes, data warehouses, or other analytical systems.
  • Azure Databricks Expertise:
  • Utilize Databricks features, including Delta Lake, notebooks, and optimized Spark clusters, to build and manage data processing workflows.
  • Data Integration:
  • Integrate data from diverse sources such as relational databases, APIs, cloud storage, and streaming platforms, ensuring data quality and consistency.
  • Performance Optimization:
  • Optimize data pipelines and processing workflows for performance, efficiency, and cost-effectiveness within the Azure environment.
  • Data Governance & Security:
  • Implement data quality checks, ensure data security and compliance with relevant regulations, and manage access controls.
  • Collaboration:
  • Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver tailored solutions that support business needs.
  • Troubleshooting & Support:
  • Monitor data pipeline performance, troubleshoot issues, and provide ongoing support and maintenance for data solutions.
  • Documentation:
  • Create and maintain technical documentation, including data models, pipeline designs, and best practices.

Required Skills and Qualifications:

  • Programming Proficiency:
     Strong expertise in Python and PySpark.
  • Azure Platform Knowledge:
     In-depth understanding of Azure services relevant to data engineering, including Azure Databricks, Azure Data Lake Storage, Azure Data Factory, and potentially Azure Synapse Analytics.
  • Big Data Technologies:
     Experience with Apache Spark and distributed computing concepts.
  • Data Warehousing & ETL:
     Solid understanding of data warehousing principles, data modeling, and ETL/ELT processes.
  • SQL Skills:
     Proficiency in SQL for data manipulation and querying.
  • Problem-Solving:
     Excellent analytical and problem-solving skills to address complex data challenges.
  • Communication:
     Strong communication and collaboration skills to interact effectively with technical and non-technical stakeholders.

Preferred Qualifications (Optional):

  • Relevant certifications (e.g., Databricks Certified Data Engineer Associate/Professional, Microsoft Certified: Azure Data Engineer Associate).
  • Experience with other data tools or platforms (e.g., Apache Kafka, Snowflake, Power BI).
  • Familiarity with Agile development methodologies.

  • Python DevOps Engineer

    2 weeks ago

    Taguig, National Capital Region, Philippines GECO Asia Pte. Ltd Full time $90,000 - $120,000 per year

    Summary:We are seeking a skilled Python DevOps Engineer with strong expertise in scripting, cloud-native solutions, and container orchestration. The role involves designing, developing, and maintaining automation scripts, container images, and CI/CD pipelines to support enterprise-scale deployments. The ideal candidate will have solid experience in Python,...

  • Data Engineer

    5 days ago

    Taguig, National Capital Region, Philippines Eastvantage Full time ₱900,000 - ₱1,200,000 per year

    We're Hiring: Data Engineer We are seeking a skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have hands-on experience in designing, building, and maintaining data pipelines, ensuring seamless data flow for analytics and reporting. If you're passionate about data architecture and helping organizations make data-driven...

  • PH - Senior Engineering Consultant (Analytics Engineering)

    2 weeks ago

    Taguig, National Capital Region, Philippines Thinking Machines Data Science Full time ₱1,800,000 - ₱2,500,000 per year

    Working at Thinking MachinesThinking Machines is a technology consultancy building AI & data platforms to solve high impact problems for our clients. Our vision is for Southeast Asia to become a global hub for data science. To do that, we create data cultures one organization at a time.We're a company made up of intellectually curious, civic-minded,...

  • Junior Data Engineer

    5 days ago

    Taguig, National Capital Region, Philippines Creathink Solutions Full time ₱900,000 - ₱1,200,000 per year

    Junior Data Engineer Location: Metro Manila or Metro Cebu (Hybrid) Contract Type: Project BasedLanguage Requirement: Strong proficiency in English preferredPosition OverviewWe are seeking a Junior Data Engineer to join our growing data team. The successful candidate will assist in building and maintaining data pipelines using modern tools and frameworks...

  • ETL Data Engineer – AWS

    4 days ago

    Taguig, National Capital Region, Philippines Eastvantage Full time ₱900,000 - ₱1,200,000 per year

    We're Hiring: ETL Data Engineer – AWS & Python Specialist We are seeking an experienced ETL Data Engineer to design, develop, and maintain robust data pipelines using AWS cloud services and Python. The ideal candidate will have expertise in extracting, transforming, and loading large datasets while ensuring data quality, performance, and scalability...

  • Python Developer

    2 weeks ago

    Taguig, National Capital Region, Philippines BIITECH, LLC Full time ₱40,000 - ₱70,000 per year

    Job Title: Python DeveloperLocation:Taguig (Onsite)Shift:Day ShiftSalary Range:PHP 40,000 – 70,000About the RoleWe are looking for a highly skilled Python Developer with strong expertise in Data Science and Python programming to join our team. The ideal candidate will have a proven track record of leveraging Python for data-driven solutions and possess at...

  • Microsoft Azure Data Services/Data Engineer

    2 weeks ago

    Taguig, National Capital Region, Philippines New York Global Consultants Inc. (NYGCI) Full time ₱900,000 - ₱1,200,000 per year

    Responsible for designing, developing, and optimizing big data solutions using the Databricks platform. This role involves close collaboration with data engineers, data scientists, and stakeholders to ensure efficient data processing, quality, and performanceKey Responsibilities• Develop and implement advanced data solutions on Databricks using Python,...

  • Python Developer

    2 weeks ago

    Taguig, National Capital Region, Philippines LanceSoft, Inc. Full time ₱900,000 - ₱1,200,000 per year

    Role: Advanced Application Engineer-pythonLocation: Taguig, Uptown Bonifacio Tower 2Job type: 6 months extendable contractWork setup: hybrid(2 times WFO in week )work shift: (night shift) 12am to 10amHYBRID SETUP: Standard for the project is 2 times a week – Wed and Thu; but for night shift workers it is with exception of once every 2 monthsRequirements•...

  • AI Data Engineer

    1 week ago

    Taguig, National Capital Region, Philippines Globe Telecom Full time ₱1,200,000 - ₱2,400,000 per year

    At Globe, our goal is to create a wonderful world for our people, business, and nation. By uniting people of passion who believe they can make a difference, we are confident that we can achieve this goal.Job DescriptionWe are seeking an AI Data Engineer with specialized expertise in Databricks and comprehensive experience implementing bronze, silver, and...

  • Python Developer

    2 weeks ago

    Taguig, National Capital Region, Philippines TaskBridge Hub Full time ₱480,000 - ₱840,000 per year

    Job Title:Python DeveloperLocation: TaguigWork Setup: Onsite (Day Shift)Salary Range: 40,000 – 70,000 (depending on experience)We are looking for an experienced and highly skilled Python Developer with a strong background in Data Science. The ideal candidate will have at least 5 years of relevant hands-on experience and must be an expert in Python...