Data Engineer – Azure Databricks

14 hours ago

Manila, National Capital Region, Philippines Quikr Full time

Data Engineer – Azure Databricks, Purview & Fabric

Experience: 5+ years of hands-on experience in development and production implementation with Azure Databricks and Spark

Location- Manila, Philippines

About the Role

We are on the lookout for a skilled Data Engineer to join our dynamic team. The ideal candidate will have hands-on experience with Azure Databricks for data engineering and analytics, Microsoft Purview for data governance, and Microsoft Fabric for modern data integration and analytics. Proficiency in Python (PySpark) and SQL, along with expertise in data lake architecture, ETL processes, and data quality management, is essential. Experience with Azure data services and excellent technical documentation skills are also required.

Responsibilities:

  • Design, develop, and implement data processing pipelines using Azure Databricks and Spark.

  • Write efficient and optimized code in Python (PySpark) and SQL for large-scale data processing.

  • Architect and maintain data lakehouse solutions leveraging Microsoft Fabric for analytics and reporting.

  • Implement data governance and cataloging using Microsoft Purview, ensuring compliance and lineage tracking.

  • Build and optimize ETL workflows for ingestion, transformation, and integration across Azure services.

  • Ensure data quality, security, and integrity through robust validation and governance practices.

  • Collaborate with cross-functional teams to understand business requirements and deliver scalable solutions.

  • Maintain version control using Git and follow best practices for CI/CD in data engineering.

  • Create comprehensive technical documentation, including requirements, design, and testing artifacts.

Requirements:

  • 5+ years of hands-on experience in development and production implementation with Azure Databricks and Spark.

  • Proven experience with Microsoft Purview for data governance and compliance.

  • Working knowledge of Microsoft Fabric for analytics and integration.

  • Proficiency in Python (PySpark) and SQL coding.

  • Strong understanding of data lake architecture, ETL processes, and data quality management.

  • Experience with Azure data analytics services (e.g., Data Lake, Synapse, Data Factory).

  • Excellent technical writing and communication skills.

  • Ability to optimize performance for large-scale data processing and ensure scalability.

DataEngineer #SeniorDataEngineer #AzureDataEngineer #BigDataEngineer #AnalyticsEngineer #AzureDatabricks #ApacheSpark #PySpark #SQL #MicrosoftFabric #MicrosoftPurview #AzureDataFactory
AzureSynapse #DataLake #LakehouseArchitecture #ETL #DataPipelines #HiringNow #TechHiring
ManilaJobs #PhilippinesJobs

  • Databricks Engineer

    16 hours ago

    Manila, National Capital Region, Philippines New York Global Consultants Inc. (NYGCI) Full time

    Company DescriptionNew York Global Consultants Inc. (NYGCI) is an innovative technology services provider specializing in IT Consulting, Data Protection Services, and Application Performance Management. Founded in 2007 in New York State, NYGCI has expanded its footprint to over 27 U.S. states and supports Fortune Global 500 clients globally, including an...

  • Databricks Data Engineering Instructor

    14 hours ago

    Manila, National Capital Region, Philippines Trainocate Group Full time

    Are you a Databricks expert who thrives on teaching and inspiring the next generation of data professionals? Trainocate is seeking a highly experienced Databricks Instructor to deliver industry-ready programs that empower learners in Data Engineering, Generative AI Engineering, and Machine Learning on Databricks.Key ResponsibilitiesResponsible for...

  • Azure Data Engineer

    15 hours ago

    Manila, National Capital Region, Philippines Directio PHL, Inc. Full time

    Directio is a global IT services company. We consult, code, test, deploy, and manage mainly cloud-based and mobile applications, providing around-the-clock support from our offices in Poland, the Philippines, Mexico, and the USA. We prepare our FMCG, retail, automotive, and SaaS clients for the future by accelerating their digital transformation. Operating...

  • Data Engineer

    2 weeks ago

    Manila, National Capital Region, Philippines NextGen Executive Solutions Full time

    We're Hiring: Data Engineer – Azure Data Platform Hybrid | Full-timeWe're looking for an experienced Data Engineer to lead the end-to-end implementation of our solution on the Azure Data Platform — from architecture and development to deployment and ongoing optimization. What You'll DoDrive end-to-end implementation on Azure Data Platform — including...

  • Data Engineer

    14 hours ago

    Manila, National Capital Region, Philippines Quikr Full time

    Job- Role Details:Job-Role- Data EngineerJob-Location: Manila, Philippines locationExperience required: 5+ yearsSalary to be offered: decent hike on current CTC as per the company/market standardsJob-Requirements:Job Description:5+ years of hands-on experience in development and production implementation with Azure Databricks and SparkWe are on the lookout...

  • Data Operations Engineer

    15 hours ago

    Manila, National Capital Region, Philippines Kroll Full time

    DescriptionKroll Business Services (KBS) is looking for a Data Engineer with strong Databricks experience to join our Support Ops technology organization. Support Ops is a consolidated technology department within KBS, bringing together project management, product office, enterprise architecture, software engineering, data analysis, data engineering, and...

  • Senior Data Engineer

    16 hours ago

    Manila, National Capital Region, Philippines Outstaffer Full time

    We're Hiring:Azure Data Engineer Location:Onsite – BGC, Taguig Work Schedule:US Time Zone Industry:Healthcare Employment Type:Full-timeAbout UsWe are on the lookout for a skilled Azure Data Engineer to join our dynamic team for a healthcare industry client. This role is based onsite in BGC, Taguig, working on US time zone hours, and focuses on building...

  • Data Engineer

    16 hours ago

    Manila, National Capital Region, Philippines ARTECH TECHNOLOGY INC Full time

    We are HIRINGJob title: Databricks Data EngineerLocation: Uptown tower-2 TaguigWork Setup: Hybrid (2 days from Office)Shift time: Mid Shift (2PM – 12AM)Competitive SalarySummary:As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data...

  • Senior Data Engineer

    16 hours ago

    Manila, National Capital Region, Philippines Permhunt Full time

    Our client is the leading insights company that helps organizations make smarter commercial and product decisions through large-scale, high-quality data platforms.Job ResponsibilitiesSQL DatabasesDesign and evolve schemas for OLTP and OLAP workloads (Azure SQL, Synapse, Delta Lake), including partitioning, indexing, and row-level security in multi-tenant...

  • Data Engineer

    15 hours ago

    Manila, National Capital Region, Philippines Private Advertiser Full time

    Job Title: Data EngineerLocation: Uptown Tower 3 Metro ManilaWork Setup: Mid Shift (2PM – 12AM)Shift Schedule: Hybrid, 2x a week RTODuration: 6 Months ContractJob Description:As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing.Your typical day will involve creating data...