Lead Data Engineer

2 weeks ago

Manila, National Capital Region, Philippines Eclaro Business Solutions Incorporated Full time
Lead Data Engineer

Receive a Warm Welcome with Our Joining BonusWork details: Full onsite, Night shift 9PM-6AM, Full time role
Duties/Responsibilities:
  • Design and maintain a scalable and secure Azure data warehouse.
  • Build data pipelines: Create and manage data integration processes, including data extraction, transformation, and loading (ETL) from various sources into the data warehouse.
  • Develop and implement data management strategies to ensure data quality, consistency, and accuracy.
  • Collaborate with cross-functional teams, including to identify data requirements and develop data models.
  • Develop, adhere, and enforce data governance policies and procedures to ensure compliance.
  • Monitor data quality and develop response mechanisms to address problems.
  • Collaborate with IT teams to ensure the availability, reliability, and performance of data systems and infrastructure.
  • Develop documentation related to data management processes, procedures, and data dictionaries.
  • Stay up to date with industry trends and advancements in data management technologies and techniques.
  • Maintain the current state legacy Microsoft environment and processing, which includes troubleshooting production issues and implementing tactical enhancements where needed.
  • As needed, collaborate with external contractors to enhance data solutions. Coordinate their work, provide guidance, and ensure alignment with project goals.
Qualifications:

Education/Experience

Data Management Proficiency:
Azure Technologies:
Technical Skills:
Data Privacy and Security:
Problem-Solving and Analytical Skills:
Effective Communication:
Positive Attitude and Adaptability:
Bachelor's or master's degree in computer science, Information Systems, or a related field.
Proven experience working as a Data Engineer or in a similar role, preferably within the insurance or financial sector.
Strong understanding of data management principles, including data modeling, schema design, and data lineage.
Knowledge of data quality assurance techniques and best practices.
Familiarity with data governance frameworks and policies.
Proficiency in data warehousing concepts and hands-on experience with Azure services (e.g., Azure Data Factory, Azure Synapse Analytics, Azure SQL Database).
Ability to design and implement ETL processes using Azure tools.
Proficiency in SQL for data manipulation and querying.
Experience with Python for data transformation and ing.
Familiarity with ETL frameworks (e.g., Apache Spark, Talend).
Solid understanding of regulatory requirements such as GDPR and HIPAA.
Ability to implement data privacy controls and ensure secure data handling.
Excellent ability to analyze complex data sets, troubleshoot issues, and optimize data workflows.
Creative problem-solving mindset to address data-related challenges.
Strong interpersonal skills to collaborate with cross-functional teams.
Ability to convey complex technical ideas clearly to both technical and non-technical stakeholders.
A can-do mindset and willingness to tackle challenges head-on.
Adaptability to evolving technologies and business needs.
Technical Competencies

Microsoft Azure Services Proficiency:
Data Processing and Analytics:
Data Governance and Security:
Monitoring and Troubleshooting:
ing and Automation:
Effective Communication and Collaboration:
Continuous Learning and Adaptability:
Support and maintenance for legacy technologies
Azure Data Factory: Ability to design and implement data integration workflows using Azure Data Factory.
Azure Data Lake Storage: Familiarity with managing data in Azure Data Lake Storage.
Azure SQL Data Warehouse: Expertise in designing and optimizing data warehousing solutions using Azure SQL Data Warehouse.
Azure Data Lake Analytics: Understanding of data processing using Azure Data Lake Analytics.
Big Data Technologies: Knowledge of big data frameworks (e.g., Apache Spark, Hadoop) within Azure.
Data Governance Principles: Awareness of data governance best practices within Azure.
Access Control: Understanding of role-based access control (RBAC) and permissions management.
Data Privacy Compliance: Knowledge of compliance requirements (e.g., GDPR, HIPAA) related to data privacy and security.
Azure Data Factory Monitoring: Skills in monitoring, optimizing, and troubleshooting data pipelines within Azure Data Factory.
Diagnostic Logging: Familiarity with diagnostic logs and metrics for Azure services.
PowerShell or Python: Proficiency in ing languages (PowerShell or Python) for automating tasks within Azure.
Cross-Functional Teams: Strong communication skills to collaborate effectively with data scientists, analysts, and business stakeholders.
Technical Documentation: Ability to document data solutions clearly.
Stay Updated: Proactively keep up with the latest Azure data services, features, and advancements.
Adaptability: Be ready to embrace new technologies and adapt to evolving business needs.
Microsoft SQL Server: Knowledge of SQL Server for data warehousing and relational databases.
T-SQL: Proficiency in Transact-SQL (T-SQL) for querying and managing data.
Understanding of operating systems such as:
Microsoft Windows
Linux
UNIX

#J-18808-Ljbffr

  • Project Engineer

    2 weeks ago

    Manila, National Capital Region, Philippines The Chemical Engineer Full time

    ABOUT UNILEVERUnilever is the place where you can bring your purpose to life with the work that you do – creating a better business and a better world. You will work on brands that are loved and improve the lives of our consumers and the communities around us. You will lead innovations, big and small, that will make our business win and grow. You will...

  • Data Engineer

    2 weeks ago

    Manila, National Capital Region, Philippines Michael Page Philippines Full time

    About Our Client The company is a leading business in the retail sector, focused on growth and expansion. Job Description Design, develop, and support data pipelines, warehouses, data models, and reporting systems to tackle marketing impact, performance analysis and new campaign opportunities.Troubleshoot existing data setups to uncover data transformation...

  • Data Engineer

    4 weeks ago

    Manila, National Capital Region, Philippines Michael Page Philippines Full time

    About Our Client The company is a leading business in the retail sector, focused on growth and expansion. Job Description Design, develop, and support data pipelines, warehouses, data models, and reporting systems to tackle marketing impact, performance analysis and new campaign opportunities.Troubleshoot existing data setups to uncover data transformation...

  • Lead Data Engineer

    2 weeks ago

    Manila, National Capital Region, Philippines Eclaro Full time

    Mathematics, Statistics & Information Sciences (Science & Technology) Design and maintain a scalable and secure Azure data warehouse.Build data pipelines: Create and manage data integration processes, including data extraction, transformation, and loading (ETL) from various sources into the data warehouse.Develop and implement data management strategies to...

  • Data Engineer

    2 weeks ago

    Manila, National Capital Region, Philippines Michael Page Full time

    About Our Client The company is a leading business in the retail sector, focused on growth and expansion. Job DescriptionDesign, develop, and support data pipelines, warehouses, data models, and reporting systems to tackle marketing impact, performance analysis and new campaign opportunities.Troubleshoot existing data setups to uncover data transformation...

  • Data Platforms Lead

    2 weeks ago

    Manila, National Capital Region, Philippines Advanced Energy Full time

    Management (Information & Communication Technology) Develop a roadmap for the Data Analytics Platform by collaborating with technology stakeholders and peersDrive the technical vision, select the technology stack, and identify emerging technologies for Foundational and Advanced AnalyticsBuild a business case for data platform transformation and investment...

  • Analyst (Data Validation)

    2 weeks ago

    Manila, National Capital Region, Philippines DATA MART Consulting GmbH Full time

    Company DescriptionM3 Global Research, part of M3 Inc., provides the most comprehensive and highest quality market research recruitment and support services available to the industry with relationships reaching respondents in more than 70 countries worldwide.M3 Global Research maintains ISO 26362 and 27001 certifications with the highest quality data...

  • Lead Data Engineer

    2 weeks ago

    Manila, National Capital Region, Philippines 3Cloud Full time

    Are you looking for a role that motivates and challenges you? Are you ready for an opportunity for growth? Do you want to work on teams where people roll up their sleeves to take on tough problems together, and regularly blow the doors off our clients with their outstanding teamwork? If you answered yes to those questions, 3Cloud might just be for youAt...

  • Data Engineer

    4 weeks ago

    Manila, National Capital Region, Philippines Deloitte SEA Full time

    Data Engineer (Azure) Consultant for Deloitte Consulting Philippines Delivery CenterAre you ready to unlock your potential?At Deloitte, our mission is to create a meaningful impact for our clients, our team, and the communities we engage with.We believe in the power of being a positive force for change, and our WorldImpact initiatives are dedicated to...

  • Data Engineer

    1 month ago

    Manila, National Capital Region, Philippines Deloitte SEA Full time

    Data Engineer (Azure) Consultant for Deloitte Consulting Philippines Delivery CenterAre you ready to unlock your potential?At Deloitte, our mission is to create a meaningful impact for our clients, our team, and the communities we engage with.We believe in the power of being a positive force for change, and our WorldImpact initiatives are dedicated to...

  • Data Engineer

    2 weeks ago

    Manila, National Capital Region, Philippines Deloitte SEA Full time

    Data Engineer (Azure) Consultant for Deloitte Consulting Philippines Delivery CenterAre you ready to unlock your potential?At Deloitte, our mission is to create a meaningful impact for our clients, our team, and the communities we engage with.We believe in the power of being a positive force for change, and our WorldImpact initiatives are dedicated to...

  • Data Engineer

    2 weeks ago

    Manila, National Capital Region, Philippines Opswerks Full time

    We're looking for a Data Engineer to join our growing and mission driven Data Science team.About the jobAs a Data Engineer working in Product Services Group (PSG)'s Data Science Team you will:Build scalable data infrastructure and understand distributed systems concepts from a data storage and compute perspectiveBuild different types of data warehousing...

  • Data Engineer

    4 days ago

    Manila, National Capital Region, Philippines Malayan Insurance Co., Inc. (MICO) Full time

    The Data Engineer is responsible for designing, building, and maintaining the data architecture and infrastructure that supports data-driven applications and systems.This includes creation & management of data pipelines that transform and transport data from various sources to data warehouses or other target systems; ensure data quality, security, and...

  • Data Engineer

    4 weeks ago

    Manila, National Capital Region, Philippines US Fair Group Full time

    We USA Fair Group Inc. Located in New York City are searching for an accountable, multitalented data engineer and IT Technician to facilitate the operations of our data scientists in the Philippines . The data engineer will be responsible for employing machine learning techniques to create and sustain structures that allow for the analysis of data while...

  • Data Engineer

    2 months ago

    Manila, National Capital Region, Philippines US Fair Group Full time

    We USA Fair Group Inc. Located in New York City are searching for an accountable, multitalented data engineer and IT Technician to facilitate the operations of our data scientists in the Philippines . The data engineer will be responsible for employing machine learning techniques to create and sustain structures that allow for the analysis of data while...

  • Chief Engineer – Data Centres – Philippines

    2 weeks ago

    Manila, National Capital Region, Philippines Macdonald & Company Full time

    Job Summary:A leading data centre developer is seeking a highly skilled and experienced Chief Engineer to lead the technical operations of their state-of-the-art data center in Manila. As the Chief Engineer, you will be responsible for overseeing the design, maintenance, and efficient operation of the data center's infrastructure, ensuring optimal...

  • Enterprise Data Architect Lead

    2 weeks ago

    Manila, National Capital Region, Philippines Advanced Energy Full time

    Mathematics, Statistics & Information Sciences (Science & Technology) Create AEI's Data Architecture vision covering all Data & Analytics components, enterprise-wide baseline and target data architectures.Support in Data & Analytics solutions and product development as Data architect in terms of Data architecture, standards, best practices, assets and...

  • Data Engineer

    2 weeks ago

    Manila, National Capital Region, Philippines GECO Asia Pte Ltd Full time

    We are looking for a skilled Data Engineer to join our team and help design and maintain robust data pipelines and systems. Responsibilities:Collaborate with business units to understand data needs and translate them into scalable AWS solutions.Design, develop, and maintain data pipelines using AWS services (Glue, S3, Lambda, RedShift, etc.).Implement data...

  • Lead Software Engineer

    2 weeks ago

    Manila, National Capital Region, Philippines Metacom BPO Full time

    Metacom Solutions is looking for a Lead Software Engineer to join their team. Here are the details:Must-Haves:Minimum of 3 years of experience leading a technical teamMinimum of 8 years of hands-on software engineering experienceExperience in leading software engineering, front-end web, systems integrations, API, back-end batch processing, and/or ETL...

  • Data Governance Lead

    2 weeks ago

    Manila, National Capital Region, Philippines Satellite Office Full time

    Work for our global clients and immerse in our rich and diverse company culture where you can thrive, grow and just be aweSOme Apply now and discover the Satellite Office Candidate Experience – recognized as one of BEST among BPO companies worldwide. Responsible for leading Data Governance and Data Management initiatives in support of the Data and...