Lead Data Engineer

2 weeks ago

Manila, National Capital Region, Philippines Eclaro Full time

Mathematics, Statistics & Information Sciences (Science & Technology)

  • Design and maintain a scalable and secure Azure data warehouse.
  • Build data pipelines: Create and manage data integration processes, including data extraction, transformation, and loading (ETL) from various sources into the data warehouse.
  • Develop and implement data management strategies to ensure data quality, consistency, and accuracy.
  • Collaborate with cross-functional teams, including to identify data requirements and develop data models.
  • Develop, adhere, and enforce data governance policies and procedures to ensure compliance.
  • Monitor data quality and develop response mechanisms to address problems.
  • Collaborate with IT teams to ensure the availability, reliability, and performance of data systems and infrastructure.
  • Develop documentation related to data management processes, procedures, and data dictionaries.
  • Stay up to date with industry trends and advancements in data management technologies and techniques.
  • Maintain the current state legacy Microsoft environment and processing, which includes troubleshooting production issues and implementing tactical enhancements where needed.
  • As needed, collaborate with external contractors to enhance data solutions. Coordinate their work, provide guidance, and ensure alignment with project goals.

Qualifications:

Education/Experience

  • Education and Experience:
  • Technical Skills:
  • Data Privacy and Security:
  • Problem-Solving and Analytical Skills:
  • Effective Communication:
  • Positive Attitude and Adaptability:
  • Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
  • Proven experience working as a Data Engineer or in a similar role, preferably within the insurance or financial sector.
  • Strong understanding of data management principles, including data modeling, schema design, and data lineage.
  • Knowledge of data quality assurance techniques and best practices.
  • Familiarity with data governance frameworks and policies.
  • Proficiency in data warehousing concepts and hands-on experience with Azure services (e.g., Azure Data Factory, Azure Synapse Analytics, Azure SQL Database).
  • Ability to design and implement ETL processes using Azure tools.
  • Proficiency in SQL for data manipulation and querying.
  • Experience with Python for data transformation and scripting.
  • Familiarity with ETL frameworks (e.g., Apache Spark, Talend).
  • Solid understanding of regulatory requirements such as GDPR and HIPAA.
  • Ability to implement data privacy controls and ensure secure data handling.
  • Excellent ability to analyze complex data sets, troubleshoot issues, and optimize data workflows.
  • Creative problem-solving mindset to address data-related challenges.
  • Strong interpersonal skills to collaborate with cross-functional teams.
  • Ability to convey complex technical ideas clearly to both technical and non-technical stakeholders.
  • A can-do mindset and willingness to tackle challenges head-on.
  • Adaptability to evolving technologies and business needs.
  • Data Processing and Analytics:
  • Data Governance and Security:
  • Monitoring and Troubleshooting:
  • Scripting and Automation:
  • Effective Communication and Collaboration:
  • Continuous Learning and Adaptability:
  • Support and maintenance for legacy technologies
  • Azure Data Factory: Ability to design and implement data integration workflows using Azure Data Factory.
  • Azure Data Lake Storage: Familiarity with managing data in Azure Data Lake Storage.
  • Azure SQL Data Warehouse: Expertise in designing and optimizing data warehousing solutions using Azure SQL Data Warehouse.
  • Azure Data Lake Analytics: Understanding of data processing using Azure Data Lake Analytics.
  • Big Data Technologies: Knowledge of big data frameworks (e.g., Apache Spark, Hadoop) within Azure.
  • Data Governance Principles: Awareness of data governance best practices within Azure.
  • Access Control: Understanding of role-based access control (RBAC) and permissions management.
  • Data Privacy Compliance: Knowledge of compliance requirements (e.g., GDPR, HIPAA) related to data privacy and security.
  • Azure Data Factory Monitoring: Skills in monitoring, optimizing, and troubleshooting data pipelines within Azure Data Factory.
  • Diagnostic Logging: Familiarity with diagnostic logs and metrics for Azure services.
  • PowerShell or Python: Proficiency in scripting languages (PowerShell or Python) for automating tasks within Azure.
  • Cross-Functional Teams: Strong communication skills to collaborate effectively with data scientists, analysts, and business stakeholders.
  • Technical Documentation: Ability to document data solutions clearly.
  • Stay Updated: Proactively keep up with the latest Azure data services, features, and advancements.
  • Adaptability: Be ready to embrace new technologies and adapt to evolving business needs.
  • Microsoft SQL Server: Knowledge of SQL Server for data warehousing and relational databases.
  • T-SQL: Proficiency in Transact-SQL (T-SQL) for querying and managing data.
  • Understanding of operating systems such as:
  • Microsoft Windows
  • Linux
  • UNIX
Your application will include the following questions:

What's your expected monthly basic salary?

How many years' experience do you have as a Data Engineer?

ECLARO is an IT and Business Consulting Firm which was founded in the United States in 1999 and has offices in the US, Canada, Puerto Rico and here in the Philippines. We support a number of our American and other global clients from our office in Quezon City. ECLARO's core competency can be found in the recruitment, management, and administration of deploying contingent staff of highly skilled individuals in these specialized disciplines. ECLARO has developed a flexible array of service offerings from project work, to staff augmentation, permanent placement, outplacement, HR outsourcing, payroll and training.

ECLARO is an IT and Business Consulting Firm which was founded in the United States in 1999 and has offices in the US, Canada, Puerto Rico and here in the Philippines. We support a number of our American and other global clients from our office in Quezon City. ECLARO's core competency can be found in the recruitment, management, and administration of deploying contingent staff of highly skilled individuals in these specialized disciplines. ECLARO has developed a flexible array of service offerings from project work, to staff augmentation, permanent placement, outplacement, HR outsourcing, payroll and training.

Don't provide your bank or credit card details when applying for jobs.

#J-18808-Ljbffr

  • Project Engineer

    2 weeks ago

    Manila, National Capital Region, Philippines The Chemical Engineer Full time

    ABOUT UNILEVERUnilever is the place where you can bring your purpose to life with the work that you do – creating a better business and a better world. You will work on brands that are loved and improve the lives of our consumers and the communities around us. You will lead innovations, big and small, that will make our business win and grow. You will...

  • Lead Data Engineer

    2 weeks ago

    Manila, National Capital Region, Philippines Eclaro Business Solutions Incorporated Full time

    Lead Data Engineer Receive a Warm Welcome with Our Joining BonusWork details: Full onsite, Night shift 9PM-6AM, Full time roleDuties/Responsibilities:Design and maintain a scalable and secure Azure data warehouse. Build data pipelines: Create and manage data integration processes, including data extraction, transformation, and loading (ETL) from various...

  • Data Engineer

    2 weeks ago

    Manila, National Capital Region, Philippines Michael Page Philippines Full time

    About Our Client The company is a leading business in the retail sector, focused on growth and expansion. Job Description Design, develop, and support data pipelines, warehouses, data models, and reporting systems to tackle marketing impact, performance analysis and new campaign opportunities.Troubleshoot existing data setups to uncover data transformation...

  • Data Engineer

    4 weeks ago

    Manila, National Capital Region, Philippines Michael Page Philippines Full time

    About Our Client The company is a leading business in the retail sector, focused on growth and expansion. Job Description Design, develop, and support data pipelines, warehouses, data models, and reporting systems to tackle marketing impact, performance analysis and new campaign opportunities.Troubleshoot existing data setups to uncover data transformation...

  • Data Engineer

    2 weeks ago

    Manila, National Capital Region, Philippines Michael Page Full time

    About Our Client The company is a leading business in the retail sector, focused on growth and expansion. Job DescriptionDesign, develop, and support data pipelines, warehouses, data models, and reporting systems to tackle marketing impact, performance analysis and new campaign opportunities.Troubleshoot existing data setups to uncover data transformation...

  • Data Platforms Lead

    2 weeks ago

    Manila, National Capital Region, Philippines Advanced Energy Full time

    Management (Information & Communication Technology) Develop a roadmap for the Data Analytics Platform by collaborating with technology stakeholders and peersDrive the technical vision, select the technology stack, and identify emerging technologies for Foundational and Advanced AnalyticsBuild a business case for data platform transformation and investment...

  • Lead Data Engineer

    2 weeks ago

    Manila, National Capital Region, Philippines 3Cloud Full time

    Are you looking for a role that motivates and challenges you? Are you ready for an opportunity for growth? Do you want to work on teams where people roll up their sleeves to take on tough problems together, and regularly blow the doors off our clients with their outstanding teamwork? If you answered yes to those questions, 3Cloud might just be for youAt...

  • Data Engineer

    4 weeks ago

    Manila, National Capital Region, Philippines Deloitte SEA Full time

    Data Engineer (Azure) Consultant for Deloitte Consulting Philippines Delivery CenterAre you ready to unlock your potential?At Deloitte, our mission is to create a meaningful impact for our clients, our team, and the communities we engage with.We believe in the power of being a positive force for change, and our WorldImpact initiatives are dedicated to...

  • Data Engineer

    1 month ago

    Manila, National Capital Region, Philippines Deloitte SEA Full time

    Data Engineer (Azure) Consultant for Deloitte Consulting Philippines Delivery CenterAre you ready to unlock your potential?At Deloitte, our mission is to create a meaningful impact for our clients, our team, and the communities we engage with.We believe in the power of being a positive force for change, and our WorldImpact initiatives are dedicated to...

  • Data Engineer

    2 weeks ago

    Manila, National Capital Region, Philippines Deloitte SEA Full time

    Data Engineer (Azure) Consultant for Deloitte Consulting Philippines Delivery CenterAre you ready to unlock your potential?At Deloitte, our mission is to create a meaningful impact for our clients, our team, and the communities we engage with.We believe in the power of being a positive force for change, and our WorldImpact initiatives are dedicated to...

  • Analyst (Data Validation)

    2 weeks ago

    Manila, National Capital Region, Philippines DATA MART Consulting GmbH Full time

    Company DescriptionM3 Global Research, part of M3 Inc., provides the most comprehensive and highest quality market research recruitment and support services available to the industry with relationships reaching respondents in more than 70 countries worldwide.M3 Global Research maintains ISO 26362 and 27001 certifications with the highest quality data...

  • Data Engineer

    2 weeks ago

    Manila, National Capital Region, Philippines Opswerks Full time

    We're looking for a Data Engineer to join our growing and mission driven Data Science team.About the jobAs a Data Engineer working in Product Services Group (PSG)'s Data Science Team you will:Build scalable data infrastructure and understand distributed systems concepts from a data storage and compute perspectiveBuild different types of data warehousing...

  • Data Engineer

    4 weeks ago

    Manila, National Capital Region, Philippines US Fair Group Full time

    We USA Fair Group Inc. Located in New York City are searching for an accountable, multitalented data engineer and IT Technician to facilitate the operations of our data scientists in the Philippines . The data engineer will be responsible for employing machine learning techniques to create and sustain structures that allow for the analysis of data while...

  • Data Engineer

    2 months ago

    Manila, National Capital Region, Philippines US Fair Group Full time

    We USA Fair Group Inc. Located in New York City are searching for an accountable, multitalented data engineer and IT Technician to facilitate the operations of our data scientists in the Philippines . The data engineer will be responsible for employing machine learning techniques to create and sustain structures that allow for the analysis of data while...

  • Data Engineer

    4 days ago

    Manila, National Capital Region, Philippines Malayan Insurance Co., Inc. (MICO) Full time

    The Data Engineer is responsible for designing, building, and maintaining the data architecture and infrastructure that supports data-driven applications and systems.This includes creation & management of data pipelines that transform and transport data from various sources to data warehouses or other target systems; ensure data quality, security, and...

  • Enterprise Data Architect Lead

    2 weeks ago

    Manila, National Capital Region, Philippines Advanced Energy Full time

    Mathematics, Statistics & Information Sciences (Science & Technology) Create AEI's Data Architecture vision covering all Data & Analytics components, enterprise-wide baseline and target data architectures.Support in Data & Analytics solutions and product development as Data architect in terms of Data architecture, standards, best practices, assets and...

  • Chief Engineer – Data Centres – Philippines

    2 weeks ago

    Manila, National Capital Region, Philippines Macdonald & Company Full time

    Job Summary:A leading data centre developer is seeking a highly skilled and experienced Chief Engineer to lead the technical operations of their state-of-the-art data center in Manila. As the Chief Engineer, you will be responsible for overseeing the design, maintenance, and efficient operation of the data center's infrastructure, ensuring optimal...

  • Data Engineer

    2 weeks ago

    Manila, National Capital Region, Philippines GECO Asia Pte Ltd Full time

    We are looking for a skilled Data Engineer to join our team and help design and maintain robust data pipelines and systems. Responsibilities:Collaborate with business units to understand data needs and translate them into scalable AWS solutions.Design, develop, and maintain data pipelines using AWS services (Glue, S3, Lambda, RedShift, etc.).Implement data...

  • Data Engineer

    2 weeks ago

    Manila, National Capital Region, Philippines Onebyzero Full time

    Manila, Philippines | Posted on 03/07/2024 State/Province National Capital Region (Manila) Country Philippines Job Description The ability to design, implement, and optimize large-scale data and analytics solutions on Snowflake Data Engineering Implementing ETL pipelines within and outside of a data warehouse using Python and Snowflake SnowSQL ...

  • Lead Software Engineer

    2 weeks ago

    Manila, National Capital Region, Philippines Metacom BPO Full time

    Metacom Solutions is looking for a Lead Software Engineer to join their team. Here are the details:Must-Haves:Minimum of 3 years of experience leading a technical teamMinimum of 8 years of hands-on software engineering experienceExperience in leading software engineering, front-end web, systems integrations, API, back-end batch processing, and/or ETL...