Spark Engineer

7 days ago

Mandaluyong City, National Capital Region, Philippines CAI (Computer Aid, Inc.) Full time ₱1,200,000 - ₱2,400,000 per year

Req number: R6280

Employment type: Full time

Worksite flexibility: Remote Who we are

CAI is a global technology services firm with over 8,500 associates worldwide and a yearly revenue of $1 billion+. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients, colleagues, and communities. As a privately held company, we have the freedom and focus to do what is right—whatever it takes. Our tailor-made solutions create lasting results across the public and commercial sectors, and we are trailblazers in bringing neurodiversity to the enterprise.

Job Summary As a Spark Engineer, you will design, build, and optimize large-scale data processing systems using Apache Spark. You will collaborate with data scientists, analysts, and engineers to ensure scalable, reliable, and efficient data solutions.

Job Description

We are looking for a Spark Engineer with deep expertise in distributed data processing, ETL pipelines, and performance tuning for high-volume data environments . This position will be full-time and remote.

What You'll Do:

Design, develop, and maintain big data solutions using Apache Spark (Batch and Streaming).

Build data pipelines for processing structured, semi-structured, and unstructured data from multiple sources.

Optimize Spark jobs for performance and scalability across large datasets.

Integrate Spark with various data storage systems (HDFS, S3, Hive, Cassandra, etc.).

Collaborate with data scientists and analysts to deliver robust data solutions for analytics and machine learning.

Implement data quality checks , monitoring, and alerting for Spark-based workflows.

Ensure security and compliance of data processing systems.

Troubleshoot and resolve data pipeline and Spar k job issues in production environments

What You'll Need

Required:

Bachelor's degree in Computer Science, Engineering, or related field (Master's preferred).

3+ years of hands-on experience with Apache Spark (Core, SQL, Streaming).

Strong programming skills in Scala, Java, or Python (PySpark).

Solid understanding of distributed computing concepts and big data ecosystems (Hadoop, YARN, HDFS).

Experience with data serialization formats (Parquet, ORC, Avro).

Familiarity with data lake and cloud environments (AWS EMR, Databricks, GCP DataProc, or Azure Synapse).

Knowledge of SQL and experience with data warehouses (Snowflake, Redshift, BigQuery is a plus).

Strong background in performance tuning and Spark job optimization.

Experience with CI/CD pipelines and version control (Git).

Familiarity with containerization (Docker, Kubernetes) is an advantage.

Preferred :

Experience with stream processing frameworks (Kafka, Flink).

Exposure to machine learning workflows with Spark MLlib.

Knowledge of workflow orchestration tools (Airflow, Luigi).

Physical Demands

Ability to safely and successfully perform the essential job functions

Sedentary work that involves sitting or remaining stationary most of the time with occasional need to move around the office to attend meetings, etc.

Ability to conduct repetitive tasks on a computer, utilizing a mouse, keyboard, and monitor

Reasonable accommodation statement

If you require a reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employment selection process, please direct your inquiries to or – 8111.

  • Data Engineer

    5 days ago

    Makati City, National Capital Region, Philippines NISPI Full time ₱1,440,000 - ₱1,800,000 per year

    A Data Engineer is a data professional who uses their expertise in data engineering and programming to build systems that collect, manage and convert raw data into usable information for business analysts.ResponsibilitiesAs a Data EngineerAnalyze and organize raw dataBuild data systems and pipelinesEvaluate business needs and objectivesInterpret trends and...

  • Data Engineer

    1 week ago

    Mandaluyong City, National Capital Region, Philippines Maya Full time ₱1,500,000 - ₱3,000,000 per year

    TheData Engineeris responsible for the creation, maintenance, and continuous improvement of data pipelines. Part of his/her responsibilities are to implement best practices in data management practices (i.e., cleaning, validation, and transformation of data) make data into usable datasets that can easily be consumed by other teams. This role will also work...

  • Data Engineer

    5 days ago

    Mandaluyong City, National Capital Region, Philippines Stratpoint Technologies Inc Full time $104,000 - $130,878 per year

    Who We AreWe are trusted modern technology leaders in:Agile Software DevelopmentQuality AssuranceCloud Consulting and Managed ServicesData Engineering and AnalyticsArtificial Intelligence and Machine LearningWe use technology to enrich experiences, empower businesses, and uplift communities.Our C.A.R.E. valuesnourish Creativityembody Agilitymanifest...

  • Azure Data Engineer

    5 days ago

    Quezon City, National Capital Region, Philippines Aumtrend Full time ₱1,200,000 - ₱2,400,000 per year

    Role : Azure Data EngineerCompany : One of the Global ClientLocation : Quezon CityShift : Shifting SchedulePermanent role & Direct hiring by the clientJob Description :Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent experience) and able to demonstrate high proficiency in programming fundamentals.Proven experience (3+...

  • Data Engineer

    1 week ago

    Makati City, National Capital Region, Philippines Nezda Technologies Inc Full time ₱900,000 - ₱1,200,000 per year

    Key Responsibilities:Design and build robust, scalable, and efficient data pipelines using Spark (PySpark, Scala, SQL, etc.).Manage and optimize ETL/ELT processes, including data ingestion, transformation, and integration from multiple sources into data lakes and warehouses.Utilize Azure services such as Azure Data Factory, Azure Databricks, Azure Synapse,...

  • Data Engineer

    2 weeks ago

    Makati City, National Capital Region, Philippines Private Advertiser Full time ₱1,500,000 - ₱2,500,000 per year

    Bachelor's degree in Computer Science, Information Technology, Engineering, or a related fieldAt least 5 years of experience in data engineering, ETL/ELT development, or database managementProficient in designing and maintaining data pipelines using SQL, Python, or similar technologies, with strong knowledge of data modeling and warehousing...

  • DevOps Engineer

    3 days ago

    Mandaluyong City, National Capital Region, Philippines Stratpoint Technologies Full time $70,000 - $120,000 per year

    The RoleWe are looking for a DevOps Engineer to be a pivotal member of our engineering team. The candidate will provide consulting services in DevOps, to work with Client teams and drive the DevOps journey. You will be working closely with product managers and developers who like to use lots of interesting technologies to develop core features used across...

  • Data Engineer

    2 weeks ago

    Makati City, National Capital Region, Philippines AIA Australia Full time ₱1,200,000 - ₱2,400,000 per year

    MediCard Phils., Inc. is one of the country's leading HMO and the only HMO founded and run by Doctors. Since its inception, the concept of service-oriented total health care has been the molding ideal of MediCard. The competition is vast, and the benefits being offered by the competitors are tempting. However, MEDICard has taken the lead in providing...

  • Data Engineer

    1 week ago

    Makati City, National Capital Region, Philippines ATOS Information Technology Inc. Full time ₱900,000 - ₱1,200,000 per year

    Role: Data EngineerLocation: Makati CityRole type: Project based (6+ Months with high chances of extension)Schedule: 9AM-6PMWork Setup: Hybrid (3x RTO & 2x WFH)Hire Type: ContractTechnologies: Big Data and data warehouses Azure Databricks (Pyspark, Python, Spark SQL) Azure Data factory Unity Catalog Open AI/Gen AI service Various Azure Resource (e.g.,...

  • DevOps Engineer

    1 week ago

    Makati City, National Capital Region, Philippines ACCPRO INTERNATIONAL Full time ₱840,000 per year

    We're Hiring: DevOps EngineerMakati | Hybrid | Night ShiftFully WFH during the first 4 weeks of onboardingWe're looking for a DevOps Engineer to join our growing technology team In this role, you'll be responsible for providing front-line support for Financial Market applications, managing incidents, changes, and services using ITSM frameworks and tools....