Spark Engineer

13 hours ago

Manila One World Square, Philippines CAI Full time $80,000 - $120,000 per year
Spark Engineer

Req number:

R6280

Employment type:

Full time

Worksite flexibility:

RemoteWho we are

CAI is a global technology services firm with over 8,500 associates worldwide and a yearly revenue of $1 billion+. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients, colleagues, and communities. As a privately held company, we have the freedom and focus to do what is right—whatever it takes. Our tailor-made solutions create lasting results across the public and commercial sectors, and we are trailblazers in bringing neurodiversity to the enterprise.

Job Summary

As a Spark Engineer, you will design, build, and optimize large-scale data processing systems using Apache Spark. You will collaborate with data scientists, analysts, and engineers to ensure scalable, reliable, and efficient data solutions.

Job Description

We are looking for a Spark Engineer with deep expertise in distributed data processing, ETL pipelines, and performance tuning for high-volume data environments. This position will be full-time and remote.

What You'll Do:

  • Design, develop, and maintain big data solutions using Apache Spark (Batch and Streaming).

  • Build data pipelines for processing structured, semi-structured, and unstructured data from multiple sources.

  • Optimize Spark jobs for performance and scalability across large datasets.

  • Integrate Spark with various data storage systems (HDFS, S3, Hive, Cassandra, etc.).

  • Collaborate with data scientists and analysts to deliver robust data solutions for analytics and machine learning.

  • Implement data quality checks, monitoring, and alerting for Spark-based workflows.

  • Ensure security and compliance of data processing systems.

  • Troubleshoot and resolve data pipeline and Spar k job issues in production environments

What You'll Need

Required:

  • Bachelor's degree in Computer Science, Engineering, or related field (Master's preferred).

  • 3+ years of hands-on experience with Apache Spark (Core, SQL, Streaming).

  • Strong programming skills in Scala, Java, or Python (PySpark).

  • Solid understanding of distributed computing concepts and big data ecosystems (Hadoop, YARN, HDFS).

  • Experience with data serialization formats (Parquet, ORC, Avro).

  • Familiarity with data lake and cloud environments (AWS EMR, Databricks, GCP DataProc, or Azure Synapse).

  • Knowledge of SQL and experience with data warehouses (Snowflake, Redshift, BigQuery is a plus).

  • Strong background in performance tuning and Spark job optimization.

  • Experience with CI/CD pipelines and version control (Git).

  • Familiarity with containerization (Docker, Kubernetes) is an advantage.

Preferred:

  • Experience with stream processing frameworks (Kafka, Flink).

  • Exposure to machine learning workflows with Spark MLlib.

  • Knowledge of workflow orchestration tools (Airflow, Luigi).

Physical Demands

  • Ability to safely and successfully perform the essential job functions

  • Sedentary work that involves sitting or remaining stationary most of the time with occasional need to move around the office to attend meetings, etc.

  • Ability to conduct repetitive tasks on a computer, utilizing a mouse, keyboard, and monitor

Reasonable accommodation statement

If you require a reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employment selection process, please direct your inquiries to or – 8111.

  • Data Engineer

    7 days ago

    Manila, Philippines Unison Group Full time

    Overview We are seeking a skilled Data Engineer to join our team in Singapore. The ideal candidate will have strong expertise in SQL, Python, Spark, and Hive , with hands-on experience building scalable data pipelines, data models, and analytical solutions. You will work closely with data scientists, analysts, and business stakeholders to deliver...

  • Data Engineer

    7 days ago

    Manila, Philippines Unison Group Full time

    Overview We are looking for a skilled Data Engineer with 5 years of hands-on experience in designing, developing, and optimizing big data pipelines and solutions. The ideal candidate will have strong expertise in SQL, Python, Apache Spark, Hive, and Hadoop ecosystems and will be responsible for building scalable data platforms to support business...

  • Data Engineer

    2 days ago

    Manila, National Capital Region, Philippines Unison Group Full time ₱900,000 - ₱1,200,000 per year

    We are seeking a skilled Data Engineer to join our team in Singapore. The ideal candidate will have strong expertise in SQL, Python, Spark, and Hive, with hands-on experience building scalable data pipelines, data models, and analytical solutions. You will work closely with data scientists, analysts, and business stakeholders to deliver high-quality data...

  • Data Engineer

    2 days ago

    Manila, National Capital Region, Philippines The Citco Group Limited Full time

    Position: Data Engineer (Databricks & AWS)Company Overview Citco is a global leader in financial services, delivering innovative solutions to some of the world's largest institutional clients. We harness the power of data to drive operational efficiency and informed decision-making. We are looking for a Data Engineer with strong Databricks expertise and AWS...

  • Data Engineer

    2 days ago

    Manila, National Capital Region, Philippines Unison Group Full time ₱900,000 - ₱1,200,000 per year

    Role OverviewWe are looking for a skilled Data Engineer with 5 years of hands-on experience in designing, developing, and optimizing big data pipelines and solutions. The ideal candidate will have strong expertise in SQL, Python, Apache Spark, Hive, and Hadoop ecosystems and will be responsible for building scalable data platforms to support business...

  • Data Engineer

    2 days ago

    Pampanga, Manila, Philippines The Citco Group Full time ₱900,000 - ₱1,200,000 per year

    DescriptionPosition: Data Engineer (Databricks & AWS)Company Overview Citco is a global leader in financial services, delivering innovative solutions to some of the world's largest institutional clients. We harness the power of data to drive operational efficiency and informed decision-making. We are looking for a Data Engineer with strong Databricks...

  • AWS Data Engineer

    2 days ago

    Manila, National Capital Region, Philippines Unison Group Full time ₱900,000 - ₱1,200,000 per year

    Design and build scalable ETL pipelines and data integration workflows using AWS services and Python.Develop and optimize data lake and data warehouse solutions for structured and unstructured data.Leverage Apache Spark for large-scale data processing and transformation tasks.Collaborate with cross-functional teams to gather requirements and deliver clean,...

  • Analytics Data Engineering

    3 weeks ago

    Manila, Philippines LSERV Corporation Full time

    Overview On-site - Manila 1-3 Yrs Exp Bachelor Contract Responsibilities Responsible for designing, developing and maintaining the infrastructure and systems required for data storage, processing and analysis Builds and manage the data pipelines that enable efficient and reliable data integration, transformation and delivery for all data users across the...

  • DevOps Engineer

    2 days ago

    Manila, National Capital Region, Philippines Macquarie Group Full time ₱480,000 - ₱960,000 per year

    Primary office locationManilaDate29-Sep-2025Permanent - Full time, JuniorJob categoryTechnology - Engineering3–5 years' experience in ITSM or related fields, with proficiency in ITSM tools (such as Helix) and ITIL processesHands-on experience in DevOps practices, incident management, root cause analysis and production support, including application...

  • Data Engineer

    3 weeks ago

    , Metro Manila, Philippines The Citco Group Limited Full time

    Data Engineer (Databricks & AWS) Company Overview: Citco is a global leader in financial services, delivering innovative solutions to some of the world's largest institutional clients. We harness the power of data to drive operational efficiency and informed decision‑making. This role contributes to mission‑critical data initiatives. Key Responsibilities...