Data Engineering Consultant — AI
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
By continuing, you agree to our Terms & Privacy Policy.
This role is under Proactive Hiring.
Explore With Us
Are you looking to grow your career and make a meaningful impact? Interested to tackle new challenges? We’re looking for people like you
The Proactive Hiring process is specifically designed for applicants who are seeking job opportunities at a later date. Applying for roles under Proactive Hiring means that you are applying for roles without immediate vacancies. However, we anticipate that we will need to hire for these roles in the next few months .
Here’s what you can expect when applying for a Proactive Hiring role:
- Merit-based Evaluation : Your application will still undergo our standard skills- and values-based assessments.
- Longer Lead Time : Turnaround time for processing Proactive Hiring applications may take longer than for Immediate Hiring applications, making it suitable for folks open to exploring opportunities
- Reserved Slot as a Priority Candidate : A successful application will result in a slot as one of our top candidates for the role. This is not yet a formal job offer , but expresses our intent to extend an offer to you once a vacancy becomes available.
- First In Line for the Job : Once there is an active vacancy for the role, you will be one of the first people we contact and to whom we extend an official offer
At Thinking Machines, we treat all our candidates with great care and fairness while ensuring we stay ahead of the curve to anticipate our clients’ needs.
Working at Thinking Machines
Thinking Machines is a technology consultancy building AI & data platforms to solve high-impact problems for our clients. Our vision is a future where data-driven decision-making is a norm and where AI is used to support humans in making excellent decisions. To do that, we create data cultures, one organization at a time.
We’re a company made up of intellectually curious, civic-minded, forever-learning individuals. We believe that great data science products are built with care for people and that the best way to drive inclusive innovation is to start with a diverse team.
Our field of work is incredibly dynamic, so we want to work with people who are committed to growing with us. We want to hire people who can demonstrate an ability to learn, then provide personalized coaching, growth opportunities, and a great working environment to get them to world-class.
Role Description
Data science ain’t data science without data. As an Engineering Consultant (Data Engineering), you will collect and consolidate data from various sources, secure them and transform them into useful forms so that you and your team can work data science magic on them. From a security perspective, we work with many confidential datasets, so make sure that Eve and Trudy don't get their grubby paws on them.
You will be responsible for building systems for collecting, transforming, and storing data. This can range from writing a short script that periodically calls an API, to creating a website scraper, to architecting and building a complete data collection and data warehousing system.
On a normal day, you might be architecting an analytics platform for a SaaS company, debugging a data ETL pipeline for an international NGO, and optimizing then deploying a machine learning model to TensorFlow mobile.
You'll be expected to help out on engineering tasks that may come up in any department. Since the tech space can get crazy, we are looking for someone who is up for any kind of challenge and has the initiative to seek out ways to be useful. We move fast, and we expect you to keep up
We’re looking for someone who has:
- 3+ years of work experience in a data engineering or software engineering role.
- Proficiency in Python programming language, SQL, and Airflow — Postgres is our favorite flavor of RDBMS, but you have to be ready to use tools such as dbt, BigQuery, and Snowflake. You must be very comfortable with writing and explaining code.
- Experience managing various cloud environments — Especially IaaS such as Amazon Web Services (AWS) and Google Cloud Platform (GCP). Bonus points if you love MS Azure
- Experience working with Google and/or Azure stack — Big points if you’re comfortable with BigQuery, Dataflow, TensorFlow, Azure Data Factory, Databricks and other similar tools. More bonus points if you know how to handle data that doesn’t fit your machine’s RAM
- Security-conscious mindset — Handling client data is part of our daily job. We have security guidelines and protocols in place b