Data Engineer | Remotive.com

Join The Most Talented Data Engineering Team in the Country!  

Now Is Your Chance To Be A Part of The Ongoing AI Revolution!

Teraflow is on the lookout for Mid to Senior Data Engineers to design and implement data pipelines, integrate data from various sources, and ensure data quality and security. The role includes training and collaborating with team members, as well as working closely with other data scientists, software engineers, and product managers.

If you are serious about growing your skill, working with the best and growing at speed – our structure and culture is designed to support and develop the best global talent! 

We require that you have:

• Experience with data warehousing, ETL, and big data technologies.

• Strong leadership and communication skills.

• The ability to translate a roadmap into technical stories, to be broken down into tasks

This is why we are on the lookout for A-Players…

We are currently on the lookout for A-player consultants in the Data Engineering space to help support our global clientbase with the necessary skills to make AI and digital transformation a reality. 

You will be working on fixed-scope, fixed-timeline projects across AWS and GCP for large national and international customers, including banks, airlines, medical aid providers and telecommunications companies.

We also have fully remote, hybrid and office based (Johannesburg and Cape Town) arrangements available. And we offer opportunities for upskill:

• We pay for you to take your cloud certifications

• We allow for you to study for cloud certifications on company time

• We run weekly internal knowledge sharing sessions

If you’re a Mid or Senior-level data engineer that is looking for a change of pace, development and direction, then see if this role is the right fit for you

Mid-Level Data Engineer

Required Experience 

• Hands-on experience in building ETL pipelines on Big Data, using modern cloud Data Engineering tools (1+ years):

• Object Oriented Python programming (2+ years)

• Working knowledge of PySpark (preferred) or Apache Beam

  • Efficient use of the PySpark DataFrame API

  • Knowledge of big data file formats (Parquet, ORC, AVRO) and partitioning strategies

• Hands-on experience in writing SQL queries (2+ years)

  • ANSI-SQL (preferred)

  • Postgresql (preferred)

  • MS-SQL

  • MySQL

  • Oracle

• Database experience

  • Amazon Redshift

  • Google BigQuery

  • Or equivalent

• Infrastructure as code:

  • Terraform (preferred)

  • Cloudformation

  • AWS CDK

• Hands on experience in making use of additional cloud services:

  • AWS Lambda (highly important)

  • AWS IAM (highly important)

    • Cross account roles

    • IAM policies

  • Amazon S3 (highly important)

  • AWS Step Functions (important)

  • Amazon SQS

  • Amazon SNS

  • Amazon DynamoDB

  • Amazon Kinesis is a plus

• Architectural thinking is a plus!

• Scalability, security, fault-tolerance

Required Qualifications and Experience

Senior Data Engineer

Required Experience 

• Hands-on experience in building ETL pipelines on Big Data, using modern cloud Data Engineering tools (3+ years):

• Object Oriented Python programming (5+ years)

• Working knowledge of PySpark (preferred) or Apache Beam

  • Efficient use of the PySpark DataFrame API

  • Knowledge of big data file formats (Parquet, ORC, AVRO) and partitioning strategies

• Hands-on experience in writing SQL queries (5+ years)

  • ANSI-SQL (preferred)

  • Postgresql (preferred)

  • MS-SQL

  • MySQL

  • Oracle

• Database experience

  • Amazon Redshift

  • Google BigQuery

  • Or equivalent

• Infrastructure as code:

  • Terraform (preferred)

  • Cloudformation

  • AWS CDK

• Hands on experience in making use of additional cloud services:

  • AWS Lambda (highly important)

  • AWS IAM (highly important)

    • Cross account roles

    • IAM policies

  • Amazon S3 (highly important)

  • AWS Step Functions (important)

  • Amazon SQS

  • Amazon SNS

  • Amazon DynamoDB

  • Amazon Kinesis is a plus

• Ability to scope a Data Solution end-to-end

• Scalability, security, fault-tolerance

Required Qualifications and Experience

Why Should You Apply? 

We have a number of captivating reasons.

Including the exponential growth that you will experience.

We are working on the assumption that you’re an A-Player in your field. So we’re offering you something a bit different. A bit less run-of-the-mill.

Our internal brand mission is to Leverage Yourself. And we have created a working environment that is designed to do just this: 

(*Leverage means moving from a 1:1 output to a 1:N, where N is exponential)

1. We have a decentralised business model that gives you the freedom, autonomy and responsibility to make an impact in the tech space.  

2. Our culture is built on a set of principles that places staff before customers and driven by a healthy obsession for creating real customer value. 

3. We have a mentorship-over-management approach which empowers you to make important decisions with the right support. 

4. Your career path should be determined by you, not us. Teraflow’s role is to support you in your journey, so we’ve flipped the traditional HR model to a self-determined performance approach. The more you learn to leverage yourself, the faster you grow.  

5. We are a remote-first business with head offices in London, Johannesburg, and Cape Town offices. 

Send Us Your CV & Accelerate Your Career!

Do you feel like this position and our culture is a perfect fit for you?

Then don’t hesitate! Get in touch with us

If you’re not totally convinced, then please take a glance at our resources:

If we like your CV, you will be invited to a screening interview, followed by one or more technical interviews*. If you make it past the technical interviews, we follow the topgrading interview process for culture fit.

* Please note that your technical interview will include a live coding component.