Cape Town City Centre: Senior Data Engineering Technical Lead

January 16, 2026 Jobs in Cape Peninsula

Cape Town Region

IT / Computing / Software

Job Description

About the Role

You’ll combine deep technical expertise with leadership, guiding engineers, shaping architecture, and delivering mission-critical data solutions that power real business outcomes. If you’re passionate about data engineering, ownership, and building systems that truly matter, this is the role for you.

Key Responsibilities

Design and deliver large-scale data migration strategies supporting identity transformation across multi-petabyte datasets
Develop robust data lineage mapping and validation frameworks to ensure accuracy and integrity
Build scalable batch and streaming data transformation pipelines with parallel orchestration
Lead JDK and Apache Spark upgrades while maintaining production stability
Implement monitoring and observability to ensure data pipeline performance and system health
Create comprehensive testing and validation frameworks for complex migration scenarios

Requirements

Minimum 8 years experience in data engineering or related engineering roles
Bachelors or Masters degree in Computer Science, Engineering, or equivalent practical experience
Proven expertise in large-scale data migration and ETL pipeline development
Advanced proficiency in Scala and Java using Gradle or Maven
Deep experience with Apache Spark and distributed storage systems (HDFS, S3, and GCS)
Production experience with cloud data platforms, including Amazon Web Services, Google Cloud Platform, Microsoft Azure, or Databricks
Hands-on experience with Amazon EKS and containerised workloads

Qualifications

Completed Masters degree in Computer Science, Engineering, or related field (Bachelors may be considered for exceptional candidates)

Salary & Benefits

(No information available)

How to Apply

Click the green “Go Apply” button below to apply directly online with the employer.

View Job Johannesburg: Bachelor Degree Data Warehouse Engineer/Developer/Analyst posted by Diverse Consulting Solutions

About IT / Computing / Software Jobs in Cape Town Region

The IT and computing industry in the Cape Town region is generally thriving, with a strong demand for skilled professionals in fields such as software development, data analytics, and cybersecurity. Typically, these roles are found across various sectors, including technology, finance, healthcare, and education. As a result, career opportunities in this field are often diverse and abundant.

In terms of salary ranges, it’s common to find IT and computing professionals earning between R400 000 to R1 200 000 per annum, depending on factors such as experience, company size, and industry sector. However, please note that these figures are broad estimates and may vary significantly based on individual circumstances. For instance, senior roles or those in larger companies tend to command higher salaries, while entry-level positions may be lower.

Common skills required for IT and computing roles include proficiency in programming languages such as Java, Python, or C++, experience with software development methodologies like Agile or Scrum, knowledge of data structures and algorithms, and familiarity with cloud computing platforms. Additionally, many employers also value skills such as data analysis, problem-solving, and communication.

The technology industry is a significant sector that employs IT professionals in Cape Town, followed by the financial services and manufacturing sectors. Other industries that commonly require these roles include education, healthcare, and government.

For those looking to advance their careers in IT and computing, there are various opportunities for professional development. Typically, this involves obtaining relevant certifications, such as CompTIA or Cisco, and staying up-to-date with industry trends through online courses or workshops. Many employers also provide training and mentorship programs to support employee growth. With experience and continuous learning, it’s possible to move into senior roles or specialise in a particular area of expertise.

View Job Cape Town City Centre: Microsoft Power Platform & SharePoint Developer

This information provides general career guidance. Actual salaries and requirements vary by employer.

GO APPLY NOW

Safe & secure application process