Job Description
About the Role
As a Technical Lead Senior Data Engineer at our company, you will be responsible for leading large-scale data migrations and identity transformations across multi-petabyte datasets. You will design scalable batch and streaming data pipelines with robust validation and lineage tracking, deliver platform upgrades while ensuring production stability, and implement monitoring, testing, and observability for data pipeline performance and integrity.
Key Responsibilities
- Led large-scale data migrations and identity transformations across multi-petabyte datasets
- Designed scalable batch and streaming data pipelines with robust validation and lineage tracking
- Delivered platform upgrades (JDK, Apache Spark) while ensuring production stability
- Implemented monitoring, testing, and observability for data pipeline performance and integrity
- Owned critical systems, mentored engineers, and led technical design decisions
- Removed delivery blockers and partnered cross-functionally to drive successful outcomes
Requirements
- Min 8 years experience in Data engineering
- Degree or Master degree in Computer Science, Engineering or similar
- Proven expertise in large-scale data migration and ETL pipeline development
- Advance proficiency in Scala and Java with Gradle or Maven
- Experience with Apache Spark, AWS, GCP, Azure, Databricks
Qualifications
None mentioned.
Salary & Benefits
Salary information not specified.
How to Apply
Click the green “Go Apply” button below to apply directly online with the employer.
About IT / Computing / Software Jobs in Cape Town Region
The IT and computing industry in the Cape Town region is generally thriving, with a strong demand for skilled professionals in fields such as software development, data analytics, and cybersecurity. Typically, these roles are found across various sectors, including technology, finance, healthcare, and education. As a result, career opportunities in this field are often diverse and abundant.
In terms of salary ranges, it’s common to find IT and computing professionals earning between R400 000 to R1 200 000 per annum, depending on factors such as experience, company size, and industry sector. However, please note that these figures are broad estimates and may vary significantly based on individual circumstances. For instance, senior roles or those in larger companies tend to command higher salaries, while entry-level positions may be lower.
Common skills required for IT and computing roles include proficiency in programming languages such as Java, Python, or C++, experience with software development methodologies like Agile or Scrum, knowledge of data structures and algorithms, and familiarity with cloud computing platforms. Additionally, many employers also value skills such as data analysis, problem-solving, and communication.
The technology industry is a significant sector that employs IT professionals in Cape Town, followed by the financial services and manufacturing sectors. Other industries that commonly require these roles include education, healthcare, and government.
For those looking to advance their careers in IT and computing, there are various opportunities for professional development. Typically, this involves obtaining relevant certifications, such as CompTIA or Cisco, and staying up-to-date with industry trends through online courses or workshops. Many employers also provide training and mentorship programs to support employee growth. With experience and continuous learning, it’s possible to move into senior roles or specialise in a particular area of expertise.
This information provides general career guidance. Actual salaries and requirements vary by employer.
Explore More Opportunities
[quick_job_alert]
[jobseeker_tips]
How to Apply
Click “GO APPLY NOW” to visit the company’s application page.
Follow their instructions carefully.
JVR Jobs connects you with employers – we don’t process applications directly.
Latest Job Opportunities
[sa_latest_jobs count=”6″ columns=”2″]
Browse Employers
Job Alerts