Menu Close

Cape Town City Centre: Senior Data Engineer

Cape Town City Centre: Senior Data Engineer

Posted on 2025-05-02 00:00:00

Job Summary

You wont just support data systems – youll reshape them. This role is central to migrating from legacy on-prem environments to a cutting-edge lake house architecture. Youll lead the charge in designing scalable pipelines, building real-time data flows, and mentoring future data leaders – all while leveraging the latest in cloud technologies. Duties: Design, build, and maintain robust pipelines in hybrid environments (on-prem & cloud). Lead the migration of systems to cloud lake house platforms like Delta Lake or Apache Hudi. Implement real-time streaming solutions using Kafka or RabbitMQ. Optimize SQL queries and database structures for performance and scale. Develop scalable data models for cloud-native analytics. Collaborate across teams to integrate data sources into a single platform. Mentor junior engineers and foster a culture of technical excellence. Stay ahead of industry trends and guide architectural evolution. Job Experience & Skills Required: Qualifications: Matric (Grade 12) Qualification in Computer Science or Software Engineering. Experience: 5 years in data engineering or related roles. Strong SQL skills (queries, optimization, stored procedures). Proficient in Python, Java, or Scala. Experience with cloud platforms like AWS Redshift, Azure Synapse, or Google BigQuery. Hands-on knowledge of lake house technologies (Delta Lake, Apache Iceberg, etc.). Expertise in streaming platforms (Kafka, RabbitMQ). Skilled in both on-prem and cloud data modelling. Confident mentoring and guiding junior team members. Experience with big data frameworks (Spark, Flink, Hadoop). Knowledge of Docker, Kubernetes, and CI/CD for data workflows. Real-time analytics and event-driven architectures in cloud settings. Experience with cloud cost optimization and hybrid data environments. Proficiency in C#, Bash, or PowerShell scripting Terraform or other IaC tooling. Skills & Competencies: Strong experience with cloud data services such as AWS Redshift, Azure Synapse, or Google BigQuery, along with the ability to design, build, and optimize scalable cloud-based data pipelines. Expertise in SQL for querying, optimization, and stored procedures, as well as designing data models that support both on-premises and cloud-based systems. Proficiency in real-time data streaming using platforms like Kafka or RabbitMQ, ensuring efficient and scalable data flows for high-performance systems. Strong ability to mentor junior engineers, fostering a collaborative team environment and helping others build their skills and expertise in cloud data engineering. Continuous learning and staying updated on the latest cloud technologies and lake house architectures (e.g., Delta Lake, Apache Iceberg) to ensure the team is at the forefront of industry standards. If you have not had any response in two weeks, please consider the vacancy application unsuccessful. Your profile will be kept on our database for any other suitable roles / positions.

View Job  East London: POS Installation & Support Technician - East London

Click Go Apply to apply online!


Get Similar Job Alerts
Enter your WhatsApp number (e.g., +27740908132)
You'll receive alerts for new jobs in Cape Town City Centre, Cape Town Region

Apply directly for this position. Please read all instructions carefully.

We do not process job applications; we simply aggregate and display job listings.

More related positions


Cape Town: Google Ads Manager – Urgent Hire posted by Imatik Ltd

? Job Opportunity Google Ads Specialist Retainer Extra Income Can work around a FT existing role ?Are you a skilled Google Ads expert with 1-2 years of...


View Job
Google Ads Manager – Urgent Hire

Cape Town: Junior Consultant posted by Acquirely

Junior Consultant Remote - Sales Appointment SettingSalary R23,000 commissionOTE R30,000 R50,000month 2.5 per saleLocation Remote Work for a U.S....


View Job
Junior Consultant

Cape Town: Customer Support Manager – Entry Level posted by Right Kareer

Youll be the voice of our brand, communicating with customers, identifying their needs, and delivering a top-notch experience. Youll be the superhero they...


View Job
Customer Support Manager – Entry Level

Cape Town: Sales Rep posted by Alifurn Outdoor Furniture

Looking for a Sales Rep Furniture IndustryWere looking for a dynamic and driven sales representative to join our team! The role is based at our showroom in...


View Job
Sales Rep

Cape Town: DevOps Engineer (Support) posted by Construct Executive Search

Applicants must have the following requirementsMust have a Matric Certificate.Must have 6-8 years of experience as a DevOps Engineer in a software...

View Job  Mokopane: Assistant Production Manager (Grapes) Mokopane Area

View Job
DevOps Engineer (Support)

Cape Town: New Vehicle Sales Executive posted by Intercon Recruitment

Dealership in Cape Town is looking for an experienced New Vehicle Sales Executive, with previous Motor Dealership New Vehicle Sales Experience. Salary Basic...


View Job
New Vehicle Sales Executive

Northern Suburbs: BOILERMAKERS – Based In Cape Town posted by Tom Nel Recruitment

Leading Progressive Manufacturing company seeks a number of Boilermakers urgently for six month contracts.Key experience of 3-5 Years post apprenticeship...


View Job
BOILERMAKERS – Based In Cape Town

Cape Town: National Key Accounts Sales Manager posted by The Individual Touch CC

Generate new additional businessGrow the national customer baseManaging analyzing the national customer baseAnalyzing price decreases suspended business...


View Job
National Key Accounts Sales Manager

Cape Town: Junior Accountant posted by Africa Thinking Management Solutions

Job Advertisement Junior AccountantLocation Cape Town -Observatory Company Africa Thinking Management SolutionsAfrica Thinking Management Solutions is...


View Job
Junior Accountant

Cape Town: Vehicle Chip Repair Technician posted by Chip Magic Technologies (Pty) Ltd

Company DescriptionChip Magic Technologies Pty Ltd are experts in vehicle paint chip repairs and automotive vehicle aesthetic restoration specialists.We...


View Job
Vehicle Chip Repair Technician

Cape Town: Intermediate Financial Administrator posted by Construct Executive Search

Applicants must have the following requirementsMust have a Diploma in Accounting or Bookkeeping.Must have 3-5 years of experience as a Financial...


View Job
Intermediate Financial Administrator

Eastern Cape: Town Planner (JB5167) posted by Kontak Recruitment

Town Planner JB5167 Chintsa, Eastern CapeCompensation Range R40 45 000 CTC per month Negotiable Category EngineeringLead zoning, rezoning, and land use...


View Job
Town Planner (JB5167)

Cape Town: Roof sheeter – Urgently Needed posted by Batt Master Roofing and Guttering

Roof sheeter needed Must be able to remove and install roof sheets etc and waterproofing for maintenance company Work in fascias as wellWork experience a...


View Job
Roof sheeter – Urgently Needed

Cape Town: Litigation Secretary posted by Marais Muller Hendricks Attorneys

Marais Muller Hendricks Inc., a leading law firm in Cape Town, is seeking to appoint an experienced and highly organised Litigation Secretary to join our...


View Job
Litigation Secretary

Cape Town: Sales Administrator – IT Industry posted by The Vocation Station

Are you a proactive and detail-oriented professional with a knack for client service and relationship management in the IT Distribution space? Were looking...


View Job
Sales Administrator – IT Industry

Cape Town: Junior System Support Engineer posted by The Vocation Station

Are you an enthusiastic IT professional with a passion for delivering top-notch support to diverse customers? Our client is looking for a Remote Support...

View Job  Johannesburg: AWS Data Engineer – Johannesburg – R530 to R630 per hour

View Job
Junior System Support Engineer

Cape Town: Electrical Engineer – Building Services posted by Business Recruitment Services

This role requires collaboration with multidisciplinary teams and clients to deliver fit-for-purpose solutions that surpass industry best practices and...


View Job
Electrical Engineer – Building Services

Cape Town: Intermediate SHERQ Officer posted by Construct Executive Search

Applicants must have the following requirementsMust have a Bachelors Degree or National Diploma in Safety Management or Occupational Health and Safety. Must...


View Job
Intermediate SHERQ Officer

Cape Town: Bookkeeper – Restaurant Industry (Salt River) posted by The Vocation Station

About the RoleWere looking for a detail-oriented Bookkeeper to join our clients team and support the financial operations of four businesses under one roof....


View Job
Bookkeeper – Restaurant Industry (Salt River)

Cape Town: Litigation Secretary posted by Cora O’Neil Recruitment Agency

Cape Town City Centre LITIGATION SECRETARY Minimum Requirements-Well presentable and professional preferably female-Excellent verbal communication skills-2...


View Job
Litigation Secretary

Cape Town: Financial Accountant posted by Executive Placings

Travel Management Company is looking for an Accountant to be based in Cape Town. This is a hybrid role.The main purpose of this role is to ensure accuracy...


View Job
Financial Accountant

Cape Town: Regional Manager in Built-in Furniture Manufacturing Industry posted by Home Concept

Home Concept is looking for an experienced Regional Manager to join our team. In this role, youll lead sales, manage operations, and support teams to ensure...


View Job
Regional Manager in Built-in Furniture Manufacturing Industry

Cape Town: Car Rental Agent – Urgent posted by Vogue Personnel

Join Our Team as a Car Rental Agent! Were looking for a dedicated and organized Car Rental Agent to join our dynamic team and play a key role in ensuring...


View Job
Car Rental Agent – Urgent

Cape Town: New Business Consultant posted by Intercon Recruitment

Company based in Cape Town is looking for a Senior New Business Consultant Sales Increase and drive new business with a focus on quality and...


View Job
New Business Consultant

Cape Town: New Vehicle Sales Executive posted by Intercon Recruitment

Dealership in Cape Town is looking for an experienced New Vehicle Sales Executive with previous Motor Dealership New Vehicle Sales Experience. Salary Basic...


View Job
New Vehicle Sales Executive

Share this to someone who needs a job:
Posted in IT / Computing / Software, Jobs in Cape Town City Centre, Jobs in Cape Town Region

More Jobs in Your Area