Western Cape: Senior Data Engineer posted by Salix Recruitment
Posted on 2025-05-02 00:00:00
| Employer | Salix Recruitment |
|---|---|
| Category | Datacapturing |
| Location | Western Cape / Western Cape |
Job Summary
This role is central to migrating from legacy on-prem environments to a cutting-edge lake house architecture. You’ll lead the charge in designing scalable pipelines, building real-time data flows, and mentoring future data leaders – all while leveraging the latest in cloud technologies.
Duties:
- Design, build, and maintain robust pipelines in hybrid environments (on-prem & cloud).
- Lead the migration of systems to cloud lake house platforms like Delta Lake or Apache Hudi.
- Implement real-time streaming solutions using Kafka or RabbitMQ.
- Optimize SQL queries and database structures for performance and scale.
- Develop scalable data models for cloud-native analytics.
- Collaborate across teams to integrate data sources into a single platform.
- Mentor junior engineers and foster a culture of technical excellence.
- Stay ahead of industry trends and guide architectural evolution.
Job Experience & Skills Required:
Qualifications:
- Matric (Grade 12)
- Qualification in Computer Science or Software Engineering.
Experience:
- 5+ years in data engineering or related roles.
- Strong SQL skills (queries, optimization, stored procedures).
- Proficient in Python, Java, or Scala.
- Experience with cloud platforms like AWS Redshift, Azure Synapse, or Google BigQuery.
- Hands-on knowledge of lake house technologies (Delta Lake, Apache Iceberg, etc.).
- Expertise in streaming platforms (Kafka, RabbitMQ).
- Skilled in both on-prem and cloud data modelling.
- Confident mentoring and guiding junior team members.
- Experience with big data frameworks (Spark, Flink, Hadoop).
- Knowledge of Docker, Kubernetes, and CI/CD for data workflows.
- Real-time analytics and event-driven architectures in cloud settings.
- Experience with cloud cost optimization and hybrid data environments.
- Proficiency in C#, Bash, or PowerShell scripting
- Terraform or other IaC tooling.
Skills & Competencies:
- Strong experience with cloud data services such as AWS Redshift, Azure Synapse, or Google BigQuery, along with the ability to design, build, and optimize scalable cloud-based data pipelines.
- Expertise in SQL for querying, optimization, and stored procedures, as well as designing data models that support both on-premises and cloud-based systems.
- Proficiency in real-time data streaming using platforms like Kafka or RabbitMQ, ensuring efficient and scalable data flows for high-performance systems.
- Strong ability to mentor junior engineers, fostering a collaborative team environment and helping others build their skills and expertise in cloud data engineering.
- Continuous learning and staying updated on the latest cloud technologies and lake house architectures (e.g., Delta Lake, Apache Iceberg) to ensure the team is at the forefront of industry standards.
If you have not had any response in two weeks, please consider the vacancy application unsuccessful. Your profile will be kept on our database for any other suitable roles / positions.
Click Go Apply to apply online!
Get Similar Job Alerts
More jobs in Western Cape
More jobs in Western Cape
Browse Datacapturing Jobs
Browse Salix Recruitment Jobs
Apply directly for this position. Please read all instructions carefully.
We do not process job applications; we simply aggregate and display job listings.
More related positions
Western Cape: Outbound Sales Representative posted by Acquirely
Sales Consultant Remote - Appointment SettingSalary R23,000 commissionOTE R30,000 R50,000month 2.5 per saleLocation Remote Work for a US-based...
View Job
Outbound Sales Representative
Western Cape: Sales Development Representative (SDR) – Junior Consultant posted by Acquirely
Sales Development Representative SDR - Junior ConsultantSalary R20,000 commissionOTE R30,000 R50,000month Location Remote Work for a US-based companyHours...
View Job
Sales Development Representative (SDR) – Junior Consultant
Western Cape: Regional Executive (Engineering) posted by Construct Executive Search
Applicants must have the following requirementsMust have a Masters Degree or a Bachelors Degree in Engineering.Must be registered with ECSA as a...
View Job
Regional Executive (Engineering)
Western Cape: Junior Horticulturalist – Safecracker Properties – Start Date ASAP posted by Indigo Properties
Required to oversee a team for installing and maintaining gardens and installations in Cape Town and FranschoekPrerequisite Horticulture Qualification.
View Job
Junior Horticulturalist – Safecracker Properties – Start Date ASAP
Western Cape: Qualified Claims Handler
Minimum Requirements Must have a minimum of 2 years experience as a Claims Handler Administrator in the Short-term Insurance Industry RE5 or NQF 4 in...
View Job
Qualified Claims Handler
Western Cape: Quality Assurance Technician
Minimum Requirements Minimum of 3 years experience as an Information Technology Quality Assurance Technician in the Insurance Industry Relevant Tertiary...
View Job
Quality Assurance Technician
Cape Town City Centre: PHARMACY SALES REPRESENTATIVE â HYBIRD (WESTERN CAPE)
Qualifications and Experience A bachelors degree in business management, marketing, pharmacy, or a related field. Demonstrated success in pharmaceutical...
View Job
PHARMACY SALES REPRESENTATIVE â HYBIRD (WESTERN CAPE)
Cape Town City Centre: Senior Sales Portfolio Manager – Crop Protection / Agrochemical Industry – Western Cape
Minimum requirements for the role A business management or agricultural degree or diploma or related qualification is preferred. Previous sales experience...
View Job
Senior Sales Portfolio Manager – Crop Protection / Agrochemical Industry – Western Cape
South Africa: Parts Sales Executive – Western Cape, Helderberg
Duties Accurately sell parts to address defects and meet customer needs on the first attempt. Ensure initial quotations are precise. Extensive knowledge of...
View Job
Parts Sales Executive – Western Cape, Helderberg
South Africa: Installation Technician – Vehicle Tracking – AA/EE – Western Cape
Installation Technician Vehicle Tracking - AAEE Vredendal, Worcester Surrounds Western Cape Company requires the services of an Installation Technician in...
View Job
Installation Technician – Vehicle Tracking – AA/EE – Western Cape
Western Cape: Structural Engineer
Minimum Requirements Must have a minimum of 6 to 10 years experience as a Structural Engineer in Residential Structural Consulting Tertiary Qualification in...
View Job
Structural Engineer
Blackheath: Sales Executive – Western Cape
Sales Executive Western Cape Are you a hunter, ambitious, self-motivated, confident, and persistent? Do you see yourself being part of a winning team? Look...
View Job
Sales Executive – Western Cape
Cape Town City Centre: SALES REPRESENTATIVE â DISPENSING DOCTORS & PHARMACIES (WESTERN CAPE)
Qualifications Experience Bachelors degree in business management, Marketing, Pharmacy, or a related field. Proven track record in pharmaceutical sales....
View Job
SALES REPRESENTATIVE â DISPENSING DOCTORS & PHARMACIES (WESTERN CAPE)
Western Cape: Chief Financial Officer – CFO
A rapidly expanding company on the scenic Garden Route seeks a qualified and experienced CFO to join its executive board. This strategic leadership role...
View Job
Chief Financial Officer – CFO
Claremont: FINANCE MANAGER (Private Credit: Finance and Fund Administration) – Cape Town, Western Province
FINANCE MANAGER Private Credit Finance and Fund Administration - Cape Town, Western Province Highly Competitive Package on Offer Our client, an innovative...
View Job
FINANCE MANAGER (Private Credit
Western Cape: FIELD RESEARCHERS posted by PLUS 94
A leading Market Research Company seeks to employ the services of FIELD RESEARCHERS across South Africa to work on a project-to-project basis.Applicants...
View Job
FIELD RESEARCHERS
Western Cape: SHIFT WHEAT/HEAD MILLER posted by PAR EXCELLANCE
English-speaking Gr.12 Wheat Miller W-AMaize Miller M-AFumigation Comp.Lit 5 yrs Shift Wheat Miller Head Miller Production Mngrmeet QCcustomer servicesafety...
View Job
SHIFT WHEAT/HEAD MILLER
Western Cape: WHEAT GRADER/SILOMAN posted by PAR EXCELLANCE
MatricMathsAccND FoodChemProdMngt Wheat Grading Grain Fumigation OracleMS Office 3-10 years plancntl dep .budgetminimum stock, efficient running of silos,...
View Job
WHEAT GRADER/SILOMAN
Western Cape: SHIFT GRAIN MILLER/PRODUCTION MNGR posted by PAR EXCELLANCE
WheatMaize Miller W-A or M-A Grain Fumigation5 years of milling experience post trade test. Managing all aspects of 8,5tonhr 31,25 tonhr flour mill....
View Job
SHIFT GRAIN MILLER/PRODUCTION MNGR
Western Cape: Dealership Bookings Clerk
Minimum Requirements Must have a minimum of 2 years experience as a Bookings Clerk within the Automotive Industry Must have a Grade 12 Qualification Strong...
View Job
Dealership Bookings Clerk
Western Cape: Senior Electrical Engineer
Main Responsibilities Serve as the Electrical Engineering Subject Matter Expert for the refinery. Ensure compliance with Electrical Safe Work Practices and...
View Job
Senior Electrical Engineer
Cape Town City Centre: Receptionist – Western Cape
Minimum Requirements Matric Relevant degree will be advantageous At least 5 years relevant experience Well-spoken and fluent in English Switchboard...
View Job
Receptionist – Western Cape
Western Cape: Sr. Engineer posted by Ayers Gulf Recruitment and visa agency
Minimum Requirements Applicable to All Roles Relevant degreediploma in the related engineering discipline 510 years experience in oil gas, petrochemical,...
View Job
Sr. Engineer
South Africa: RB 15345 – Electrical Resident Engineer (Wind Farm) – Western Cape
Employer Description Our client is an electrical contractor. Job Description This is an 18-month contract, based in the Western Cape. Duties Oversee the...
View Job
RB 15345 – Electrical Resident Engineer (Wind Farm) – Western Cape
South Africa: MK 15342 – Environmental Officer (Windfarm) – Western Cape
Employer Description Our client is a contractor specializing in electrical engineering. Job Description Compile basic assessment reports and scoping reports...
View Job
MK 15342 – Environmental Officer (Windfarm) – Western Cape