Menu Close

Cape Town: Senior Data Engineer : Ingestions Squad (Group Data & ML Platform Tribe) posted by Progressive IT Resourcing

Senior Data Engineer : Ingestions Squad (Group Data & ML Platform Tribe)

Posted on 2025-04-27 13:18:54

Company Progressive IT Resourcing
Salary 0
Category Other IT/Computer
Location South Africa  /  Western Cape  /  Cape Town

Job Summary

Our Client

Company Group Technology is responsible for the provision of a digitally enabled technology service as a group COE, drive business and transformation and provide group-wide digital and data architecture. We operate the various technology platforms and shared services, ensure Cyber and Information Security resilience, and act as technology governance and risk orchestrator for technology across Company

.What will you do?

A newly created engineering organisation on a mission to empower and accelerate autonomous value creation through insights and ML across the group. Our main users are the data scientists and analysts who sit inside the business units and support them in developing and re-developing their financial and digital products to better meet the needs of our clients and our shareholders. Our other users are the data management and data product teams who produce the data sets analysts and scientists need to launch straight into their work.

The tribe is made up of 3 different engineering squads covering everything from how we ingest and store data, to how we develop and share ML artefacts and insights. We have one for ingestions, one for data storage and processing and one for insights & ML tooling. We have one data engineering talent pipeline for the whole tribe, where placements into specific squads are explored later in the interview process based on squad needs and candidate abilities. Data engineers report to the tech leads of the squad they are embedded into.

What will make you successful in this role?

What success will look like for you 12 months into the role.

  • Built configurable data ingestion platforms to collect and protect data from any source within two weeks or less. The team has bought and built to assemble a tool soup of persistent and secure ingestion tools, optimized for cost efficiency, with reliability as a non-negotiable standard. Success will be measured by the consistent achievement of the two-week ingestion target while maintaining high reliability and security.
  • Engineered the platform for observability and performance. Made your systems observable from the outside, taking ownership of their performance. Facilitated real-time tracking of the systems internal state through logs, metrics, and traces. Defined clear and measurable Service Level Indicators (SLIs) and Service Level Objectives (SLOs), and integrate these into team OKRs to drive excellence. Success will be measured by meeting or exceeding defined performance and reliability benchmarks, and the quick identification and resolution of issues.
  • Engineer the platform with privacy and security by design. Secured the platform through compliance engineering initiatives that reduced the time and cognitive load related to compliance. Implemented our Data Governance and Privacy policies effectively, leveraging encryption, firewalls, VPCs, Role Based Access Control and IAM integrations such as Active Directory. Success will be measured by the platforms adherence to security and privacy standards, with minimal compliance overhead for users.
  • Leveraged containerization and infrastructure as code. Implemented containerization strategies and infrastructure as code (IaC) practices to ensure scalable, repeatable, and efficient deployment of data services. Utilized tools like Docker and Terraform to automate infrastructure management and streamline the development pipeline. Success will be measured by the consistency and reliability of deployments, reduced deployment times, and increased system scalability.
  • Contributed to technology decisions. Engaged in technology spikes to clarify needs and articulate solution criteria. Evaluated different options through hands-on experimentation, leading to documented evaluations and recommendations that were understood by technology leaders or users across the company. Success will be measured by the quality and clarity of your contributions to technology decisions and the adoption of your recommendations.
  • Invested in your own development. Executed on a culture of excellence and continuous improvement for both your part of the platform and your own abilities. Lived our culture of ownership, curiosity, and continuous learning. Participated in pre and post-mortems, sharing lessons learned across the organization along with how you are improving based on those lessons. Success is measured by your active participation in continuous learning initiatives and the tangible improvements in platform performance and personal growth.
  • Technical leadership and coaching. Enable a culture of continuous learning and assist other engineers in their development journey.
View Job  Pretoria: Operations Leader posted by AtripleA recruitment & temps

Qualification

  • Matric
  • National Diploma in an Information Technology related discipline or a bachelor’s degree in computer science, Statistics, Informatics, Information Systems, or a quantitative field will be recommended.

Experience

  • 5+ years’ experience as a data engineer in data platform or service engineering team with at least 2 in a modern context with cloud technologies
  • Track record of high impact and investing in your own development.

Skills and Thinking Preference

  • Ability to act independently and to deal with high levels of ambiguity.
  • You look for ways to do, instead of reasons not to. You are high agency, high ownership in everything you do. You know we own our future, only we can make it happen. If you find something that keeps us from our mission, you own it or work collaboratively with others until you find the right owner of it.
  • Where some see impossible, you see a way. You have the strong conviction in our ability to innovate and bring financial services, and financial confidence to everyone across the continent. You turn obstacles into opportunity, chance into change.
  • You move fast and fix things. You publish early and often, when you fail you learn and go again. You know that speed gives you the licence to fail, because youre moving fast enough to correct course.
  • You love creating more with less. Knowing that the biggest impact is born of the smallest acts, scale is built into your thinking from day 1. This is not about meeting the needs of thousands; its about exceeding the needs of millions. And working through small and mighty teams is way well do it.
  • You seek out and value different perspectives. Believing that when we change how we look at things, how things look for us also changes. Making tomorrow not just different, but better.

Personal Attributes

  • Plans and aligns – Contributing through others
  • Optimises work processes – Contributing through others
  • Collaborates – Contributing strategically
  • Resourcefulness – Contributing strategically
  • Tech savvy – Contributing strategically

Core Competencies

  • Cultivates innovation – Contributing through others
  • Customer focus – Contributing through others
  • Drives results – Contributing through others
  • Collaborates – Contributing through others
  • Being resilient – Contributing through others
Job Seeker Tip

Keep your LinkedIn profile up-to-date and professional - many recruiters use it to find candidates.

Click Go Apply to apply online!

Apply directly for this position. Please read all instructions carefully.

We do not process job applications; we simply aggregate and display job listings.

More related positions


Midrand: Senior Manager Data Engineer posted by Deka Minas (Pty) Ltd

RESPONSIBILITIES

  • Create and execute a long-term strategy for leveraging data and analytics as a key business enabler and competitive differentiator across the business.
  • Take responsibili


    View Job
    Senior Manager Data Engineer

Johannesburg: Senior Manager: Data Science and Business Intelligence posted by Telebest

Our client has an opportunity available for a Senior Manager in the Data Science and Business Intelligence department based in Sandton.

Requirements:


Johannesburg: Senior Data Engineer posted by Deka Minas (Pty) Ltd

Senior Data Enbgineer required in Sandton for a contract. This role is pivotal in driving our data strategy and ensuring the efficient and effective management of our data infrastructure. We are looking for a proactive, innovative, and solution-oriente


View Job
Senior Data Engineer

Johannesburg: Senior Technical Data Analyst posted by PBT Group

A Senior Technical Data Analyst is required to support data-driven initiatives within a dynamic banking environment. The ideal candidate will bring strong analytical expertise, hands-on technical skills, and experience working with cloud platforms (esp


View Job
Senior Technical Data Analyst

South Africa: Senior Data Scientist CH1109) posted by Capital H Staffing and Advisory Solutions

Are you passionate about turning data into actionable insights?

Our client, a credit provider in the retail industry, is seeking a talented Senior Data Scientist to join their team. The Data Scientist is responsible for creating business value by


View Job
Senior Data Scientist CH1109)

Western Cape: Senior Data Analyst posted by Communicate Finance


The successful candidate will collect and transform data from all corners of the business multiverse, analyze trends faster than a TikTok algorithm, and visualise everything in Looker so stakeholders don't get that "Excel migraine". This role will s


View Job
Senior Data Analyst

Centurion: Senior Data Scientist – Financial Services – R900K – R750K posted by Hire Resolve

Hire Resolve's client is looking for the expertise of a Senior Data Scientist. The role is based in Centurion, Gauteng. 


Responsibilities


Cape Town: Senior Data Analyst posted by Goldman Tech

Job Description:
We have an amazing opportunity for a Senior Data Analyst in Cape Town!

We require a candidate with experience in:
• MS Excel
• SQL query writing
• Big data reporting packages (Power BI, Qlikview,


View Job
Senior Data Analyst

Johannesburg: Senior Data Warehouse/ BI Developer posted by Goldman Tech

Job Description:
We have an amazing opportunity for a Senior Data Warehouse/ BI Developer in Johannesburg!

We require a candidate with experience in:
• BI Toolsets
• ETL Applications
• T-SQL
• Implementatio


View Job
Senior Data Warehouse/ BI Developer

South Africa: GenAI Senior Art Director (Remote) posted by Datafin

GenAI Senior Art Director (Remote)Other
Remote
ENVIRONMENT:
This role is for a GenAI Art Director joining a global team of creative professionals specializing in film, CGI, automation,


View Job
GenAI Senior Art Director (Remote)

South Africa: Senior Ruby on Rails Developer (CPT Remote) posted by Datafin

Senior Ruby on Rails Developer (CPT Remote)IT - Software Development
Cape Town - Western Cape - South Africa, Remote
ENVIRONMENT:
A dynamic Software Consultancy seeks the coding expert


View Job
Senior Ruby on Rails Developer (CPT Remote)

Cape Town: Senior JavaScript Software Engineer posted by Datafin

Senior JavaScript Software EngineerEngineering/Technical
Cape Town - Western Cape - South Africa
ENVIRONMENT:
Join a dynamic, multidisciplinary environment that fosters versatility and


View Job
Senior JavaScript Software Engineer

South Africa: Senior Full Stack .NET Developer (PTA) posted by Datafin

Senior Full Stack .NET Developer (PTA)IT - Software Development
Pretoria/Centurion - Gauteng - South Africa
ENVIRONMENT:
A cutting-edge FinTech company based in Pretoria seeks the codi


View Job
Senior Full Stack .NET Developer (PTA)

South Africa: Senior Software Engineer (Java) posted by Datafin

Senior Software Engineer (Java)IT - Software Development
Pretoria/Centurion - Gauteng - South Africa
ENVIRONMENT:
A global leader in defense and security solutions is currently looking


View Job
Senior Software Engineer (Java)

Gauteng: Senior Back-end Developer (Java) (8 month contract) posted by Datafin

Senior Back-end Developer (Java) (8 month contract)IT - Software Development
Gauteng - South Africa
ENVIRONMENT:
A global ingredient manufacturer committed to sustainably improving the


View Job
Senior Back-end Developer (Java) (8 month contract)

South Africa: Senior Full Stack Web Developer: Cloud Services Remote posted by Datafin

Senior Full Stack Web Developer: Cloud Services - RemoteIT - Software Development
Western Cape - South Africa, Remote
ENVIRONMENT:
A prominent web hosting company is looking for a tale


View Job
Senior Full Stack Web Developer

Gauteng: Senior Broker (JHB / KZN / CAPE TOWN) posted by Datafin

Senior Broker (JHB / KZN / CAPE TOWN)Other
KwaZulu Natal - South Africa, Gauteng - South Africa, Western Cape - South Africa
Apply for this Job


View Job
Senior Broker (JHB / KZN / CAPE TOWN)

Cape Town: Senior Software Engineer (Python) (Remote) posted by Datafin

Senior Software Engineer (Python) (Remote)IT - Software Development
Cape Town - Western Cape - South Africa
ENVIRONMENT:
A leading online retailer in South Africa is seeking an Interm


View Job
Senior Software Engineer (Python) (Remote)

South Africa: Senior PHP Developer Remote posted by Datafin

Senior PHP Developer - RemoteIT - Software Development
Remote
ENVIRONMENT:
Our client is hiring a Senior PHP Developer to join a leading medico-legal service and technology provider ba


View Job
Senior PHP Developer Remote

Cape Town: Senior QA Automation CPT posted by Datafin

Senior QA - Automation - CPTIT - Software Testing
Cape Town - Western Cape - South Africa
ENVIRONMENT:
A globally recognized brand with a strong strategic vision, committed to enhancin


View Job
Senior QA Automation CPT

Gauteng: Senior Frontend Engineer (React) (Remote) posted by Datafin

Senior Frontend Engineer (React) (Remote)IT - Software Development
KwaZulu Natal - South Africa, Gauteng - South Africa, Western Cape - South Africa
ENVIRONMENT:

Cape Town: Senior Cloud Data Engineer posted by Hire Resolve

Hire Resolve's client is seeking a Cloud Engineer who will be working primarily within the Google Cloud Environment using a variety of the tools that Google offers from BigQuery and Dataproc and Vertex AI. You should ideally dream in Python and speak SQL.


View Job
Senior Cloud Data Engineer

Johannesburg: Senior SQL Server Developer (Sandton Hybrid) posted by Datafin

Senior SQL Server Developer (Sandton - Hybrid)IT - Software Development
Johannesburg - Gauteng - South Africa
ENVIRONMENT:
A prominent company in mining technology, focused on advanced


View Job
Senior SQL Server Developer (Sandton Hybrid)

South Africa: C# Developer (Mid-Level Senior) (George) posted by Datafin

C# Developer (Mid-Level - Senior) (George)IT - Software Development
ENVIRONMENT:
A dynamic company, dedicated to transforming the insurance industry with innovative and customer-centr


View Job
C# Developer (Mid-Level Senior) (George)

Cape Town: Senior Data Scientist posted by Goldman Tech

Job Description:
We have an exciting client in Cape Town looking for a Senior Data Scientist.

You will:

Build segmentation and propensity models

Build real time systems that integrate with the rest of our stack

Build


View Job
Senior Data Scientist

Error making API request: cURL error 6: Could not resolve host: publisher.resgen.us
Share this to someone who needs a job:
Posted in Jobs in Cape Town, Jobs in South Africa, Jobs in Western Cape

More Jobs in Your Area