Senior Data Engineer : Ingestions Squad (Group Data & Ml Platform Tribe)
Posted on 2025-03-29
Employer | Progressive IT Resourcing |
---|---|
Salary | 0 |
Category | It Computer |
Location | Western Cape / Cape Town |
Job Summary
Our Client
Company Group Technology is responsible for the provision of a digitally enabled technology service as a group COE, drive business and transformation and provide group-wide digital and data architecture. We operate the various technology platforms and shared services, ensure Cyber and Information Security resilience, and act as technology governance and risk orchestrator for technology across Company
.What will you do?
A newly created engineering organisation on a mission to empower and accelerate autonomous value creation through insights and ML across the group. Our main users are the data scientists and analysts who sit inside the business units and support them in developing and re-developing their financial and digital products to better meet the needs of our clients and our shareholders. Our other users are the data management and data product teams who produce the data sets analysts and scientists need to launch straight into their work.
The tribe is made up of 3 different engineering squads covering everything from how we ingest and store data, to how we develop and share ML artefacts and insights. We have one for ingestions, one for data storage and processing and one for insights & ML tooling. We have one data engineering talent pipeline for the whole tribe, where placements into specific squads are explored later in the interview process based on squad needs and candidate abilities. Data engineers report to the tech leads of the squad they are embedded into.
What will make you successful in this role?
What success will look like for you 12 months into the role.
- Built configurable data ingestion platforms to collect and protect data from any source within two weeks or less. The team has bought and built to assemble a tool soup of persistent and secure ingestion tools, optimized for cost efficiency, with reliability as a non-negotiable standard. Success will be measured by the consistent achievement of the two-week ingestion target while maintaining high reliability and security.
- Engineered the platform for observability and performance. Made your systems observable from the outside, taking ownership of their performance. Facilitated real-time tracking of the systems internal state through logs, metrics, and traces. Defined clear and measurable Service Level Indicators (SLIs) and Service Level Objectives (SLOs), and integrate these into team OKRs to drive excellence. Success will be measured by meeting or exceeding defined performance and reliability benchmarks, and the quick identification and resolution of issues.
- Engineer the platform with privacy and security by design. Secured the platform through compliance engineering initiatives that reduced the time and cognitive load related to compliance. Implemented our Data Governance and Privacy policies effectively, leveraging encryption, firewalls, VPCs, Role Based Access Control and IAM integrations such as Active Directory. Success will be measured by the platforms adherence to security and privacy standards, with minimal compliance overhead for users.
- Leveraged containerization and infrastructure as code. Implemented containerization strategies and infrastructure as code (IaC) practices to ensure scalable, repeatable, and efficient deployment of data services. Utilized tools like Docker and Terraform to automate infrastructure management and streamline the development pipeline. Success will be measured by the consistency and reliability of deployments, reduced deployment times, and increased system scalability.
- Contributed to technology decisions. Engaged in technology spikes to clarify needs and articulate solution criteria. Evaluated different options through hands-on experimentation, leading to documented evaluations and recommendations that were understood by technology leaders or users across the company. Success will be measured by the quality and clarity of your contributions to technology decisions and the adoption of your recommendations.
- Invested in your own development. Executed on a culture of excellence and continuous improvement for both your part of the platform and your own abilities. Lived our culture of ownership, curiosity, and continuous learning. Participated in pre and post-mortems, sharing lessons learned across the organization along with how you are improving based on those lessons. Success is measured by your active participation in continuous learning initiatives and the tangible improvements in platform performance and personal growth.
- Technical leadership and coaching. Enable a culture of continuous learning and assist other engineers in their development journey.
Qualification
- Matric
- National Diploma in an Information Technology related discipline or a bachelor`s degree in computer science, Statistics, Informatics, Information Systems, or a quantitative field will be recommended.
Experience
- 5+ years` experience as a data engineer in data platform or service engineering team with at least 2 in a modern context with cloud technologies
- Track record of high impact and investing in your own development.
Skills and Thinking Preference
- Ability to act independently and to deal with high levels of ambiguity.
- You look for ways to do, instead of reasons not to. You are high agency, high ownership in everything you do. You know we own our future, only we can make it happen. If you find something that keeps us from our mission, you own it or work collaboratively with others until you find the right owner of it.
- Where some see impossible, you see a way. You have the strong conviction in our ability to innovate and bring financial services, and financial confidence to everyone across the continent. You turn obstacles into opportunity, chance into change.
- You move fast and fix things. You publish early and often, when you fail you learn and go again. You know that speed gives you the licence to fail, because youre moving fast enough to correct course.
- You love creating more with less. Knowing that the biggest impact is born of the smallest acts, scale is built into your thinking from day 1. This is not about meeting the needs of thousands; its about exceeding the needs of millions. And working through small and mighty teams is way well do it.
- You seek out and value different perspectives. Believing that when we change how we look at things, how things look for us also changes. Making tomorrow not just different, but better.
Personal Attributes
- Plans and aligns – Contributing through others
- Optimises work processes – Contributing through others
- Collaborates – Contributing strategically
- Resourcefulness – Contributing strategically
- Tech savvy – Contributing strategically
Core Competencies
- Cultivates innovation – Contributing through others
- Customer focus – Contributing through others
- Drives results – Contributing through others
- Collaborates – Contributing through others
- Being resilient – Contributing through others
Senior Data Engineer : Ingestions Squad (Group Data & Ml Platform Tribe) position available in Western Cape, Cape Town. This job position was posted by Progressive IT Resourcing. The job has been posted as a premium ad on 2025-03-29 at 13:16:05 in the It Computer category
Click Go Apply to apply online!
You might also like these jobs in the same area.
Apply directly for this position. Please read all instructions carefully.
We do not process job applications; we simply aggregate and display job listings.
More related positions
Johannesburg: Senior Azure Data Scientist – Johannesburg – 1Mil To 1.1Mil Per Annum
A leading Information Technology and Business Consulting firm, providing specialized solutions to enterprises across the private and public sectors, are looking for a Senior Data Scientist to join their AI & Data Analytics Department. This role offers an e
View Job
Senior Azure Data Scientist – Johannesburg – 1Mil To 1.1Mil Per Annum
Johannesburg: Senior Data Engineer – Johannesburg – R1mil Up To R1,3Mil Per Annum
A global, cutting-edge consultancy, AI solutions developer, with domain expertise in the utilities, insurance, banking, and telecommunications industries and the attitude and aptitude to change the world seek a Senior Data Engineer to join them in their en
View Job
Senior Data Engineer – Johannesburg – R1mil Up To R1,3Mil Per Annum
Johannesburg: Senior Data Analyst
Minimum requirements: Applicable certifications would be advantage Experience working with the following areas in Call Centre environment would be a benefit Credit Card, Personal Loans, Legal up to Judgement granted More then 10 years of experience would b
View Job
Senior Data Analyst
Rivonia: Senior Data Engineer – Contract – Hybrid
Our Client a Global tech firm is seeking 2 Senior Data Engineers to join their in Rivonia on a contract basis (Hybrid). They offer stability, growth, attractive rates and a great working environment. The Data Engineer will be responsible for developing, ma
View Job
Senior Data Engineer – Contract – Hybrid
Rivonia: Senior Data Engineer – Contract – Hybrid
Our Client a Global tech firm is seeking 2 Senior Data Engineers to join their team in Rivonia on a contract basis (Hybrid). They offer stability, growth, attractive rates and a great working environment. The Data Engineer will be responsible for developin
View Job
Senior Data Engineer – Contract – Hybrid
Kuils River: Data Scientist (Junior And Senior Roles) (Ch1109)
Join our client in the credit Industry as a Data Scientist Are you passionate about turning data into actionable insights? Our client is seeking talented Data Scientists on all levels (Senior & Junior), to join their team In this role, you’ll leverage your
View Job
Data Scientist (Junior And Senior Roles) (Ch1109)
Johannesburg: Senior Aws Data Engineer
Our client who is a leader in the Financial Services space has an exciting opportunity for a Senior AWS Data Engineer. Minimum Qualifications Bachelor`s Degree in Computer Science, Information Technology, or other relevant fields. Has experience in any of
View Job
Senior Aws Data Engineer
Johannesburg: Senior Data Steward
PBT Group is seeking a dynamic Data Steward to join our team In this role, you will ensure adherence to data governance and management standards across business units and enterprise levels. You’ll work closely with stakeholders, develop data standards and
View Job
Senior Data Steward
Johannesburg: Senior Data Engineer
Our client is seeking an experienced senior data engineer to join their team. Candidate must hold the necessary tertiary qualification and have extensive experience with SQL/SSIS packages. Senior Data Engineer position available in Gauteng, Johannesburg. T
View Job
Senior Data Engineer
Johannesburg: Senior Data Scientist (Ai, Machine Learning) – Johannesburg – R1mil To R1.3Mil Ctc
An African financial services organisation that offers a broad spectrum of financial solutions and offers great culture, leadership, learning opportunities, challenges, rewards and recognition to its employees seeks a Senior Data Scientist who will be acco
View Job
Senior Data Scientist (Ai, Machine Learning) – Johannesburg – R1mil To R1.3Mil Ctc
Pretoria: Senior Data Engineer
As a Senior Data Engineer, you will lead the development of scalable data pipelines, mentor junior team members, and drive best practices in data engineering. You will work closely with data scientists and analysts to ensure they have access to the right d
View Job
Senior Data Engineer
Cape Town City Centre: Senior Data Scientist
Welcome to the big leagues of data science This isnt just crunching numbersthis is revolutionizing how people shop. As a Senior Data Scientist, youll dive deep into complex datasets, uncover hidden insights, and deploy machine learning models to transform
View Job
Senior Data Scientist
Johannesburg: Senior Azure Data Engineer – Johannesburg – R500 To R600 Per Hour
A leading autonomous Namibian bank, committed to providing superior financial services to individual and corporate clients, as well as international banking services through global financial centres, is seeking a Senior Azure Data Engineer . This role offe
View Job
Senior Azure Data Engineer – Johannesburg – R500 To R600 Per Hour
Cape Town City Centre: Senior Cloud Data Engineer (Ch1103)
Our client, a leader in the media industry, is looking for Senior Cloud Data Engineer to join their dynamic and fast-paced team, where technology, content, and innovation shape South Africa’s top digital, print, and ecommerce platforms. The client’s team o
View Job
Senior Cloud Data Engineer (Ch1103)
Cape Town City Centre: Senior Data Scientist: Client Insights – Contract – Onsite
Our Client a Global tech firm is seeking a Manager: Data and Analytics (Analytics Engineering) to join their team in a banking project on a contract basis in Cape town (Onsite). They offer stability, growth, attract rates and a great working environment Ab
View Job
Senior Data Scientist
Johannesburg: Senior Azure Data Scientist – Johannesburg (Hybrid) – Up To R700 Per Hour
Are you a passionate Senior Data Scientist ready to tackle cutting-edge AI and Data Science challenges? We``re seeking an expert to design and develop Machine Learning (ML) and AI solutions using Microsoft Azure. You``ll work with large datasets, build pre
View Job
Senior Azure Data Scientist – Johannesburg (Hybrid) – Up To R700 Per Hour
South Africa: Senior Data Science Consultant
Our client is seeking a full-time Senior Data Science Consultant with strong data science and consulting expertise to join their dynamic and growing Data Science team. Role and Responsibilities: As part of the company Data Science team, you will report dir
View Job
Senior Data Science Consultant
Cape Town City Centre: Senior Data Analyst
Are you a data enthusiast with a passion for turning complex data into actionable insights? A leading company in the retail tech space is looking for a Senior Data Analyst to join their innovative data team . In this remote role, you will play a pivotal pa
View Job
Senior Data Analyst
Midrand: Senior Credit Data Analyst / Credit Data And Risk Insights Analyst
About the Role Fempower is recruiting for a highly skilled Senior Credit Data Analyst on behalf of a leading financial institution. This role is pivotal in sourcing, aggregating, and analyzing credit data to support risk modeling, pricing, and portfolio re
View Job
Senior Credit Data Analyst / Credit Data And Risk Insights Analyst
Pretoria: Senior Technical Project Manager (Data Centres)
Requirements A minimum of a B Degree / Advanced Diploma in Information Technology or equivalent A formal project management qualification / certification Previous technical expertise in infrastructure (any of the following domains: data centre, mainframe,
View Job
Senior Technical Project Manager (Data Centres)
Johannesburg: Senior Data Engineer
Key Responsibilities: Architect and build highly scalable distributed systems using open-source tools. Design and implement efficient data models, with a deep understanding of various data structures and their benefits and limitations. Work with big data b
View Job
Senior Data Engineer
Cape Town City Centre: Senior Data Engineer
Key Responsibilities: Architect and build highly scalable distributed systems using open-source tools. Design and implement efficient data models, with a deep understanding of various data structures and their benefits and limitations. Work with big data b
View Job
Senior Data Engineer
Midrand: Senior Credit Data Analyst / Credit Data And Risk Insights Analyst posted by Fempower Personnel
About the RoleFempower is recruiting for a highly skilled Senior Credit Data Analyst on behalf of a leading financial institution. This role is pivotal in sourcing, aggregating, and analyzing credit data to support risk modeling, pricing, and portfolio rep
View Job
Senior Credit Data Analyst / Credit Data And Risk Insights Analyst
Johannesburg: Senior Data Steward posted by PBT Group
PBT Group is seeking a dynamic Data Steward to join our team! In this role, you will ensure adherence to data governance and management standards across business units and enterprise levels. Youll work closely with stakeholders, develop data standards and
View Job
Senior Data Steward
South Africa: Data Scientist (Junior And Senior Roles) (Ch1109) posted by Capital H Staffing and Advisory Solutions
Join our client in the credit Industry as a Data Scientist!Are you passionate about turning data into actionable insights?Our client is seeking talented Data Scientists on all levels (Senior & Junior), to join their team! In this role, youll leverage y
View Job
Data Scientist (Junior And Senior Roles) (Ch1109)