Cape Town: Senior Data Engineer : Ingestions Squad (Group Data & ML Platform Tribe) posted by Progressive IT Resourcing
Posted on 2025-04-30 00:00:00
Employer | Progressive IT Resourcing |
---|---|
Category | Other IT/Computer |
Location | Western Cape / Cape Town |
Job Summary
Our Client
Company Group Technology is responsible for the provision of a digitally enabled technology service as a group COE, drive business and transformation and provide group-wide digital and data architecture. We operate the various technology platforms and shared services, ensure Cyber and Information Security resilience, and act as technology governance and risk orchestrator for technology across Company
.What will you do?
A newly created engineering organisation on a mission to empower and accelerate autonomous value creation through insights and ML across the group. Our main users are the data scientists and analysts who sit inside the business units and support them in developing and re-developing their financial and digital products to better meet the needs of our clients and our shareholders. Our other users are the data management and data product teams who produce the data sets analysts and scientists need to launch straight into their work.
The tribe is made up of 3 different engineering squads covering everything from how we ingest and store data, to how we develop and share ML artefacts and insights. We have one for ingestions, one for data storage and processing and one for insights & ML tooling. We have one data engineering talent pipeline for the whole tribe, where placements into specific squads are explored later in the interview process based on squad needs and candidate abilities. Data engineers report to the tech leads of the squad they are embedded into.
What will make you successful in this role?
What success will look like for you 12 months into the role.
- Built configurable data ingestion platforms to collect and protect data from any source within two weeks or less. The team has bought and built to assemble a tool soup of persistent and secure ingestion tools, optimized for cost efficiency, with reliability as a non-negotiable standard. Success will be measured by the consistent achievement of the two-week ingestion target while maintaining high reliability and security.
- Engineered the platform for observability and performance. Made your systems observable from the outside, taking ownership of their performance. Facilitated real-time tracking of the systems internal state through logs, metrics, and traces. Defined clear and measurable Service Level Indicators (SLIs) and Service Level Objectives (SLOs), and integrate these into team OKRs to drive excellence. Success will be measured by meeting or exceeding defined performance and reliability benchmarks, and the quick identification and resolution of issues.
- Engineer the platform with privacy and security by design. Secured the platform through compliance engineering initiatives that reduced the time and cognitive load related to compliance. Implemented our Data Governance and Privacy policies effectively, leveraging encryption, firewalls, VPCs, Role Based Access Control and IAM integrations such as Active Directory. Success will be measured by the platforms adherence to security and privacy standards, with minimal compliance overhead for users.
- Leveraged containerization and infrastructure as code. Implemented containerization strategies and infrastructure as code (IaC) practices to ensure scalable, repeatable, and efficient deployment of data services. Utilized tools like Docker and Terraform to automate infrastructure management and streamline the development pipeline. Success will be measured by the consistency and reliability of deployments, reduced deployment times, and increased system scalability.
- Contributed to technology decisions. Engaged in technology spikes to clarify needs and articulate solution criteria. Evaluated different options through hands-on experimentation, leading to documented evaluations and recommendations that were understood by technology leaders or users across the company. Success will be measured by the quality and clarity of your contributions to technology decisions and the adoption of your recommendations.
- Invested in your own development. Executed on a culture of excellence and continuous improvement for both your part of the platform and your own abilities. Lived our culture of ownership, curiosity, and continuous learning. Participated in pre and post-mortems, sharing lessons learned across the organization along with how you are improving based on those lessons. Success is measured by your active participation in continuous learning initiatives and the tangible improvements in platform performance and personal growth.
- Technical leadership and coaching. Enable a culture of continuous learning and assist other engineers in their development journey.
Qualification
- Matric
- National Diploma in an Information Technology related discipline or a bachelor’s degree in computer science, Statistics, Informatics, Information Systems, or a quantitative field will be recommended.
Experience
- 5+ years’ experience as a data engineer in data platform or service engineering team with at least 2 in a modern context with cloud technologies
- Track record of high impact and investing in your own development.
Skills and Thinking Preference
- Ability to act independently and to deal with high levels of ambiguity.
- You look for ways to do, instead of reasons not to. You are high agency, high ownership in everything you do. You know we own our future, only we can make it happen. If you find something that keeps us from our mission, you own it or work collaboratively with others until you find the right owner of it.
- Where some see impossible, you see a way. You have the strong conviction in our ability to innovate and bring financial services, and financial confidence to everyone across the continent. You turn obstacles into opportunity, chance into change.
- You move fast and fix things. You publish early and often, when you fail you learn and go again. You know that speed gives you the licence to fail, because youre moving fast enough to correct course.
- You love creating more with less. Knowing that the biggest impact is born of the smallest acts, scale is built into your thinking from day 1. This is not about meeting the needs of thousands; its about exceeding the needs of millions. And working through small and mighty teams is way well do it.
- You seek out and value different perspectives. Believing that when we change how we look at things, how things look for us also changes. Making tomorrow not just different, but better.
Personal Attributes
- Plans and aligns – Contributing through others
- Optimises work processes – Contributing through others
- Collaborates – Contributing strategically
- Resourcefulness – Contributing strategically
- Tech savvy – Contributing strategically
Core Competencies
- Cultivates innovation – Contributing through others
- Customer focus – Contributing through others
- Drives results – Contributing through others
- Collaborates – Contributing through others
- Being resilient – Contributing through others
Click Go Apply to apply online!
Get Similar Job Alerts
More jobs in Cape Town
More jobs in Western Cape
Browse Other IT/Computer Jobs
Browse Progressive IT Resourcing Jobs
Apply directly for this position. Please read all instructions carefully.
We do not process job applications; we simply aggregate and display job listings.
More related positions
Cape Town: Property Practitioner posted by Harcourts Dunn
Are you a persuasive communicator with a knack for sales? Do you thrive on making connections and closing deals? Join our dynamic real estate team as a Cold...
View Job
Property Practitioner
Cape Town: Google Ads Manager – Urgent Hire posted by Imatik Ltd
? Job Opportunity Google Ads Specialist Retainer Extra Income Can work around a FT existing role ?Are you a skilled Google Ads expert with 1-2 years of...
View Job
Google Ads Manager – Urgent Hire
Cape Town: Junior Consultant posted by Acquirely
Junior Consultant Remote - Sales Appointment SettingSalary R23,000 commissionOTE R30,000 R50,000month 2.5 per saleLocation Remote Work for a U.S....
View Job
Junior Consultant
Cape Town: Customer Support Manager – Entry Level posted by Right Kareer
Youll be the voice of our brand, communicating with customers, identifying their needs, and delivering a top-notch experience. Youll be the superhero they...
View Job
Customer Support Manager – Entry Level
Cape Town: Sales Rep posted by Alifurn Outdoor Furniture
Looking for a Sales Rep Furniture IndustryWere looking for a dynamic and driven sales representative to join our team! The role is based at our showroom in...
View Job
Sales Rep
Cape Town: DevOps Engineer (Support) posted by Construct Executive Search
Applicants must have the following requirementsMust have a Matric Certificate.Must have 6-8 years of experience as a DevOps Engineer in a software...
View Job
DevOps Engineer (Support)
Cape Town: New Vehicle Sales Executive posted by Intercon Recruitment
Dealership in Cape Town is looking for an experienced New Vehicle Sales Executive, with previous Motor Dealership New Vehicle Sales Experience. Salary Basic...
View Job
New Vehicle Sales Executive
Cape Town: National Key Accounts Sales Manager posted by The Individual Touch CC
Generate new additional businessGrow the national customer baseManaging analyzing the national customer baseAnalyzing price decreases suspended business...
View Job
National Key Accounts Sales Manager
Northern Suburbs: BOILERMAKERS – Based In Cape Town posted by Tom Nel Recruitment
Leading Progressive Manufacturing company seeks a number of Boilermakers urgently for six month contracts.Key experience of 3-5 Years post apprenticeship...
View Job
BOILERMAKERS – Based In Cape Town
Cape Town: Vehicle Chip Repair Technician posted by Chip Magic Technologies (Pty) Ltd
Company DescriptionChip Magic Technologies Pty Ltd are experts in vehicle paint chip repairs and automotive vehicle aesthetic restoration specialists.We...
View Job
Vehicle Chip Repair Technician
Cape Town: Junior Accountant posted by Africa Thinking Management Solutions
Job Advertisement Junior AccountantLocation Cape Town -Observatory Company Africa Thinking Management SolutionsAfrica Thinking Management Solutions is...
View Job
Junior Accountant
Cape Town: Intermediate Financial Administrator posted by Construct Executive Search
Applicants must have the following requirementsMust have a Diploma in Accounting or Bookkeeping.Must have 3-5 years of experience as a Financial...
View Job
Intermediate Financial Administrator
Cape Town: Roof sheeter – Urgently Needed posted by Batt Master Roofing and Guttering
Roof sheeter needed Must be able to remove and install roof sheets etc and waterproofing for maintenance company Work in fascias as wellWork experience a...
View Job
Roof sheeter – Urgently Needed
Cape Town: Litigation Secretary posted by Marais Muller Hendricks Attorneys
Marais Muller Hendricks Inc., a leading law firm in Cape Town, is seeking to appoint an experienced and highly organised Litigation Secretary to join our...
View Job
Litigation Secretary
Cape Town: Bookkeeper – Restaurant Industry (Salt River) posted by The Vocation Station
About the RoleWere looking for a detail-oriented Bookkeeper to join our clients team and support the financial operations of four businesses under one roof....
View Job
Bookkeeper – Restaurant Industry (Salt River)
Cape Town: Litigation Secretary posted by Cora O’Neil Recruitment Agency
Cape Town City Centre LITIGATION SECRETARY Minimum Requirements-Well presentable and professional preferably female-Excellent verbal communication skills-2...
View Job
Litigation Secretary
Cape Town: Sales Administrator – IT Industry posted by The Vocation Station
Are you a proactive and detail-oriented professional with a knack for client service and relationship management in the IT Distribution space? Were looking...
View Job
Sales Administrator – IT Industry
Cape Town: Junior System Support Engineer posted by The Vocation Station
Are you an enthusiastic IT professional with a passion for delivering top-notch support to diverse customers? Our client is looking for a Remote Support...
View Job
Junior System Support Engineer
Cape Town: Electrical Engineer – Building Services posted by Business Recruitment Services
This role requires collaboration with multidisciplinary teams and clients to deliver fit-for-purpose solutions that surpass industry best practices and...
View Job
Electrical Engineer – Building Services
Cape Town: Intermediate SHERQ Officer posted by Construct Executive Search
Applicants must have the following requirementsMust have a Bachelors Degree or National Diploma in Safety Management or Occupational Health and Safety. Must...
View Job
Intermediate SHERQ Officer
Cape Town: Financial Accountant posted by Executive Placings
Travel Management Company is looking for an Accountant to be based in Cape Town. This is a hybrid role.The main purpose of this role is to ensure accuracy...
View Job
Financial Accountant
Cape Town: Regional Manager in Built-in Furniture Manufacturing Industry posted by Home Concept
Home Concept is looking for an experienced Regional Manager to join our team. In this role, youll lead sales, manage operations, and support teams to ensure...
View Job
Regional Manager in Built-in Furniture Manufacturing Industry
Cape Town: Car Rental Agent – Urgent posted by Vogue Personnel
Join Our Team as a Car Rental Agent! Were looking for a dedicated and organized Car Rental Agent to join our dynamic team and play a key role in ensuring...
View Job
Car Rental Agent – Urgent
Cape Town: New Business Consultant posted by Intercon Recruitment
Company based in Cape Town is looking for a Senior New Business Consultant Sales Increase and drive new business with a focus on quality and...
View Job
New Business Consultant
Cape Town: New Vehicle Sales Executive posted by Intercon Recruitment
Dealership in Cape Town is looking for an experienced New Vehicle Sales Executive with previous Motor Dealership New Vehicle Sales Experience. Salary Basic...
View Job
New Vehicle Sales Executive