Data Engineer : Ingestions Squad (Group Data & Ml Platform Tribe)
Posted on 2025-03-16
Employer | Progressive IT Resourcing |
---|---|
Salary | 0 |
Category | It Computer |
Location | Western Cape / Cape Town |
Job Summary
Job Details
Who are we?
Company Group Technology is responsible for the provision of a digitally enabled technology service as a group COE, drive business and transformation and provide group-wide digital and data architecture. We operate the various technology platforms and shared services, ensure Cyber and Information Security resilience, and act as technology governance and risk orchestrator for technology across Company
.What will you do?
Were a newly created engineering organisation on a mission to empower and accelerate autonomous value creation through insights and ML across the group. Our main users are the data scientists and analysts who sit inside the business units and support them in developing and re-developing their financial and digital products to better meet the needs of our clients and our shareholders. Our other users are the data management and data product teams who produce the data sets analysts and scientists need to launch straight into their work.
The tribe is made up of 3 different engineering squads covering everything from how we ingest and store data, to how we develop and share ML artefacts and insights. We have one for ingestions, one for data storage and processing and one for insights & ML tooling. We have one data engineering talent pipeline for the whole tribe, where placements into specific squads are explored later in the interview process based on squad needs and candidate abilities. Data engineers report to the tech leads of the squad they are embedded into.
What will make you successful in this role?
What success will look like for you 12 months into the role.
- Built configurable data ingestion platforms to collect and protect data from any source within two weeks or less. The team has bought and built to assemble a tool suite of persistent and secure ingestion tools, optimized for cost efficiency, with reliability as a non-negotiable standard. Success will be measured by the consistent achievement of the two-week ingestion target while maintaining high reliability and security.
- Engineered the platform for observability and performance. Made your systems observable from the outside, taking ownership of their performance. Facilitated real-time tracking of the systems internal state through logs, metrics, and traces. Defined clear and measurable Service Level Indicators (SLIs) and Service Level Objectives (SLOs), and integrate these into team OKRs to drive excellence. Success will be measured by meeting or exceeding defined performance and reliability benchmarks, and the quick identification and resolution of issues.
- Engineer the platform with privacy and security by design. Secured the platform through compliance engineering initiatives that reduced the time and cognitive load related to compliance. Implemented our Data Governance and Privacy policies effectively, leveraging encryption, firewalls, VPCs, Role Based Access Control and IAM integrations such as Active Directory. Success will be measured by the platforms adherence to security and privacy standards, with minimal compliance overhead for users.
- Leveraged containerization and infrastructure as code. Implemented containerization strategies and infrastructure as code (IaC) practices to ensure scalable, repeatable, and efficient deployment of data services. Utilized tools like Docker and Terraform to automate infrastructure management and streamline the development pipeline. Success will be measured by the consistency and reliability of deployments, reduced deployment times, and increased system scalability.
- Contributed to technology decisions. Engaged in technology spikes to clarify needs and articulate solution criteria. Evaluated different options through hands-on experimentation, leading to documented evaluations and recommendations that were understood by technology leaders or users across the company. Success will be measured by the quality and clarity of your contributions to technology decisions and the adoption of your recommendations.
- Invested in your own development. Executed on a culture of excellence and continuous improvement for both your part of the platform and your own abilities. Lived our culture of ownership, curiosity, and continuous learning. Participated in pre and post-mortems, sharing lessons learned across the organization along with how you are improving based on those lessons. Success is measured by your active participation in continuous learning initiatives and the tangible improvements in platform performance and personal growth.
Qualification
- Matric
- National Diploma in an Information Technology related discipline or a bachelor`s degree in computer science, Statistics, Informatics, Information Systems, or a quantitative field will be recommended.
Experience
- 5+ years` experience as a data engineer in data platform or service engineering team with at least 2 in a modern context with cloud technologies
- Track record of high impact and investing in your own development.
Skills and Thinking Preference
- You look for ways to do, instead of reasons not to. You are high agency, high ownership in everything you do. You know we own our future, only we can make it happen. If you find something that keeps us from our mission, you own it or work collaboratively with others until you find the right owner of it.
- Where some see impossible, you see a way. You have the strong conviction in our ability to innovate and bring financial services, and financial confidence to everyone across the continent. You turn obstacles into opportunity, chance into change.
- You move fast and fix things. You publish early and often, when you fail you learn and go again. You know that speed gives you the licence to fail, because youre moving fast enough to correct course.
- You love creating more with less. Knowing that the biggest impact is born of the smallest acts, scale is built into your thinking from day 1. This is not about meeting the needs of thousands; its about exceeding the needs of millions. And working through small and mighty teams is way well do it.
- You seek out and value different perspectives. Believing that when we change how we look at things, how things look for us also changes. Making tomorrow not just different, but better.
Personal Attributes
- Plans and aligns – Contributing through others
- Optimises work processes – Contributing through others
- Collaborates – Contributing strategically
- Resourcefulness – Contributing strategically
- Tech savvy – Contributing strategically
Data Engineer : Ingestions Squad (Group Data & Ml Platform Tribe) position available in Western Cape, Cape Town. This job position was posted by Progressive IT Resourcing. The job has been posted as a premium ad on 2025-03-16 at 13:14:39 in the It Computer category
Click Go Apply to apply online!
You might also like these jobs in the same area.
Apply directly for this position. Please read all instructions carefully.
We do not process job applications; we simply aggregate and display job listings.
More related positions
Alberton: Junior Data Analyst / Engineer (Jb4991) posted by Kontak Recruitment
Junior Data Analyst / Engineer (JB4991) Alberton, Gauteng R15 000 to R20 000 a month CTCContract 6 to 12 months (May become permanent)Join a cutting-edge Supply Chain and Business Strategy Consultation company dedicated to turning data into powerful strate
View Job
Junior Data Analyst / Engineer (Jb4991)
Alberton: Graduate Data Analyst / Engineer (Jb4992) posted by Kontak Recruitment
Graduate Data Analyst / Engineer (JB4992) Alberton, GautengR10 000 to R15 000 a month CTCContract 6 to 12 months (May become permanent)Join a cutting-edge Supply Chain and Business Strategy Consultation company dedicated to turning data into powerful strat
View Job
Graduate Data Analyst / Engineer (Jb4992)
Johannesburg: Aws Data Engineer – Johannesburg – R900k To R1.1Mil Per Annum
Join a leading company pioneering the power of Artificial Intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide. With a vision to provide next-generation insights by harnessing data through high-performan
View Job
Aws Data Engineer – Johannesburg – R900k To R1.1Mil Per Annum
Ladysmith: Engineering Workshop Data Capturer
NEW EMPLOYMENT AVAILABLE | NUWE WERK BESKIKBAAR IMISEBENZI EKHONA | UMSEBENZI OMTSHA OKHOYO | MOSEBETSI O MOCHA O FUMANEGANG Engineering Workshop Data Capturer position available in Emnambithi-Ladysmith, Ladysmith. This job position was posted by . The job
View Job
Engineering Workshop Data Capturer
Johannesburg: Senior Azure Data Engineer – Johannesburg – R500 To R600 Per Hour
An autonomous Namibian bank, providing superior financial services to individual and corporate clients as well as international banking services by liaising directly with financial centres and institutions worldwide is looking for an Azure Data Engineer. T
View Job
Senior Azure Data Engineer – Johannesburg – R500 To R600 Per Hour
Somerset West: Data Engineer posted by Blue Nova Energy (Pty) Ltd
Job Summary:The Data Engineer will manage and analyse Blue Nova Energys data from battery systems, microgrids, and energy management solutions. This role includes designing databases, developing analytics/reporting systems, and applying machine learning (M
View Job
Data Engineer
Johannesburg: Aws Data Engineer – Johannesburg – R530 To R630 Per Hour
An IT South Africa Hub delivering cutting-edge IT solutions to the global Group and specialising in innovative and comprehensive IT services, including Development and Operations for SAP, JAVA, Azure, Cloud , ensure deep integration with compliance, IT met
View Job
Aws Data Engineer – Johannesburg – R530 To R630 Per Hour
Midrand: Data Engineer
Minimum Requirements Matric BSc Computer Science / B.tech in IT / Data scientist / Analytics (statistics) Valid Drivers License and Own Vehicle 3 5 years experience as a Data Engineer or in a similar role SQL & Power BI experience and knowledge (essential)
View Job
Data Engineer
Sandton: Data Engineer
Design and develop custom Power BI Reports and Dashboards to meet specific client requirements Transform raw data into actionable insights through effective Power BI data visualization and dashboard development Establish connections and extract data from d
View Job
Data Engineer
Cape Town City Centre: Technical Network Engineer ((Isp & Data Centre) Anywhere In Sa)
Were hiring a Technical Manager to shape our network, prevent downtime, and mentor a growing team. If you excel at near-perfect uptime, network design, and leading engineers, contact us. What Youll Do Optimize monitoring (Zabbix/ LibreQOS) and automate rou
View Job
Technical Network Engineer ((Isp & Data Centre) Anywhere In Sa)
South Africa: Data Centre Electrical Engineer (Ireland/Europe)
As part of your role, you will be primarily responsible for the design, implementation, and maintenance of electrical systems in data centres. Responsibilities: Design, develop, and supervise the installation of data centres. Ensure all electrical systems
View Job
Data Centre Electrical Engineer (Ireland/Europe)
Durban: Network Engineer – Data Centre Specialist – Contract
Our Client a Global Tech firm is seeking a Network Engineer Data centre specialist to join their team in Durban on a contract basis. They offer stability, growth, attractive rate and a great working environment. The Network Engineer - Data Centre Specialis
View Job
Network Engineer – Data Centre Specialist – Contract
Cape Town City Centre: Product Data Engineer
Purpose Statement To contribute to the design and development of new applications / systems to meet the business requirements of the product line environment. To analyse business or system requirements and data to enhance understanding of the product line
View Job
Product Data Engineer
Johannesburg: Data Engineer
Job & Company Description An industry requiring specialist skills, deserves specialist recruitment. I am a Specialist Risk Analytics & Data Recruiter working with very prestigious corporate concerns in Gauteng. Assisting you in exploring new commercial opp
View Job
Data Engineer
Johannesburg: Aws Data Engineer
We are seeking an AWS Data Engineer to develop data products and pipelines in cloud and on-premises environments. Utilize your skills in Python, Dbt, and Apache Airflow to enhance business insights and operational efficiency. Key Responsibilities: Build da
View Job
Aws Data Engineer
Cape Town City Centre: Data Engineer Technical Lead (Ai/Ml) – (Contract)
Leadership: • Demonstrated ability to act as a tech lead, guiding the design, development, and implementation of data solutions while ensuring alignment with best practices and the company and its client’s objectives. • Skilled in mentoring and supporting
View Job
Data Engineer Technical Lead (Ai/Ml) – (Contract)
Cape Town City Centre: Senior Cloud Data Engineer (Ch1103)
Our client, a leader in the media industry, is looking for Senior Cloud Data Engineer to join their dynamic and fast-paced team, where technology, content, and innovation shape South Africa’s top digital, print, and ecommerce platforms. The client’s team o
View Job
Senior Cloud Data Engineer (Ch1103)
Cape Town City Centre: Manager: Data And Analytics (Analytics Engineering) – Contract – Onsite
Our Client a Global tech firm is seeking a Manager: Data and Analytics (Analytics Engineering) to join their team in a banking project on a contract basis in Cape town (Onsite). They offer stability, growth, attract rates and a great working environment Ab
View Job
Manager
Randburg: Data Engineer
To collect and validate business information (which can then be used by data scientists and business stakeholders). To design and implement data models and architectures that enable business stakeholders to gain insights from large-scale datasets. To desig
View Job
Data Engineer
Johannesburg: Aws Data Engineer
Minimum Experience: 5 years of experience in Python/C# development 3 years of experience in AWS data engineering Education Requirements: Bachelors Degree in Computer Science, Information Systems, or a related field Advantageous: AWS Certified Machine Learn
View Job
Aws Data Engineer
Centurion: Data Engineer
As a Specialist Recruitment Consultant within the IT industry, my clients and I are constantly on the lookout for passionate Data Engineers with strong academics, robust project experience and technical knowledge. Requirements: Completed Bachelors Degree i
View Job
Data Engineer
Johannesburg: Cloud Data Engineer – Johannesburg – R1mil Up To R1.3Mil Per Annum
An independent, results-focused management consulting firm specialising in working with industry-leading banks and insurance companies around the world, including institutions in the United Kingdom, Europe, Scandinavia, Asia, South Africa and throughout su
View Job
Cloud Data Engineer – Johannesburg – R1mil Up To R1.3Mil Per Annum
Johannesburg: Senior Data Engineer – Johannesburg – R1mil Up To R1,3Mil Per Annum
A global, cutting-edge consultancy, AI solutions developer, with domain expertise in the utilities, insurance, banking, and telecommunications industries and the attitude and aptitude to change the world seek a Senior Data Engineer to join them in their en
View Job
Senior Data Engineer – Johannesburg – R1mil Up To R1,3Mil Per Annum
Johannesburg: Azure Data Engineer – Johannesburg – R500 To R600 Per Hour
Join a company that is committed to creating intelligence for a healthier tomorrow by leveraging vast datasets to generate valuable insights that improve both clinical and operational environments. As an Azure Data Engineer, you must be able to design, bui
View Job
Azure Data Engineer – Johannesburg – R500 To R600 Per Hour
Centurion: Data Quality Engineer
Requirements: - Must skill: Experience: 3 years in a data quality, data engineering, or related role, preferably in the healthcare industry. - Technical Skills: Proficiency in SQL, Python, or other scripting languages. - Experience with data quality tools
View Job
Data Quality Engineer