Senior Data Engineer : Ingestions Squad (Group Data & Ml Platform Tribe)
Posted on 2025-02-26
Employer | Progressive IT Resourcing |
---|---|
Salary | 0 |
Category | It Computer |
Location | Western Cape / Cape Town |
Job Summary
Our Client
Company Group Technology is responsible for the provision of a digitally enabled technology service as a group COE, drive business and transformation and provide group-wide digital and data architecture. We operate the various technology platforms and shared services, ensure Cyber and Information Security resilience, and act as technology governance and risk orchestrator for technology across Company
.What will you do?
A newly created engineering organisation on a mission to empower and accelerate autonomous value creation through insights and ML across the group. Our main users are the data scientists and analysts who sit inside the business units and support them in developing and re-developing their financial and digital products to better meet the needs of our clients and our shareholders. Our other users are the data management and data product teams who produce the data sets analysts and scientists need to launch straight into their work.
The tribe is made up of 3 different engineering squads covering everything from how we ingest and store data, to how we develop and share ML artefacts and insights. We have one for ingestions, one for data storage and processing and one for insights & ML tooling. We have one data engineering talent pipeline for the whole tribe, where placements into specific squads are explored later in the interview process based on squad needs and candidate abilities. Data engineers report to the tech leads of the squad they are embedded into.
What will make you successful in this role?
What success will look like for you 12 months into the role.
- Built configurable data ingestion platforms to collect and protect data from any source within two weeks or less. The team has bought and built to assemble a tool soup of persistent and secure ingestion tools, optimized for cost efficiency, with reliability as a non-negotiable standard. Success will be measured by the consistent achievement of the two-week ingestion target while maintaining high reliability and security.
- Engineered the platform for observability and performance. Made your systems observable from the outside, taking ownership of their performance. Facilitated real-time tracking of the systems internal state through logs, metrics, and traces. Defined clear and measurable Service Level Indicators (SLIs) and Service Level Objectives (SLOs), and integrate these into team OKRs to drive excellence. Success will be measured by meeting or exceeding defined performance and reliability benchmarks, and the quick identification and resolution of issues.
- Engineer the platform with privacy and security by design. Secured the platform through compliance engineering initiatives that reduced the time and cognitive load related to compliance. Implemented our Data Governance and Privacy policies effectively, leveraging encryption, firewalls, VPCs, Role Based Access Control and IAM integrations such as Active Directory. Success will be measured by the platforms adherence to security and privacy standards, with minimal compliance overhead for users.
- Leveraged containerization and infrastructure as code. Implemented containerization strategies and infrastructure as code (IaC) practices to ensure scalable, repeatable, and efficient deployment of data services. Utilized tools like Docker and Terraform to automate infrastructure management and streamline the development pipeline. Success will be measured by the consistency and reliability of deployments, reduced deployment times, and increased system scalability.
- Contributed to technology decisions. Engaged in technology spikes to clarify needs and articulate solution criteria. Evaluated different options through hands-on experimentation, leading to documented evaluations and recommendations that were understood by technology leaders or users across the company. Success will be measured by the quality and clarity of your contributions to technology decisions and the adoption of your recommendations.
- Invested in your own development. Executed on a culture of excellence and continuous improvement for both your part of the platform and your own abilities. Lived our culture of ownership, curiosity, and continuous learning. Participated in pre and post-mortems, sharing lessons learned across the organization along with how you are improving based on those lessons. Success is measured by your active participation in continuous learning initiatives and the tangible improvements in platform performance and personal growth.
- Technical leadership and coaching. Enable a culture of continuous learning and assist other engineers in their development journey.
Qualification
- Matric
- National Diploma in an Information Technology related discipline or a bachelor`s degree in computer science, Statistics, Informatics, Information Systems, or a quantitative field will be recommended.
Experience
- 5+ years` experience as a data engineer in data platform or service engineering team with at least 2 in a modern context with cloud technologies
- Track record of high impact and investing in your own development.
Skills and Thinking Preference
- Ability to act independently and to deal with high levels of ambiguity.
- You look for ways to do, instead of reasons not to. You are high agency, high ownership in everything you do. You know we own our future, only we can make it happen. If you find something that keeps us from our mission, you own it or work collaboratively with others until you find the right owner of it.
- Where some see impossible, you see a way. You have the strong conviction in our ability to innovate and bring financial services, and financial confidence to everyone across the continent. You turn obstacles into opportunity, chance into change.
- You move fast and fix things. You publish early and often, when you fail you learn and go again. You know that speed gives you the licence to fail, because youre moving fast enough to correct course.
- You love creating more with less. Knowing that the biggest impact is born of the smallest acts, scale is built into your thinking from day 1. This is not about meeting the needs of thousands; its about exceeding the needs of millions. And working through small and mighty teams is way well do it.
- You seek out and value different perspectives. Believing that when we change how we look at things, how things look for us also changes. Making tomorrow not just different, but better.
Personal Attributes
- Plans and aligns – Contributing through others
- Optimises work processes – Contributing through others
- Collaborates – Contributing strategically
- Resourcefulness – Contributing strategically
- Tech savvy – Contributing strategically
Core Competencies
- Cultivates innovation – Contributing through others
- Customer focus – Contributing through others
- Drives results – Contributing through others
- Collaborates – Contributing through others
- Being resilient – Contributing through others
Senior Data Engineer : Ingestions Squad (Group Data & Ml Platform Tribe) position available in Western Cape, Cape Town. This job position was posted by Progressive IT Resourcing. The job has been posted as a premium ad on 2025-02-26 at 13:15:28 in the It Computer category
Click Go Apply to apply online!
You might also like these jobs in the same area.
Apply directly for this position. Please read all instructions carefully.
We do not process job applications; we simply aggregate and display job listings.
More related positions
Johannesburg: Senior Data Engineer (Azure) – Johannesburg – 900K To 1.1Mil Per Annum
A technology and analytics driven consulting company empowering clients by solving real-world business challenges that deliver tangible value and count their core capabilities as spanning the disciplines of Data Science, Data Engineering and Software Engin
View Job
Senior Data Engineer (Azure) – Johannesburg – 900K To 1.1Mil Per Annum
South Africa: Senior Microsoft Data Engineer
5 years of experience in building Data Warehouse solutions Required skills: Data Warehouse Theory, SQL, ETL/ELT, Project Management Skills required: Snowflake, and Kafka, Azure and MS Fabric Advantageous Skills: Taland, SSIS/SSAS, MS Azure, SAP BW, Qlik, P
View Job
Senior Microsoft Data Engineer
Johannesburg: Senior Data Engineer – Johannesburg – R550 To R650 Per Hour
A registered Financial Service Provider with an undivided team of diverse thinkers and doers who believe in leading through technology and pushing past their limits with innovation at its core is seeking a dynamic Senior Data Engineer to execute data engin
View Job
Senior Data Engineer – Johannesburg – R550 To R650 Per Hour
Pretoria: Senior Bi Analyst/ Data Architect – Midrand / Semi-Remote – R750 Per Hour
We are looking for a BI Analyst and Architect with experience in Oracle and PostgreSQL and AWS Glue. To grab this opportunity, you need to have the ability to develop within a specific sought-after programming language and or Cloud services and you need to
View Job
Senior Bi Analyst/ Data Architect – Midrand / Semi-Remote – R750 Per Hour
Johannesburg: Senior Azure Data Engineer – Johannesburg – R500 To R600 Per Hour
An autonomous Namibian bank, providing superior financial services to individual and corporate clients as well as international banking services by liaising directly with financial centres and institutions worldwide is looking for an Azure Data Engineer. T
View Job
Senior Azure Data Engineer – Johannesburg – R500 To R600 Per Hour
Cape Town: Senior Data Steward posted by PBT Group
PBT Group is seeking a dynamic Data Steward to join our team! In this role, you will ensure adherence to data governance and management standards across business units and enterprise levels. Youll work closely with stakeholders, develop data standards and
View Job
Senior Data Steward
Cape Town: Senior Hubspot Crm & Data Specialist posted by Ad Talent Africa
Who are we?A fast-paced, innovation-driven company specialising in spend management. They develop cloud-based software that simplifies procurement processes for mid-sized companies, enabling them to manage, optimise, and analyse business spend effectively.
View Job
Senior Hubspot Crm & Data Specialist
Cape Town: Senior Data Engineer : Ingestions Squad (Group Data & Ml Platform Tribe) posted by Progressive IT Resourcing
Our ClientCompany Group Technology is responsible for the provision of a digitally enabled technology service as a group COE, drive business and transformation and provide group-wide digital and data architecture. We operate the various technology platform
View Job
Senior Data Engineer
Pretoria: Senior Manager: Digital And Data posted by People Dimension
Job Description/Duties: Formulation of a digital strategy Manage third-party IT providers and the development of data architecture. Manage and coordinate the development of bespoke systems, digital channels and other software development. Ensure solutions
View Job
Senior Manager
Johannesburg: Senior Data Analyst posted by Isilumko Staffing
We are seeking highly skilled and experienced Data Analysts to join our dynamic team. As a Data Analyst, you will play a pivotal role in collecting, analyzing, and interpreting large datasets to derive actionable insights that contribute to strategic decis
View Job
Senior Data Analyst
Johannesburg: Senior Manager: Data-Driven Marketing (6 Months) posted by Isilumko Staffing
One of the TOP banks in South Africa is looking for a Senior Marketing Manager. You will be responsible for managing programmes, managing technologies, etc. Requirements:Proficient in digital marketing.Digital media knowledge.Proactive.A self-starter. Se
View Job
Senior Manager
Midrand: Senior Manager Data Engineer posted by Deka Minas (Pty) Ltd
RESPONSIBILITIESCreate and execute a long-term strategy for leveraging data and analytics as a key business enabler and competitive differentiator across the business.Take responsibility for developing and delivering a key element of the organisation`s dat
View Job
Senior Manager Data Engineer
Johannesburg: Senior Data Engineer posted by Salt Employee Benefits
Salt Employee Benefits is looking for a savvy Snr Data Engineer to join our IT team. This role requires the incumbent to have a significant set of technical skills, including a deep knowledge of SQL database design and multiple programming languages. The
View Job
Senior Data Engineer
Johannesburg: Senior Data Engineer posted by Salt Employee Benefits
PURPOSE OF ROLEData is one of the most valuable resources a company owns, and savy data engineers are required to build an infrastructure to keep it organized. This role requires a significant set of technical skills, including a deep knowledge of SQL data
View Job
Senior Data Engineer
Johannesburg: Senior Manager: Data Science And Business Intelligence posted by Telebest
Our client has an opportunity available for a Senior Manager in the Data Science and Business Intelligence department based in Sandton.Requirements:Postgraduate degree in and Analytical or Qualitative Field.An MBA or additional financial qualification woul
View Job
Senior Manager
Durban: Senior Data Engineer posted by Carlysle Human Capital
This role is for a Senior Data Engineer to help build and maintain scalable data pipelines and related systems in a research focused environment. You will be responsible for designing, developing, testing, and deploying technical platforms and data solutio
View Job
Senior Data Engineer
Cape Town: Senior Data Analyst posted by Goldman Tech
Job Description:We have an amazing opportunity for one of our clients in Bellville - Cape Town.We require a candidate with:• Diploma in Data analysis / Information sciences / IT• At least Matric• 2 or more years in data processing / cleaning
View Job
Senior Data Analyst
Cape Town: Senior Data Analyst posted by Goldman Tech
Job Description:We are seeking a highly skilled and experienced Senior Data Analyst to join one of our Financial Services clients. The ideal candidate will be responsible for analyzing complex data sets and providing valuable insights to inform our busines
View Job
Senior Data Analyst
South Africa: Senior Data Engineer posted by Goldman Tech
Job Description:We have an amazing opportunity for a Senior Data EngineerWe require a candidate with:• Degree in Data Science, Engineering, Computer Science or Math.• Cloud certifications advantageous.• 5-10 years of experience in a data eng
View Job
Senior Data Engineer
Johannesburg: Senior Data Analyst posted by Goldman Tech
Job Description:One of our clients in Johannesburg is searching for an innovative senior data analyst to join their team. We require a candidate with:• Post matric qualifications (Quantitative or IT subjects are advantageous• 3 + years working ex
View Job
Senior Data Analyst
Johannesburg: Senior Data Warehouse Developer posted by Goldman Tech
Job Description:We have an amazing opportunity for a Senior Data Warehouse Developer in Johannesburg!We require a candidate with:• BSc. Computer Sciences or National Diploma in IT• 5+ years experience in a data warehousing role• 4+ years wri
View Job
Senior Data Warehouse Developer
Cape Town: Senior Sql Database Administrator posted by Goldman Tech
Job Description:We have an amazing opportunity for a Senior SQL Database Administrator in Cape Town!We require a candidate with:• A relevant 3-year Information Technology Degree or Diploma• Minimum of 10 years` experience in a similar role •
View Job
Senior Sql Database Administrator
Cape Town: Senior Data Analyst posted by Goldman Tech
Job Description:We have an amazing opportunity for a Senior Data Analyst in Cape Town! We require a candidate with experience in:• MS Excel• SQL query writing• Big data reporting packages (Power BI, Qlikview, Tableau)Should you meet the requ
View Job
Senior Data Analyst
Johannesburg: Senior Data Warehouse/ Bi Developer posted by Goldman Tech
Job Description:We have an amazing opportunity for a Senior Data Warehouse/ BI Developer in Johannesburg!We require a candidate with experience in:• BI Toolsets• ETL Applications• T-SQL• Implementation of DW/BI environments• BI Too
View Job
Senior Data Warehouse/ Bi Developer
Cape Town: Senior Data Scientist posted by Goldman Tech
Job Description:We have an exciting client in Cape Town looking for a Senior Data Scientist.You will:Build segmentation and propensity modelsBuild real time systems that integrate with the rest of our stackBuild visualisations using R Shiny, DataStudio, Ta
View Job
Senior Data Scientist