Data Engineer : Ingestions Squad (Group Data & Ml Platform Tribe)
Posted on 2025-01-31
Job Summary
Job Details
Who are we?
Company Group Technology is responsible for the provision of a digitally enabled technology service as a group COE, drive business and transformation and provide group-wide digital and data architecture. We operate the various technology platforms and shared services, ensure Cyber and Information Security resilience, and act as technology governance and risk orchestrator for technology across Company
.What will you do?
Were a newly created engineering organisation on a mission to empower and accelerate autonomous value creation through insights and ML across the group. Our main users are the data scientists and analysts who sit inside the business units and support them in developing and re-developing their financial and digital products to better meet the needs of our clients and our shareholders. Our other users are the data management and data product teams who produce the data sets analysts and scientists need to launch straight into their work.
The tribe is made up of 3 different engineering squads covering everything from how we ingest and store data, to how we develop and share ML artefacts and insights. We have one for ingestions, one for data storage and processing and one for insights & ML tooling. We have one data engineering talent pipeline for the whole tribe, where placements into specific squads are explored later in the interview process based on squad needs and candidate abilities. Data engineers report to the tech leads of the squad they are embedded into.
What will make you successful in this role?
What success will look like for you 12 months into the role.
- Built configurable data ingestion platforms to collect and protect data from any source within two weeks or less. The team has bought and built to assemble a tool suite of persistent and secure ingestion tools, optimized for cost efficiency, with reliability as a non-negotiable standard. Success will be measured by the consistent achievement of the two-week ingestion target while maintaining high reliability and security.
- Engineered the platform for observability and performance. Made your systems observable from the outside, taking ownership of their performance. Facilitated real-time tracking of the systems internal state through logs, metrics, and traces. Defined clear and measurable Service Level Indicators (SLIs) and Service Level Objectives (SLOs), and integrate these into team OKRs to drive excellence. Success will be measured by meeting or exceeding defined performance and reliability benchmarks, and the quick identification and resolution of issues.
- Engineer the platform with privacy and security by design. Secured the platform through compliance engineering initiatives that reduced the time and cognitive load related to compliance. Implemented our Data Governance and Privacy policies effectively, leveraging encryption, firewalls, VPCs, Role Based Access Control and IAM integrations such as Active Directory. Success will be measured by the platforms adherence to security and privacy standards, with minimal compliance overhead for users.
- Leveraged containerization and infrastructure as code. Implemented containerization strategies and infrastructure as code (IaC) practices to ensure scalable, repeatable, and efficient deployment of data services. Utilized tools like Docker and Terraform to automate infrastructure management and streamline the development pipeline. Success will be measured by the consistency and reliability of deployments, reduced deployment times, and increased system scalability.
- Contributed to technology decisions. Engaged in technology spikes to clarify needs and articulate solution criteria. Evaluated different options through hands-on experimentation, leading to documented evaluations and recommendations that were understood by technology leaders or users across the company. Success will be measured by the quality and clarity of your contributions to technology decisions and the adoption of your recommendations.
- Invested in your own development. Executed on a culture of excellence and continuous improvement for both your part of the platform and your own abilities. Lived our culture of ownership, curiosity, and continuous learning. Participated in pre and post-mortems, sharing lessons learned across the organization along with how you are improving based on those lessons. Success is measured by your active participation in continuous learning initiatives and the tangible improvements in platform performance and personal growth.
Qualification
- Matric
- National Diploma in an Information Technology related discipline or a bachelor`s degree in computer science, Statistics, Informatics, Information Systems, or a quantitative field will be recommended.
Experience
- 5+ years` experience as a data engineer in data platform or service engineering team with at least 2 in a modern context with cloud technologies
- Track record of high impact and investing in your own development.
Skills and Thinking Preference
- You look for ways to do, instead of reasons not to. You are high agency, high ownership in everything you do. You know we own our future, only we can make it happen. If you find something that keeps us from our mission, you own it or work collaboratively with others until you find the right owner of it.
- Where some see impossible, you see a way. You have the strong conviction in our ability to innovate and bring financial services, and financial confidence to everyone across the continent. You turn obstacles into opportunity, chance into change.
- You move fast and fix things. You publish early and often, when you fail you learn and go again. You know that speed gives you the licence to fail, because youre moving fast enough to correct course.
- You love creating more with less. Knowing that the biggest impact is born of the smallest acts, scale is built into your thinking from day 1. This is not about meeting the needs of thousands; its about exceeding the needs of millions. And working through small and mighty teams is way well do it.
- You seek out and value different perspectives. Believing that when we change how we look at things, how things look for us also changes. Making tomorrow not just different, but better.
Personal Attributes
- Plans and aligns – Contributing through others
- Optimises work processes – Contributing through others
- Collaborates – Contributing strategically
- Resourcefulness – Contributing strategically
- Tech savvy – Contributing strategically
Data Engineer : Ingestions Squad (Group Data & Ml Platform Tribe) position available in Western Cape, Cape Town. This job position was posted by Progressive IT Resourcing. The job has been posted as a premium ad on 2025-01-31 at 13:13:39 in the It Computer category
Click Go Apply to apply online!
You might also like these jobs in the same area.
Apply directly for this position. Please read all instructions carefully.
We do not process job applications; we simply aggregate and display job listings.
More related positions
Cape Town City Centre: Senior Software Engineer – Data, Group Data & Ml Platform Tribe
What will you do ? Our client is a newly created engineering organisation on a mission to empower and accelerate autonomous value creation through insights and ML across the group. The company main users are the data scientists and analysts who sit inside
View Job
Senior Software Engineer – Data, Group Data & Ml Platform Tribe
Johannesburg: Senior Teradata Data Engineer – Contract – Sandton – R680 Per Hour
We are currently in search for a Data Engineer with 5 to 8 years experience in data engineering and strong backend and front-end development skills. You will be required to build data warehouse components on Teradata warehouse (3NF) and will have to comply
View Job
Senior Teradata Data Engineer – Contract – Sandton – R680 Per Hour
Johannesburg: Data Engineering Specialist
Experience using Kimball Experience working on Microsoft Dynamics 365 Experience working with Azure cloud-based data platform and Azure Databricks (data bricks is advantageous) Inmon would be advantageous but not essential Data Engineering Specialist posit
View Job
Data Engineering Specialist
Cape Town City Centre: Senior Data And Vehicle Support Engineer (Telematics) Cape Town
Senior Data and Vehicle Support Engineer (Telematics) Cape Town Minimum requirements and experience: BEng or MEng (Electronic or Mechatronic Engineering) Minimum of 5 years working experience in telematics systems and -components including data managemen
View Job
Senior Data And Vehicle Support Engineer (Telematics) Cape Town
Centurion: Senior Data And Vehicle Support Engineer (Telematics) Centurion
Senior Data and Vehicle Support Engineer (Telematics) Centurion Minimum requirements and experience: BEng or MEng (Electronic or Mechatronic Engineering) Minimum of 5 years working experience in telematics systems and -components including data managemen
View Job
Senior Data And Vehicle Support Engineer (Telematics) Centurion
Johannesburg: Data Engineer
As a Specialist Recruiter, I am looking for driven and skilled Data Engineers to partner with to secure their next role. As a Data Engineer, you will have the opportunity to work on complex data infrastructure, build scalable data pipelines, and play a piv
View Job
Data Engineer
Johannesburg: Junior Data Engineer – Johannesburg – R380k To R480k Per Annum
A leading African Integrated Workplace Management Solutions Provider with over 50-years of experience are looking for a junior Data Engineer to design, build, and maintain scalable data pipelines and systems to support analytics and reporting as well as en
View Job
Junior Data Engineer – Johannesburg – R380k To R480k Per Annum
Johannesburg: Senior Data Analyst/Engineer – Johannesburg – R800k To R1mil Per Annum
A group with an inhouse system that runs all their businesses from Life Insurance to Unit Trusts including bringing Impact Farming to Utilities Management. This modern and versatile system is their pride and secret sauce of their success. The Data Analyst/
View Job
Senior Data Analyst/Engineer – Johannesburg – R800k To R1mil Per Annum
Johannesburg: Data Engineer
Required Qualifications: Education: Bachelors degree in Computer Science, Software Engineering, Informatics, or Information Systems. A degree from an accredited institution to ensure a strong foundation in programming, algorithms, and software design. Equi
View Job
Data Engineer
Johannesburg: Data Engineer/ Scientist – Johannesburg – R500 To R600 Per Hour
A dynamic global group with a focus on innovation topics as well as comprehensive IT solutions and Global Team collaboration driving experiences with a deep insight into the compliance and IT Methodology processes is recruiting for a Data Engineer/ Scienti
View Job
Data Engineer/ Scientist – Johannesburg – R500 To R600 Per Hour
Johannesburg: Senior Azure Data Engineer – Johannesburg – R500 To R600 Per Hour
An autonomous Namibian bank, providing superior financial services to individual and corporate clients as well as international banking services by liaising directly with financial centres and institutions worldwide is looking for an Azure Data Engineer. T
View Job
Senior Azure Data Engineer – Johannesburg – R500 To R600 Per Hour
Pretoria: Data Engineer
Are you an experienced Data Engineer with a passion for building scalable data systems? A leading technology company is seeking an intermediate Data Engineer to join their fully remote team, supporting international marketplaces. This exciting opportunity
View Job
Data Engineer
Cape Town City Centre: Lead Data Engineer
We are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team in Cape Town. The ideal candidate will play a critical role in designing, developing, and optimizing our data infrastructure, ensuring it meets the needs of our gr
View Job
Lead Data Engineer
Johannesburg: Azure Data Engineer – Johannesburg – R650k Up To R850k Per Annum
A registered Financial Service Provider with an undivided team of diverse thinkers and doers who believe in leading through technology and pushing past their limits with innovation at its core is seeking a dynamic Azure Data Engineer to execute data engine
View Job
Azure Data Engineer – Johannesburg – R650k Up To R850k Per Annum
Pretoria: Team Lead Data Engineer
Qualifications & Experience Tertiary qualification in IT or related field. Certification: DP-203 (Data Engineering on Microsoft Azure). 57 years of experience in data engineering or database development. Expertise in data modeling, ETL solutions, and cloud
View Job
Team Lead Data Engineer
Cape Town City Centre: Data Engineer
Responsibilities: Building and optimising big data pipelines, architectures and data sets Performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement Operations
View Job
Data Engineer
Johannesburg: Senior Data Engineer (Sas & Python) – Johannesburg – R450 To R550 Per Hour
Join a team of dynamic experts within a consultancy known for leading a world class data analytics/warehouse capability and specialising in AI and applications and helping enterprise clients to extract business value by implementing AI solutions has a vaca
View Job
Senior Data Engineer (Sas & Python) – Johannesburg – R450 To R550 Per Hour
Cape Town City Centre: Software Engineer – Data, Group Data & Ml Platform Tribe
What will you do? Our client is a newly created engineering organisation on a mission to empower and accelerate autonomous value creation through insights and ML across the group. The companys main users are the data scientists and analysts who sit inside
View Job
Software Engineer – Data, Group Data & Ml Platform Tribe
Alberton: Junior Data Analyst / Engineer (Jb4991) posted by Kontak Recruitment
Junior Data Analyst / Engineer (JB4991) Alberton, Gauteng R15 000 to R20 000 a month CTCContract 6 to 12 months (May become permanent)Join a cutting-edge Supply Chain and Business Strategy Consultation company dedicated to turning data into powerful strate
View Job
Junior Data Analyst / Engineer (Jb4991)
Alberton: Graduate Data Analyst / Engineer (Jb4992) posted by Kontak Recruitment
Graduate Data Analyst / Engineer (JB4992) Alberton, GautengR10 000 to R15 000 a month CTCContract 6 to 12 months (May become permanent)Join a cutting-edge Supply Chain and Business Strategy Consultation company dedicated to turning data into powerful strat
View Job
Graduate Data Analyst / Engineer (Jb4992)
Sandton: Data Engineer
Our client is seeking an experienced Data Engineer. The ideal candidate will have 3 to 5 years of professional experience as a Data Engineer or related role. The role involves maintaining, implementing, and innovating current and new projects within a coll
View Job
Data Engineer
Cape Town City Centre: Data Streaming Engineer
Are you a skilled Data Streaming Engineer passionate about real-time data processing and cutting-edge technology? Join our PBT team and play a pivotal role in shaping data streaming architecture. This position offers the opportunity to work with industry-l
View Job
Data Streaming Engineer
Cape Town City Centre: Data Engineer
? Join PBT Group as a Senior Data Engineer ? Are you a dynamic data engineer passionate about optimising large-scale data ecosystems? PBT Group is looking for a Data Engineer to design and implement robust, scalable processes that support our growing data
View Job
Data Engineer
Johannesburg: Data Engineering Specialist
Requirements: A Masters Degree in Computer Sciences or Data Sciences Certifications in cloud platforms (e.g., Azure) and Microsoft products (e.g., Power BI, Dynamics365) Responsibilities: Responsible to design and build data pipelines and efficient data fl
View Job
Data Engineering Specialist
Johannesburg: Senior Data Engineer
PBT Group currently has numerous vacancies for Data Engineers skilled in tools such as the Microsoft Stack (SSIS, SSRS, SSAS), Power BI, AWS, Azure, DataStage, SAS, Oracle BI etc. Duties: Design, develop, test and deploy ETL for ODS and data mart projects,
View Job
Senior Data Engineer