Date | 2024-10-15 |
---|---|
Job Title | Senior Data Engineer : Ingestions Squad (Group Data & Ml Platform Tribe) |
Employer | Progressive IT Resourcing More Information |
Salary | 0 |
Category | It Computer |
Location |
Western Cape / Cape Town |
Job Summary
Our Client
Company Group Technology is responsible for the provision of a digitally enabled technology service as a group COE, drive business and transformation and provide group-wide digital and data architecture. We operate the various technology platforms and shared services, ensure Cyber and Information Security resilience, and act as technology governance and risk orchestrator for technology across Company
.What will you do?
A newly created engineering organisation on a mission to empower and accelerate autonomous value creation through insights and ML across the group. Our main users are the data scientists and analysts who sit inside the business units and support them in developing and re-developing their financial and digital products to better meet the needs of our clients and our shareholders. Our other users are the data management and data product teams who produce the data sets analysts and scientists need to launch straight into their work.
The tribe is made up of 3 different engineering squads covering everything from how we ingest and store data, to how we develop and share ML artefacts and insights. We have one for ingestions, one for data storage and processing and one for insights & ML tooling. We have one data engineering talent pipeline for the whole tribe, where placements into specific squads are explored later in the interview process based on squad needs and candidate abilities. Data engineers report to the tech leads of the squad they are embedded into.
What will make you successful in this role?
What success will look like for you 12 months into the role.
- Built configurable data ingestion platforms to collect and protect data from any source within two weeks or less. The team has bought and built to assemble a tool soup of persistent and secure ingestion tools, optimized for cost efficiency, with reliability as a non-negotiable standard. Success will be measured by the consistent achievement of the two-week ingestion target while maintaining high reliability and security.
- Engineered the platform for observability and performance. Made your systems observable from the outside, taking ownership of their performance. Facilitated real-time tracking of the systems internal state through logs, metrics, and traces. Defined clear and measurable Service Level Indicators (SLIs) and Service Level Objectives (SLOs), and integrate these into team OKRs to drive excellence. Success will be measured by meeting or exceeding defined performance and reliability benchmarks, and the quick identification and resolution of issues.
- Engineer the platform with privacy and security by design. Secured the platform through compliance engineering initiatives that reduced the time and cognitive load related to compliance. Implemented our Data Governance and Privacy policies effectively, leveraging encryption, firewalls, VPCs, Role Based Access Control and IAM integrations such as Active Directory. Success will be measured by the platforms adherence to security and privacy standards, with minimal compliance overhead for users.
- Leveraged containerization and infrastructure as code. Implemented containerization strategies and infrastructure as code (IaC) practices to ensure scalable, repeatable, and efficient deployment of data services. Utilized tools like Docker and Terraform to automate infrastructure management and streamline the development pipeline. Success will be measured by the consistency and reliability of deployments, reduced deployment times, and increased system scalability.
- Contributed to technology decisions. Engaged in technology spikes to clarify needs and articulate solution criteria. Evaluated different options through hands-on experimentation, leading to documented evaluations and recommendations that were understood by technology leaders or users across the company. Success will be measured by the quality and clarity of your contributions to technology decisions and the adoption of your recommendations.
- Invested in your own development. Executed on a culture of excellence and continuous improvement for both your part of the platform and your own abilities. Lived our culture of ownership, curiosity, and continuous learning. Participated in pre and post-mortems, sharing lessons learned across the organization along with how you are improving based on those lessons. Success is measured by your active participation in continuous learning initiatives and the tangible improvements in platform performance and personal growth.
- Technical leadership and coaching. Enable a culture of continuous learning and assist other engineers in their development journey.
Qualification
- Matric
- National Diploma in an Information Technology related discipline or a bachelor`s degree in computer science, Statistics, Informatics, Information Systems, or a quantitative field will be recommended.
Experience
- 5+ years` experience as a data engineer in data platform or service engineering team with at least 2 in a modern context with cloud technologies
- Track record of high impact and investing in your own development.
Skills and Thinking Preference
- Ability to act independently and to deal with high levels of ambiguity.
- You look for ways to do, instead of reasons not to. You are high agency, high ownership in everything you do. You know we own our future, only we can make it happen. If you find something that keeps us from our mission, you own it or work collaboratively with others until you find the right owner of it.
- Where some see impossible, you see a way. You have the strong conviction in our ability to innovate and bring financial services, and financial confidence to everyone across the continent. You turn obstacles into opportunity, chance into change.
- You move fast and fix things. You publish early and often, when you fail you learn and go again. You know that speed gives you the licence to fail, because youre moving fast enough to correct course.
- You love creating more with less. Knowing that the biggest impact is born of the smallest acts, scale is built into your thinking from day 1. This is not about meeting the needs of thousands; its about exceeding the needs of millions. And working through small and mighty teams is way well do it.
- You seek out and value different perspectives. Believing that when we change how we look at things, how things look for us also changes. Making tomorrow not just different, but better.
Personal Attributes
- Plans and aligns – Contributing through others
- Optimises work processes – Contributing through others
- Collaborates – Contributing strategically
- Resourcefulness – Contributing strategically
- Tech savvy – Contributing strategically
Core Competencies
- Cultivates innovation – Contributing through others
- Customer focus – Contributing through others
- Drives results – Contributing through others
- Collaborates – Contributing through others
- Being resilient – Contributing through others
Senior Data Engineer : Ingestions Squad (Group Data & Ml Platform Tribe) position available in Western Cape, Cape Town. This job position was posted by Progressive IT Resourcing. The job has been posted as a premium ad on 2024-10-15 at 13:01:25 in the It Computer category
Click Go Apply to apply online!
You might also like to look at the available jobs in the same area.
Apply directly on jobmail for this position
Some posts have contact information included with other instructions. All applicants are urged to read the instructions carefully.
We will list jobs at the bottom of each job, so feel free to scroll down and continue your search.
We do not accept any job applications and merely offer the service of daily jobs being mined and displayed on our job portal.
Each job post has a link to take you directly to the original post to apply on their website or the original website where the post came from.
Here are some more related positions
City Bowl: Senior Data Analyst/Scientist posted by Lebo Business Consulting (Pty) Ltd
Manage performance of data analyst/operator team; Play a leading role in the designing and documenting of operating procedures; Conduct, monitor and calibrate astronomical observations and use appropriate computing resources towards successful operation of
View Job
Senior Data Analyst/Scientist
Pretoria: Senior Manager: Digital And Data
Job Description/Duties: · Formulation of a digital strategy · Manage third-party IT providers and the development of data architecture. · Manage and coordinate the development of bespoke systems, digital channels and other software development. · Ensure so
View Job
Senior Manager
South Africa: Senior Data Scientist – Cape Town – 6-Month Contract – R70k To R130k Per Month
Join a company filled with like-minded individuals who deliver quality solution delivery services and prioritize flexibility in work arrangements, embracing both remote and hybrid models to cater to our staff``s preferences as a Senior Data Scientist you w
View Job
Senior Data Scientist – Cape Town – 6-Month Contract – R70k To R130k Per Month
South Africa: Senior Data Engineer – Remote – R800k To R1 Mil Per Annum
Join a market leader in compliant call recording solutions and beyond capturing every interaction, with analytics platform extracts, processes and delivers insights from millions of data points across diverse communication channels the analytics team is lo
View Job
Senior Data Engineer – Remote – R800k To R1 Mil Per Annum
Cape Town City Centre: Senior Data Engineer
Responsibilities: Design and implement scalable data pipelines using Apache Spark, Scala, and Java Develop and maintain data architectures for batch and real-time processing Collaborate with cross-functional teams to identify and prioritize project require
View Job
Senior Data Engineer
Centurion: Senior Database Administrator
Key Responsibilities : Requirements Gathering : Collaborate with business stakeholders to collect, document, and review database requirements. Database Design & Development : Architect, develop, and implement scalable, reliable databases that meet business
View Job
Senior Database Administrator
Cape Town City Centre: Senior Data And Vehicle Support Engineer (Telematics) Cape Town
Senior Data and Vehicle Support Engineer (Telematics) Cape Town Minimum requirements and experience: BEng or MEng (Electronic or Mechatronic Engineering) Minimum of 5 years working experience in telematics systems and -components including data management
View Job
Senior Data And Vehicle Support Engineer (Telematics) Cape Town
Centurion: Senior Data And Vehicle Support Engineer (Telematics) Centurion
Senior Data and Vehicle Support Engineer (Telematics) Centurion Minimum requirements and experience: BEng or MEng (Electronic or Mechatronic Engineering) Minimum of 5 years working experience in telematics systems and -components including data management
View Job
Senior Data And Vehicle Support Engineer (Telematics) Centurion
Johannesburg: Senior Data Scientist – Johannesburg – Renewable Contract– Up To R100k Per Month
Join a company filled with like-minded individuals who deliver quality solution delivery services and prioritize flexibility in work arrangements, embracing both remote and hybrid models to cater to our staff``s preferences as a Senior Data Scientist you w
View Job
Senior Data Scientist – Johannesburg – Renewable Contract– Up To R100k Per Month
Johannesburg: Senior Sql Data Engineer
As a Specialist Recruitment Consultant within the IT industry, my clients and I are constantly on the lookout for accomplished Senior SQL Data Engineer with strong academics, robust project experience and technical knowledge. Requirements: Completed qualif
View Job
Senior Sql Data Engineer
Johannesburg: Senior Data Scientist
Qualifications and Experience required 5-8 years of experience as a Data Scientist with expertise in machine learning and AI technologies. Proficient in Python and experience with deep learning frameworks such as TensorFlow. Hands-on experience with machin
View Job
Senior Data Scientist
South Africa: Senior Data Scientist – Cape Town – R1.2Mil To R1.4Mil Per Annum
A dynamic, industrial holding company dedicated to investing in, growing and starting businesses a global footprint in diverse industries including manufacturing, distribution, technology, big data, engineering and energy efficiency seek a Senior Data Scie
View Job
Senior Data Scientist – Cape Town – R1.2Mil To R1.4Mil Per Annum
Cape Town City Centre: Senior Data Scientist / Ai Developer (Ch1051) – Fully Remote
Our client is a leading software services and consulting company focusing on delivering innovative solutions with a strategic emphasis on generative AI. They are looking for an experienced Senior Data Scientist / AI Developer / Data Engineer to join their
View Job
Senior Data Scientist / Ai Developer (Ch1051) – Fully Remote
Johannesburg: Senior Data Analyst
Requirements: Understanding and application of Big Data Design and assist in the optimization of Data Warehouse/Data Lake and Reporting Development, testing and administration of BI models(tabular, SSIS, SSAS & Visual Studio) Proficiency in data manipulati
View Job
Senior Data Analyst
Cape Town City Centre: Senior Data Engineer : Ingestions Squad (Group Data & Ml Platform Tribe)
Our Client Company Group Technology is responsible for the provision of a digitally enabled technology service as a group COE, drive business and transformation and provide group-wide digital and data architecture. We operate the various technology platfor
View Job
Senior Data Engineer
Johannesburg: Senior Data Analyst
We are seeking a highly skilled Data Management Specialist to join our dynamic team. The successful candidate will play a critical role in linking external data to master data, ensuring the accuracy of inbound data through analysis and troubleshooting. You
View Job
Senior Data Analyst
Johannesburg: Senior Data Scientist
Duties: Optimisation and programming as a skill set on all platforms Understanding all the latest AI and ML Action planner Experience handling high level projects Has developed software from the beginning Job Experience & Skills Required: 5 years experienc
View Job
Senior Data Scientist
Johannesburg: Senior Data Engineer posted by Deka Minas (Pty) Ltd
We are excited to introduce an exceptional opportunity for a Senior Data Engineer! In this pivotal role, you will spearhead the development and optimization of our data engineering solutions, focusing on modernizing our data warehousing and processing stra
View Job
Senior Data Engineer
Pretoria: Senior Manager: Digital And Data posted by People Dimension
Job Description/Duties: Formulation of a digital strategy Manage third-party IT providers and the development of data architecture. Manage and coordinate the development of bespoke systems, digital channels and other software development. Ensure solutions
View Job
Senior Manager
Cape Town: Senior Data Analyst posted by PBT Group
PBT Group is seeking a Senior Data Analyst with at least 3 years of relevant experience within the insurance or financial services industry. The successful candidate will support and maintain the data warehouse in line with the data model and metadata repo
View Job
Senior Data Analyst
Stellenbosch: Senior Decision (Data) Scientist (Ch1033) posted by Capital H Staffing and Advisory Solutions
Our client in the banking industry is looking for experienced Senior Decision Scientists.The purpose of the role is delivering business solutions via a collaborative approach involving mathematical formulae, business tactics, technological applications, an
View Job
Senior Decision (Data) Scientist (Ch1033)
Centurion: Senior Data Engineer posted by CF & I Consulting
The Data Engineer will have a knack for data analysis, data manipulation and data modelling and will be responsible for understanding and driving the overall technical vision and planning of a client`s organisation and translating business needs into techn
View Job
Senior Data Engineer
Cape Town: Senior Data Scientist posted by PBT Group
PBT Group is seeking a Senior Data Scientist to spearhead the development of retail Analytical Data Assets (ADA) and associated strategies for key `Use Cases` using data analysis, predictive modeling, simulation, and optimization techniques to identify tre
View Job
Senior Data Scientist
East London: Senior Data Specialist (Permanent) posted by Profile Personnel
Main purpose of the jobOwnership of Outsourced Credit Controls data and processes including, but not limited to, development, implementation and maintenance of operational and reporting processes. Engaging with business to ensure understanding and complian
View Job
Senior Data Specialist (Permanent)
Johannesburg: Senior Data Analyst posted by Isilumko Staffing
Job description:The key accountabilities for the data analyst includes but is not limited to:Data collection and cleansing.Data Analysis.Reporting and visualisation.Data modelling and forecasting.Data interpretation and insights.Data quality and governance
View Job
Senior Data Analyst
Email Alerts
Click the button below and submit your email to receive email alerts with the latest jobs.
This service is offered by Result Generation
We do not save your information, and your email is the only information we forward to the service.
If you wish to unsubscribe, please click here