Menu Close

Cape Town: Data Engineering & Streaming Lead posted by PBT Group

Cape Town: Data Engineering & Streaming Lead posted by PBT Group

Posted on 2025-05-18 00:00:00

Employer PBT Group
Category Other Finance/Accounting
Location Western Cape  / Cape Town

Job Summary

The Data Engineering & Streaming Lead will be responsible for building, enhancing, and maintaining real-time data pipelines. The role involves working closely with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer, the candidate will develop and maintain data ingestion pipelines, ensuring the bank’s continued growth through efficient data handling. The role also includes collaborating with multiple teams to understand data needs and translate them into scalable platforms and services.

Duties & Responsibilities

Operational Delivery

  • Build, enhance, and maintain real-time data pipelines.
  • Work with infrastructure and operations teams to maintain data infrastructure.
  • Identify, document, and resolve feature gaps while implementing solutions.
  • Modernize and maintain services and tooling to ensure resilience, fix data discrepancies, and enhance customer experience.
  • Monitor daily execution, diagnose and log issues, and fix pipelines to ensure SLAs are met.
  • Mentor junior engineers through code reviews, best practices, and knowledge sharing.

Technical Leadership

  • Participate in the engineering community of practice.
  • Share AWS knowledge and practical experience within the community.
  • Challenge and contribute to the development of architectural principles and patterns.

Compliance

  • Ensure solutions adhere to Olympus patterns, guidelines, and standards.
  • Operate within project environments and participate in continuous improvement efforts.

Delivery Management

  • Follow and participate in Agile methodologies such as sprint planning, backlog grooming, retrospectives, demos, and PI planning.

Skills & Experience Required

Essential:

  • Strong AWS Data Engineering experience.
  • Hands-on experience with Kafka and Confluent.
  • Strong expertise in real-time data streaming tools such as Kafka & Flink.
  • Proficiency in:
    • Apache Spark
    • Apache Storm
    • Cloudera Data Flow
    • Databricks
    • Hadoop
    • AWS Kinesis Streaming
  • Experience in developing cloud-based solutions.
  • 2-3 years of experience designing and developing streaming data pipelines for ingestion or transformation using AWS technologies.
  • Experience with distributed log systems such as Kafka and AWS Kinesis.

Qualifications & Certifications

  • A degree in Computer Science, Information Systems, Business Administration, Commerce, or equivalent.
  • Bachelors Degree in Computer Science, Big Data, or similar fields.
  • AWS Data Engineer Certification (Advantageous).
  • Relevant technical certifications (Preferred).

* In order to comply with the POPI Act, for future career opportunities, we require your permission to maintain your personal details on our database. By completing and returning this form you give PBT your consent

View Job  Cape Town: Outdoor Media Specialist – Sales (OOH) posted by Talent Link

** If you have not received any feedback after 2 weeks, please consider you application as unsuccessful.

Click Go Apply to apply online!


Get Similar Job Alerts
Enter your WhatsApp number (e.g., +27740908132)
You'll receive alerts for new jobs in Cape Town, Western Cape

Apply directly for this position. Please read all instructions carefully.

We do not process job applications; we simply aggregate and display job listings.

More related positions


Cape Town: New Vehicle Sales Executive posted by Intercon Recruitment

Dealership in Cape Town is looking for an experienced New Vehicle Sales Executive, with previous Motor Dealership New Vehicle Sales Experience. Salary Basic...


View Job
New Vehicle Sales Executive

Northern Suburbs: BOILERMAKERS – Based In Cape Town posted by Tom Nel Recruitment

Leading Progressive Manufacturing company seeks a number of Boilermakers urgently for six month contracts.Key experience of 3-5 Years post apprenticeship...


View Job
BOILERMAKERS – Based In Cape Town

Cape Town: National Key Accounts Sales Manager posted by The Individual Touch CC

Generate new additional businessGrow the national customer baseManaging analyzing the national customer baseAnalyzing price decreases suspended business...


View Job
National Key Accounts Sales Manager

Cape Town: Junior Accountant posted by Africa Thinking Management Solutions

Job Advertisement Junior AccountantLocation Cape Town -Observatory Company Africa Thinking Management SolutionsAfrica Thinking Management Solutions is...


View Job
Junior Accountant

Cape Town: Intermediate Financial Administrator posted by Construct Executive Search

Applicants must have the following requirementsMust have a Diploma in Accounting or Bookkeeping.Must have 3-5 years of experience as a Financial...


View Job
Intermediate Financial Administrator

Eastern Cape: Town Planner (JB5167) posted by Kontak Recruitment

Town Planner JB5167 Chintsa, Eastern CapeCompensation Range R40 45 000 CTC per month Negotiable Category EngineeringLead zoning, rezoning, and land use...

View Job  Johannesburg: Sales & Marketing_Woodmead JHB posted by Pro Tem

View Job
Town Planner (JB5167)

Cape Town: Roof sheeter – Urgently Needed posted by Batt Master Roofing and Guttering

Roof sheeter needed Must be able to remove and install roof sheets etc and waterproofing for maintenance company Work in fascias as wellWork experience a...


View Job
Roof sheeter – Urgently Needed

Cape Town: Litigation Secretary posted by Marais Muller Hendricks Attorneys

Marais Muller Hendricks Inc., a leading law firm in Cape Town, is seeking to appoint an experienced and highly organised Litigation Secretary to join our...


View Job
Litigation Secretary

Cape Town: Bookkeeper – Restaurant Industry (Salt River) posted by The Vocation Station

About the RoleWere looking for a detail-oriented Bookkeeper to join our clients team and support the financial operations of four businesses under one roof....


View Job
Bookkeeper – Restaurant Industry (Salt River)

Cape Town: Litigation Secretary posted by Cora O’Neil Recruitment Agency

Cape Town City Centre LITIGATION SECRETARY Minimum Requirements-Well presentable and professional preferably female-Excellent verbal communication skills-2...


View Job
Litigation Secretary

Cape Town: Electrical Engineer – Building Services posted by Business Recruitment Services

This role requires collaboration with multidisciplinary teams and clients to deliver fit-for-purpose solutions that surpass industry best practices and...


View Job
Electrical Engineer – Building Services

Cape Town: Intermediate SHERQ Officer posted by Construct Executive Search

Applicants must have the following requirementsMust have a Bachelors Degree or National Diploma in Safety Management or Occupational Health and Safety. Must...


View Job
Intermediate SHERQ Officer

Cape Town: Regional Manager in Built-in Furniture Manufacturing Industry posted by Home Concept

Home Concept is looking for an experienced Regional Manager to join our team. In this role, youll lead sales, manage operations, and support teams to ensure...


View Job
Regional Manager in Built-in Furniture Manufacturing Industry

Cape Town: Financial Accountant posted by Executive Placings

Travel Management Company is looking for an Accountant to be based in Cape Town. This is a hybrid role.The main purpose of this role is to ensure accuracy...


View Job
Financial Accountant

Cape Town: Car Rental Agent – Urgent posted by Vogue Personnel

Join Our Team as a Car Rental Agent! Were looking for a dedicated and organized Car Rental Agent to join our dynamic team and play a key role in ensuring...


View Job
Car Rental Agent – Urgent

Cape Town: New Business Consultant posted by Intercon Recruitment

Company based in Cape Town is looking for a Senior New Business Consultant Sales Increase and drive new business with a focus on quality and...

View Job  Johannesburg South: Financial Manager posted by Network Finance

View Job
New Business Consultant

Cape Town: New Vehicle Sales Executive posted by Intercon Recruitment

Dealership in Cape Town is looking for an experienced New Vehicle Sales Executive with previous Motor Dealership New Vehicle Sales Experience. Salary Basic...


View Job
New Vehicle Sales Executive

Cape Town: Business Development Manager – Urgently Needed posted by One Source ICT

One Source ICT is an innovative technology company specializing in Information and Communication Technology ICT solutions. With a focus on excellence and...


View Job
Business Development Manager – Urgently Needed

Cape Town: Tour Operator – Urgent posted by Vogue Personnel

Exciting Career Opportunity in Southern Africa Travel!Are you passionate about travel and adventure? Do you have the skills and drive to make unforgettable...


View Job
Tour Operator – Urgent

Cape Town: Senior Construction Contracts Manager posted by Construct Executive Search

Applicants must have the following requirementsMust have a Bachelors Degree or Diploma in Building or Civil Engineering.Must be registered with SACPCMP as a...


View Job
Senior Construction Contracts Manager

Cape Town: Sales Representative | New Business Consultant posted by Intercon Recruitment

Company based in Cape Town is looking for a Sales Representative New Business Consultant to Increase Sales and drive new business with a focus on quality...


View Job
Sales Representative | New Business Consultant

Cape Town: SALES MANAGER posted by The Recruitment Guy

Title SALES MANAGERArea Cape Town PE HubsIndustry Rental Hire Working of height machinery and equipment Trade Desk Ref No. TRG 2303Salary TCT R71...


View Job
SALES MANAGER

Cape Town: IT Manager – Urgently needed posted by Edelson & Associates

IT Manager Cape Town R45000 NEG Working Knowledge of Microsoft Admin Centres and Licensing. Knowledge of SQL database Management. Also on site...


View Job
IT Manager – Urgently needed

Cape Town: SITE AGENT posted by Furipoint pty,ltd

Furipoint is excited to announce that we are currently expanding our team and are looking for highly motivated and skilled professionals to fill the Site...


View Job
SITE AGENT

Cape Town: QUANTITY SURVEYORS posted by Furipoint pty,ltd

Furipoint is excited to announce that we are currently expanding our team and are looking for highly motivated and skilled professionals to fill the...


View Job
QUANTITY SURVEYORS

Share this to someone who needs a job:
Posted in Jobs in Cape Town, Jobs in South Africa, Jobs in Western Cape, Other Finance/Accounting

More Jobs in Your Area