Cape Town: AWS Data Engineer posted by PBT Group
Posted on 2025-07-26 00:00:00
| Employer | PBT Group |
|---|---|
| Category | Other Finance/Accounting |
| Location | Western Cape / Cape Town |
Job Summary
PBT Group is currently offering an opportunity for a Senior AWS Data Engineer.
The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse sources, ensuring its conformity to data quality standards, and enabling downstream users to access data promptly. This position is an integral part of an agile team.
These professionals are entrusted with the responsibility of establishing the infrastructure required to derive insights from raw data, integrating data from various sources seamlessly. They empower solutions by efficiently managing substantial volumes of data, both in batch and real-time, utilizing cutting-edge technologies from the realms of big data and cloud computing. Additional responsibilities encompass the development of proof-of-concepts and the implementation of intricate big data solutions, with a primary focus on collecting, parsing, managing, analyzing, and visualizing extensive datasets. They are adept at employing technologies to resolve challenges associated with handling vast amounts of data in diverse formats, thereby delivering innovative solutions.
Data Engineering is a technically demanding role that necessitates a broad spectrum of expertise in software development and programming. These professionals possess knowledge in data analysis, understanding end-user and business requirements, and have the ability to translate these needs into technical solutions. They exhibit a strong grasp of physical database design and the systems development lifecycle. Collaboration within a team environment is essential for success in this role.
Key Responsibilities:
- Architecting Data analytics framework.
- Translating complex functional and technical requirements into detailed architecture, design, and high-performance software.
- Leading the development of data and batch/real-time analytical solutions by leveraging transformative technologies.
- Engaging in multiple projects as a technical lead, overseeing user story analysis, design, software development, testing, and automation tool creation.
Duties: Primary Job Objectives:
- Development and Operations
- Database Development and Operations
- Establishment and Adherence to Policies, Standards, and Procedures
- Communication
- Business Continuity and Disaster Recovery Planning
- Research and Evaluation
- Coaching and Mentoring
Required Skills, Knowledge, and Experience:
- A minimum of 5 years of experience in Data Engineering or Software Engineering.
- Demonstrated leadership experience, managing teams of engineers for 3-5 years.
- A minimum of 2 years of experience in Big Data.
- At least 5 years of experience with Extract, Transform, and Load (ETL) processes.
- A minimum of 2 years of experience with AWS (Amazon Web Services).
- Demonstrated experience with agile or other rapid application development methodologies for at least 2 years (e.g., Agile, Kanban, Scrum).
- 5 years of proven expertise in object-oriented design, coding, testing patterns, and working with commercial or open-source software platforms and large-scale data infrastructures.
- Proficiency in creating data feeds from on-premise to AWS Cloud (2 years).
- Support experience for data feeds in production on a break-fix basis (2 years).
- A minimum of 4 years of experience in creating data marts using Talend or similar ETL development tools.
- Proficiency in data manipulation using Python and PySpark (2 years).
- Experience in processing data using the Hadoop paradigm, particularly with EMR, AWS’s distribution of Hadoop (2 years).
- DevOps experience in Big Data and Business Intelligence, including automated testing and deployment (2 years).
- Extensive knowledge of various programming or scripting languages.
- Expertise in data modeling and an understanding of different data structures and their suitability for specific use cases.
Additional Technical Skills Required:
- The ability to design highly scalable distributed systems using various open-source tools.
- Proficiency in both batch and streaming Big Data tools.
- Experience with Talend for at least 1 year.
- Familiarity with AWS services such as EMR, EC2, and S3 for at least 1 year.
- Proficiency in Python for at least 1 year.
- Familiarity with PySpark or Spark (desirable for at least 1 year).
- Experience in Business Intelligence data modeling for 3 years.
- Proficiency in SQL for 3 years.
Qualifications/Certifications:
- A Bachelor’s degree in computer science, computer engineering, or equivalent work experience for a minimum of 4 years.
- AWS Certification, at least at the associate level.
* In order to comply with the POPI Act, for future career opportunities, we require your permission to maintain your personal details on our database. By completing and returning this form you give PBT your consent
Click Go Apply to apply online!
Get Similar Job Alerts
More jobs in Cape Town
More jobs in Western Cape
Browse Other Finance/Accounting Jobs
Browse PBT Group Jobs
Apply directly for this position. Please read all instructions carefully.
We do not process job applications; we simply aggregate and display job listings.
More related positions
Cape Town: Mobile Technician posted by BCE Foodservice Equipment
Overall purpose of the job To produce the required labour hours through maintenance and repair work, in accordance with the Company quality and efficiency...
View Job
Mobile Technician
Cape Town: New Business Development posted by Kontak Recruitment
New Business Development - Plastic and Packaging JB5332 Cape Town, Western Cape R25 000 - R40 000 CTC per month plus commission PermanentFully remote Join a...
View Job
New Business Development
Cape Town: Senior Project Manager (Electrical) posted by Construct Executive Search
Applicants must have the following requirementsMust have a Bachelors Degree or Diploma in Electrical Engineering or Construction.Must have 8-10 years of...
View Job
Senior Project Manager (Electrical)
Cape Town: Senior Site Agent posted by Construct Executive Search
Applicants must have the following requirementsMust have a Bachelors Degree or Diploma in Electrical Engineering or Construction.Must have a Trade Test...
View Job
Senior Site Agent
Cape Town: Professional Transportation Engineer posted by Construct Executive Search
Applicants must have the following requirementsMust have a Bachelor of Science Degree or a Bachelor of Technology Degree in EngineeringMust be registered...
View Job
Professional Transportation Engineer
Cape Town: Professional Bridge Design Engineer posted by Construct Executive Search
Applicants must have the following requirementsMust have a Bachelor of Science Degree in Civil Engineering.Must be registered with ECSA as a Professional...
View Job
Professional Bridge Design Engineer
Cape Town: Professional Engineer (Roads & Municipal Services) posted by Construct Executive Search
Applicants must have the following requirementsMust have a Bachelor of Science Degree or a Bachelor of Engineering Degree in Civil Engineering.Must be...
View Job
Professional Engineer (Roads & Municipal Services)
Cape Town: Warehouse Checker posted by ROSS Verification Services
Warehouse checkers need for the Cape Town area.Must have a minimum of 2 years warehousing experience. Must have matric with Maths.
View Job
Warehouse Checker
Cape Town City Centre: Sales Representative (Chemical Industry)
Requirements Female applicants only Experience in the Technical Chemical Industry Strong sales and negotiation skills Self-motivated, independent, and a...
View Job
Sales Representative (Chemical Industry)
Cape Town City Centre: Senior SAIPA Accountant
Minimum Requirements Must have a minimum of 2 years experience as a SAIPA Registered Accountant in the Financial Services Industry Bcom Accounting Relevant...
View Job
Senior SAIPA Accountant
Cape Town City Centre: Software Engineer
Were seeking a talented and motivated Software Engineer to join our dynamic team and help build cutting-edge applications that make a real impact. Key...
View Job
Software Engineer
Cape Town: Personal Assistant (PA) – Urgently Needed posted by Epiglo PTY LTD
Medicore situated in Constantia is seeking an exceptional Personal Assistant to provide comprehensive support to a dynamic professional businessman active...
View Job
Personal Assistant (PA) – Urgently Needed
Cape Town: Office Administrator posted by Private
Office AdministratorJob SummaryWe seek a detail-oriented and organized Office Administrator to join our team. This permanent position is based in...
View Job
Office Administrator
Western Cape: Autos Press & Plating Team Leader – Maitland, Cape town posted by Paqueta Personnel
My client, a leading Manufacturing Company based in Maitland, Cape Town requires a competent and experienced Autos Press and Plating Team Leader to join...
View Job
Autos Press & Plating Team Leader – Maitland, Cape town
Cape Town: External Sales Rep – Urgently needed posted by Africote
External Sales Rep RequiredArea Paarden Eiland Cape TownSalary To be discussed Permanent position We are a well-established Paint, Plaster and screed...
View Job
External Sales Rep – Urgently needed
Cape Town: Regional Technical Support Specialist – Capital Equipment posted by The Recruitment Guy
An experienced REGIONAL TECHNICAL SUPPORT SPECIALIST is required for permanent employment based in Cape Town Western Cape region.To be the technical...
View Job
Regional Technical Support Specialist – Capital Equipment
Cape Town City Centre: Transfers Conveyancing Secretary
Key Requirements Minimum 2 years of experience for Junior candidates and 5 years for Senior candidates in a conveyancing-related role Proven ability to...
View Job
Transfers Conveyancing Secretary
Cape Town: Junior Administrator – Urgently Needed posted by Nu-Line Elevator Maintenance
Nu-Line Elevator Maintenance is looking for a Junior Administrator to join our team in Killarney Gardens, Cape Town. If youre passionate about learning and...
View Job
Junior Administrator – Urgently Needed
Cape Town City Centre: AUTO ELECTRICIAN – COMMERCIAL TRUCKS (CAPE TOWN)
Minimum Requirements Diesel Auto Electrician Trade Certificate Minimum 5 years experience in a similar role Valid Code 1014 Drivers License with PrDP...
View Job
AUTO ELECTRICIAN – COMMERCIAL TRUCKS (CAPE TOWN)
Cape Town: Operations Administrator posted by AJ Roodt Consulting (Pty) Ltd
Position available for an experienced Administrator to handle daily admin and operations functions.Candidates must have previous working experience in the...
View Job
Operations Administrator
Cape Town: Accountant – Urgently Needed posted by Epiglo PTY LTD
A dynamic pharmaceutical company in Constantia, Cape Town is seeking a highly organised and detail-oriented Accountant to join our growing team. The ideal...
View Job
Accountant – Urgently Needed
Cape Town City Centre: Senior Human Resources Business Partner
Purpose of the Role The Senior Human Resources Business Partner HRBP will be responsible for translating group and functional strategy into actionable human...
View Job
Senior Human Resources Business Partner
Cape Town City Centre: Technical Sales Representative (Granular Fertilizers & Biostimulants) – Western Cape
Are you passionate about agriculture and eager to help farmers succeed? Join my clients dynamic team leading the way in granular fertilizers and...
View Job
Technical Sales Representative (Granular Fertilizers & Biostimulants) – Western Cape
Cape Town City Centre: Technical Buyer Ref: 3884
Youll need Matric engineering qualifications are advantageous, as well as 3 5 years experience in the FMCG Transportation sectors in a technical...
View Job
Technical Buyer Ref
Cape Town City Centre: Accounts Payable Controller
Are you a detail-oriented professional with a passion for numbers and a knack for managing supplier relationships? Were searching for a proactive and...
View Job
Accounts Payable Controller