Cape Town: AWS Data Engineer posted by PBT Group
Posted on 2025-07-15 00:00:00
| Employer | PBT Group |
|---|---|
| Category | Other Finance/Accounting |
| Location | Western Cape / Cape Town |
Job Summary
PBT Group is currently offering an opportunity for a Senior AWS Data Engineer.
The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse sources, ensuring its conformity to data quality standards, and enabling downstream users to access data promptly. This position is an integral part of an agile team.
These professionals are entrusted with the responsibility of establishing the infrastructure required to derive insights from raw data, integrating data from various sources seamlessly. They empower solutions by efficiently managing substantial volumes of data, both in batch and real-time, utilizing cutting-edge technologies from the realms of big data and cloud computing. Additional responsibilities encompass the development of proof-of-concepts and the implementation of intricate big data solutions, with a primary focus on collecting, parsing, managing, analyzing, and visualizing extensive datasets. They are adept at employing technologies to resolve challenges associated with handling vast amounts of data in diverse formats, thereby delivering innovative solutions.
Data Engineering is a technically demanding role that necessitates a broad spectrum of expertise in software development and programming. These professionals possess knowledge in data analysis, understanding end-user and business requirements, and have the ability to translate these needs into technical solutions. They exhibit a strong grasp of physical database design and the systems development lifecycle. Collaboration within a team environment is essential for success in this role.
Key Responsibilities:
- Architecting Data analytics framework.
- Translating complex functional and technical requirements into detailed architecture, design, and high-performance software.
- Leading the development of data and batch/real-time analytical solutions by leveraging transformative technologies.
- Engaging in multiple projects as a technical lead, overseeing user story analysis, design, software development, testing, and automation tool creation.
Duties: Primary Job Objectives:
- Development and Operations
- Database Development and Operations
- Establishment and Adherence to Policies, Standards, and Procedures
- Communication
- Business Continuity and Disaster Recovery Planning
- Research and Evaluation
- Coaching and Mentoring
Required Skills, Knowledge, and Experience:
- A minimum of 5 years of experience in Data Engineering or Software Engineering.
- Demonstrated leadership experience, managing teams of engineers for 3-5 years.
- A minimum of 2 years of experience in Big Data.
- At least 5 years of experience with Extract, Transform, and Load (ETL) processes.
- A minimum of 2 years of experience with AWS (Amazon Web Services).
- Demonstrated experience with agile or other rapid application development methodologies for at least 2 years (e.g., Agile, Kanban, Scrum).
- 5 years of proven expertise in object-oriented design, coding, testing patterns, and working with commercial or open-source software platforms and large-scale data infrastructures.
- Proficiency in creating data feeds from on-premise to AWS Cloud (2 years).
- Support experience for data feeds in production on a break-fix basis (2 years).
- A minimum of 4 years of experience in creating data marts using Talend or similar ETL development tools.
- Proficiency in data manipulation using Python and PySpark (2 years).
- Experience in processing data using the Hadoop paradigm, particularly with EMR, AWS’s distribution of Hadoop (2 years).
- DevOps experience in Big Data and Business Intelligence, including automated testing and deployment (2 years).
- Extensive knowledge of various programming or scripting languages.
- Expertise in data modeling and an understanding of different data structures and their suitability for specific use cases.
Additional Technical Skills Required:
- The ability to design highly scalable distributed systems using various open-source tools.
- Proficiency in both batch and streaming Big Data tools.
- Experience with Talend for at least 1 year.
- Familiarity with AWS services such as EMR, EC2, and S3 for at least 1 year.
- Proficiency in Python for at least 1 year.
- Familiarity with PySpark or Spark (desirable for at least 1 year).
- Experience in Business Intelligence data modeling for 3 years.
- Proficiency in SQL for 3 years.
Qualifications/Certifications:
- A Bachelor’s degree in computer science, computer engineering, or equivalent work experience for a minimum of 4 years.
- AWS Certification, at least at the associate level.
* In order to comply with the POPI Act, for future career opportunities, we require your permission to maintain your personal details on our database. By completing and returning this form you give PBT your consent
Click Go Apply to apply online!
Get Similar Job Alerts
More jobs in Cape Town
More jobs in Western Cape
Browse Other Finance/Accounting Jobs
Browse PBT Group Jobs
Apply directly for this position. Please read all instructions carefully.
We do not process job applications; we simply aggregate and display job listings.
More related positions
Cape Town: Intermediate Developer posted by Fempower Personnel
Job Title Intermediate Developer Location Hybrid Based in StellenboschA leading payment aggregator and provider of secure payment solutions is looking for...
View Job
Intermediate Developer
Cape Town: Technical Buyer Ref: 3884 posted by NDC Personnel
Yoursquoll need Matric engineering qualifications are advantageous, as well as 3 ndash 5 yearsrsquo experience in the FMCG Transportation sectors in a...
View Job
Technical Buyer Ref
Cape Town: Technical Sales Representative (Granular Fertilizers & Biostimulants) – Western Cape posted by Mirna Butler Recruitment
Are you passionate about agriculture and eager to help farmers succeed? Join my clients dynamic team leading the way in granular fertilizers and...
View Job
Technical Sales Representative (Granular Fertilizers & Biostimulants) – Western Cape
Cape Town: Back Office Employee posted by abc worldwide
Back Office Employee mfd for Consulting Firm Location Remote Home Office Start Date ImmediatelyWorking Hours Full-time Our goal is to guide doctors through...
View Job
Back Office Employee
Cape Town: Safer Gambling Analyst – Remote posted by Hire Resolve
Hire Resolves client is urgently seeking the expertise of a Safer Gambling Analyst for a fully remote position.ResponsibilitiesCommunicating with customers...
View Job
Safer Gambling Analyst – Remote
Cape Town: Site Engineer posted by Hire Resolve
Hire Resolves client, who offers the highest quality construction, project management and specialist subcontracting services, is searching for a Site...
View Job
Site Engineer
Cape Town: Project Manager posted by Hire Resolve
Hire Resolves client is a leading player in the engineering industry, renowned for delivering high-quality infrastructure and industrial projects across...
View Job
Project Manager
Cape Town: Projects Contracts Manager posted by Hire Resolve
Hire Resolves client is looking for a ProjectsContracts Manager to join their team in Cape Town. Theynbspare a construction industry and mainly serve...
View Job
Projects Contracts Manager
Cape Town: Operations Administrator posted by AJ Roodt Consulting (Pty) Ltd
Position available for an experienced Administrator to handle daily admin and operations functions.Candidates must have previous working experience in the...
View Job
Operations Administrator
Cape Town: Junior Administrator – Urgently Needed posted by Nu-Line Elevator Maintenance
Nu-Line Elevator Maintenance is looking for a Junior Administrator to join our team in Killarney Gardens, Cape Town. If youre passionate about learning and...
View Job
Junior Administrator – Urgently Needed
Cape Town: Facility / Office Manager (6 month fixed term contract) posted by O’Brien Recruitment
Are you a facilities mastermind with a passion for creating smooth, well-oiled office environments? Do you thrive on managing multiple sites, juggling...
View Job
Facility / Office Manager (6 month fixed term contract)
Western Cape: DIESEL TECHNICIAN – COMMERCIAL TRUCKS (CAPE TOWN) posted by MPRTC Recruitment
Minimum RequirementsMatricDiesel Trade Test completed2ndash3 years relevant experienceValid Code 14 Driverrsquos License with PDPSolid technical knowledge...
View Job
DIESEL TECHNICIAN – COMMERCIAL TRUCKS (CAPE TOWN)
Cape Town: Brand Training Specialist posted by O’Brien Recruitment
Were Hiring Brand Training Specialist Cape Town ParowOffice-based Employment Equity Applicable All Genders and Races WelcomeWere seeking a dynamic Brand...
View Job
Brand Training Specialist
Cape Town: Engineering Manager Ref: 3974 posted by NDC Personnel
With 5 years of experience and a strong skill-set in project management, planning, and organisation, yoursquoll be a great fit! Effective communication is...
View Job
Engineering Manager Ref
Cape Town: Senior Quantity Surveyor (Building Construction) – CPT posted by Hire Resolve
Hire Resolves client, a well-established and dynamic construction company known for delivering high-quality residential and commercial building projects, is...
View Job
Senior Quantity Surveyor (Building Construction) – CPT
Cape Town: Senior Foreman posted by Hire Resolve
Hire Resolves client is looking for a Senior Foreman to join their team in Cape Town. The company always ensures the best results for their clients in the...
View Job
Senior Foreman
Cape Town: Project Manager posted by Sharon Nurock Recruitment cc
Main Purpose of the RoleOversee the daily workings of the organisations operations.Responsible to maintain a high-quality standard of the organisations...
View Job
Project Manager
Cape Town: General Worker posted by Cre8work!
MATRIC, ID, UI19, CONTACTABLE REFERENCES, CLEAR CRIMINAL RECORD SA CITIZEN SHIFT WORK, HOURS ARE FROM 07h00 TO 19h00 OR 19h00 TO 07h00 HARD LABOUR STRONG...
View Job
General Worker
Cape Town: T/A Merchandiser – Retail posted by Recruitment Matters
Our client is looking for a dynamic and proactive TA Merchandiser to support the retail sales team through effective merchandising, store execution, and...
View Job
T/A Merchandiser – Retail
Cape Town: Technical Sales Representative posted by Time Personnel
REQUIREMENTSMatric,Valid drivers license and own transportation3 4 years experience in a similar industryExceptional customers communication and...
View Job
Technical Sales Representative
Cape Town: Reach Truck Drivers posted by Tailormade Solution
We are Hiring Reach Truck Drivers The Reach Truck Operator is responsible for operating a reach truck to move, locate, relocate, and stack merchandise in...
View Job
Reach Truck Drivers
Cape Town: Player Success Agent posted by Hire Resolve
Job Title Player Success AgentThe Player Success Agent is responsible for managing daily operational assessments, customer interactions, and reviews to...
View Job
Player Success Agent
Cape Town: Senior Foreman posted by Hire Resolve
Hire Resolves client whonbspoperates out ofnbsp Wetton, Cape Town and offers the highest quality construction, project management and specialist...
View Job
Senior Foreman
Cape Town: Mechanical Design Technologist/Engineer posted by Hire Resolve
Hire Resolves client is looking for a Mechanical Design TechnologistEngineer to join their team in Cape Town. This client is a multi-disciplinary firm...
View Job
Mechanical Design Technologist/Engineer
Cape Town: Mechanical Design Technologist/Engineer (Consulting) – CPT posted by Hire Resolve
Hire Resolves client, a reputable and forward-thinking consulting engineering firm known for its commitment to innovation and excellence in building...
View Job
Mechanical Design Technologist/Engineer (Consulting) – CPT