PBT Group is currently offering an opportunity for an AWS Data Engineer with 2 to 5 years of relevant experience.
The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse sources, ensuring its conformity to data quality standards, and enabling downstream users to access data promptly. This position is an integral part of an agile team.
These professionals are entrusted with the responsibility of establishing the infrastructure required to derive insights from raw data, integrating data from various sources seamlessly. They empower solutions by efficiently managing substantial volumes of data, both in batch and real-time, utilizing cutting-edge technologies from the realms of big data and cloud computing. Additional responsibilities encompass the development of proof-of-concepts and the implementation of intricate big data solutions, with a primary focus on collecting, parsing, managing, analyzing, and visualizing extensive datasets. They are adept at employing technologies to resolve challenges associated with handling vast amounts of data in diverse formats, thereby delivering innovative solutions.
Data Engineering is a technically demanding role that necessitates a broad spectrum of expertise in software development and programming. These professionals possess knowledge in data analysis, understanding end-user and business requirements, and have the ability to translate these needs into technical solutions. They exhibit a strong grasp of physical database design and the systems development lifecycle. Collaboration within a team environment is essential for success in this role.
Key
Responsibilities:
- Architecting Data analytics framework.
- Translating complex functional and technical requirements into detailed architecture, design, and high-performance software.
- Leading the development of data and batch/real-time analytical solutions by leveraging transformative technologies.
- Engaging in multiple projects as a technical lead, overseeing user story analysis, design, software development, testing, and automation tool creation.
Duties:
Primary Job Objectives:
- Development and Operations
- Database Development and Operations
- Establishment and Adherence to Policies, Standards, and Procedures
- Communication
- Business Continuity and Disaster Recovery Planning
- Research and Evaluation
- Coaching and Mentoring
Required Skills, Knowledge, and Experience:
- A minimum of 2 years of experience in Data Engineering or Software Engineering.
- At least 2 years of experience with Extract, Transform, and Load (ETL) processes.
- A minimum of 2 years of experience with AWS (Amazon Web Services) and Databricks.
- Demonstrated experience with agile or other rapid application development methodologies for at least 2 years (e.g., Agile, Kanban, Scrum).
- 2 years of proven expertise in object-oriented design, coding, testing patterns, and working with commercial or open-source software platforms and large-scale data infrastructures.
- Proficiency in creating data feeds from on-premise to AWS Cloud (2 years).
- Support experience for data feeds in production on a break-fix basis (2 years).
- Proficiency in data manipulation using Python and PySpark (2 years).
- DevOps experience in Big Data and Business Intelligence, including automated testing and deployment (2 years).
- Extensive knowledge of various programming or scripting languages.
Additional Technical Skills Required:
- The ability to design highly scalable distributed systems using various open-source tools.
- Proficiency in both batch and streaming Big Data tools.
- Familiarity with AWS services such as EMR, EC2, and S3 for at least 1 year.
- Proficiency in Python for at least 1 year.
- Familiarity with PySpark or Spark (desirable for at least 1 year).
- Experience in Business Intelligence data modeling for 3 years.
- Proficiency in SQL for 3 years.
Qualifications/Certifications:
- A Bachelor`s degree in computer science, computer engineering, or equivalent work experience for a minimum of 4 years.
- AWS Certification, at least at the associate level.
* In order to comply with the POPI Act, for future career opportunities, we require your permission to maintain your personal details on our database. By completing and returning this form you give PBT your consent
Aws Data Engineer position available in Gauteng, Johannesburg. This job position was posted by PBT Group. The job has been posted as a premium ad on 2025-01-31 at 13:13:18 in the Finance Accounting category
Click Go Apply to apply online!
You might also like these jobs in the same area.
Apply directly for this position. Please read all instructions carefully.
We do not process job applications; we simply aggregate and display job listings.
More related positions
Johannesburg: Aws Data Scientist – Johannesburg – R480 To R580 Per Hour
A dynamic global group with a focus on innovation topics as well as comprehensive IT solutions and Global Team collaboration driving experiences with a deep insight into the compliance and IT Methodology processes is recruiting for a Data Scientist to deve
View Job
Aws Data Scientist – Johannesburg – R480 To R580 Per Hour
Pretoria: Aws Data Scientist – Midrand /Centurion/ Semi-Remote – Contract – R600 Per Hour
A NEW Opportunity for an AWS Data Scientist with experience in Python and SQL has been made available with a leading car manufacturer. You will have to develop data science solutions and integrate and scale these solutions into MLOps pipelines and also imp
View Job
Aws Data Scientist – Midrand /Centurion/ Semi-Remote – Contract – R600 Per Hour
Johannesburg: Data Scientist (Sql, Aws) – Johannesburg – R1mil To R1.3Mil Per Annum
Join a global financial services organisation whose core purpose is to seek out and invest in exceptional individuals who understand and support their core purpose, and whose values align and pride themselves with attracting intellectual leaders who are th
View Job
Data Scientist (Sql, Aws) – Johannesburg – R1mil To R1.3Mil Per Annum
Cape Town: Aws Data Engineer posted by PBT Group
AWS Data Engineer Opportunity at PBT GroupAre you a skilled Data Engineer with AWS expertise looking for an opportunity to grow your career in a dynamic, consultancy-driven environment? PBT Group offers you the chance to work on cutting-edge projects acros
View Job
Aws Data Engineer
Johannesburg: Aws Data Engineer posted by PBT Group
PBT Group is currently offering an opportunity for an AWS Data Engineer with 2 to 5 years of relevant experience. The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and se
View Job
Aws Data Engineer
Johannesburg: Aws Data Engineer – Johannesburg – Up To R800 Per Hour posted by E-Merge
This technology company is enthusiastic about resolving business challenges for their clients and is actively seeking an AWS Data Engineer to join their team. By employing advanced data analytics, actuarial services, software development, and automation, t
View Job
Aws Data Engineer – Johannesburg – Up To R800 Per Hour
Cape Town: Mid- Senior Full Stack Software Engineer (Python, Django, Aws) (Cpt Hybrid) posted by Datafin
Mid- Senior Full Stack Software Engineer (Python, Django, AWS) (CPT Hybrid)IT - Software DevelopmentCape Town - Western CapeENVIRONMENT: A rapidly growing provider of cutting-edge IoT Systems seeks a highly skilled Mid Senior Full Stack Software Engineer
View Job
Mid- Senior Full Stack Software Engineer (Python, Django, Aws) (Cpt Hybrid)
Cape Town: Senior Full Stack Engineer (Python, Django, Aws) (Cpt Hybrid) posted by Datafin
Senior Full Stack Engineer (Python, Django, AWS) (CPT Hybrid)IT - Software DevelopmentCape Town - Western CapeENVIRONMENT: DELIVER impactful, life-saving tech when you join the team of a rapidly growing provider of a cutting-edge IoT System seeking your co
View Job
Senior Full Stack Engineer (Python, Django, Aws) (Cpt Hybrid)
Johannesburg: Aws/ Azure Data Solutions Architect – Johannesburg – R1.2Mil To R1.4Mil Per Annum
As a Cloud Data Solutions Architect and Engineer , you will design, build, and deliver transformative business solutions using modern data platforms. Your role involves integrating, storing, modelling, analysing, and reporting data while aligning solutions
View Job
Aws/ Azure Data Solutions Architect – Johannesburg – R1.2Mil To R1.4Mil Per Annum