Date | 2024-08-31 |
---|---|
Job Title | Data Streaming Engineer |
Employer | PBT Group More Information |
Salary | 0 |
Category | Finance Accounting |
Location |
Western Cape / Cape Town |
Job Summary
PBT Group has an opportunity for a Data Streaming Engineer to build, enhance, and maintain real-time data pipeline. Work with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer on the Data Streaming Platform team, you will be responsible for developing and maintaining data ingestion pipelines vital to the continued growth. You will collaborate with many teams to understand data needs and turn them into platforms and services, monitor and maintain the health of the data streams, and have an impact on the data ecosystem.
Duties:
- Operational Delivery
- Build, enhance, and maintain our real-time data pipeline.
- Work with various infrastructure and operations teams to maintain our data infrastructure.
- Be self-driven in identifying and documenting feature gaps and designing and implementing solutions to them.
- Help build, modernize, and maintain services and tooling to ensure resiliency, fix data discrepancies, and enhance the customer experience.
- Monitor daily execution, diagnose and log issues, and fix pipelines to ensure SLAs are met with internal stakeholders.
- Mentor other engineers and help them grow; code reviews, guidance on best practices, leveraging your experience in the field.
- Technical Leadership
- Participate in the engineering and other disciplines community of practice.
- Share AWS knowledge and practical experience with community.
- Challenge and contribute to development of architectural principals and patterns.
- Compliance
- Ensure solutions adhere to Olympus patterns, guidelines and standards.
- Operate within project environments and participate in continuous improvement efforts.
- Delivery Management
- Follow and participate in defined ways of work including, but not limited to, sprint planning, backlog grooming, retrospectives, demos and PI planning.
Skills and Experience Required:
- Experience of developing solutions in the cloud
- At least 2-3 years` experience with designing and developing streaming Data Pipelines for Data Ingestion or Transformation using AWS technologies.
- Experience with distributed log systems, such as Kafka and AWS Kinesis
- Must have experience with DataBricks, Hadoop, Spark
- redPanda or Confluence experience advantageous
- Experience in developing data warehouses and data marts
- Experience in Data Vault and Dimensional modelling techniques
- Experience working with automated data warehousing solutions would be advantageous.
Qualifications/ Certification:
- Bachelors degree in computer science or similar fields like Information Systems, Big Data, etc.
- AWS Data Engineer Certification would be advantageous.
- Related Technical certifications.
* In order to comply with the POPI Act, for future career opportunities, we require your permission to maintain your personal details on our database. By completing and returning this form you give PBT your consent
Data Streaming Engineer position available in Western Cape, Cape Town. This job position was posted by PBT Group. The job has been posted as a premium ad on 2024-08-31 at 13:03:59 in the Finance Accounting category
Click Go Apply to apply online!
You might also like to look at the available jobs in the same area.
Apply directly on jobmail for this position
Some posts have contact information included with other instructions. All applicants are urged to read the instructions carefully.
We will list jobs at the bottom of each job, so feel free to scroll down and continue your search.
We do not accept any job applications and merely offer the service of daily jobs being mined and displayed on our job portal.
Each job post has a link to take you directly to the original post to apply on their website or the original website where the post came from.
Here are some more related positions
Pretoria: Data Streaming Platform Engineer (Entry)
Key Competencies: Familiarity with at least one of the following programming languages: Kotlin, Java or JavaScript or Python or C# ITIL certification 2-3 years experience with microservices, cloud, or container architectures, such as Docker Extensive exper
View Job
Data Streaming Platform Engineer (Entry)
Cape Town: Data Streaming Engineer posted by PBT Group
PBT Group has an opportunity for a Data Streaming Engineer to build, enhance, and maintain real-time data pipeline. Work with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer on the Data Streaming Platform t
View Job
Data Streaming Engineer
Midrand: Data Streaming Platform Engineer – 1324 posted by JorDan HR
ESSENTIAL SKILLS REQUIREMENTS: Familiarity with at least one of the following programming languages: Kotlin, Java or JavaScript or Python or C# Basic knowledge of microservices architectures, cloud architectures, or container architectures (e.g., Docker).
View Job
Data Streaming Platform Engineer – 1324
Midrand: Data Streaming Platform Engineer – 1324 posted by Jordan Human Resources
ESSENTIAL SKILLS REQUIREMENTS:Familiarity with at least one of the following programming languages: Kotlin, Java or JavaScript or Python or C#Basic knowledge of microservices architectures, cloud architectures, or container architectures (e.g., Docker).Bas
View Job
Data Streaming Platform Engineer – 1324
Gauteng: Data Streaming Platform Engineer (Entry) posted by Liyema Consulting
Key Competencies:Familiarity with at least one of the following programming languages: Kotlin, Java or JavaScript or Python or C#ITIL certification2-3 years experience with microservices, cloud, or container architectures, such as DockerExtensive experienc
View Job
Data Streaming Platform Engineer (Entry)
Gauteng: Data Streaming Platform Engineer posted by ALOS Innovative Workforce Solution
ESSENTIAL SKILLS REQUIREMENTS: Sound knowledge in Kotlin, Java or JavaScript or Python or C# Familiarity with Microservices Architectures, Cloud Architectures or Container Architectures e.g., Docker Experience in developing solutions on public cloud platfo
View Job
Data Streaming Platform Engineer
Midrand: Data Streaming Platform Engineer Snr 2514
What You`ll Need to Bring: Mastery in Coding: Proficient in Kotlin, Java, JavaScript, Python, or C#. Architectural Genius: Hands-on experience with Microservices, Cloud, or Container Architectures (think Docker). Cloud Savvy: Skilled in developing solution
View Job
Data Streaming Platform Engineer Snr 2514
Midrand: Data Streaming Platform Engineer Snr 2514 posted by Opensource
What You`ll Need to Bring:Mastery in Coding: Proficient in Kotlin, Java, JavaScript, Python, or C#.Architectural Genius: Hands-on experience with Microservices, Cloud, or Container Architectures (think Docker!).Cloud Savvy: Skilled in develo
View Job
Data Streaming Platform Engineer Snr 2514