Menu Close

Cape Town City Centre: Data Engineer (Spark)

Date 2024-10-26
Job Title Data Engineer (Spark)
Employer
More Information
Salary Negotiable
Category It Computing Software
Location Cape Town Region
/ Cape Town City Centre

Job Summary

We are looking for an experienced Data Engineer to join our team and play a key role in building and optimizing scalable data solutions. As a Data Engineer, you will design, implement, and maintain data architectures using cutting-edge technologies like Spark, while collaborating with a dynamic team to deliver high-quality solutions that meet business needs. What you’ll do: Implement scalable data architectures using technologies like Spark. Evaluate and recommend new technologies and approaches to improve the performance, scalability, and reliability of our software systems. Build and maintain data pipelines and compute tiers, primarily operating on Spark (Hadoop knowledge is a plus). Serve as a technical resource for team members and mentor junior engineers. Collaborate with the team to deliver high-quality solutions that meet business requirements. Ensure that code is well-designed, maintainable, and adheres to best practices and standards. Play a key role in shaping the direction of engineering practices by working on a scrum-sized team empowered to organize and manage the team’s operations. Utilize project development tools like JIRA, Confluence, and GIT. Write Python/SQL scripts to automate ETL processes. Build and maintain operations tools for monitoring, notifications, trending, and analysis. Define, create, test, and execute operations procedures. Assist the DevOps Engineer in automating CI/CD practices. Your expertise: 4 to 8 years of experience in Data Engineering/Development. Strong experience in Python, SQL, and Data Flow. Hands-on experience with Spark development and a background in big data. Experience with Linux is preferred. Experience in AWS (AWS certification is a plus). Solid understanding of data modeling and data architecture design. Personal attributes: Proven ability to work creatively and analytically in a problem-solving environment Confidence to express ideas as part of a team Excellent communication (written, oral) and interpersonal skills. A Self-Starter capable of working under pressure Curious and engaged in Continuous Learning and Professional Development Other information applicable to the opportunity: Contract Position (12 Months) Location: Johannesburg or Cape Town Why work for us? Want to work for an organization that solves complex real-world problems with innovative software solutions? At iOCO, we believe anything is possible with modern technology, software, and development expertise. We are continuously pushing the boundaries of innovative solutions across multiple industries using an array of technologies.  You will be part of a consultancy, working with some of the most knowledgeable minds in the industry on interesting solutions across different business domains.  Our culture of continuous learning will ensure that you will have all the opportunities, tools, and support to hone and grow your craft.  By joining IOCO you will have an open invitation to our inspiring developer forums. A place where you will be able to connect and learn from and with your peers by sharing ideas, experiences, practices, and solutions. 

Data Engineer (Spark) position available in Cape Town Region, Cape Town City Centre. This job position was posted by . The job has been posted on 2024-10-26 in the It Computing Software category

Click Go Apply to apply online!


You might also like to look at the available jobs in the same area.

Apply directly for this position
Some posts have contact information included with other instructions. All applicants are urged to read the instructions carefully.
We will list jobs at the bottom of each job, so feel free to scroll down and continue your search.

We do not accept any job applications and merely offer the service of daily jobs being mined and displayed on our job portal.
Each job post has a link to take you directly to the original post to apply on their website or the original website where the post came from.


Here are some more related positions


South Africa: Senior Data Engineer – Remote – R800k To R1 Mil Per Annum

Join a market leader in compliant call recording solutions and beyond capturing every interaction, with analytics platform extracts, processes and delivers insights from millions of data points across diverse communication channels the analytics team is lo


View Job
Senior Data Engineer – Remote – R800k To R1 Mil Per Annum

Cape Town City Centre: Senior Data Engineer

Responsibilities: Design and implement scalable data pipelines using Apache Spark, Scala, and Java Develop and maintain data architectures for batch and real-time processing Collaborate with cross-functional teams to identify and prioritize project require


View Job
Senior Data Engineer

Cape Town City Centre: Senior Data And Vehicle Support Engineer (Telematics) Cape Town

Senior Data and Vehicle Support Engineer (Telematics) Cape Town Minimum requirements and experience: BEng or MEng (Electronic or Mechatronic Engineering) Minimum of 5 years working experience in telematics systems and -components including data management


View Job
Senior Data And Vehicle Support Engineer (Telematics) Cape Town

Centurion: Senior Data And Vehicle Support Engineer (Telematics) Centurion

Senior Data and Vehicle Support Engineer (Telematics) Centurion Minimum requirements and experience: BEng or MEng (Electronic or Mechatronic Engineering) Minimum of 5 years working experience in telematics systems and -components including data management


View Job
Senior Data And Vehicle Support Engineer (Telematics) Centurion

Cape Town City Centre: Data Streaming Engineer

PBT Group has an opportunity for a Data Streaming Engineer to build, enhance, and maintain real-time data pipeline. Work with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer on the Data Streaming Platform t


View Job
Data Streaming Engineer

Johannesburg: Senior Sql Data Engineer

As a Specialist Recruitment Consultant within the IT industry, my clients and I are constantly on the lookout for accomplished Senior SQL Data Engineer with strong academics, robust project experience and technical knowledge. Requirements: Completed qualif


View Job
Senior Sql Data Engineer

Johannesburg: Oracle Database Support Engineer

Ensuring database availability and performance consistent with required SLAs. Daily Oracle Database administration across all Oracle environments. Install, configure and administer production and non-production Oracle databases. Monitor database systems fo


View Job
Oracle Database Support Engineer

Cape Town City Centre: Data Analytics Engineer

We are looking for a Data Analytics Engineer, to join our team based in Cape Town(on-site). Main Responsibilities: Define a structured approach to problem solving and delivery against it. Create role specific design standards, patterns, and principles. Ass


View Job
Data Analytics Engineer

South Africa: Data Engineer (Python, Java) – Cape Town – R650k To R850k Per Annum

Join a talented team as a Data Engineer . This role will focus on developing and maintaining robust data infrastructure on the Google Cloud Platform (GCP) to support data-driven decision-making. As a Data Engineer you will be responsible for designing, imp


View Job
Data Engineer (Python, Java) – Cape Town – R650k To R850k Per Annum

Johannesburg: Data Engineer

We are seeking a skilled Data Engineer with strong expertise in business intelligence (BI) and Oracle systems to join our dynamic team on a contract role within the Financial Services Industry. The successful candidate will work on designing, developing, a


View Job
Data Engineer

Johannesburg: Data Engineer (Azure & Fabric) – Johannesburg – R550k To R850k Per Annum

An IT solution company dedicated to transforming data into actionable insights that drive business decisions are looking for a talented Data Engineer to join our dynamic team and play a pivotal role in leveraging cutting-edge technologies to optimize our d


View Job
Data Engineer (Azure & Fabric) – Johannesburg – R550k To R850k Per Annum

Johannesburg: Data Scientist / Machine Learning Engineer

Role Purpose Collaborating with cross-functional teams to identify and define data-driven solutions to healthcare problems which have the potential to transform healthcare Out-of-the-box thinking to use information to create new value-adding products Cleve


View Job
Data Scientist / Machine Learning Engineer

Johannesburg: Junior Data Engineer

Requirements: BSc related Degree from a recognised university, completed in record time Excellent Matric results 70% average University results Skills: Python, SQL, Scala, Java, Relational Databases, Cloud Platforms, ETL, Data Modelling Excellent Communica


View Job
Junior Data Engineer

Cape Town City Centre: Data Engineer

Must have completed Post Graduate Degree (Computer Science/Information Systems/Maths/Stats/Business Science/Actuarial) Strong programming skills in Python and SQL Experience in database management, data analysis and producing ETL processes Data Engineer po


View Job
Data Engineer

Pretoria North: Software Engineer – Sql Database Specialist posted by Sastel Packaging

Development and maintenance of inhouse database. Must have qualifications and experience in MySQL, Python and C#. Software Engineer - Sql Database Specialist position available in Gauteng, Pretoria North. This job position was posted by Sastel Packaging. T


View Job
Software Engineer – Sql Database Specialist

Johannesburg: Junior Data Engineer

Qualifications: IT Degree Microsoft Certified: Data Engineer Requirements: 3 years in a similar role Azure, SQL, Python, ETL Data Formats: JSON, CSV, XLSM, XML Stored procedures KPAs: Build and maintain data pipelines and ETL processes Profile data for qua


View Job
Junior Data Engineer

Cape Town City Centre: Cyber Security Engineer – Data Security – Contract

Our Client a Global tech firm is seeking Cyber Security Engineer (Data Security) to join their team in Cape town on a contract basis for 6 months. Purpose To provide cloud security expertise to build out and maintain resilient, scalable, cost effective and


View Job
Cyber Security Engineer – Data Security – Contract

Johannesburg: Data Engineer

Preferred Qualifications: Qualifications: Education: Bachelors or Masters degree in Computer Science, Engineering, Information Technology, or a related field Experience: 5 years of experience in data engineering and ETL development Extensive experience wit


View Job
Data Engineer

Johannesburg: Maintenance Datacom Engineer

Major Compulsory Responsibilities Responsible for routine network maintenance, fault locating, troubleshooting of datacom products. Responsible for routine health check, network risk clearance, perform rectification and precaution check on datacom products


View Job
Maintenance Datacom Engineer

North Johannesburg: Data Engineer (Ab Initio)

The Group Data and Analytics Office is on the lookout for a skilled Ab Initio Data Engineer. The ideal candidate will have extensive experience in data engineering, particularly with Ab Initio, and will be responsible for designing, developing, and maintai


View Job
Data Engineer (Ab Initio)

Pretoria: 2510_Cloud Database Engineer (Advanced)

Key Responsibilities: Cloud Database Migration: Develop and execute comprehensive migration plans for transitioning on-premises databases to cloud platforms, leveraging OCI, Azure, and AWS. Database Design and Implementation: Design, implement, and optimiz


View Job
2510_Cloud Database Engineer (Advanced)

Cape Town City Centre: Data Engineer

What will you do? Our client is a newly created engineering organisation on a mission to empower and accelerate autonomous value creation through insights and ML across the group. The companys main users are the data scientists and analysts who sit inside


View Job
Data Engineer

Cape Town City Centre: Senior Data Engineer : Ingestions Squad (Group Data & Ml Platform Tribe)

Our Client Company Group Technology is responsible for the provision of a digitally enabled technology service as a group COE, drive business and transformation and provide group-wide digital and data architecture. We operate the various technology platfor


View Job
Senior Data Engineer

Cape Town City Centre: Data Engineer: Ingestions Squad (Group Data & Ml Platform Tribe)

What will you do? Our client is a newly created engineering organisation on a mission to empower and accelerate autonomous value creation through insights and ML across the group. The companys main users are the data scientists and analysts who sit inside


View Job
Data Engineer

Cape Town City Centre: Data Engineer : Ingestions Squad (Group Data & Ml Platform Tribe)

Job Details Who are we? Company Group Technology is responsible for the provision of a digitally enabled technology service as a group COE, drive business and transformation and provide group-wide digital and data architecture. We operate the various techn


View Job
Data Engineer

Error making API request.
Share this to someone who needs a job:
Posted in Uncategorized

More Jobs in Your Area