Menu Close

Stellenbosch: Data Engineer posted by Datafin

Date 2024-10-13
Job Title Data Engineer
Employer Datafin
More Information
Salary 0
Category It Computer
Location Western Cape
/ Stellenbosch

Job Summary

Data EngineerIT – Analyst, Data Management
Stellenbosch – Western Cape

ENVIRONMENT:
An AgriTech company in Stellenbosch is seeking a skilled and motivated Data Engineer to join their dynamic team as an integration specialist. As a Data Engineer, you will be responsible for designing, implementing, and maintaining the companys data infrastructure and pipelines. You will collaborate closely with data scientists, analysts, and software engineers to ensure efficient and reliable data flows throughout the organisation. The ideal candidate has a strong background in data engineering, excellent problem-solving skills, and a passion for working with large datasets.
DUTIES:
  • Design, develop, and maintain scalable and efficient data pipelines and ETL processes to ingest, transform, and load data from various sources:
    • Develop and implement data warehousing solutions.
    • Collaborate with cross-functional teams to integrate various data sources.
    • Ensure data quality and consistency across different data systems.
    • Optimise data retrieval for dashboard/reporting solutions.
  • Optimise data infrastructure, including data storage, data retrieval, and data processing for enhanced performance and scalability.
  • Implement data quality and data governance processes to ensure accuracy, consistency, and integrity of data.
  • Monitor and troubleshoot data pipelines to identify and resolve issues in a timely manner.
  • Perform data profiling and analysis to identify data quality issues and propose improvements.
  • Collaborate with data scientists and analysts to provide them with the necessary data sets for analysis and reporting.
  • Stay up to date with emerging technologies and trends in data engineering and recommend new tools and frameworks to improve data infrastructure.
REQUIREMENTS:
  • Preferably a bachelors degree in computer science, engineering, or a related field.
  • Certifications (Azure) a plus
Knowledge, Skills & Experience
  • Proven experience as a Data Engineer or similar role, with a Minimum of 2 years experience
  • Strong understanding of data modelling, data warehousing, and ETL processes.
  • 1-2 years of experience working with Azure Synapse
  • Proficiency in SQL and experience working with relational databases (e.g., PostgreSQL, SQL Server)
  • Strong programming skills in at least one scripting language (e.g., Python) and experience with data manipulation and transformation libraries (e.g., Pandas, PySpark).
  • Comfortable working with cloud-based infrastructure and services provided by Azure
  • Familiarity with data pipeline orchestration tools (e.g., Apache Airflow, Functions, Lambda) and workflow management systems.
  • Experience with real-time data streaming technologies (e.g., Apache Kafka, Apache Flink).
  • Knowledge of containerisation technologies and orchestration tools (e.g., Docker, Kubernetes).
Familiarity with machine learning concepts and frameworks.
Apply for this Job

Data Engineer position available in Western Cape, Stellenbosch. This job position was posted by Datafin. The job has been posted as a premium ad on 2024-10-13 at 16:09:23 in the It Computer category

Click Go Apply to apply online!


You might also like to look at the available jobs in the same area.

View Job  Cape Town: Accountant posted by Goldman Tech

Apply directly on jobmail for this position
Some posts have contact information included with other instructions. All applicants are urged to read the instructions carefully.
We will list jobs at the bottom of each job, so feel free to scroll down and continue your search.

We do not accept any job applications and merely offer the service of daily jobs being mined and displayed on our job portal.
Each job post has a link to take you directly to the original post to apply on their website or the original website where the post came from.


Here are some more related positions


South Africa: Senior Data Engineer – Remote – R800k To R1 Mil Per Annum

Join a market leader in compliant call recording solutions and beyond capturing every interaction, with analytics platform extracts, processes and delivers insights from millions of data points across diverse communication channels the analytics team is lo


View Job
Senior Data Engineer – Remote – R800k To R1 Mil Per Annum

Cape Town City Centre: Senior Data Engineer

Responsibilities: Design and implement scalable data pipelines using Apache Spark, Scala, and Java Develop and maintain data architectures for batch and real-time processing Collaborate with cross-functional teams to identify and prioritize project require


View Job
Senior Data Engineer

Cape Town City Centre: Senior Data And Vehicle Support Engineer (Telematics) Cape Town

Senior Data and Vehicle Support Engineer (Telematics) Cape Town Minimum requirements and experience: BEng or MEng (Electronic or Mechatronic Engineering) Minimum of 5 years working experience in telematics systems and -components including data management


View Job
Senior Data And Vehicle Support Engineer (Telematics) Cape Town

Centurion: Senior Data And Vehicle Support Engineer (Telematics) Centurion

Senior Data and Vehicle Support Engineer (Telematics) Centurion Minimum requirements and experience: BEng or MEng (Electronic or Mechatronic Engineering) Minimum of 5 years working experience in telematics systems and -components including data management


View Job
Senior Data And Vehicle Support Engineer (Telematics) Centurion

Cape Town City Centre: Data Streaming Engineer

PBT Group has an opportunity for a Data Streaming Engineer to build, enhance, and maintain real-time data pipeline. Work with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer on the Data Streaming Platform t


View Job
Data Streaming Engineer

Johannesburg: Senior Sql Data Engineer

As a Specialist Recruitment Consultant within the IT industry, my clients and I are constantly on the lookout for accomplished Senior SQL Data Engineer with strong academics, robust project experience and technical knowledge. Requirements: Completed qualif


View Job
Senior Sql Data Engineer

Johannesburg: Oracle Database Support Engineer

Ensuring database availability and performance consistent with required SLAs. Daily Oracle Database administration across all Oracle environments. Install, configure and administer production and non-production Oracle databases. Monitor database systems fo


View Job
Oracle Database Support Engineer

Cape Town City Centre: Data Analytics Engineer

We are looking for a Data Analytics Engineer, to join our team based in Cape Town(on-site). Main Responsibilities: Define a structured approach to problem solving and delivery against it. Create role specific design standards, patterns, and principles. Ass

View Job  Cape Town: Agricultural Commodity Trading Roles (Western Cape) posted by Helen Wilson Recruitment

View Job
Data Analytics Engineer

South Africa: Data Engineer (Python, Java) – Cape Town – R650k To R850k Per Annum

Join a talented team as a Data Engineer . This role will focus on developing and maintaining robust data infrastructure on the Google Cloud Platform (GCP) to support data-driven decision-making. As a Data Engineer you will be responsible for designing, imp


View Job
Data Engineer (Python, Java) – Cape Town – R650k To R850k Per Annum

Johannesburg: Data Engineer

We are seeking a skilled Data Engineer with strong expertise in business intelligence (BI) and Oracle systems to join our dynamic team on a contract role within the Financial Services Industry. The successful candidate will work on designing, developing, a


View Job
Data Engineer

Johannesburg: Data Engineer (Azure & Fabric) – Johannesburg – R550k To R850k Per Annum

An IT solution company dedicated to transforming data into actionable insights that drive business decisions are looking for a talented Data Engineer to join our dynamic team and play a pivotal role in leveraging cutting-edge technologies to optimize our d


View Job
Data Engineer (Azure & Fabric) – Johannesburg – R550k To R850k Per Annum

Johannesburg: Data Scientist / Machine Learning Engineer

Role Purpose Collaborating with cross-functional teams to identify and define data-driven solutions to healthcare problems which have the potential to transform healthcare Out-of-the-box thinking to use information to create new value-adding products Cleve


View Job
Data Scientist / Machine Learning Engineer

Johannesburg: Junior Data Engineer

Requirements: BSc related Degree from a recognised university, completed in record time Excellent Matric results 70% average University results Skills: Python, SQL, Scala, Java, Relational Databases, Cloud Platforms, ETL, Data Modelling Excellent Communica


View Job
Junior Data Engineer

Cape Town City Centre: Data Engineer

Must have completed Post Graduate Degree (Computer Science/Information Systems/Maths/Stats/Business Science/Actuarial) Strong programming skills in Python and SQL Experience in database management, data analysis and producing ETL processes Data Engineer po


View Job
Data Engineer

Pretoria North: Software Engineer – Sql Database Specialist posted by Sastel Packaging

Development and maintenance of inhouse database. Must have qualifications and experience in MySQL, Python and C#. Software Engineer - Sql Database Specialist position available in Gauteng, Pretoria North. This job position was posted by Sastel Packaging. T


View Job
Software Engineer – Sql Database Specialist

Johannesburg: Junior Data Engineer

Qualifications: IT Degree Microsoft Certified: Data Engineer Requirements: 3 years in a similar role Azure, SQL, Python, ETL Data Formats: JSON, CSV, XLSM, XML Stored procedures KPAs: Build and maintain data pipelines and ETL processes Profile data for qua


View Job
Junior Data Engineer

Cape Town City Centre: Cyber Security Engineer – Data Security – Contract

Our Client a Global tech firm is seeking Cyber Security Engineer (Data Security) to join their team in Cape town on a contract basis for 6 months. Purpose To provide cloud security expertise to build out and maintain resilient, scalable, cost effective and


View Job
Cyber Security Engineer – Data Security – Contract

Johannesburg: Data Engineer

Preferred Qualifications: Qualifications: Education: Bachelors or Masters degree in Computer Science, Engineering, Information Technology, or a related field Experience: 5 years of experience in data engineering and ETL development Extensive experience wit

View Job  Cape Town: Italian Customer Service & Sales Representative posted by ABC Worldwide

View Job
Data Engineer

Johannesburg: Maintenance Datacom Engineer

Major Compulsory Responsibilities Responsible for routine network maintenance, fault locating, troubleshooting of datacom products. Responsible for routine health check, network risk clearance, perform rectification and precaution check on datacom products


View Job
Maintenance Datacom Engineer

North Johannesburg: Data Engineer (Ab Initio)

The Group Data and Analytics Office is on the lookout for a skilled Ab Initio Data Engineer. The ideal candidate will have extensive experience in data engineering, particularly with Ab Initio, and will be responsible for designing, developing, and maintai


View Job
Data Engineer (Ab Initio)

Pretoria: 2510_Cloud Database Engineer (Advanced)

Key Responsibilities: Cloud Database Migration: Develop and execute comprehensive migration plans for transitioning on-premises databases to cloud platforms, leveraging OCI, Azure, and AWS. Database Design and Implementation: Design, implement, and optimiz


View Job
2510_Cloud Database Engineer (Advanced)

Cape Town City Centre: Data Engineer

What will you do? Our client is a newly created engineering organisation on a mission to empower and accelerate autonomous value creation through insights and ML across the group. The companys main users are the data scientists and analysts who sit inside


View Job
Data Engineer

Cape Town City Centre: Senior Data Engineer : Ingestions Squad (Group Data & Ml Platform Tribe)

Our Client Company Group Technology is responsible for the provision of a digitally enabled technology service as a group COE, drive business and transformation and provide group-wide digital and data architecture. We operate the various technology platfor


View Job
Senior Data Engineer

Cape Town City Centre: Data Engineer: Ingestions Squad (Group Data & Ml Platform Tribe)

What will you do? Our client is a newly created engineering organisation on a mission to empower and accelerate autonomous value creation through insights and ML across the group. The companys main users are the data scientists and analysts who sit inside


View Job
Data Engineer

Cape Town City Centre: Data Engineer : Ingestions Squad (Group Data & Ml Platform Tribe)

Job Details Who are we? Company Group Technology is responsible for the provision of a digitally enabled technology service as a group COE, drive business and transformation and provide group-wide digital and data architecture. We operate the various techn


View Job
Data Engineer

Error making API request.

Share this to someone who needs a job:
Posted in Jobs in Stellenbosch, Jobs in Western Cape

More Jobs in Your Area