Menu Close

Gauteng: Intermediate Data Engineer posted by Network Finance






Date 2024-07-15
Job Title Intermediate Data Engineer
Employer Network Finance
More Information
Salary 54200
Category Administration Pa Secretary
Location Gauteng
/ Gauteng

Job Summary

Responsibilities:

  • Develop and manage data pipelines to support data scientists, analysts, actuaries, and other initiatives.
  • Ensure accurate, efficient, and cost-effective development of robust data systems in line with the organization`s data strategy.
  • Implement data validation processes to maintain clean, high-quality data.
  • Establish and enforce guidelines for data collection, integration, and retention.
  • Monitor data sources, processing, and environment for inconsistencies or anomalies, and resolve data quality problems.
  • Leverage Azure DevOps Repos for version control and foster a collaborative development environment.
  • Implement CI/CD practices using Azure Pipelines to automate and streamline build and deployment processes.
  • Ensure seamless integration between code repositories and deployment pipelines.
  • Build and nurture relationships across the business to ensure alignment and commitment to data engineering objectives.
  • Engage effectively with stakeholders to drive the success of data initiatives.
  • Participate in assessment and development planning activities, formal and informal training, and coaching.
  • Maintain an understanding of relevant technology, external regulation, and industry best practices through ongoing education and professional development.
  • Upskill in all facets of data engineering.

Skills:

  • Expert knowledge in Azure data services including Azure Data Factory, Azure Databricks, Data Lake, SQL Databases, Azure DevOps Boards and Repos.
  • Proficiency in large-scale data processing with Apache Spark.
  • Knowledge of GCP and AWS is desirable but not essential.
  • Proficiency in Python and SQL is imperative.
  • Exposure to PySpark is advantageous.

Qualifications:

  • Grade 12/SAQA Accredited Equivalent (Essential)
  • 3-year degree in Information Technology/Sciences/Informatics/Computer Sciences (Essential)
  • Master’s Degree in Information Technology/Sciences/Informatics/Computer Sciences (Advantageous)

Experience:

  • 2 to 5 years of experience in data engineering, data science, or computer science (Essential)
  • Experience in the Financial Services Industry, specifically Short-Term Insurance (Advantageous)

We appreciate your interest, however if you have not had any response within 2 weeks, please consider your application unsuccessful.
We also invite you to contact us to discuss your next career move in IT.

IT Consultant
Network Finance
Intermediate Data Engineer position available in Gauteng, Gauteng. This job position was posted by Network Finance. The job has been posted as a char8000 ad on 2024-07-15 at 01:16:04 in the Administration Pa Secretary category

Click Go Apply to apply online!


You might also like to look at the available jobs in the same area.

Apply directly on jobmail for this position
Some posts have contact information included with other instructions. All applicants are urged to read the instructions carefully.
We will list jobs at the bottom of each job, so feel free to scroll down and continue your search.

View Job  Johannesburg: Accounts Administrator

We do not accept any job applications and merely offer the service of daily jobs being mined and displayed on our job portal.
Each job post has a link to take you directly to the original post to apply on their website or the original website where the post came from.


Here are some more related positions


Pretoria: Intermediate Data Scientist – Pretoria – R500k Up To R700k Per Annum

A company at the forefront of innovation in the telecommunications industry, priding themselves in providing cutting-edge services and solutions that enhance connectivity and empowering their clients seek the services of an Intermediate Data Scientist who


View Job
Intermediate Data Scientist – Pretoria – R500k Up To R700k Per Annum

Johannesburg: Intermediate Data Solutions Engineer – Johannesburg – R600k To R800 Per Annum

Join a data driven team as an Intermediate Data Solutions Engineer , where your thorough understanding of best practice business intelligence implementations will be crucial in driving business forward. If you have a passion for data and how it flows from


View Job
Intermediate Data Solutions Engineer – Johannesburg – R600k To R800 Per Annum

Johannesburg: Intermediate/Senior Data Scientist – Johannesburg – R800k Up To R1mil Per Annum

A registered Financial Service Provider with an undivided team of diverse thinkers and doers who believe in leading through technology and pushing past their limits with innovation at its core is seeking a dynamic Intermediate/Senior Data Scientist who can


View Job
Intermediate/Senior Data Scientist – Johannesburg – R800k Up To R1mil Per Annum

Johannesburg: Intermediate Data Analyst: Statis Data Team: Maternity Cover: Banking

Data Analyst in the Static Data Team: Maternity Cover Contract: Banking Responsible for performing data quality checks resulting in accurate regulatory, portfolio compliance and institutional client reporting. Critical role within the team supporting the t


View Job
Intermediate Data Analyst

Johannesburg: Intermediate Data Engineer

Intermediate Data Engineer Johannesburg Responsibilities: Develop and manage data pipelines to support data scientists, analysts, actuaries, and other initiatives. Ensure accurate, efficient, and cost-effective development of robust data systems in line wi


View Job
Intermediate Data Engineer

Durban: Intermediate Sql Database Administrator

Responsibilities: Establishing the needs of users and monitoring user access and security Monitoring performance and managing parameters to provide fast responses to front-end users Mapping out the conceptual design for a planned database Considering both


View Job
Intermediate Sql Database Administrator

Johannesburg: Intermediate Data Analyst: Statis Data Team: Maternity Cover: Banking posted by Isilumko Staffing

Data Analyst in the Static Data Team: Maternity Cover Contract: BankingResponsible for performing data quality checks resulting in accurate regulatory, portfolio compliance and institutional client reporting.Critical role within the team supporting the tea


View Job
Intermediate Data Analyst

South Africa: Intermediate Data Scientist posted by IOCO

We are seeking a talented and analytical Intermediate Data Scientists to join our dynamic data team. The ideal candidate will have a strong foundation in data science methodologies, hands-on experience with data analysis, and the ability to derive actionab

View Job  Kempton Park: Procurement Manager - Manufacturing Exp A Must posted by Natebo Consulting

View Job
Intermediate Data Scientist

South Africa: Intermediate Data Scientist posted by IOCO

We are seeking a talented and analytical Intermediate Data Scientists to join our dynamic data team. The ideal candidate will have a strong foundation in data science methodologies, hands-on experience with data analysis, and the ability to derive actionab


View Job
Intermediate Data Scientist

Johannesburg: Intermediate – Senior Data Engineer (Jhb – Hybrid) posted by IOCO

About the Role: iOCO is seeking a skilled and experienced Intermediate to Senior Data Engineer to join our dynamic team in Johannesburg. This hybrid role requires expertise in SQL Server Analysis Services (SSAS), SQL Server Reporting Services (SSRS), SQL S


View Job
Intermediate – Senior Data Engineer (Jhb – Hybrid)

Johannesburg: Intermediate – Senior Data Engineer (Jhb – Hybrid) posted by IOCO

About the Role: iOCO is seeking a skilled and experienced Intermediate to Senior Data Engineer to join our dynamic team in Johannesburg. This hybrid role requires expertise in SQL Server Analysis Services (SSAS), SQL Server Reporting Services (SSRS), SQL S


View Job
Intermediate – Senior Data Engineer (Jhb – Hybrid)

South Africa: Intermediate Data Engineer – Permanent – Hybrid – Pretoria R720 Pa posted by E-Merge

A company at the forefront of innovation in the telecommunications industry, priding themselves in providing cutting-edge services and solutions that enhance connectivity and empowering their clients seeks the services of an Intermediate Data Engineer.You


View Job
Intermediate Data Engineer – Permanent – Hybrid – Pretoria R720 Pa

Johannesburg: Intermediate/Senior Data Scientist – Johannesburg – R800k Up To R1mil Per Annum posted by E-Merge

A registered Financial Service Provider with an undivided team of diverse thinkers and doers who believe in leading through technology and pushing past their limits with innovation at its core is seeking a dynamic Intermediate/Senior Data Scientist who can


View Job
Intermediate/Senior Data Scientist – Johannesburg – R800k Up To R1mil Per Annum

Johannesburg: Intermediate Data Solutions Engineer – Johannesburg – R600k To R800 Per Annum posted by E-Merge

Join a data driven team as an Intermediate Data Solutions Engineer, where your thorough understanding of best practice business intelligence implementations will be crucial in driving business forward. If you have a passion for data and how it flows from s


View Job
Intermediate Data Solutions Engineer – Johannesburg – R600k To R800 Per Annum

Pretoria: Intermediate Data Scientist – Pretoria – R500k Up To R700k Per Annum posted by E-Merge

A company at the forefront of innovation in the telecommunications industry, priding themselves in providing cutting-edge services and solutions that enhance connectivity and empowering their clients seek the services of an Intermediate Data Scientist who


View Job
Intermediate Data Scientist – Pretoria – R500k Up To R700k Per Annum

Johannesburg: Intermediate Data Scientist – Johannesburg – R700k To R900 Per Annum posted by E-Merge

Join the home of the #changeables as an Intermediate Data Scientist implementing designs for the shapeshifters and delivery of products and services. You will be expected to address business opportunities and problems and implement business strategy, under

View Job  Pretoria: Sap Authorizations Consultant (Advanced) 2682 posted by JorDan HR

View Job
Intermediate Data Scientist – Johannesburg – R700k To R900 Per Annum

Cape Town: Intermediate Full Stack Php Developer (Cpt Hybrid) posted by Datafin

Intermediate Full Stack PHP Developer (CPT Hybrid)IT - Software DevelopmentCape Town - Western CapeENVIRONMENT: A dynamic Education Specialist seeks an Intermediate Full Stack PHP Developer who is experienced in developing business web applications and app


View Job
Intermediate Full Stack Php Developer (Cpt Hybrid)

Johannesburg: Intermediate Javascript Developer (Jhb/Pta/Cpt) posted by Datafin

Intermediate JavaScript Developer (JHB/PTA/CPT)IT - Software DevelopmentCape Town - Western Cape ~ Johannesburg - Gauteng ~ Pretoria/Centurion - GautengENVIRONMENT: A cutting-edge provider of End-to-End Technology & Services seeks the coding expertise of a


View Job
Intermediate Javascript Developer (Jhb/Pta/Cpt)

Johannesburg: Intermediate Java Developer (Jhb/Cpt/Pta) posted by Datafin

Intermediate Java Developer (JHB/CPT/PTA)IT - Software DevelopmentCape Town - Western Cape ~ Johannesburg - Gauteng ~ Pretoria/Centurion - GautengENVIRONMENT: A cutting-edge provider of End-to-End Technology & Services seeks the coding expertise of a Senio


View Job
Intermediate Java Developer (Jhb/Cpt/Pta)

Cape Town: Intermediate .Net Developer posted by Datafin

Intermediate .Net DeveloperIT - Software DevelopmentCape Town - Western CapeENVIRONMENT: JOIN the team of a cutting-edge provider of End-to-End Technology & Services seeks your coding talents as an Intermediate.Net Developer. Applicants must possess a BSc,


View Job
Intermediate .Net Developer

Cape Town: Intermediate Full Stack Developer (React, Node.Js) (Onsite) posted by Datafin

Intermediate Full Stack Developer (React, Node.js) (Onsite)IT - Software DevelopmentCape Town - Western CapeENVIRONMENT: Our partner is a globally acknowledged business consulting firm with expertise in enterprise resource planning, corporate performance m


View Job
Intermediate Full Stack Developer (React, Node.Js) (Onsite)

Johannesburg: Intermediate Php Developer (Remote) posted by Datafin

Intermediate PHP Developer (Remote)IT - Software DevelopmentCape Town - Western Cape ~ Johannesburg - GautengENVIRONMENT: A leading Digital Business Solutions company in Johannesburg is looking for a proficient and visionary Intermediate PHP Developer to b


View Job
Intermediate Php Developer (Remote)

Cape Town: Intermediate C# Application Developer (Hybrid) (Contract) posted by Datafin

Intermediate C# Application Developer (Hybrid) (Contract)IT - Software DevelopmentCape Town - Western CapeENVIRONMENT: Join a team where innovation, creativity, and strategic thinking are at the core. Our client is more than just a company; it`s a hub of t


View Job
Intermediate C# Application Developer (Hybrid) (Contract)

South Africa: Intermediate-Senior Mobile Applications Developer (Flutter) (Pta Hybrid) posted by Datafin

Intermediate-Senior Mobile Applications Developer (Flutter) (PTA Hybrid)IT - Software DevelopmentPretoria/Centurion - GautengENVIRONMENT: AN Intermediate-Senior Mobile Applications Developer (Flutter) who is passionate about building seamless & user-friend


View Job
Intermediate-Senior Mobile Applications Developer (Flutter) (Pta Hybrid)

Johannesburg: Intermediate To Senior Front-End Developer posted by Datafin

Intermediate to Senior Front-End DeveloperIT - Software DevelopmentJohannesburg - GautengENVIRONMENT: A software company based in Johannesburg is currently in search of a highly skilled Senior Front End Developer to join their team. This role necessitates


View Job
Intermediate To Senior Front-End Developer

Share this to someone who needs a job:
Posted in Jobs in Gauteng

More Jobs in Your Area