Menu Close

Johannesburg: Data Engineer (Jhb) posted by Datafin

Date 2024-12-28
Job Title Data Engineer (Jhb)
Employer Datafin
More Information
Salary 0
Category It Computer
Location Gauteng
/ Johannesburg

Job Summary

Data Engineer (JHB)IT – Analyst, Data Management
Johannesburg – Gauteng

ENVIRONMENT:
OPTIMIZE data pipelines for performance, scalability, and reliability as the next Data Engineer sought by a dynamic Retail and Consumer Finance Concern in Joburg. The ideal candidate will use their passion for Big Data & Analytics to provide insights to the business covering a range of topics. You will play a critical role in the development and maintenance of data infrastructure while ensuring data availability, quality, and accessibility for analysis. You must possess a Bachelors Degree in Computer Science/IT or similar discipline, have relevant Certifications such as AWS Certified Data Analytics, Google Cloud Professional Data Engineer and have 5-10 years experience and understanding in designing and developing data warehouses according to the Kimball methodology. You will also need proficiency with SQL, Python/R, Scala, Java, Snowflake, Redshift, AWS, SAS Data Studio & ETL tools.
DUTIES:
  • Collaborate with Data Scientists, Analysts, and business stakeholders to understand data requirements.
  • Design, develop, and maintain data pipelines and ETL processes.
  • Implement and maintain data warehousing and data storage solutions.
  • Optimize data pipelines for performance, scalability, and reliability.
  • Ensure data quality and integrity through data validation and cleansing processes.
  • Monitor and troubleshoot data infrastructure issues.
  • Stay current with emerging technologies and best practices in Data Engineering.
  • Systematic solution design of the ETL and data pipeline in line with business user specifications.
  • Develop and implement ETL pipelines aligned to the approved solution design.
  • Ensure data governance and data quality assurance standards are upheld.
  • Deal with customers in a customer centric manner.
REQUIREMENTS:
Qualifications
  • Bachelor`s Degree in Computer Science, Information Technology, or a related field.
  • Relevant Certifications (e.g., AWS Certified Data Analytics, Google Cloud Professional Data Engineer).
Experience/Skills
  • 5-10 Years experience and understanding in designing and developing data warehouses according to the Kimball methodology.
  • Proven experience as a Data Engineer in a professional setting.
  • Proficiency in Data Engineering technologies and Programming languages (e.g., SQL, Python, Scala, Java).
  • Strong knowledge of data storage, database design, and data modelling concepts
  • Experience with ETL tools, data integration, and data pipeline orchestration.
  • Familiarity with data warehousing solutions (e.g., Snowflake, Redshift).
  • Excellent problem-solving and troubleshooting skills.
  • Adept at design and development of ETL processes.
  • SQL development experience, preferably SAS Data Studio and AWS experience. Have the ability to ingest/output CSV, JSON and other flat file types and any related data sources.
  • Proficient in Python or R or willingness to learn. Experience within Retail, Financial Services and Logistics environments.
  • Redshift Technologies.
  • Understanding of data security and compliance best practices.
ATTRIBUTES:
  • Effective self-management and teamwork.
  • Strong communication and collaboration skills.
Apply for this Job

Data Engineer (Jhb) position available in Gauteng, Johannesburg. This job position was posted by Datafin. The job has been posted as a premium ad on 2024-12-28 at 16:09:47 in the It Computer category

Click Go Apply to apply online!


You might also like to look at the available jobs in the same area.



View Job  Pretoria East: Saica Trainee (January 2025) posted by Network Finance

Select one of the buttons below to browse for more available jobs.









Apply directly on jobmail for this position
Some posts have contact information included with other instructions. All applicants are urged to read the instructions carefully.
We will list jobs at the bottom of each job, so feel free to scroll down and continue your search.

We do not accept any job applications and merely offer the service of daily jobs being mined and displayed on our job portal.
Each job post has a link to take you directly to the original post to apply on their website or the original website where the post came from.


Here are some more related positions


Pretoria North: Software Engineer – Sql Database Specialist posted by Sastel Packaging

Development and maintenance of inhouse database. Must have qualifications and experience in MySQL, Python and C#. Software Engineer - Sql Database Specialist position available in Gauteng, Pretoria North. This job position was posted by Sastel Packaging. T


View Job
Software Engineer – Sql Database Specialist

Centurion: Data Science Engineer – Centurion posted by MJM RECRUITMENT

We are hiring:Data science engineer x 1 (centurion)salary: R 30 000 R 35 000pm tctcExperience in the following industies: Vehicle tracking/fleet management/ saas/ big data or telematics highly advantageousbrief description of role:The main purpose of the


View Job
Data Science Engineer – Centurion

Alberton: Junior Data Analyst / Engineer (Jb4854) posted by Kontak Recruitment

"Junior Data Analyst / Engineer (JB4854) Alberton, Gauteng R10 000 to R15 000 a month CTCContract 6 to 12 months, which may become permanent A company committed to leveraging technology for data-driven insights and strategic intelligence solutions, offerin


View Job
Junior Data Analyst / Engineer (Jb4854)

Sandton: Data Engineer (Bi Analyst/ Etl Developer)

We are looking for Data Engineers to join our team based in JHB- onsite. The ideal candidate will have extensive experience in data engineering, particularly with SAS, SQL and Azure Cloud Stack, and will be responsible for designing, developing, and mainta


View Job
Data Engineer (Bi Analyst/ Etl Developer)

Pretoria: Junior Data Engineer – Centurion – R330k To R430k Per Annum

An AI and Fleet telematics that assist with your day-to-day operations, forecasting, reporting & compliance are in the market for a Junior Data Engineer. The ideal candidate must have a strong analytical background to help drive value from the companys dat


View Job
Junior Data Engineer – Centurion – R330k To R430k Per Annum

Cape Town City Centre: Mid Data Engineer

Responsibilities: Data Reporting: Design and maintain insightful reports to support key business decisions. Pipeline Development: Build and optimise scalable data pipelines for enhanced data accessibility. Collaboration: Work closely with cross-functional


View Job
Mid Data Engineer

Cape Town City Centre: Sap Data Engineer

The company helps organizations improve efficiency, drive digital transformation, and foster innovation across various industries. With a global presence, it is known for its customer-focused approach and expertise in using technology to address complex bu

View Job  Johannesburg: Confirmations Officer posted by Isilumko Staffing

View Job
Sap Data Engineer

Cape Town City Centre: Data Engineer

Key Responsibilities: Design, build, and maintain scalable data pipelines to support data integration, processing, and analytics. Collaborate with cross-functional teams to understand business requirements and implement data solutions. Work with large data


View Job
Data Engineer

Johannesburg: Data Engineer

As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines, databases, and infrastructure that enable high-quality data processing and analytics. You will work with cross-functional teams, including Data Scientists,


View Job
Data Engineer

Cape Town City Centre: Aws Data Engineer

PBT Group is currently offering an opportunity for an AWS Data Engineer with 4 years of relevant experience. The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and securit


View Job
Aws Data Engineer

Johannesburg: Data Engineer

Duties and Responsibilities: Develop and maintain data pipelines Implement data integrations Perform data transformations Collaborate with cross-functional teams on data projects Ensure data quality and integrity Qualifications: Bachelor`s degree in Comput


View Job
Data Engineer

Centurion: Senior Data Engineer

Key Responsibilities Design & Build: Develop end-to-end data pipelines (ETL/ELT) to centralize and transform data from various sources. Data Mart Management: Design, implement, and optimize high-performing data marts for analytical and reporting needs. Clo


View Job
Senior Data Engineer

Johannesburg: Data Engineer – Johannesburg – R800k To R1mil Per Annum

Data Engineer Johannesburg - R800k to R1mil per annum Join a global financial services organisation whose core purpose is to seek out and invest in exceptional individuals who understand and support their core purpose, and whose values align and pride them


View Job
Data Engineer – Johannesburg – R800k To R1mil Per Annum

Midrand: Data Engineer

Position: Data Engineer Industry: Logistics Sector: Technology Location: Permanent Salary: Market related REQUIREMENTS: Matric or equivalent qualification A Bachelor`s degree or several years of experience in computer science, data science, software develo


View Job
Data Engineer

Cape Town City Centre: Data Engineer

Our client is currently seeking an experienced Data Engineer. The main focus of this role will be report writing and providing actionable insights. As the role evolves, the successful candidate will develop and maintain robust data pipelines to ensure seam


View Job
Data Engineer

Johannesburg: Data Engineer

TERTIARY QUALIFICATION(S) University Degree/College Diploma in the field of computer science or Informatics along with work experience in related field Essential Additional Computer Skills MicrosoftsAzure stack (ADF, Databricks,Azure SQLDatabase/Azure Syna


View Job
Data Engineer

Johannesburg: Data Engineer

My client from a Freight Forwarding Company is seeking a Data Engineer to join their team Responsibilities: The role is responsible for the design, development, testing, implementation, maintenance and support of the BI report and Data Warehouse solutions


View Job
Data Engineer

Johannesburg: Data Engineer

A reputable company in the Financial Services sector is seeking a Data Engineer to work with cloud data systems. Proficiency in the Microsoft BI Stack, T-SQL development, and cloud services is essential. Join a dynamic team and enhance your expertise while

View Job  Johannesburg: Senior Credit Manager posted by Telebest

View Job
Data Engineer

Kempton Park: Ref88265- Healthcare Azure Data Engineer (Road Logistics)

REF88265- Healthcare Azure Data Engineer (Road Logistics), Kempton Park, Rneg Ben Degree/Diploma Comp Science/ IT 5 years AZURE Development 8 years BI ETL Development 8 Years Advance SQL 5 years Data Warehouse Management MS Azure Stack BI Architcture Prin


View Job
Ref88265- Healthcare Azure Data Engineer (Road Logistics)

South Africa: Data Engineering (Us Working Hours)

The core advanced data engineering skillset is a comprehensive combination of technical expertise, platform knowledge, and problem-solving abilities required to build, maintain, and optimize robust, scalable, and efficient data systems. Data Architecture a


View Job
Data Engineering (Us Working Hours)

Cape Town City Centre: Senior Data And Vehicle Support Engineer (Telematics) Cape Town

Senior Data and Vehicle Support Engineer (Telematics) Cape Town Minimum requirements and experience: BEng or MEng (Electronic or Mechatronic Engineering) Minimum of 5 years working experience in telematics systems and -components including data managemen


View Job
Senior Data And Vehicle Support Engineer (Telematics) Cape Town

Centurion: Senior Data And Vehicle Support Engineer (Telematics) Centurion

Senior Data and Vehicle Support Engineer (Telematics) Centurion Minimum requirements and experience: BEng or MEng (Electronic or Mechatronic Engineering) Minimum of 5 years working experience in telematics systems and -components including data managemen


View Job
Senior Data And Vehicle Support Engineer (Telematics) Centurion

Johannesburg: Intermediate Azure Data Engineer – Johannesburg – R470k Up To R570k Per Annum

A consulting company is seeking an Intermediate Data Engineer to support a major client. In this role, you will execute data engineering tasks aligned with the clients established standards, frameworks, and roadmaps. If you have a solid background in data


View Job
Intermediate Azure Data Engineer – Johannesburg – R470k Up To R570k Per Annum

Johannesburg: Data Engineer (Fully Remote)

Data Architecture and Design - Data Modeling: o Create normalized and denormalized schemas (3NF, star, snowflake). o Design data lakes, warehouses, and marts optimized for analytical or transactional workloads. o Incorporate modern paradigms like data mesh


View Job
Data Engineer (Fully Remote)

Sandton: Data Engineer – Lumos – Sandton- 12 Months – Start Date – January 2025

Job Title: Data Engineer - Lumos - Sandton Location: Gauteng, Johannesburg Metro, Sandton Job Type: Contract Duration: 12 months Start Date: January 2025 Job Description Job Duties: Design and implement data solutions to support business requirements Devel


View Job
Data Engineer – Lumos – Sandton- 12 Months – Start Date – January 2025

Error making API request.

Share this to someone who needs a job:
Posted in Jobs in Gauteng, Jobs in Johannesburg

More Jobs in Your Area

Johannesburg: Data Engineer (Jhb) posted by Datafin

Date 2024-12-25
Job Title Data Engineer (Jhb)
Employer Datafin
More Information
Salary 0
Category It Computer
Location Gauteng
/ Johannesburg

Job Summary

Data Engineer (JHB)IT – Analyst, Data Management
Johannesburg – Gauteng

ENVIRONMENT:
Our client is a development firm focusing on the advancement of innovative agricultural technologies. They are in search of a proficient and enthusiastic Data Engineer to join their dynamic team in the role of integration specialist. Your duties will involve the design, implementation, and maintenance of the organization`s data infrastructure and pipelines. Close collaboration with data scientists, analysts, and software engineers is essential to ensure smooth and dependable data flows across the entire organization. The ideal candidate possesses a robust foundation in data engineering, exceptional problem-solving abilities, and a keen interest in working with extensive datasets.
DUTIES:
    • Design, develop, and maintain scalable and efficient data pipelines and ETL processes to ingest, transform, and load data from various sources.
    • Develop and implement data warehousing solutions.
    • Collaborate with cross-functional teams to integrate various data sources.
    • Ensure data quality and consistency across different data systems.
    • Optimise data retrieval for dashboard/reporting solutions.
    • Optimise data infrastructure, including data storage, data retrieval, and data processing for enhanced performance and scalability.
    • Implement data quality and data governance processes to ensure accuracy, consistency, and integrity of data.
    • Monitor and troubleshoot data pipelines to identify and resolve issues in a timely manner.
    • Perform data profiling and analysis to identify data quality issues and propose improvements.
    • Collaborate with data scientists and analysts to provide them with the necessary data sets for analysis and reporting.
    • Stay up to date with emerging technologies and trends in data engineering and recommend new tools and frameworks to improve data infrastructure.
    • Willingness to actively contribute to BI analytics tasks, such as creating and maintaining reports.
    • This means being comfortable with hands-on work, including report development, SQL writing, and refactoring tasks.
REQUIREMENTS:
Qualification:
    • Preferably a bachelors degree in computer science, engineering, or a related field.
    • Certifications (AWS, GCP, Azure, Microsoft) a plus.
Knowledge, Skills & Experience:
    • Proven experience as a Data Engineer or similar role, with a strong understanding of data modelling, data warehousing, and ETL processes.
    • Proficient in SQL and experience working with relational databases (e.g., PostgreSQL, MySQL, SQL Server) and NoSQL databases (e.g., MongoDB, Cassandra).
    • Strong programming skills in at least one scripting language (e.g., Python) and experience with data manipulation and transformation libraries (e.g., Pandas, PySpark).
    • Comfortable working with cloud-based infrastructure and services provided by Amazon Web Services (AWS)/ Azure.
    • Familiarity with data pipeline orchestration tools (e.g., Apache Airflow, Luigi, Lambda) and workflow management systems.
    • Experience with real-time data streaming technologies (e.g., Apache Kafka, Apache Flink).
    • Knowledge of containerisation technologies and orchestration tools (e.g., Docker, Kubernetes).
    • Familiarity with machine learning concepts and frameworks.
Apply for this Job

Data Engineer (Jhb) position available in Gauteng, Johannesburg. This job position was posted by Datafin. The job has been posted as a premium ad on 2024-12-25 at 16:09:10 in the It Computer category

Click Go Apply to apply online!


You might also like to look at the available jobs in the same area.



View Job  Johannesburg: Consumer Portfolio Manager posted by Career-seekers Recruitment Solutions

Select one of the buttons below to browse for more available jobs.









Apply directly on jobmail for this position
Some posts have contact information included with other instructions. All applicants are urged to read the instructions carefully.
We will list jobs at the bottom of each job, so feel free to scroll down and continue your search.

We do not accept any job applications and merely offer the service of daily jobs being mined and displayed on our job portal.
Each job post has a link to take you directly to the original post to apply on their website or the original website where the post came from.


Here are some more related positions


Pretoria North: Software Engineer – Sql Database Specialist posted by Sastel Packaging

Development and maintenance of inhouse database. Must have qualifications and experience in MySQL, Python and C#. Software Engineer - Sql Database Specialist position available in Gauteng, Pretoria North. This job position was posted by Sastel Packaging. T


View Job
Software Engineer – Sql Database Specialist

Centurion: Data Science Engineer – Centurion posted by MJM RECRUITMENT

We are hiring:Data science engineer x 1 (centurion)salary: R 30 000 R 35 000pm tctcExperience in the following industies: Vehicle tracking/fleet management/ saas/ big data or telematics highly advantageousbrief description of role:The main purpose of the


View Job
Data Science Engineer – Centurion

Alberton: Junior Data Analyst / Engineer (Jb4854) posted by Kontak Recruitment

"Junior Data Analyst / Engineer (JB4854) Alberton, Gauteng R10 000 to R15 000 a month CTCContract 6 to 12 months, which may become permanent A company committed to leveraging technology for data-driven insights and strategic intelligence solutions, offerin


View Job
Junior Data Analyst / Engineer (Jb4854)

Sandton: Data Engineer (Bi Analyst/ Etl Developer)

We are looking for Data Engineers to join our team based in JHB- onsite. The ideal candidate will have extensive experience in data engineering, particularly with SAS, SQL and Azure Cloud Stack, and will be responsible for designing, developing, and mainta


View Job
Data Engineer (Bi Analyst/ Etl Developer)

Pretoria: Junior Data Engineer – Centurion – R330k To R430k Per Annum

An AI and Fleet telematics that assist with your day-to-day operations, forecasting, reporting & compliance are in the market for a Junior Data Engineer. The ideal candidate must have a strong analytical background to help drive value from the companys dat


View Job
Junior Data Engineer – Centurion – R330k To R430k Per Annum

Cape Town City Centre: Mid Data Engineer

Responsibilities: Data Reporting: Design and maintain insightful reports to support key business decisions. Pipeline Development: Build and optimise scalable data pipelines for enhanced data accessibility. Collaboration: Work closely with cross-functional


View Job
Mid Data Engineer

Cape Town City Centre: Sap Data Engineer

The company helps organizations improve efficiency, drive digital transformation, and foster innovation across various industries. With a global presence, it is known for its customer-focused approach and expertise in using technology to address complex bu

View Job  Johannesburg: Confirmations Officer posted by Isilumko Staffing

View Job
Sap Data Engineer

Cape Town City Centre: Data Engineer

Key Responsibilities: Design, build, and maintain scalable data pipelines to support data integration, processing, and analytics. Collaborate with cross-functional teams to understand business requirements and implement data solutions. Work with large data


View Job
Data Engineer

Johannesburg: Data Engineer

As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines, databases, and infrastructure that enable high-quality data processing and analytics. You will work with cross-functional teams, including Data Scientists,


View Job
Data Engineer

Cape Town City Centre: Aws Data Engineer

PBT Group is currently offering an opportunity for an AWS Data Engineer with 4 years of relevant experience. The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and securit


View Job
Aws Data Engineer

Johannesburg: Data Engineer

Duties and Responsibilities: Develop and maintain data pipelines Implement data integrations Perform data transformations Collaborate with cross-functional teams on data projects Ensure data quality and integrity Qualifications: Bachelor`s degree in Comput


View Job
Data Engineer

Centurion: Senior Data Engineer

Key Responsibilities Design & Build: Develop end-to-end data pipelines (ETL/ELT) to centralize and transform data from various sources. Data Mart Management: Design, implement, and optimize high-performing data marts for analytical and reporting needs. Clo


View Job
Senior Data Engineer

Johannesburg: Data Engineer – Johannesburg – R800k To R1mil Per Annum

Data Engineer Johannesburg - R800k to R1mil per annum Join a global financial services organisation whose core purpose is to seek out and invest in exceptional individuals who understand and support their core purpose, and whose values align and pride them


View Job
Data Engineer – Johannesburg – R800k To R1mil Per Annum

Midrand: Data Engineer

Position: Data Engineer Industry: Logistics Sector: Technology Location: Permanent Salary: Market related REQUIREMENTS: Matric or equivalent qualification A Bachelor`s degree or several years of experience in computer science, data science, software develo


View Job
Data Engineer

Cape Town City Centre: Data Engineer

Our client is currently seeking an experienced Data Engineer. The main focus of this role will be report writing and providing actionable insights. As the role evolves, the successful candidate will develop and maintain robust data pipelines to ensure seam


View Job
Data Engineer

Johannesburg: Data Engineer

TERTIARY QUALIFICATION(S) University Degree/College Diploma in the field of computer science or Informatics along with work experience in related field Essential Additional Computer Skills MicrosoftsAzure stack (ADF, Databricks,Azure SQLDatabase/Azure Syna


View Job
Data Engineer

Johannesburg: Data Engineer

My client from a Freight Forwarding Company is seeking a Data Engineer to join their team Responsibilities: The role is responsible for the design, development, testing, implementation, maintenance and support of the BI report and Data Warehouse solutions


View Job
Data Engineer

Johannesburg: Data Engineer

A reputable company in the Financial Services sector is seeking a Data Engineer to work with cloud data systems. Proficiency in the Microsoft BI Stack, T-SQL development, and cloud services is essential. Join a dynamic team and enhance your expertise while

View Job  Johannesburg: Senior Credit Manager posted by Telebest

View Job
Data Engineer

Kempton Park: Ref88265- Healthcare Azure Data Engineer (Road Logistics)

REF88265- Healthcare Azure Data Engineer (Road Logistics), Kempton Park, Rneg Ben Degree/Diploma Comp Science/ IT 5 years AZURE Development 8 years BI ETL Development 8 Years Advance SQL 5 years Data Warehouse Management MS Azure Stack BI Architcture Prin


View Job
Ref88265- Healthcare Azure Data Engineer (Road Logistics)

South Africa: Data Engineering (Us Working Hours)

The core advanced data engineering skillset is a comprehensive combination of technical expertise, platform knowledge, and problem-solving abilities required to build, maintain, and optimize robust, scalable, and efficient data systems. Data Architecture a


View Job
Data Engineering (Us Working Hours)

Cape Town City Centre: Senior Data And Vehicle Support Engineer (Telematics) Cape Town

Senior Data and Vehicle Support Engineer (Telematics) Cape Town Minimum requirements and experience: BEng or MEng (Electronic or Mechatronic Engineering) Minimum of 5 years working experience in telematics systems and -components including data managemen


View Job
Senior Data And Vehicle Support Engineer (Telematics) Cape Town

Centurion: Senior Data And Vehicle Support Engineer (Telematics) Centurion

Senior Data and Vehicle Support Engineer (Telematics) Centurion Minimum requirements and experience: BEng or MEng (Electronic or Mechatronic Engineering) Minimum of 5 years working experience in telematics systems and -components including data managemen


View Job
Senior Data And Vehicle Support Engineer (Telematics) Centurion

Johannesburg: Intermediate Azure Data Engineer – Johannesburg – R470k Up To R570k Per Annum

A consulting company is seeking an Intermediate Data Engineer to support a major client. In this role, you will execute data engineering tasks aligned with the clients established standards, frameworks, and roadmaps. If you have a solid background in data


View Job
Intermediate Azure Data Engineer – Johannesburg – R470k Up To R570k Per Annum

Johannesburg: Data Engineer (Fully Remote)

Data Architecture and Design - Data Modeling: o Create normalized and denormalized schemas (3NF, star, snowflake). o Design data lakes, warehouses, and marts optimized for analytical or transactional workloads. o Incorporate modern paradigms like data mesh


View Job
Data Engineer (Fully Remote)

Sandton: Data Engineer – Lumos – Sandton- 12 Months – Start Date – January 2025

Job Title: Data Engineer - Lumos - Sandton Location: Gauteng, Johannesburg Metro, Sandton Job Type: Contract Duration: 12 months Start Date: January 2025 Job Description Job Duties: Design and implement data solutions to support business requirements Devel


View Job
Data Engineer – Lumos – Sandton- 12 Months – Start Date – January 2025

Error making API request.

Share this to someone who needs a job:
Posted in Jobs in Gauteng, Jobs in Johannesburg

More Jobs in Your Area