Menu Close

Centurion: Senior Data Engineer posted by CF & I Consulting

Date 2024-09-15
Job Title Senior Data Engineer
Employer CF & I Consulting
More Information
Salary 70000
Category It Computer
Location Gauteng
/ Centurion

Job Summary

The Data Engineer will have a knack for data analysis, data manipulation and data modelling and will be responsible for understanding and driving the overall technical vision and planning of a client`s organisation and translating business needs into technical strategy.

Required Qualifications:

  • Tertiary degree, diploma or certificate in a related field (BSc Computer Science, B.IT or Informatics related degrees).
  • DP-203: Data Engineering on Microsoft Azure Certification.

Experience and Knowledge:

  • 8-10 years working experience as a Data Engineer / Database Developer.
  • Experience in data mining, large scale data modelling and business requirements gathering/analysis.
  • Understanding and working experience in data integration and transformation.
  • Experience implementing data modelling methodologies like Dimensional Modeling and / or Data Vault.
  • Working knowledge of data quality processes and master data management.
  • Experience implementing design support systems using Database Management Systems (DBMS) such as SQL Server or Oracle.
  • Proficiency in designing and implementing data integration and ETL solutions using SSIS, Azure Data Factory and / or SQL Server stored procedures.
  • Understanding of several Big Data technologies like Hadoop, MapReduce and Spark as well as event processing or message ingestion services like Kafka, Event Hub and Stream Analytics.
  • Experience in database query languages such as T-SQL, ANSI SQL, PL/SQL.
  • Some experience developing software solutions using Visual Basic, C++, C#, Java or Python.
  • Experience using SQL Server management Studio and Visual Studio.
  • Experience implementing solutions using Azure SQL databases, Azure Synapse (Previously SQL Data Warehouse), Azure Storage Accounts (Data Lake) and / or Databricks.
  • Analytical mind and business acumen
  • Additional skills in the following will be taken into consideration: Tableau, Power BI, strong math skills (e.g. statistics, algebra), Scala, Python or R.

Key

Responsibilities:

  • Identify valuable data sources and automate collection processes.
  • Undertake preprocessing of structured and unstructured data.
  • Analyze large amounts of information to discover trends and patterns.
  • Data Modelling (Relational and Star Schema).
  • Database design.
  • Database development.
  • Data Warehouse Design – Build and Development.
  • Database Administration.
  • Database Performance Tuning and Optimisation.
  • Present information using data visualization techniques.
  • Propose solutions and strategies to business challenges.
  • Collaborate with engineering and product development teams.
  • An understanding and hands on experience on Hadoop/Spark based distributed storage and computing frameworks.
  • Real-Time analytics and batch processing.
  • Strong experience in architecting analytical applications in cloud environment such as Amazon Web Services and Microsoft Azure.

Senior Data Engineer position available in Gauteng, Centurion. This job position was posted by CF & I Consulting. The job has been posted as a premium ad on 2024-09-15 at 13:08:17 in the It Computer category

Click Go Apply to apply online!


You might also like to look at the available jobs in the same area.

Apply directly on jobmail for this position
Some posts have contact information included with other instructions. All applicants are urged to read the instructions carefully.
We will list jobs at the bottom of each job, so feel free to scroll down and continue your search.

View Job  Johannesburg: Investment Associate posted by Fempower Personnel

We do not accept any job applications and merely offer the service of daily jobs being mined and displayed on our job portal.
Each job post has a link to take you directly to the original post to apply on their website or the original website where the post came from.


Here are some more related positions


City Bowl: Senior Data Analyst/Scientist posted by Lebo Business Consulting (Pty) Ltd

Manage performance of data analyst/operator team; Play a leading role in the designing and documenting of operating procedures; Conduct, monitor and calibrate astronomical observations and use appropriate computing resources towards successful operation of


View Job
Senior Data Analyst/Scientist

Midrand: Senior Data Scientist/Engineer

Key Responsibilities: Data Analysis and Interpretation: - Analyze and interpret complex datasets to uncover trends, patterns, and actionable insights. - Develop and implement advanced statistical models and machine learning algorithms to solve business pro


View Job
Senior Data Scientist/Engineer

Cape Town City Centre: Senior Data And Vehicle Support Engineer (Telematics) Cape Town

Senior Data and Vehicle Support Engineer (Telematics) Cape Town Minimum requirements and experience: BEng or MEng (Electronic or Mechatronic Engineering) Minimum of 5 years working experience in telematics systems and -components including data management


View Job
Senior Data And Vehicle Support Engineer (Telematics) Cape Town

Pretoria: Senior Data Science Consultant (1 Year Contract)

Requirements Masters or Doctoral degree or equivalent in Actuarial Science, Finance, Statistics, Mathematics, Financial Mathematics, Business / Financial Risk Management, Informatics, Information Systems, Computer Science, Computer Engineering, etc. Data S


View Job
Senior Data Science Consultant (1 Year Contract)

Johannesburg: Intermediate/Senior Aws Data Engineer

The role involves working with advanced AWS technologies to design, build, and maintain scalable data pipelines and architectures. The ideal candidate will have strong expertise in SQL, Python/PySpark, and key AWS services including Glue, Step Functions, E


View Job
Intermediate/Senior Aws Data Engineer

Cape Town City Centre: Senior Data Modeller

PBT Group has an opportunity for Data Modellers to design and maintain optimal data models/structures at both an enterprise and system / application level that meet the business and architectural objectives of the organisation. Duties: Design data models t


View Job
Senior Data Modeller

Cape Town City Centre: Senior Data Analyst

PBT Group is seeking a Senior Data Analyst with at least 3 years of relevant experience within the insurance or financial services industry. The successful candidate will support and maintain the data warehouse in line with the data model and metadata repo


View Job
Senior Data Analyst

Johannesburg: Senior Data Analytics Specialist

We are seeking a Senior Data Analytics Specialist with excellent problem-solving skills, attention to detail, and the ability to translate data insights into strategic business recommendations. You will be responsible for providing data-driven insights and


View Job
Senior Data Analytics Specialist

Johannesburg: New Work In: Senior Data Engineer (Azure) – Johannesburg (Remote) – Paying R1.3Mil Per Annum Ctc

NEW WORK IN at a leading innovator in the tech industry, dedicated to providing cutting-edge solutions that drive business success with clients Globally. The current need is for Senior Data Engineer with a passion and love for Azure Cloud. There is so much

View Job  Pretoria: Receiving Manager posted by Retail Magic (Pty) Ltd

View Job
New Work In

Johannesburg: Intermediate/Senior Business Data Analyst – Johannesburg – R500 To R700 Per Hour

Join a company that drives Data, Digital and Innovation value propositions, and believe in long-term engagement with clients and pride themselves in being action-oriented disruptors who deliver quality work. As a Business Data analyst , you will be respons


View Job
Intermediate/Senior Business Data Analyst – Johannesburg – R500 To R700 Per Hour

Johannesburg: Senior Azure Data Engineer – Johannesburg – R900k Up To R1.1 Mil Per Annum

A long serving bank known as Africa``s biggest lender of assets and financial services group committed to providing banking insurance and asset management services have an open role for a Data Engineer to execute data engineering duties according to the st


View Job
Senior Azure Data Engineer – Johannesburg – R900k Up To R1.1 Mil Per Annum

Centurion: Senior Voice And Data Engineer

Key Responsibilities Set up, configure, and maintain new customer data links through various cloud platforms. Create tickets, troubleshoot issues, and follow up on data links identified as problematic by the monitoring system. Manage and configure SIP prot


View Job
Senior Voice And Data Engineer

Johannesburg: Senior Data Engineer (Azure) – Johannesburg – 900K To 1.1Mil Per Annum

A technology and analytics driven consulting company empowering clients by solving real-world business challenges that deliver tangible value and count their core capabilities as spanning the disciplines of Data Science, Data Engineering and Software Engin


View Job
Senior Data Engineer (Azure) – Johannesburg – 900K To 1.1Mil Per Annum

Johannesburg: Senior Database Administrator (Postgressql) Dba

Requirements: Bachelor`s degree in information technology, computer science, mathematics, information systems or related fields with at least three years` experience as a DBA. Knowledge of and experience in the following are required: Experience in a data


View Job
Senior Database Administrator (Postgressql) Dba

Centurion: Senior Data Business Analyst

What you will be doing: Responsible for detailed business analysis - Stakeholder engagement via workshop facilitation, meetings, research and interviews to elicit and understand business requirements for major projects and change requests. Gain and apply u


View Job
Senior Data Business Analyst

Cape Town City Centre: Senior Data Engineer

We are looking for a Senior Data Engineer to support and manage BI analytics solutions. In this role, you should have a background in data and business intelligence. You should be analytical; an excellent communicator and a problem-solving aptitude is need


View Job
Senior Data Engineer

Centurion: Senior Data And Vehicle Support Engineer (Telematics) Centurion

Senior Data and Vehicle Support Engineer (Telematics) Centurion Minimum requirements and experience: BEng or MEng (Electronic or Mechatronic Engineering) Minimum of 5 years working experience in telematics systems and -components including data management


View Job
Senior Data And Vehicle Support Engineer (Telematics) Centurion

Pietermaritzburg: Senior Data Analyst – Pietermaritzburg

Responsibilities: Collect data from Collections team to use in establishing organizational structure Interact with Collections team managers to understand their needs from what their agents are doing during the process of collecting money from debtors Pres

View Job  Johannesburg: Senior Recruitment Specialist

View Job
Senior Data Analyst – Pietermaritzburg

Johannesburg: Senior Data Analyst.

Able to acquire data from primary or secondary sources. Develop and implement data analysis, data collection systems and other strategies. Able to identify raw vs transformed data, transactional vs non-transactional etc. Identify, analyse, and interpret tr


View Job
Senior Data Analyst.

Johannesburg: Senior Azure Data Engineer – Johannesburg – R1.2Mil To R1.4Mil Per Annum

An autonomous Namibian bank, providing superior financial services to individual and corporate clients as well as international banking services by liaising directly with financial centres and institutions worldwide is looking for an Azure Data Engineer. T


View Job
Senior Azure Data Engineer – Johannesburg – R1.2Mil To R1.4Mil Per Annum

Pretoria: Senior Manager: Digital And Data

Job Description/Duties: · Formulation of a digital strategy · Manage third-party IT providers and the development of data architecture. · Manage and coordinate the development of bespoke systems, digital channels and other software development. · Ensure so


View Job
Senior Manager

Pretoria: Senior Manager: Digital And Data posted by People Dimension

Job Description/Duties: Formulation of a digital strategy Manage third-party IT providers and the development of data architecture. Manage and coordinate the development of bespoke systems, digital channels and other software development. Ensure solutions


View Job
Senior Manager

Cape Town: Senior Data Modeller posted by PBT Group

PBT Group has an opportunity for Data Modellers to design and maintain optimal data models/structures at both an enterprise and system / application level that meet the business and architectural objectives of the organisation. Duties:Design data models th


View Job
Senior Data Modeller

Cape Town: Senior Data Analyst posted by PBT Group

PBT Group is seeking a Senior Data Analyst with at least 3 years of relevant experience within the insurance or financial services industry. The successful candidate will support and maintain the data warehouse in line with the data model and metadata repo


View Job
Senior Data Analyst

Johannesburg: Intermediate/Senior Aws Data Engineer posted by PBT Group

The role involves working with advanced AWS technologies to design, build, and maintain scalable data pipelines and architectures. The ideal candidate will have strong expertise in SQL, Python/PySpark, and key AWS services including Glue, Step Functions, E


View Job
Intermediate/Senior Aws Data Engineer

Error making API request.

Share this to someone who needs a job:
Posted in Jobs in Centurion, Jobs in Gauteng

More Jobs in Your Area