Menu Close

Pretoria: Senior Data Engineer – Software posted by Hire Resolve

Date 2024-10-23
Job Title Senior Data Engineer – Software
Employer Hire Resolve
More Information
Salary 0
Category It Computer
Location Gauteng
/ Pretoria

Job Summary

Hire Resolve`s Client is on the hunt for an experienced Senior Data Engineer to enhance their team. This role will focus on designing and implementing data pipelines and architectures, ensuring data is accessible, reliable, and secure. The ideal candidate will work closely with cross-functional teams to support data analytics and business intelligence efforts, playing a key role in driving data-driven decisions across the organization.

Responsibilities:

  • Identify valuable data sources and automate data collection processes.
  • Perform preprocessing on both structured and unstructured data.
  • Analyze large datasets to discover trends and patterns.
  • Expertise in Data Modeling (Relational and Star Schema).
  • Skilled in database design, development, and administration.
  • Experience in Data Warehouse design, build, and development.
  • Proficiency in database performance tuning and optimization.
  • Present data insights through data visualization techniques.
  • Propose solutions and strategies to address business challenges.
  • Collaborate with engineering and product development teams.
  • Hands-on experience with Hadoop/Spark-based distributed storage and computing frameworks.
  • Proficiency in real-time analytics and batch processing.
  • Strong background in architecting analytical applications in cloud environments such as Amazon Web Services (AWS) and Microsoft Azure.

Competencies:

  • Critical Thinking: Skilled in using logic and reasoning to evaluate strengths, weaknesses, and approaches to solutions.
  • Active Learning: Able to understand the impact of new information for current and future decision-making.
  • Systems Analysis: Capable of determining how a system should function and assessing the effects of changes in conditions or operations.
  • Complex Problem Solving: Ability to identify and address complex problems by developing and evaluating potential solutions.
  • Deductive Reasoning: Proficient in applying general rules to specific problems for logical solutions.
  • Inductive Reasoning: Skilled in combining information to identify relationships and form conclusions.
  • Excellent Communication: Ability to engage with C-level stakeholders and convey a deep understanding of business and technology.
  • Technical Literacy: Possesses a high level of technical proficiency to assess how software fits within an organizations structure.
  • Analytical Assessment: Strong analytical skills for evaluating current systems and determining project needs and scope.
  • Schedule Management: Extensive time management skills to set development schedules, milestones, and ensure timely delivery.
  • Team Leadership: Experience in leading and motivating development teams throughout the project lifecycle.
  • Strategic Execution: Ability to translate strategy into measurable and executable projects.
  • Project Experience: Experience working on large-scale projects with established processes, procedures, and standards.

Requirements:

  • 8-10 years of experience as a Data Engineer or Database Developer.
  • Tertiary qualification in a related field (e.g., BSc in Computer Science, B.IT, or Informatics).
  • DP-203: Data Engineering on Microsoft Azure Certification.
  • Expertise in data mining, large-scale data modeling, and business requirements gathering/analysis.
  • Strong understanding and hands-on experience with data integration and transformation.
  • Proficient in implementing data modeling methodologies such as Dimensional Modeling and/or Data Vault.
  • Knowledge of data quality processes and master data management.
  • Experience in building design support systems using Database Management Systems (DBMS) like SQL Server or Oracle.
  • Skilled in designing and implementing data integration and ETL solutions using SSIS, Azure Data Factory, and/or SQL Server stored procedures.
  • Familiarity with Big Data technologies such as Hadoop, MapReduce, Spark, and message/event processing services like Kafka, Event Hub, and Stream Analytics.
  • Proficient in database query languages including T-SQL, ANSI SQL, and PL/SQL.
  • Some experience in software development using languages like Visual Basic, C++, C#, Java, or Python.
  • Experience with SQL Server Management Studio and Visual Studio.
  • Knowledge of implementing solutions using Azure SQL databases, Azure Synapse, Azure Storage Accounts (Data Lake), and/or Databricks.
  • Strong analytical skills and business acumen.
  • Additional skills in Tableau, Power BI, advanced math (e.g., statistics, algebra), Scala, Python, or R are advantageous.
View Job  Springs: Application Development Manager - Jhb posted by Hire Resolve

Benefits:

Contact Hire Resolve for you next career-changing move

Apply directly on jobmail for this position
Some posts have contact information included with other instructions. All applicants are urged to read the instructions carefully.
We will list jobs at the bottom of each job, so feel free to scroll down and continue your search.

We do not accept any job applications and merely offer the service of daily jobs being mined and displayed on our job portal.
Each job post has a link to take you directly to the original post to apply on their website or the original website where the post came from.


Here are some more related positions


City Bowl: Senior Data Analyst/Scientist posted by Lebo Business Consulting (Pty) Ltd

Manage performance of data analyst/operator team; Play a leading role in the designing and documenting of operating procedures; Conduct, monitor and calibrate astronomical observations and use appropriate computing resources towards successful operation of


View Job
Senior Data Analyst/Scientist

Pretoria: Senior Manager: Digital And Data

Job Description/Duties: · Formulation of a digital strategy · Manage third-party IT providers and the development of data architecture. · Manage and coordinate the development of bespoke systems, digital channels and other software development. · Ensure so


View Job
Senior Manager

South Africa: Senior Data Scientist – Cape Town – 6-Month Contract – R70k To R130k Per Month

Join a company filled with like-minded individuals who deliver quality solution delivery services and prioritize flexibility in work arrangements, embracing both remote and hybrid models to cater to our staff``s preferences as a Senior Data Scientist you w


View Job
Senior Data Scientist – Cape Town – 6-Month Contract – R70k To R130k Per Month

South Africa: Senior Data Engineer – Remote – R800k To R1 Mil Per Annum

Join a market leader in compliant call recording solutions and beyond capturing every interaction, with analytics platform extracts, processes and delivers insights from millions of data points across diverse communication channels the analytics team is lo


View Job
Senior Data Engineer – Remote – R800k To R1 Mil Per Annum

Cape Town City Centre: Senior Data Engineer

Responsibilities: Design and implement scalable data pipelines using Apache Spark, Scala, and Java Develop and maintain data architectures for batch and real-time processing Collaborate with cross-functional teams to identify and prioritize project require


View Job
Senior Data Engineer

Centurion: Senior Database Administrator

Key Responsibilities : Requirements Gathering : Collaborate with business stakeholders to collect, document, and review database requirements. Database Design & Development : Architect, develop, and implement scalable, reliable databases that meet business


View Job
Senior Database Administrator

Cape Town City Centre: Senior Data And Vehicle Support Engineer (Telematics) Cape Town

Senior Data and Vehicle Support Engineer (Telematics) Cape Town Minimum requirements and experience: BEng or MEng (Electronic or Mechatronic Engineering) Minimum of 5 years working experience in telematics systems and -components including data management


View Job
Senior Data And Vehicle Support Engineer (Telematics) Cape Town

Centurion: Senior Data And Vehicle Support Engineer (Telematics) Centurion

Senior Data and Vehicle Support Engineer (Telematics) Centurion Minimum requirements and experience: BEng or MEng (Electronic or Mechatronic Engineering) Minimum of 5 years working experience in telematics systems and -components including data management


View Job
Senior Data And Vehicle Support Engineer (Telematics) Centurion

Johannesburg: Senior Data Scientist – Johannesburg – Renewable Contract– Up To R100k Per Month

Join a company filled with like-minded individuals who deliver quality solution delivery services and prioritize flexibility in work arrangements, embracing both remote and hybrid models to cater to our staff``s preferences as a Senior Data Scientist you w


View Job
Senior Data Scientist – Johannesburg – Renewable Contract– Up To R100k Per Month

Johannesburg: Senior Sql Data Engineer

As a Specialist Recruitment Consultant within the IT industry, my clients and I are constantly on the lookout for accomplished Senior SQL Data Engineer with strong academics, robust project experience and technical knowledge. Requirements: Completed qualif


View Job
Senior Sql Data Engineer

Johannesburg: Senior Data Scientist

Qualifications and Experience required 5-8 years of experience as a Data Scientist with expertise in machine learning and AI technologies. Proficient in Python and experience with deep learning frameworks such as TensorFlow. Hands-on experience with machin


View Job
Senior Data Scientist

South Africa: Senior Data Scientist – Cape Town – R1.2Mil To R1.4Mil Per Annum

A dynamic, industrial holding company dedicated to investing in, growing and starting businesses a global footprint in diverse industries including manufacturing, distribution, technology, big data, engineering and energy efficiency seek a Senior Data Scie


View Job
Senior Data Scientist – Cape Town – R1.2Mil To R1.4Mil Per Annum

Cape Town City Centre: Senior Data Scientist / Ai Developer (Ch1051) – Fully Remote

Our client is a leading software services and consulting company focusing on delivering innovative solutions with a strategic emphasis on generative AI. They are looking for an experienced Senior Data Scientist / AI Developer / Data Engineer to join their


View Job
Senior Data Scientist / Ai Developer (Ch1051) – Fully Remote

Johannesburg: Senior Data Analyst

Requirements: Understanding and application of Big Data Design and assist in the optimization of Data Warehouse/Data Lake and Reporting Development, testing and administration of BI models(tabular, SSIS, SSAS & Visual Studio) Proficiency in data manipulati


View Job
Senior Data Analyst

Cape Town City Centre: Senior Data Engineer : Ingestions Squad (Group Data & Ml Platform Tribe)

Our Client Company Group Technology is responsible for the provision of a digitally enabled technology service as a group COE, drive business and transformation and provide group-wide digital and data architecture. We operate the various technology platfor


View Job
Senior Data Engineer

Johannesburg: Senior Data Analyst

We are seeking a highly skilled Data Management Specialist to join our dynamic team. The successful candidate will play a critical role in linking external data to master data, ensuring the accuracy of inbound data through analysis and troubleshooting. You


View Job
Senior Data Analyst

Johannesburg: Senior Data Scientist

Duties: Optimisation and programming as a skill set on all platforms Understanding all the latest AI and ML Action planner Experience handling high level projects Has developed software from the beginning Job Experience & Skills Required: 5 years experienc


View Job
Senior Data Scientist

Johannesburg: Senior Data Engineer posted by Deka Minas (Pty) Ltd

We are excited to introduce an exceptional opportunity for a Senior Data Engineer! In this pivotal role, you will spearhead the development and optimization of our data engineering solutions, focusing on modernizing our data warehousing and processing stra


View Job
Senior Data Engineer

Pretoria: Senior Manager: Digital And Data posted by People Dimension

Job Description/Duties: Formulation of a digital strategy Manage third-party IT providers and the development of data architecture. Manage and coordinate the development of bespoke systems, digital channels and other software development. Ensure solutions


View Job
Senior Manager

Cape Town: Senior Data Analyst posted by PBT Group

PBT Group is seeking a Senior Data Analyst with at least 3 years of relevant experience within the insurance or financial services industry. The successful candidate will support and maintain the data warehouse in line with the data model and metadata repo


View Job
Senior Data Analyst

Stellenbosch: Senior Decision (Data) Scientist (Ch1033) posted by Capital H Staffing and Advisory Solutions

Our client in the banking industry is looking for experienced Senior Decision Scientists.The purpose of the role is delivering business solutions via a collaborative approach involving mathematical formulae, business tactics, technological applications, an


View Job
Senior Decision (Data) Scientist (Ch1033)

Centurion: Senior Data Engineer posted by CF & I Consulting

The Data Engineer will have a knack for data analysis, data manipulation and data modelling and will be responsible for understanding and driving the overall technical vision and planning of a client`s organisation and translating business needs into techn


View Job
Senior Data Engineer

Cape Town: Senior Data Scientist posted by PBT Group

PBT Group is seeking a Senior Data Scientist to spearhead the development of retail Analytical Data Assets (ADA) and associated strategies for key `Use Cases` using data analysis, predictive modeling, simulation, and optimization techniques to identify tre


View Job
Senior Data Scientist

East London: Senior Data Specialist (Permanent) posted by Profile Personnel

Main purpose of the jobOwnership of Outsourced Credit Controls data and processes including, but not limited to, development, implementation and maintenance of operational and reporting processes. Engaging with business to ensure understanding and complian


View Job
Senior Data Specialist (Permanent)

Johannesburg: Senior Data Analyst posted by Isilumko Staffing

Job description:The key accountabilities for the data analyst includes but is not limited to:Data collection and cleansing.Data Analysis.Reporting and visualisation.Data modelling and forecasting.Data interpretation and insights.Data quality and governance


View Job
Senior Data Analyst

Error making API request.

Share this to someone who needs a job:
Posted in Jobs in Gauteng, Jobs in Pretoria

More Jobs in Your Area