Job Description
The Data Engineer will be responsible for designing, building, and maintaining the data architecture and infrastructure necessary for effective data processing and analysis. This role involves collaborating with data analysts, and other stakeholders to ensure that data is accessible, reliable, and optimised for use in various applications. The candidate will be required to deliver to all stages of the data engineering process data ingestion, transformation, data modelling and data warehousing, and build self-service data products.
Key responsibilities:
- Work closely with end-users and Data Analysts to understand the business and their data requirements.
- Carry out ad hoc data analysis and transform data using Databricks, MS Fabric, or Synapse Analytics.
- Building meta-data driven data ingestion patterns using Azure Data Factory and Databricks, or MS Fabric, or Synapse
- Build and maintain the on-premises SQL Data Warehouse.
- Build and maintain business focused data products.
- Build and maintain Azure Analysis Services cubes.
- Work with Architecture and Engineering teams to deliver projects and ensure that supporting code and infrastructure follows best practices outlined by these teams.
- Collaborate with Data Engineering Lead, Data Domain Lead and Architect to drive group engineering context within the team continuously.
- Develop and promote exceptional engineering documentation and practices.
- Actively engage with the business units engineering community to promote knowledge sharing.
- Collaborate with squad leader, Head of, engineers, and architects to ensure cohesive strategies and practices within the team.
Requirements
- Proven engineering expertise (7+ years)
- Excellent data analysis and exploration using T-SQL
- Strong SQL programming (stored procedures, functions)
- Extensive experience with SQL Server and SSIS
- Knowledge and experience of data warehouse modelling methodologies, in particular Star Schema and Snowflake Schema
- Experience in Azure one or more of the following: Data Factory, Databricks, MS Fabric, Synapse Analytics, ADLS Gen2.
- Experience in building robust and performant ETL processes.
- Experience in using source control, CI/CD pipelines, and Azure DevOps.
- Build infrastructure-as-code’ deployment pipelines.
- Familiarity with modern engineering practices and data store design, in particular Lakehouse and Medallion architecture.
- Familiarity with the Data as a Product approach
- Excellent analytical and problem-solving skills, with the ability to think critically and strategically.
- Strong communication and interpersonal skills, with the ability to engage and influence stakeholders at all levels.
How to Apply
Click the green “Go Apply” button below to apply directly online with the employer.
About Other IT/Computer Jobs in Gauteng
The IT and computer industry is one of the most dynamic and growing sectors in Gauteng, with a thriving job market that offers a wide range of opportunities for career advancement.
In terms of salary ranges, IT professionals in Gauteng can expect to earn anywhere from R800 000 per annum for junior positions to over R2 million for senior executives. The average salary for software engineers is around R1.5 million, while data analysts can earn between R900 000 and R1.2 million. With experience and skills, IT professionals in Gauteng can expect significant salary increases, with some roles offering bonuses and benefits that can increase their overall remuneration.
To succeed in the IT industry in Gauteng, candidates need to possess a range of key skills, including programming languages such as Java, Python, and C++, as well as experience with databases, cloud computing, and cybersecurity. Strong problem-solving skills, attention to detail, and excellent communication skills are also essential for success in this field. Additionally, knowledge of ITIL (Information Technology Infrastructure Library) and Agile methodologies can be highly valued by employers.
Several major companies and industries in Gauteng are currently hiring IT professionals, including technology firms such as Microsoft, IBM, and Oracle, as well as banks and financial institutions like Standard Bank and Nedbank. The finance industry is also a significant employer of IT staff, with roles ranging from software development to data analytics and cybersecurity.
Career growth opportunities are abundant in the IT industry in Gauteng, with many companies investing heavily in employee training and development programs. With experience and skills, IT professionals can move into senior leadership positions or start their own businesses, while also pursuing further education and certifications. The Johannesburg Stock Exchange (JSE) is also a significant employer of IT staff, with roles ranging from software development to data analytics and cybersecurity.
Overall, the IT industry in Gauteng offers a wide range of exciting career opportunities for job seekers with the right skills and experience. With salaries that are competitive with those offered by major companies globally, there has never been a better time to pursue a career in this dynamic and rapidly evolving field.
This information provides general career guidance. Actual salaries and requirements vary by employer.
GO APPLY NOW
Safe & secure application process
Explore More Opportunities
Get Similar Job Alerts
Job Seeker Tip
Consider temporary or contract work to gain experience and potentially convert to permanent roles.
How to Apply
Click “GO APPLY NOW” to visit the company’s application page.
Follow their instructions carefully.
JVR Jobs connects you with employers – we don’t process applications directly.
Latest Job Opportunities
Kempton Park: Fitter & Turner posted by Wipcorp Project Management
Fitter & Turner Qualified Fitter & Turner Knowledge of Pneumatics, Electrical & Mechanics essential Able to work under pressure &…
View JobMilnerton: Vehicle Sales Executive posted by Stiles Recruit
We are seeking a motivated and results-driven Used Vehicle Sales Executive to join our Automotive Group. The successful candidate will…
View JobPretoria: Financial Controller (FN24) / Finansiële Kontroleerder (FN24) posted by Werkie
(Eng= Financial Controller Our client is seeking a detail-oriented and reliable Financial Controller to join their finance team. This role…
View JobJohannesburg: Security Technician & Installer posted by HR Group
We are seeking an experienced and reliable Security Technician and Installer to join our team. The successful candidate will be…
View JobGauteng: Security Technician & Installer posted by HR Group
We are seeking an experienced and reliable Security Technician and Installer to join our team. The successful candidate will be…
View JobEkurhuleni: Code 14 with PrDP & DGP posted by Dynamic Outsourced Solutions Pty. Ltd
We are looking for 30x Code 14 Drivers with PrDP & Hazchem Minimum of 5 years driving experience of which…
View Job
Browse Employers
Job Alerts