Job Description
The Data Engineer will be responsible for designing, building, and maintaining the data architecture and infrastructure necessary for effective data processing and analysis. This role involves collaborating with data analysts, and other stakeholders to ensure that data is accessible, reliable, and optimised for use in various applications. The candidate will be required to deliver to all stages of the data engineering process data ingestion, transformation, data modelling and data warehousing, and build self-service data products.
Key responsibilities:
- Work closely with end-users and Data Analysts to understand the business and their data requirements.
- Carry out ad hoc data analysis and transform data using Databricks, MS Fabric, or Synapse Analytics.
- Building meta-data driven data ingestion patterns using Azure Data Factory and Databricks, or MS Fabric, or Synapse
- Build and maintain the on-premises SQL Data Warehouse.
- Build and maintain business focused data products.
- Build and maintain Azure Analysis Services cubes.
- Work with Architecture and Engineering teams to deliver projects and ensure that supporting code and infrastructure follows best practices outlined by these teams.
- Collaborate with Data Engineering Lead, Data Domain Lead and Architect to drive group engineering context within the team continuously.
- Develop and promote exceptional engineering documentation and practices.
- Actively engage with the business units engineering community to promote knowledge sharing.
- Collaborate with squad leader, Head of, engineers, and architects to ensure cohesive strategies and practices within the team.
Requirements
- Proven engineering expertise (7+ years)
- Excellent data analysis and exploration using T-SQL
- Strong SQL programming (stored procedures, functions)
- Extensive experience with SQL Server and SSIS
- Knowledge and experience of data warehouse modelling methodologies, in particular Star Schema and Snowflake Schema
- Experience in Azure one or more of the following: Data Factory, Databricks, MS Fabric, Synapse Analytics, ADLS Gen2.
- Experience in building robust and performant ETL processes.
- Experience in using source control, CI/CD pipelines, and Azure DevOps.
- Build infrastructure-as-code’ deployment pipelines.
- Familiarity with modern engineering practices and data store design, in particular Lakehouse and Medallion architecture.
- Familiarity with the Data as a Product approach
- Excellent analytical and problem-solving skills, with the ability to think critically and strategically.
- Strong communication and interpersonal skills, with the ability to engage and influence stakeholders at all levels.
How to Apply
Click the green “Go Apply” button below to apply directly online with the employer.
About Other IT/Computer Jobs in Gauteng
The IT and computer industry is one of the most dynamic and growing sectors in Gauteng, with a thriving job market that offers a wide range of opportunities for career advancement.
In terms of salary ranges, IT professionals in Gauteng can expect to earn anywhere from R800 000 per annum for junior positions to over R2 million for senior executives. The average salary for software engineers is around R1.5 million, while data analysts can earn between R900 000 and R1.2 million. With experience and skills, IT professionals in Gauteng can expect significant salary increases, with some roles offering bonuses and benefits that can increase their overall remuneration.
To succeed in the IT industry in Gauteng, candidates need to possess a range of key skills, including programming languages such as Java, Python, and C++, as well as experience with databases, cloud computing, and cybersecurity. Strong problem-solving skills, attention to detail, and excellent communication skills are also essential for success in this field. Additionally, knowledge of ITIL (Information Technology Infrastructure Library) and Agile methodologies can be highly valued by employers.
Several major companies and industries in Gauteng are currently hiring IT professionals, including technology firms such as Microsoft, IBM, and Oracle, as well as banks and financial institutions like Standard Bank and Nedbank. The finance industry is also a significant employer of IT staff, with roles ranging from software development to data analytics and cybersecurity.
Career growth opportunities are abundant in the IT industry in Gauteng, with many companies investing heavily in employee training and development programs. With experience and skills, IT professionals can move into senior leadership positions or start their own businesses, while also pursuing further education and certifications. The Johannesburg Stock Exchange (JSE) is also a significant employer of IT staff, with roles ranging from software development to data analytics and cybersecurity.
Overall, the IT industry in Gauteng offers a wide range of exciting career opportunities for job seekers with the right skills and experience. With salaries that are competitive with those offered by major companies globally, there has never been a better time to pursue a career in this dynamic and rapidly evolving field.
This information provides general career guidance. Actual salaries and requirements vary by employer.
GO APPLY NOW
Safe & secure application process
Explore More Opportunities
Get Similar Job Alerts
Job Seeker Tip
Dress professionally for interviews, even if the company has a casual dress code.
How to Apply
Click “GO APPLY NOW” to visit the company’s application page.
Follow their instructions carefully.
JVR Jobs connects you with employers – we don’t process applications directly.
Latest Job Opportunities
Kempton Park: Fitter & Turner posted by Wipcorp Project Management
Fitter & Turner Qualified Fitter & Turner Knowledge of Pneumatics, Electrical & Mechanics essential Able to work under pressure &…
View JobGauteng: External Sales Representative posted by Tumaini Consulting
Are you a technically skilled sales representative with a passion for plastics and customer service? A well-established plastic manufacturing company…
View JobCape Town Region: Production Planner posted by Goldman Tech Resourcing
One of the leading food manufacturing companies in Cape Town is currently looking for a skilled Production Planner with strong…
View JobMpumalanga: 24Hr Flexi Sales Associate – Mbombela Showroom (Maternity Cover) posted by homechoice
homechoice is a leading South African homeware retailer. For 40 years weve helped our customers create beautiful homes they love…
View JobJohannesburg: Pharmacist – Rosebank – Johannesburg posted by Dis-Chem Pharmacies
Dis-Chem Pharmacies require the services of a reputable Pharmacist for their Rosebank store. Your portfolio will cover the provision of…
View JobGauteng: Post Basic Qualified Pharmacist Assistant – Farramere – Benoni posted by Dis-Chem Pharmacies
Dis-Chem Pharmacies require the services of a reputable Post Basic Qualify Pharmacist Assistant for their Farramere store. Your portfolio will…
View Job
Browse Employers
Job Alerts