Job Description
About the Role
The Azure Data Engineer will be responsible for designing, building, optimizing, and maintaining data pipelines and data solutions within the Microsoft Azure ecosystem. The role requires strong experience in cloud-based data engineering, modern data architectures, and scalable data processing frameworks.
Key Responsibilities
- Design, develop, and maintain Azure-based data pipelines (batch and streaming).
- Implement ETL/ELT solutions using Azure Data Factory (ADF), Azure Databricks, Synapse Analytics, and related Azure services.
- Build and optimize data models, including Data Lakehouse architectures (Medallion, Delta Lake).
- Ensure data quality, integrity, and governance across all data processes.
- Collaborate with data scientists, analysts, and business teams to provide clean, reliable datasets.
- Perform pipeline monitoring, troubleshooting, performance optimization, and cost optimization.
- Develop CI/CD pipelines using Azure DevOps for data-related deployments.
- Implement security best practices, including RBAC, encryption, and data access governance.
Requirements
- Strong proficiency with Azure Data Factory (ADF), Azure Databricks (PySpark), and Azure Synapse Analytics.
- Expert knowledge of Python, SQL, and data transformation frameworks.
- Experience with Delta Lake, Spark, Data Lake Storage (ADLS), and distributed compute patterns.
- Familiarity with Data Vault, Dimensional Modelling, or Medallion architecture.
- Experience with cloud DevOps tools (Azure DevOps, GitHub Actions).
- Knowledge of streaming technologies (Kafka, Event Hubs) is an advantage.
Qualifications
- Azure certifications such as AZ900 Azure Fundamentals, DP203 Azure Data Engineer Associate, and Databricks Data Engineer certifications (Preferred)
- Bachelor’s degree in Computer Science, Engineering, or related field (Preferred)
Salary & Benefits
No salary information available.
How to Apply
Click the green “Go Apply” button below to apply directly online with the employer.
About Other IT/Computer Jobs in Gauteng
The IT and computer industry is one of the most dynamic and growing sectors in Gauteng, with a thriving job market that offers a wide range of opportunities for career advancement.
In terms of salary ranges, IT professionals in Gauteng can expect to earn anywhere from R800 000 per annum for junior positions to over R2 million for senior executives. The average salary for software engineers is around R1.5 million, while data analysts can earn between R900 000 and R1.2 million. With experience and skills, IT professionals in Gauteng can expect significant salary increases, with some roles offering bonuses and benefits that can increase their overall remuneration.
To succeed in the IT industry in Gauteng, candidates need to possess a range of key skills, including programming languages such as Java, Python, and C++, as well as experience with databases, cloud computing, and cybersecurity. Strong problem-solving skills, attention to detail, and excellent communication skills are also essential for success in this field. Additionally, knowledge of ITIL (Information Technology Infrastructure Library) and Agile methodologies can be highly valued by employers.
Several major companies and industries in Gauteng are currently hiring IT professionals, including technology firms such as Microsoft, IBM, and Oracle, as well as banks and financial institutions like Standard Bank and Nedbank. The finance industry is also a significant employer of IT staff, with roles ranging from software development to data analytics and cybersecurity.
Career growth opportunities are abundant in the IT industry in Gauteng, with many companies investing heavily in employee training and development programs. With experience and skills, IT professionals can move into senior leadership positions or start their own businesses, while also pursuing further education and certifications. The Johannesburg Stock Exchange (JSE) is also a significant employer of IT staff, with roles ranging from software development to data analytics and cybersecurity.
Overall, the IT industry in Gauteng offers a wide range of exciting career opportunities for job seekers with the right skills and experience. With salaries that are competitive with those offered by major companies globally, there has never been a better time to pursue a career in this dynamic and rapidly evolving field.
This information provides general career guidance. Actual salaries and requirements vary by employer.
GO APPLY NOW
Safe & secure application process
Explore More Opportunities
Get Similar Job Alerts
Job Seeker Tip
Create a professional email address for job hunting - avoid nicknames or casual addresses.
How to Apply
Click “GO APPLY NOW” to visit the company’s application page.
Follow their instructions carefully.
JVR Jobs connects you with employers – we don’t process applications directly.
Latest Job Opportunities
Gauteng: Project Manager posted by Network Finance
Our client is a large, established organisation seeking a Project Manager (PMO) to oversee and coordinate multiple projects within a…
View JobWestern Cape: Junior Graphic Designer posted by Craven Cottage CC
Duties: Assist in the creation of digital and print design materials (social media graphics, brochures, flyers, presentations, banners, etc.)Support senior...
View JobGauteng: Solutions Specialist – Gauteng posted by Bidvest Protea Coin
Research & Development (R&D)Drive innovation by identifying, testing, and integrating new security and technology solutions that enhance service delivery...
View JobSouth Africa: Airfreight Manager posted by MECS Africa
Main goalManage airfreight operations for Port Moresby branch as well as customer relationships in compliance with PNG legal requirements, Company…
View JobGauteng: Health, Safety & Environmental Officer posted by Phakisa Holdings
Purpose of the RoleTo ensure compliance with health, safety, and environmental legislation, standards, and company policies within the gold processing...
View JobPretoria North: Workshop Foreman posted by GAP Consulting
Minimum Requirements:Must have a minimum of 3-5 years’ experience as a Workshop Foreman or Senior Mechanic in the Transport &…
View Job
Browse Employers
Job Alerts