Job Description
We are looking for a skilled Data Engineer with strong Python and Databricks experience to design, build, and maintain scalable data pipelines and platforms that enable analytics, reporting, and advanced data use cases. You will work closely with Data Scientists, BI Developers, and business stakeholders to deliver high-quality, production-ready data solutions across cloud-based environments.
This role requires strong engineering fundamentals, hands-on Databricks development, and experience working with large, complex datasets.
What youll do:
- Design, develop, and maintain scalable data pipelines using Python and Databricks
- Build robust ETL/ELT processes to ingest structured and unstructured data
- Develop and optimize Spark jobs for performance and reliability
- Implement data models to support analytics and downstream consumption
- Integrate multiple data sources (APIs, databases, files, streaming sources)
- Ensure data quality, validation, and governance standards are met
- Collaborate with Data Scientists and BI teams to operationalize analytics solutions
- Implement monitoring, logging, and error-handling mechanisms
- Support production deployments and troubleshoot pipeline issues
- Participate in code reviews and contribute to engineering best practices
- Document solutions and processes clearly
Your Expertise:
- Experience with Azure Databricks or AWS Databricks
- Knowledge of data orchestration tools (Airflow, ADF, etc.)
- Experience with streaming technologies (Kafka, Event Hubs, etc.)
- Exposure to data governance and security frameworks
- Experience supporting machine learning pipelines
- Understanding of DevOps practices
Qualification:
- 5+ years experience as a Data Engineer or similar role
- Strong proficiency in Python for data engineering
- Hands-on experience with Databricks (notebooks, jobs, workflows)
- Solid understanding of Apache Spark concepts
- Experience building ETL/ELT pipelines
- Strong SQL skills
- Experience working in cloud environments (AWS / Azure / GCP)
- Familiarity with Delta Lake or similar lakehouse architectures
- Version control (Git) and CI/CD exposure
- Strong problem-solving and analytical skills
How to Apply
Click the green “Go Apply” button below to apply directly online with the employer.
About Other IT/Computer Jobs in Western Cape
The Western Cape, situated on the south coast of South Africa, is home to a thriving IT industry that offers a diverse range of career opportunities for professionals with expertise in various fields.
The job market in the Western Cape is highly competitive, with many major companies and startups operating in the region. The province’s strategic location, combined with its well-developed infrastructure, makes it an attractive hub for businesses looking to establish themselves in Africa. As a result, there is a high demand for skilled IT professionals who can support the growth of these companies.
The average salary ranges for IT professionals in the Western Cape are as follows: software engineers and developers can expect to earn between R800 000 to R1 200 000 per annum; data scientists and analysts can range from R600 000 to R900 000; cybersecurity specialists can earn anywhere from R500 000 to R800 000; and IT project managers can command salaries ranging from R400 000 to R700 000. These figures are based on industry standards and may vary depending on factors such as experience, qualifications, and company size.
To succeed in an IT career in the Western Cape, professionals need to possess a range of key skills, including programming languages (Java, Python, C++), data structures and algorithms, software development methodologies, cloud computing (AWS, Azure, Google Cloud), cybersecurity principles, and excellent communication skills. Additionally, knowledge of industry-specific tools and technologies, such as SAP or Oracle, can be highly valued.
Several major companies and industries are actively hiring IT professionals in the Western Cape. For example, tech giants like IBM and Dell have a strong presence in the region, while financial institutions such as Standard Bank and First National Bank also have significant IT departments. The automotive industry is another major sector that employs IT professionals, with companies like Toyota and Volkswagen having operations in the province.
Career growth opportunities are plentiful for IT professionals in the Western Cape, with many companies offering training and development programs to help employees upskill and reskill. With experience, professionals can move into senior roles such as technical lead or manager, or transition into related fields like business analysis or consulting. The region’s entrepreneurial spirit also makes it an ideal location for startups, providing opportunities for IT professionals to launch their own businesses or join innovative companies that are shaping the future of technology.
This information provides general career guidance. Actual salaries and requirements vary by employer.
GO APPLY NOW
Safe & secure application process
Explore More Opportunities
Get Similar Job Alerts
Job Seeker Tip
Network actively - many jobs are filled through referrals before being advertised.
How to Apply
Click “GO APPLY NOW” to visit the company’s application page.
Follow their instructions carefully.
JVR Jobs connects you with employers – we don’t process applications directly.
Latest Job Opportunities
Kempton Park: Fitter & Turner posted by Wipcorp Project Management
Fitter & Turner Qualified Fitter & Turner Knowledge of Pneumatics, Electrical & Mechanics essential Able to work under pressure &…
View JobWestern Cape: Senior Logistics & Operations Manager posted by Tumaini Consulting
One of our prominent clients in the food manufacturing industry is looking to appoint a Senior Logistics & Operations Manager…
View JobWestern Cape: Supply Chain Buyer posted by Tumaini Consulting
An exciting opportunity has opened with one of our leading clients in the food industry, who is looking to appoint…
View JobFree State: Construction Foreman – Civils posted by Tumaini Consulting
Be part of large-scale renewable and civil projects that are transforming communities and powering South Africas energy future Our client,…
View JobFree State: Site Agent – Construction Supervisors (Energy) posted by Tumaini Consulting
Seasoned Site Agent? Ready to take charge of high-impact renewable energy and large-scale civil projects? Keeping reading ! Our client…
View JobFree State: Civil Construction Manager posted by Tumaini Consulting
Take the lead on landmark Renewable Energy projects across South Africa Our client is a contractor with offices in 6…
View Job
Browse Employers
Job Alerts