Job Description
We are looking for a skilled Data Engineer with strong Python and Databricks experience to design, build, and maintain scalable data pipelines and platforms that enable analytics, reporting, and advanced data use cases. You will work closely with Data Scientists, BI Developers, and business stakeholders to deliver high-quality, production-ready data solutions across cloud-based environments.
This role requires strong engineering fundamentals, hands-on Databricks development, and experience working with large, complex datasets.
What youll do:
- Design, develop, and maintain scalable data pipelines using Python and Databricks
- Build robust ETL/ELT processes to ingest structured and unstructured data
- Develop and optimize Spark jobs for performance and reliability
- Implement data models to support analytics and downstream consumption
- Integrate multiple data sources (APIs, databases, files, streaming sources)
- Ensure data quality, validation, and governance standards are met
- Collaborate with Data Scientists and BI teams to operationalize analytics solutions
- Implement monitoring, logging, and error-handling mechanisms
- Support production deployments and troubleshoot pipeline issues
- Participate in code reviews and contribute to engineering best practices
- Document solutions and processes clearly
Your Expertise:
- Experience with Azure Databricks or AWS Databricks
- Knowledge of data orchestration tools (Airflow, ADF, etc.)
- Experience with streaming technologies (Kafka, Event Hubs, etc.)
- Exposure to data governance and security frameworks
- Experience supporting machine learning pipelines
- Understanding of DevOps practices
Qualification:
- 5+ years experience as a Data Engineer or similar role
- Strong proficiency in Python for data engineering
- Hands-on experience with Databricks (notebooks, jobs, workflows)
- Solid understanding of Apache Spark concepts
- Experience building ETL/ELT pipelines
- Strong SQL skills
- Experience working in cloud environments (AWS / Azure / GCP)
- Familiarity with Delta Lake or similar lakehouse architectures
- Version control (Git) and CI/CD exposure
- Strong problem-solving and analytical skills
How to Apply
Click the green “Go Apply” button below to apply directly online with the employer.
About Other IT/Computer Jobs in Western Cape
The Western Cape, situated on the south coast of South Africa, is home to a thriving IT industry that offers a diverse range of career opportunities for professionals with expertise in various fields.
The job market in the Western Cape is highly competitive, with many major companies and startups operating in the region. The province’s strategic location, combined with its well-developed infrastructure, makes it an attractive hub for businesses looking to establish themselves in Africa. As a result, there is a high demand for skilled IT professionals who can support the growth of these companies.
The average salary ranges for IT professionals in the Western Cape are as follows: software engineers and developers can expect to earn between R800 000 to R1 200 000 per annum; data scientists and analysts can range from R600 000 to R900 000; cybersecurity specialists can earn anywhere from R500 000 to R800 000; and IT project managers can command salaries ranging from R400 000 to R700 000. These figures are based on industry standards and may vary depending on factors such as experience, qualifications, and company size.
To succeed in an IT career in the Western Cape, professionals need to possess a range of key skills, including programming languages (Java, Python, C++), data structures and algorithms, software development methodologies, cloud computing (AWS, Azure, Google Cloud), cybersecurity principles, and excellent communication skills. Additionally, knowledge of industry-specific tools and technologies, such as SAP or Oracle, can be highly valued.
Several major companies and industries are actively hiring IT professionals in the Western Cape. For example, tech giants like IBM and Dell have a strong presence in the region, while financial institutions such as Standard Bank and First National Bank also have significant IT departments. The automotive industry is another major sector that employs IT professionals, with companies like Toyota and Volkswagen having operations in the province.
Career growth opportunities are plentiful for IT professionals in the Western Cape, with many companies offering training and development programs to help employees upskill and reskill. With experience, professionals can move into senior roles such as technical lead or manager, or transition into related fields like business analysis or consulting. The region’s entrepreneurial spirit also makes it an ideal location for startups, providing opportunities for IT professionals to launch their own businesses or join innovative companies that are shaping the future of technology.
This information provides general career guidance. Actual salaries and requirements vary by employer.
GO APPLY NOW
Safe & secure application process
Explore More Opportunities
Get Similar Job Alerts
Job Seeker Tip
Quantify your achievements on your CV using numbers and percentages where possible.
How to Apply
Click “GO APPLY NOW” to visit the company’s application page.
Follow their instructions carefully.
JVR Jobs connects you with employers – we don’t process applications directly.
Latest Job Opportunities
Kempton Park: Fitter & Turner posted by Wipcorp Project Management
Qualified Fitter & Turner. Knowledge of Pneumatics, Electrical & Mechanics essential. Able to work under pressure & within a team.…
View JobWestern Cape: Creditors Clerk – B&T – Shared Services posted by The Building Company
Introduction: The Main purpose of the job is to reconcile creditors accounts and ensure accurate and timeous payments of suppliers…
View JobCape Town Region: Senior Refrigeration Technician posted by DB Recruitment
Our client, a well-established company within the refrigeration and cooling industry, is seeking an experienced Senior Refrigeration Technician to join...
View JobGauteng: Fast Food Area Manager posted by Net. Talent
Responsibilities Managing a portfolio of restaurants Driving sustainability, sales, and profitability of sites Assist with the development and...
View JobCenturion: Fast Food Manager posted by Net. Talent
Fast Food Manager required in Centurion Responsibilities To manage a restaurant in accordance with Restaurants Policies and Procedures. To maximize...
View JobSandton: Fast Food Manager posted by Net. Talent
Fast Food Manager required in Centurion Responsibilities To manage a restaurant in accordance with Restaurants Policies and Procedures. To maximize...
View Job
Browse Employers
Job Alerts