Menu Close

Cape Town: Data Engineer (Databricks) posted by iOCO Digital Pty Lty

Advertisement



Job Description

We are looking for a skilled Data Engineer with strong Python and Databricks experience to design, build, and maintain scalable data pipelines and platforms that enable analytics, reporting, and advanced data use cases. You will work closely with Data Scientists, BI Developers, and business stakeholders to deliver high-quality, production-ready data solutions across cloud-based environments.

This role requires strong engineering fundamentals, hands-on Databricks development, and experience working with large, complex datasets.

What youll do:

  • Design, develop, and maintain scalable data pipelines using Python and Databricks
  • Build robust ETL/ELT processes to ingest structured and unstructured data
  • Develop and optimize Spark jobs for performance and reliability
  • Implement data models to support analytics and downstream consumption
  • Integrate multiple data sources (APIs, databases, files, streaming sources)
  • Ensure data quality, validation, and governance standards are met
  • Collaborate with Data Scientists and BI teams to operationalize analytics solutions
  • Implement monitoring, logging, and error-handling mechanisms
  • Support production deployments and troubleshoot pipeline issues
  • Participate in code reviews and contribute to engineering best practices
  • Document solutions and processes clearly

Your Expertise:

  • Experience with Azure Databricks or AWS Databricks
  • Knowledge of data orchestration tools (Airflow, ADF, etc.)
  • Experience with streaming technologies (Kafka, Event Hubs, etc.)
  • Exposure to data governance and security frameworks
  • Experience supporting machine learning pipelines
  • Understanding of DevOps practices

Qualification:

  • 5+ years experience as a Data Engineer or similar role
  • Strong proficiency in Python for data engineering
  • Hands-on experience with Databricks (notebooks, jobs, workflows)
  • Solid understanding of Apache Spark concepts
  • Experience building ETL/ELT pipelines
  • Strong SQL skills
  • Experience working in cloud environments (AWS / Azure / GCP)
  • Familiarity with Delta Lake or similar lakehouse architectures
  • Version control (Git) and CI/CD exposure
  • Strong problem-solving and analytical skills
View Job  Pretoria: Back-End Developer posted by Sabenza IT & Recruitment

How to Apply

Click the green “Go Apply” button below to apply directly online with the employer.

About Other IT/Computer Jobs in Western Cape

The Western Cape, situated on the south coast of South Africa, is home to a thriving IT industry that offers a diverse range of career opportunities for professionals with expertise in various fields.

The job market in the Western Cape is highly competitive, with many major companies and startups operating in the region. The province’s strategic location, combined with its well-developed infrastructure, makes it an attractive hub for businesses looking to establish themselves in Africa. As a result, there is a high demand for skilled IT professionals who can support the growth of these companies.

The average salary ranges for IT professionals in the Western Cape are as follows: software engineers and developers can expect to earn between R800 000 to R1 200 000 per annum; data scientists and analysts can range from R600 000 to R900 000; cybersecurity specialists can earn anywhere from R500 000 to R800 000; and IT project managers can command salaries ranging from R400 000 to R700 000. These figures are based on industry standards and may vary depending on factors such as experience, qualifications, and company size.

To succeed in an IT career in the Western Cape, professionals need to possess a range of key skills, including programming languages (Java, Python, C++), data structures and algorithms, software development methodologies, cloud computing (AWS, Azure, Google Cloud), cybersecurity principles, and excellent communication skills. Additionally, knowledge of industry-specific tools and technologies, such as SAP or Oracle, can be highly valued.

Several major companies and industries are actively hiring IT professionals in the Western Cape. For example, tech giants like IBM and Dell have a strong presence in the region, while financial institutions such as Standard Bank and First National Bank also have significant IT departments. The automotive industry is another major sector that employs IT professionals, with companies like Toyota and Volkswagen having operations in the province.

View Job  South Africa: Executive Sous posted by HotelJobs

Career growth opportunities are plentiful for IT professionals in the Western Cape, with many companies offering training and development programs to help employees upskill and reskill. With experience, professionals can move into senior roles such as technical lead or manager, or transition into related fields like business analysis or consulting. The region’s entrepreneurial spirit also makes it an ideal location for startups, providing opportunities for IT professionals to launch their own businesses or join innovative companies that are shaping the future of technology.


This information provides general career guidance. Actual salaries and requirements vary by employer.



GO APPLY NOW

Safe & secure application process

Advertisement



Advertisement




Get Similar Job Alerts
Enter your WhatsApp number (e.g., +27740908132)
You'll receive alerts for new jobs in Cape Town, Western Cape


Job Seeker Tip

Network actively - many jobs are filled through referrals before being advertised.

How to Apply

Click “GO APPLY NOW” to visit the company’s application page.
Follow their instructions carefully.

View Job  South Africa: Lodge Manager | Luxury Lodge | Kruger National Park | Ss posted by HotelJobs

JVR Jobs connects you with employers – we don’t process applications directly.

Latest Job Opportunities

Kempton Park: Fitter & Turner posted by Wipcorp Project Management

Jobs in Germiston February 9, 2026
Gauteng Jobs in Germiston Kempton Park Wipcorp Project Management

Fitter & Turner Qualified Fitter & Turner Knowledge of Pneumatics, Electrical & Mechanics essential Able to work under pressure &…

View Job

Western Cape: Senior Logistics & Operations Manager posted by Tumaini Consulting

Jobs in South Africa February 9, 2026
logistics Transport Tumaini Consulting warehouse

One of our prominent clients in the food manufacturing industry is looking to appoint a Senior Logistics & Operations Manager…

View Job

Western Cape: Supply Chain Buyer posted by Tumaini Consulting

Jobs in South Africa February 9, 2026
logistics Transport Tumaini Consulting warehouse

An exciting opportunity has opened with one of our leading clients in the food industry, who is looking to appoint…

View Job

Free State: Construction Foreman – Civils posted by Tumaini Consulting

Jobs in Free State February 9, 2026
Engineering Tumaini Consulting

Be part of large-scale renewable and civil projects that are transforming communities and powering South Africas energy future Our client,…

View Job

Free State: Site Agent – Construction Supervisors (Energy) posted by Tumaini Consulting

Jobs in Free State February 9, 2026
Engineering Tumaini Consulting

Seasoned Site Agent? Ready to take charge of high-impact renewable energy and large-scale civil projects? Keeping reading ! Our client…

View Job

Free State: Civil Construction Manager posted by Tumaini Consulting

Jobs in Free State February 9, 2026
Engineering Tumaini Consulting

Take the lead on landmark Renewable Energy projects across South Africa Our client is a contractor with offices in 6…

View Job

Browse Employers

View All

Job Alerts


Share this to someone who needs a job:
Posted in Jobs in Cape Peninsula, Jobs in Cape Town, Jobs in South Africa, Jobs in Western Cape

More Jobs in Your Area