Menu Close

South Africa: Senior Data Engineer (Spark & Python Specialist) – Remote

Advertisement



Job Description

About the Role

We are seeking an experienced Senior Data Engineer to join our team as a Spark & Python Specialist. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data workloads that drive business insights and inform strategic decisions.

Key Responsibilities

  • Design, build, and maintain complex data pipelines using Spark and PySpark
  • Develop reusable libraries and implement automated testing for production-grade Python applications
  • Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and develop solutions that meet business objectives
  • Lead initiatives to enhance data engineering capabilities, introduce new technologies, and drive best practices
  • Mentor junior engineers, conduct code reviews, and contribute to building a culture of technical excellence
  • Communicate effectively with technical and non-technical stakeholders, translating complex data concepts into actionable insights

Requirements

  • 6 years of experience with Spark/PySpark, with the ability to diagnose performance bottlenecks via the Spark UI and optimize complex DAGs
  • Strong proficiency in production-grade Python, with experience building reusable libraries and implementing automated testing
  • Solid T-SQL skills to accurately interpret and migrate existing logic into the new Python-centric environment
  • Solid experience working within Azure Synapse, specifically with Dedicated SQL Pools and Data Factory working with complex pipelines
  • Hands-on experience with Delta Lake and Parquet, specifically in high-volume environments
  • Agnostic mindset with experience working with open-source standards and containerization (Docker) to ensure data workloads can be ported across different cloud infrastructures

Qualifications

Bachelor’s degree in computer science, Information Systems, Engineering, or a closely related field.

View Job  Cape Town City Centre: 1st Line Service Desk Engineer

Salary & Benefits

Competitive salary, ESOP, recognition for hard work.

How to Apply

Click the green “Go Apply” button below to apply directly online with the employer.

About IT / Computing / Software Jobs in ZA

In the IT and computing industry in South Africa, the job market is generally stable with a steady demand for skilled professionals. The growing importance of technology in various sectors, such as financial services, healthcare, and e-commerce, has created a strong foundation for career growth and development.

Typically, salaries for IT and computing positions in South Africa vary widely depending on factors such as experience, company size, industry sector, and specific job requirements. Generally, salaries range from around R400 000 to over R1 million per annum, although these figures are subject to variation and may not reflect actual salaries at specific companies or in certain regions. For example, senior IT professionals with extensive experience may earn higher salaries than junior entry-level positions.

Common skills required for IT and computing roles in South Africa include proficiency in programming languages such as Java, Python, or C++, as well as experience with software development methodologies like Agile or Scrum. Other essential skills often include knowledge of cloud computing platforms, database management systems, and cybersecurity principles. Additionally, excellent problem-solving skills, communication skills, and the ability to work collaboratively with teams are highly valued.

The IT and computing industry is a significant employer in various sectors, including financial services, technology, manufacturing, and healthcare. Financial institutions often require IT professionals for roles such as system administration, network management, or risk management, while tech companies need skilled developers, testers, and project managers to support their software development efforts. In the manufacturing sector, IT professionals are often required for roles like quality control, supply chain management, or production planning.

View Job  Midrand: Scrum Master

For those interested in pursuing a career in IT and computing, there are many opportunities for career development and advancement. Typically, entry-level positions serve as a starting point, followed by progression to senior developer, system administrator, or project manager roles. Many companies also offer training and development programs to enhance skills and knowledge, while online courses, certifications, and industry events provide additional opportunities for professional growth.


This information provides general career guidance. Actual salaries and requirements vary by employer.



GO APPLY NOW

Safe & secure application process

Advertisement


Advertisement



Get Similar Job Alerts
Enter your WhatsApp number (e.g., +27740908132)
You'll receive alerts for new jobs in South Africa, ZA


Job Seeker Tip

Quantify your achievements on your CV using numbers and percentages where possible.

How to Apply

Click “GO APPLY NOW” to visit the company’s application page.
Follow their instructions carefully.

View Job  Johannesburg: Project Coordinator (Hybrid - 7 Months Contract - Renewal based on funding - Wits SHI)

JVR Jobs connects you with employers – we don’t process applications directly.

Latest Job Opportunities

Johannesburg: Branch Manager posted by Hire Resolve

Jobs in Central Johannesburg April 18, 2026
Hire Resolve Other Management

Hire Resolve is currently seeking a highly skilled and experienced Branch Manager to join their client's team in Gauteng. Our…

View Job

Cape Town: Buyer posted by Hire Resolve

Jobs in Cape Peninsula April 18, 2026
Hire Resolve Other Clearing and Forwarding

Hire Resolves' client is seeking a highly motivated and detail-oriented individual to join their team as a Buyer in Cape…

View Job

South Africa: Internal Sales

Jobs in South Africa April 18, 2026
Sales

Were growing! We need a technically minded sales pro who knows their way around an SLD and speaks the language…

View Job

Boksburg: External Sales Executive (Security Technology)

Jobs in Boksburg April 18, 2026
Sales

External Sales Executive (Security Technology) POS26186 Location: Edenvale Salary : R25 28 000.00 pm commission Our client is seeking a…

View Job

Cape Town City Centre: Qualified Plumber

Jobs in Cape Peninsula April 18, 2026
Construction trades

We are seeking a skilled and experienced Qualified Plumber to join our team. The successful candidate will be responsible for…

View Job

Johannesburg: Debtors Clerk – Industrial Sector (Kempton Park)

Jobs in Central Johannesburg April 18, 2026
Accounting Finance

Responsibilities: Maintain and update debtor accounts, ensuring accuracy and completeness Generate and distribute invoices and statements to customers...

View Job

Browse Employers

View All

Job Alerts


Share this to someone who needs a job:
Posted in Jobs in South Africa, Jobs in ZA

More Jobs in Your Area