Menu Close

South Africa: Senior Data Engineer (Spark & Python Specialist) – Remote

Advertisement



Job Description

About the Role

We are seeking an experienced Senior Data Engineer to join our remote team. As a Spark & Python Specialist, you will play a critical role in designing, developing, and maintaining large-scale data workloads that drive business value. With a strong focus on collaboration, innovation, and technical excellence, we invite you to join our dynamic team and contribute your expertise to shaping the future of our data engineering capabilities.

Key Responsibilities

  • Design, develop, and maintain complex data pipelines using Spark and PySpark
  • Diagnose performance bottlenecks via the Spark UI and optimize DAGs for improved efficiency
  • Build reusable Python libraries and implement automated testing for production-grade applications
  • Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and develop solutions that meet business objectives
  • Lead initiatives to enhance data engineering capabilities, introduce new technologies, and drive best practices
  • Mentor junior engineers, conduct code reviews, and contribute to building a culture of technical excellence

Requirements

  • 6 years of experience with Spark/PySpark, with the ability to diagnose performance bottlenecks via the Spark UI and optimize complex DAGs
  • Strong proficiency in production-grade Python, with experience building reusable libraries and implementing automated testing
  • Solid T-SQL skills to accurately interpret and migrate existing logic into a new Python-centric environment
  • Solid experience working within Azure Synapse, specifically with Dedicated SQL Pools and Data Factory working with complex pipelines
  • Hands-on experience with Delta Lake and Parquet, specifically in high-volume environments
  • Experience working with open-source standards and containerization (Docker) to ensure data workloads can be ported across different cloud infrastructures
View Job  Pretoria: IT Specialist (End User Support)

Qualifications

  • Bachelor’s degree in computer science, Information Systems, Engineering, or a closely related field

Salary & Benefits

Competitive salary, ESOP, and recognition for hard work.

How to Apply

Click the green “Go Apply” button below to apply directly online with the employer.

About IT / Computing / Software Jobs in ZA

In the IT and computing industry in South Africa, the job market is generally stable with a steady demand for skilled professionals. The growing importance of technology in various sectors, such as financial services, healthcare, and e-commerce, has created a strong foundation for career growth and development.

Typically, salaries for IT and computing positions in South Africa vary widely depending on factors such as experience, company size, industry sector, and specific job requirements. Generally, salaries range from around R400 000 to over R1 million per annum, although these figures are subject to variation and may not reflect actual salaries at specific companies or in certain regions. For example, senior IT professionals with extensive experience may earn higher salaries than junior entry-level positions.

Common skills required for IT and computing roles in South Africa include proficiency in programming languages such as Java, Python, or C++, as well as experience with software development methodologies like Agile or Scrum. Other essential skills often include knowledge of cloud computing platforms, database management systems, and cybersecurity principles. Additionally, excellent problem-solving skills, communication skills, and the ability to work collaboratively with teams are highly valued.

The IT and computing industry is a significant employer in various sectors, including financial services, technology, manufacturing, and healthcare. Financial institutions often require IT professionals for roles such as system administration, network management, or risk management, while tech companies need skilled developers, testers, and project managers to support their software development efforts. In the manufacturing sector, IT professionals are often required for roles like quality control, supply chain management, or production planning.

View Job  South Africa: Business Analyst posted by PST.AG

For those interested in pursuing a career in IT and computing, there are many opportunities for career development and advancement. Typically, entry-level positions serve as a starting point, followed by progression to senior developer, system administrator, or project manager roles. Many companies also offer training and development programs to enhance skills and knowledge, while online courses, certifications, and industry events provide additional opportunities for professional growth.


This information provides general career guidance. Actual salaries and requirements vary by employer.



GO APPLY NOW

Safe & secure application process

Advertisement


Advertisement



Get Similar Job Alerts
Enter your WhatsApp number (e.g., +27740908132)
You'll receive alerts for new jobs in South Africa, ZA


Job Seeker Tip

Always customize your CV and cover letter for each job application. Generic applications are often ignored.

How to Apply

Click “GO APPLY NOW” to visit the company’s application page.
Follow their instructions carefully.

View Job  Skukuza: Guest Experience Manager posted by HotelJobs

JVR Jobs connects you with employers – we don’t process applications directly.

Latest Job Opportunities

Durban: General Manager posted by Hire Power

Jobs in Durban March 24, 2026
Hire Power Other Administration PA Secretary

General Manager (Quick Service Restaurant Franchise)

View Job

Stellenbosch: Assistant to Accountant posted by Helderberg Personnel

Jobs in Cape Winelands March 24, 2026
Accounting Helderberg Personnel Other Finance

Purpose of the Role: To maintain accurate financial records with a strong focus on debtors and creditors management. This role…

View Job

Western Cape: Administrative and Logistics Coordinator posted by Helderberg Personnel

Jobs in South Africa March 24, 2026
Helderberg Personnel Maintenance Engineering Plant

Responsibilities Opening contracts on systemMaking out physical contractsFollowing up and collecting signed contracts.Managing monthly bank audits by...

View Job

Centurion: Accounting Assistant posted by Recruitpro Solutions

Jobs in Centurion March 24, 2026
Accounting Management Finance Recruitpro Solutions

Duties & ResponsibilitiesManage and maintain general ledger accountsEnsure correct VAT allocations and calculationsMaintain the integrity, accuracy, and...

View Job

Gauteng: Sourcing and Product Specialist (R&D) posted by Switch Recruit

Jobs in Gauteng March 24, 2026
Supermarket Switch Recruit

A dynamic opportunity is available in a role that combines strategic influence with hands-on execution. The position requires strong knowledge…

View Job

Durban: Branch Manager posted by Switch Recruit

Jobs in Durban March 24, 2026
Supermarket Switch Recruit

An exciting opportunity is available in the electrical engineering industry for a professional with strong leadership, organizational, and problem-solving...

View Job

Browse Employers

View All

Job Alerts


Share this to someone who needs a job:
Posted in Jobs in South Africa, Jobs in ZA

More Jobs in Your Area