Job Description
About the Role
We are seeking an experienced Senior Data Engineer to join our remote team. As a Spark & Python Specialist, you will play a critical role in designing, developing, and maintaining large-scale data workloads that drive business value. With a strong focus on collaboration, innovation, and technical excellence, we invite you to join our dynamic team and contribute your expertise to shaping the future of our data engineering capabilities.
Key Responsibilities
- Design, develop, and maintain complex data pipelines using Spark and PySpark
- Diagnose performance bottlenecks via the Spark UI and optimize DAGs for improved efficiency
- Build reusable Python libraries and implement automated testing for production-grade applications
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and develop solutions that meet business objectives
- Lead initiatives to enhance data engineering capabilities, introduce new technologies, and drive best practices
- Mentor junior engineers, conduct code reviews, and contribute to building a culture of technical excellence
Requirements
- 6 years of experience with Spark/PySpark, with the ability to diagnose performance bottlenecks via the Spark UI and optimize complex DAGs
- Strong proficiency in production-grade Python, with experience building reusable libraries and implementing automated testing
- Solid T-SQL skills to accurately interpret and migrate existing logic into a new Python-centric environment
- Solid experience working within Azure Synapse, specifically with Dedicated SQL Pools and Data Factory working with complex pipelines
- Hands-on experience with Delta Lake and Parquet, specifically in high-volume environments
- Experience working with open-source standards and containerization (Docker) to ensure data workloads can be ported across different cloud infrastructures
Qualifications
- Bachelor’s degree in computer science, Information Systems, Engineering, or a closely related field
Salary & Benefits
Competitive salary, ESOP, and recognition for hard work.
How to Apply
Click the green “Go Apply” button below to apply directly online with the employer.
About IT / Computing / Software Jobs in ZA
In the IT and computing industry in South Africa, the job market is generally stable with a steady demand for skilled professionals. The growing importance of technology in various sectors, such as financial services, healthcare, and e-commerce, has created a strong foundation for career growth and development.
Typically, salaries for IT and computing positions in South Africa vary widely depending on factors such as experience, company size, industry sector, and specific job requirements. Generally, salaries range from around R400 000 to over R1 million per annum, although these figures are subject to variation and may not reflect actual salaries at specific companies or in certain regions. For example, senior IT professionals with extensive experience may earn higher salaries than junior entry-level positions.
Common skills required for IT and computing roles in South Africa include proficiency in programming languages such as Java, Python, or C++, as well as experience with software development methodologies like Agile or Scrum. Other essential skills often include knowledge of cloud computing platforms, database management systems, and cybersecurity principles. Additionally, excellent problem-solving skills, communication skills, and the ability to work collaboratively with teams are highly valued.
The IT and computing industry is a significant employer in various sectors, including financial services, technology, manufacturing, and healthcare. Financial institutions often require IT professionals for roles such as system administration, network management, or risk management, while tech companies need skilled developers, testers, and project managers to support their software development efforts. In the manufacturing sector, IT professionals are often required for roles like quality control, supply chain management, or production planning.
For those interested in pursuing a career in IT and computing, there are many opportunities for career development and advancement. Typically, entry-level positions serve as a starting point, followed by progression to senior developer, system administrator, or project manager roles. Many companies also offer training and development programs to enhance skills and knowledge, while online courses, certifications, and industry events provide additional opportunities for professional growth.
This information provides general career guidance. Actual salaries and requirements vary by employer.
GO APPLY NOW
Safe & secure application process
Explore More Opportunities
Get Similar Job Alerts
Job Seeker Tip
Always customize your CV and cover letter for each job application. Generic applications are often ignored.
How to Apply
Click “GO APPLY NOW” to visit the company’s application page.
Follow their instructions carefully.
JVR Jobs connects you with employers – we don’t process applications directly.
Latest Job Opportunities
Durban: General Manager posted by Hire Power
General Manager (Quick Service Restaurant Franchise)
View JobStellenbosch: Assistant to Accountant posted by Helderberg Personnel
Purpose of the Role: To maintain accurate financial records with a strong focus on debtors and creditors management. This role…
View JobWestern Cape: Administrative and Logistics Coordinator posted by Helderberg Personnel
Responsibilities Opening contracts on systemMaking out physical contractsFollowing up and collecting signed contracts.Managing monthly bank audits by...
View JobCenturion: Accounting Assistant posted by Recruitpro Solutions
Duties & ResponsibilitiesManage and maintain general ledger accountsEnsure correct VAT allocations and calculationsMaintain the integrity, accuracy, and...
View JobGauteng: Sourcing and Product Specialist (R&D) posted by Switch Recruit
A dynamic opportunity is available in a role that combines strategic influence with hands-on execution. The position requires strong knowledge…
View JobDurban: Branch Manager posted by Switch Recruit
An exciting opportunity is available in the electrical engineering industry for a professional with strong leadership, organizational, and problem-solving...
View Job
Browse Employers
Job Alerts