Job Description
About the Role
Our client is seeking a Senior Cloud Data Engineer to join their Engineering team. In this role, you will be a key technical contributor responsible for building, optimizing, and maintaining high-performance data processing engines. You will apply your deep expertise in Spark Best Practices to develop modular, portable PySpark applications, ensuring their platform remains provider-agnostic while operating within modern environments like Microsoft Fabric.
Key Responsibilities
• Build, optimize, and maintain high-performance data processing engines
• Develop modular, portable PySpark applications using Spark Best Practices
• Refactor legacy logic into scalable Python-centric solutions
• Optimize the client’s data lakehouse architecture
• Contribute to the overall technical excellence of the client’s data platform
Requirements
• Bachelor’s degree in computer science, Information Systems, Engineering, or a closely related field
• Senior-Level Spark: 6 years of experience with Spark/PySpark, with the ability to diagnose performance bottlenecks via the Spark UI and optimize complex DAGs
• Advanced Python: Strong proficiency in production-grade Python, with experience building reusable libraries and implementing automated testing
• SQL Proficiency: Solid T-SQL skills to accurately interpret and migrate existing logic into the new Python-centric environment
• Azure Synapse Analytics & Dedicated SQL Pools: Solid experience working within Azure Synapse, specifically with Dedicate SQL Pools and Data Factory working with complex pipelines
• Data Lakehouse Expertise: Hands-on experience with Delta Lake and Parquet, specifically in high-volume environments
• Agnostic Mindset: Experience working with open-source standards and containerization (Docker) to ensure data workloads can be ported across different cloud infrastructures
Qualifications
No formal education or certifications are required for this position.
Salary & Benefits
Salary details are not provided.
How to Apply
Click the green “Go Apply” button below to apply directly online with the employer.
About IT / Computing / Software Jobs in South Africa
The IT and computing industry in South Africa is rapidly growing, driven by the increasing demand for digital transformation and technological advancements. Typically, this growth translates to a strong job market for professionals with skills in software development, data analysis, and cybersecurity. Generally, the sector offers a wide range of career opportunities across various industries.
In terms of salary expectations, IT and computing professionals in South Africa can generally expect to earn salaries that are on par with or slightly above the national average. However, it’s essential to note that salaries can vary significantly depending on factors such as experience, company size, industry sector, and specific job requirements. Typically, experienced professionals in high-demand areas like artificial intelligence, cloud computing, or cybersecurity tend to earn higher salaries than those in entry-level positions. Nonetheless, salaries are often within the range of R600 000 to R1 million per annum for mid-level roles, with senior positions potentially exceeding R2 million.
Common skills required for IT and computing roles in South Africa include programming languages such as Java, Python, or C++, proficiency in software development methodologies like Agile or Scrum, experience with data analysis tools like Tableau or Power BI, and familiarity with cloud-based technologies like AWS or Azure. Additionally, knowledge of cybersecurity principles, network administration, and database management are highly valued skills.
The IT and computing industry is a significant sector across various industries, including financial services, technology, manufacturing, and healthcare. Many companies in these sectors require skilled professionals to develop, implement, and maintain their digital solutions. Typically, the finance industry requires specialized IT talent for areas like risk management, compliance, and anti-money laundering.
For those looking to pursue a career in IT and computing, common career progression paths include working as an individual contributor, moving into team leadership roles, or taking on senior technical positions. Many professionals also choose to specialize in emerging technologies like artificial intelligence, blockchain, or the Internet of Things (IoT). With ongoing training and development, individuals can stay up-to-date with the latest industry trends and advancements, positioning themselves for success in this rapidly evolving field.
This information provides general career guidance. Actual salaries and requirements vary by employer.
GO APPLY NOW
Safe & secure application process
Explore More Opportunities
Get Similar Job Alerts
Job Seeker Tip
Send a thank-you email within 24 hours after your interview.
How to Apply
Click “GO APPLY NOW” to visit the company’s application page.
Follow their instructions carefully.
JVR Jobs connects you with employers – we don’t process applications directly.
Latest Job Opportunities
Sandton: Post Basic Qualified Pharmacist Assistant – Fourways – Sandton posted by Dis-Chem Pharmacies
Dis-Chem Pharmacies require the services of a reputable Post Basic Qualify Pharmacist Assistant for their Fourways store. Your portfolio will…
View JobJohannesburg: Project Engineer posted by MSP Staffing LTD
Our client is looking for a Project Engineer that will manage defined project packages or components under the guidance of…
View JobGauteng: Looking for Growth? Join Liberty as a Sales Consultant (Training Ongoing Support) posted by EQ-FIN
Introduction EQ-FIN is more than a financial advisory firm it's a launchpad for ambitious individuals looking to build a career…
View JobBethlehem: Pharmacist – Dihlabeng – Bethlehem – Free State posted by Dis-Chem Pharmacies
Dis-Chem Pharmacies require the services of a reputable Pharmacist for their Bethlehem store. Your portfolio will cover the provision of…
View JobGauteng: Financial Accountant posted by Hire Resolve
A well-established and reputable legal services firm is seeking a skilled and detail-oriented Financial Accountant to join their dynamic team.…
View JobSandton: Student Casual Sales Consultants 2026 posted by Core Group
Join iStore Casual Sales Consultant (Student Opportunity) iStore, part of Core Group, is the home of everything Apple and Africas…
View Job
Browse Employers
Job Alerts