Job Description
About the Role
WatersEdge Solutions is partnering with a client to recruit a highly skilled Senior Data Engineer (Spark & Python Specialist) for a remote full-time position in South Africa. This role is ideal for someone who thrives on optimisation, code-first engineering, and modernising legacy data logic into clean, portable, Python-centric solutions.
Key Responsibilities
- Optimise Spark-based processing through best practices in memory management, shuffle tuning, and partitioning
- Build and maintain data pipelines using Python, PySpark, Delta Lake, and Parquet
- Refactor legacy SQL-based ETL logic into modular, testable, maintainable Python libraries
- Build and optimise medallion architecture layers across Bronze, Silver, and Gold
- Support code-first orchestration approaches using tools such as Airflow, Dagster, or Python-based wrappers
- Participate in code reviews and mentor junior engineers in PySpark best practices
- Contribute to automated testing frameworks using Pytest
- Work closely with data scientists, analysts, and business stakeholders to deliver fit-for-purpose solutions
- Lead initiatives that strengthen data engineering capability, tooling, and technical best practice
- Ensure strong security, compliance, and governance across engineering processes
Requirements
- 6+ years of Spark / PySpark experience
- Strong production-grade Python capability
- Solid T-SQL skills with experience interpreting and migrating existing SQL logic
- Experience with Azure Synapse Analytics, Dedicated SQL Pools, and Data Factory
- Hands-on expertise with Delta Lake and Parquet in high-volume environments
- Experience mentoring engineers and contributing to technical excellence across a team
Qualifications
- Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field
Salary & Benefits
Competitive salary, ESOP, and recognition for performance
How to Apply
Click the green “Go Apply” button below to apply directly online with the employer.
About Other Finance/Accounting Jobs in Western Cape
In the Western Cape, the finance and accounting profession is a thriving industry with a strong demand for skilled professionals. Typically, the job market trends indicate a steady growth in the need for finance and accounting expertise across various sectors. This is often driven by the increasing importance of financial management, regulatory compliance, and data-driven decision-making in businesses.
When it comes to salaries, it’s common to see broad ranges varying depending on factors like experience, company size, and industry sector. Generally, entry-level positions can expect salaries ranging from R250 000 to R400 000 per annum, while senior roles may command salaries between R600 000 and R1 200 000 or more, depending on the individual’s qualifications and level of expertise.
Common skills required for finance and accounting roles in Western Cape include proficiency in financial software such as QuickBooks, Xero, or SAP; strong analytical and problem-solving skills; excellent communication and interpersonal skills; attention to detail and organisational abilities; knowledge of tax laws and regulations; and experience with budgeting and forecasting tools. Typically, a degree in commerce, accounting, or a related field is also essential.
Industry sectors commonly employing finance and accounting professionals include the financial services sector, technology industry, manufacturing sector, and corporate organisations. These roles often involve providing financial guidance, managing budgets, preparing financial reports, and ensuring compliance with regulatory requirements.
For those looking to advance their careers in finance and accounting, career development opportunities abound. Typically, experienced professionals can move into senior management positions or pursue specialisations like forensic accounting, audit, or financial planning. Others may choose to transition into related fields like business consulting, investment banking, or entrepreneurial ventures. With continuous learning and professional development, finance and accounting professionals in Western Cape can enjoy a rewarding and challenging career with opportunities for growth and advancement.
This information provides general career guidance. Actual salaries and requirements vary by employer.
GO APPLY NOW
Safe & secure application process
Explore More Opportunities
Get Similar Job Alerts
Job Seeker Tip
Get references ready before you need them - keep in touch with past managers and colleagues.
How to Apply
Click “GO APPLY NOW” to visit the company’s application page.
Follow their instructions carefully.
JVR Jobs connects you with employers – we don’t process applications directly.
Latest Job Opportunities
Cape Town: Chief Operations Officer (COO) posted by Petroleum Agency SA (PASA)
Contract: Five (5) year fixed-termLocation: Cape Town, South Africa About the CompanyPetroleum Agency SA (“PASA”), a subsidiary of CEF SOC…
View JobCape Town: Chief Financial Officer (CFO) posted by Petroleum Agency SA (PASA)
Contract: Five (5) year fixed-termLocation: Cape Town, South Africa About the CompanyPetroleum Agency SA (“PASA”), a subsidiary of CEF SOC…
View JobGauteng: Financial Accountant posted by Network Finance
Company and Job DescriptionIn logistics and supply chain, timing is everything - and so is having the right financial insight…
View JobGauteng: BI Specialist posted by Network Finance
Responsibilities:End-to-End BI Development: Lead the full development life cycle of BI projects—from initial issue statement and analysis to design,...
View JobWestern Cape: Tax Accountant posted by Communicate Finance
Assist with auditsRespond to tax queriesReview and prepare tax provisionsPerform tax calculationsPerform tax reconciliationsDraft tax adjusted financial...
View JobGauteng: Compliance Administrator posted by Signa Opportunity
Purpose of the Role:The Compliance Administrator will be responsible for ensuring that the company complies with legal,regulatory, and internal policy...
View Job
Browse Employers
Job Alerts