Job Description
Location: Remote (South Africa)
Employment Type: Full-Time
Industry: Data Engineering | Cloud Platforms | Financial Services Technology
WatersEdge Solutions is partnering with a client to recruit a highly skilled Senior Data Engineer (Spark & Python Specialist). This is a strong opportunity for a technically advanced engineer who enjoys building scalable, high-performance data solutions in a modern cloud environment. The role is ideal for someone who thrives on optimisation, code-first engineering, and modernising legacy data logic into clean, portable, Python-centric solutions.
About the Role
As a Senior Data Engineer, youll serve as a key technical contributor within the engineering team, focused on building, maintaining, and optimising large-scale data processing engines. Youll work extensively with Spark, PySpark, Delta Lake, and cloud-based lakehouse environments, helping shape a provider-agnostic platform with strong engineering standards, portability, and performance at its core.
Key Responsibilities
-
Optimise Spark-based processing through best practices in memory management, shuffle tuning, and partitioning
-
Build and maintain data pipelines using Python, PySpark, Delta Lake, and Parquet
-
Refactor legacy SQL-based ETL logic into modular, testable, maintainable Python libraries
-
Build and optimise medallion architecture layers across Bronze, Silver, and Gold
-
Support code-first orchestration approaches using tools such as Airflow, Dagster, or Python-based wrappers
-
Participate in code reviews and mentor junior engineers in PySpark best practices
-
Contribute to automated testing frameworks using Pytest
-
Work closely with data scientists, analysts, and business stakeholders to deliver fit-for-purpose solutions
-
Lead initiatives that strengthen data engineering capability, tooling, and technical best practice
-
Ensure strong security, compliance, and governance across engineering processes
What Youll Bring
-
Bachelors degree in Computer Science, Information Systems, Engineering, or a related field
-
6+ years of Spark / PySpark experience
-
Strong production-grade Python capability
-
Solid T-SQL skills with experience interpreting and migrating existing SQL logic
-
Experience with Azure Synapse Analytics, Dedicated SQL Pools, and Data Factory
-
Hands-on expertise with Delta Lake and Parquet in high-volume environments
-
Experience with Docker and open-source, cloud-agnostic engineering standards
-
Strong collaboration skills and a proven track record modernising large-scale data workloads
-
Experience mentoring engineers and contributing to technical excellence across a team
-
Strong understanding of security, compliance, and data governance principles
Nice to Have
-
Exposure to Microsoft Fabric
-
Experience with code-first orchestration tooling such as Airflow or Dagster
-
Experience building reusable internal Python libraries and automated testing patterns
-
Background in high-scale cloud data platform modernisation
Whats On Offer
-
Fully remote role based in South Africa
-
Flexible working arrangements
-
Wellness support and home office reimbursement
-
Continuous learning opportunities
-
Competitive salary, ESOP, and recognition for performance
-
Supportive and inclusive team culture focused on accountability and work-life balance
Company Culture
This is a team that values transparency, accountability, inclusion, and technical excellence. Youll join an environment that supports strong engineering standards, continuous learning, and collaborative problem-solving while giving people the flexibility to do their best work in a sustainable way.
If you have not been contacted within 10 working days, please consider your application unsuccessful.
How to Apply
Click the green “Go Apply” button below to apply directly online with the employer.
About Other Finance/Accounting Jobs in Western Cape
In the Western Cape, the finance and accounting profession is a thriving industry with a strong demand for skilled professionals. Typically, the job market trends indicate a steady growth in the need for finance and accounting expertise across various sectors. This is often driven by the increasing importance of financial management, regulatory compliance, and data-driven decision-making in businesses.
When it comes to salaries, it’s common to see broad ranges varying depending on factors like experience, company size, and industry sector. Generally, entry-level positions can expect salaries ranging from R250 000 to R400 000 per annum, while senior roles may command salaries between R600 000 and R1 200 000 or more, depending on the individual’s qualifications and level of expertise.
Common skills required for finance and accounting roles in Western Cape include proficiency in financial software such as QuickBooks, Xero, or SAP; strong analytical and problem-solving skills; excellent communication and interpersonal skills; attention to detail and organisational abilities; knowledge of tax laws and regulations; and experience with budgeting and forecasting tools. Typically, a degree in commerce, accounting, or a related field is also essential.
Industry sectors commonly employing finance and accounting professionals include the financial services sector, technology industry, manufacturing sector, and corporate organisations. These roles often involve providing financial guidance, managing budgets, preparing financial reports, and ensuring compliance with regulatory requirements.
For those looking to advance their careers in finance and accounting, career development opportunities abound. Typically, experienced professionals can move into senior management positions or pursue specialisations like forensic accounting, audit, or financial planning. Others may choose to transition into related fields like business consulting, investment banking, or entrepreneurial ventures. With continuous learning and professional development, finance and accounting professionals in Western Cape can enjoy a rewarding and challenging career with opportunities for growth and advancement.
This information provides general career guidance. Actual salaries and requirements vary by employer.
GO APPLY NOW
Safe & secure application process
Explore More Opportunities
Get Similar Job Alerts
Job Seeker Tip
Create a professional email address for job hunting - avoid nicknames or casual addresses.
How to Apply
Click “GO APPLY NOW” to visit the company’s application page.
Follow their instructions carefully.
JVR Jobs connects you with employers – we don’t process applications directly.
Latest Job Opportunities
Gauteng: Sales Representative Pretoria posted by Jobs 4 All
Key ResponsibilitiesMaintain and strengthen relationships with existing customers through regular visits and sales callsIdentify and engage new customers to...
View JobEdenvale: HR Generalist posted by Flink Recruitment
Duties: Recruitment & Onboarding: Coordinate end-to-end recruitment processes, including advertising, shortlisting, interviews, and appointment...
View JobEdenvale: Finance Manager posted by Flink Recruitment
Responsibilities: Prepare and deliver weekly and monthly reports to the CFO and Dealer Principals Manage the full accounting function, including…
View JobGauteng: Credit Controller posted by The Recruitment People
Responsibilities will include but are not limited to:Ensure effective credit controlEnsure positive cashflow via collectionsProduce management reportsFoster...
View JobGauteng: Accountant posted by The Recruitment People
Responsibilities will include, but are not limited to:Preparing management accountsAssisting with budgeting and forecastingManaging the cash flowSubmitting...
View JobGauteng: Financial Manager posted by Network Finance
In high-performing environments, finance leaders are expected to do more than report - they drive standards, structure, and strategic direction.…
View Job
Browse Employers
Job Alerts