Job Description
About the Role
We are seeking an experienced Senior Data Engineer to join our team as a Spark & Python Specialist. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data workloads that drive business insights and inform strategic decisions.
Key Responsibilities
- Design, build, and maintain complex data pipelines using Spark and PySpark
- Develop reusable libraries and implement automated testing for production-grade Python applications
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and develop solutions that meet business objectives
- Lead initiatives to enhance data engineering capabilities, introduce new technologies, and drive best practices
- Mentor junior engineers, conduct code reviews, and contribute to building a culture of technical excellence
- Communicate effectively with technical and non-technical stakeholders, translating complex data concepts into actionable insights
Requirements
- 6 years of experience with Spark/PySpark, with the ability to diagnose performance bottlenecks via the Spark UI and optimize complex DAGs
- Strong proficiency in production-grade Python, with experience building reusable libraries and implementing automated testing
- Solid T-SQL skills to accurately interpret and migrate existing logic into the new Python-centric environment
- Solid experience working within Azure Synapse, specifically with Dedicated SQL Pools and Data Factory working with complex pipelines
- Hands-on experience with Delta Lake and Parquet, specifically in high-volume environments
- Agnostic mindset with experience working with open-source standards and containerization (Docker) to ensure data workloads can be ported across different cloud infrastructures
Qualifications
Bachelor’s degree in computer science, Information Systems, Engineering, or a closely related field.
Salary & Benefits
Competitive salary, ESOP, recognition for hard work.
How to Apply
Click the green “Go Apply” button below to apply directly online with the employer.
About IT / Computing / Software Jobs in ZA
In the IT and computing industry in South Africa, the job market is generally stable with a steady demand for skilled professionals. The growing importance of technology in various sectors, such as financial services, healthcare, and e-commerce, has created a strong foundation for career growth and development.
Typically, salaries for IT and computing positions in South Africa vary widely depending on factors such as experience, company size, industry sector, and specific job requirements. Generally, salaries range from around R400 000 to over R1 million per annum, although these figures are subject to variation and may not reflect actual salaries at specific companies or in certain regions. For example, senior IT professionals with extensive experience may earn higher salaries than junior entry-level positions.
Common skills required for IT and computing roles in South Africa include proficiency in programming languages such as Java, Python, or C++, as well as experience with software development methodologies like Agile or Scrum. Other essential skills often include knowledge of cloud computing platforms, database management systems, and cybersecurity principles. Additionally, excellent problem-solving skills, communication skills, and the ability to work collaboratively with teams are highly valued.
The IT and computing industry is a significant employer in various sectors, including financial services, technology, manufacturing, and healthcare. Financial institutions often require IT professionals for roles such as system administration, network management, or risk management, while tech companies need skilled developers, testers, and project managers to support their software development efforts. In the manufacturing sector, IT professionals are often required for roles like quality control, supply chain management, or production planning.
For those interested in pursuing a career in IT and computing, there are many opportunities for career development and advancement. Typically, entry-level positions serve as a starting point, followed by progression to senior developer, system administrator, or project manager roles. Many companies also offer training and development programs to enhance skills and knowledge, while online courses, certifications, and industry events provide additional opportunities for professional growth.
This information provides general career guidance. Actual salaries and requirements vary by employer.
GO APPLY NOW
Safe & secure application process
Explore More Opportunities
Get Similar Job Alerts
Job Seeker Tip
Quantify your achievements on your CV using numbers and percentages where possible.
How to Apply
Click “GO APPLY NOW” to visit the company’s application page.
Follow their instructions carefully.
JVR Jobs connects you with employers – we don’t process applications directly.
Latest Job Opportunities
Johannesburg: Branch Manager posted by Hire Resolve
Hire Resolve is currently seeking a highly skilled and experienced Branch Manager to join their client's team in Gauteng. Our…
View JobCape Town: Buyer posted by Hire Resolve
Hire Resolves' client is seeking a highly motivated and detail-oriented individual to join their team as a Buyer in Cape…
View JobSouth Africa: Internal Sales
Were growing! We need a technically minded sales pro who knows their way around an SLD and speaks the language…
View JobBoksburg: External Sales Executive (Security Technology)
External Sales Executive (Security Technology) POS26186 Location: Edenvale Salary : R25 28 000.00 pm commission Our client is seeking a…
View JobCape Town City Centre: Qualified Plumber
We are seeking a skilled and experienced Qualified Plumber to join our team. The successful candidate will be responsible for…
View JobJohannesburg: Debtors Clerk – Industrial Sector (Kempton Park)
Responsibilities: Maintain and update debtor accounts, ensuring accuracy and completeness Generate and distribute invoices and statements to customers...
View Job
Browse Employers
Job Alerts