Job Description
About the Role
Our client, a leading digital contracting platform for the ocean freight industry, is seeking a Senior Data Engineer to help them scale their data platform, support product innovation, and enable advanced AI, analytics, and compliance initiatives. As a Senior Data Engineer, you will design and build highly scalable data pipelines, architect foundational data systems, and support machine learning and GenAI capabilities.
Key Responsibilities
- Build and maintain robust data pipelines (batch and streaming) using Airflow, AWS Glue, Step Functions, Lambda, and more
- Develop microservices and data-centric APIs in Java, with clean modular architecture and secure data access patterns
- Deploy and monitor services in AWS with infrastructure-as-code tools like Terraform and Docker
- Design and implement reliable data models to support analytics, data products, and AI workloads
- Establish data lineage, quality monitoring, and testing frameworks using tools like Great Expectations, Marquez, or Monte Carlo
- Maintain metadata management and documentation for compliance and discoverability
- Collaborate with data scientists to provision training datasets, feature stores, and model pipelines
- Build orchestration and evaluation workflows to support LLM and GenAI development (e.g., RAG pipelines, embedding search, document intelligence)
- Integrate unstructured data (PDFs, documents, messages) into structured datasets for analytics and AI
- Implement best practices aligned with SOC 2, GDPR, and internal infosec standards
- Ensure secure access controls, audit logging, and encrypted storage for sensitive data
- Work with cybersecurity and infrastructure teams to ensure end-to-end data governance
- Partner with engineering, product, analytics, and operations teams to support cross-cutting data initiatives
- Collaborate closely with backend and DevOps engineers to align services, APIs, and deployment patterns
Requirements
- 7+ years of experience in data engineering or backend software development
- Proficiency in Java and Python, with experience developing microservices and scalable APIs
- Strong expertise in SQL, data modelling, and building reliable ETL/ELT pipelines
- Deep familiarity with AWS services (Step Functions, Lambda, Glue, S3, Redshift)
- Hands-on experience with Airflow, dbt, or similar orchestration and transformation tools
- Knowledge of data lineage, quality frameworks, and monitoring systems
- Prior experience working alongside data scientists or ML engineers
Salary & Benefits
(No salary information is provided in the original job description. If you have any additional information regarding salary, please provide it.)
Note: The original job description did not mention salary information. I’ve left this section blank as per your instructions.
How to Apply
Click the green “Go Apply” button below to apply directly online with the employer.
About Other IT/Computer Jobs in Western Cape
The Western Cape, situated on the south coast of South Africa, is home to a thriving IT industry that offers a diverse range of career opportunities for professionals with expertise in various fields.
The job market in the Western Cape is highly competitive, with many major companies and startups operating in the region. The province’s strategic location, combined with its well-developed infrastructure, makes it an attractive hub for businesses looking to establish themselves in Africa. As a result, there is a high demand for skilled IT professionals who can support the growth of these companies.
The average salary ranges for IT professionals in the Western Cape are as follows: software engineers and developers can expect to earn between R800 000 to R1 200 000 per annum; data scientists and analysts can range from R600 000 to R900 000; cybersecurity specialists can earn anywhere from R500 000 to R800 000; and IT project managers can command salaries ranging from R400 000 to R700 000. These figures are based on industry standards and may vary depending on factors such as experience, qualifications, and company size.
To succeed in an IT career in the Western Cape, professionals need to possess a range of key skills, including programming languages (Java, Python, C++), data structures and algorithms, software development methodologies, cloud computing (AWS, Azure, Google Cloud), cybersecurity principles, and excellent communication skills. Additionally, knowledge of industry-specific tools and technologies, such as SAP or Oracle, can be highly valued.
Several major companies and industries are actively hiring IT professionals in the Western Cape. For example, tech giants like IBM and Dell have a strong presence in the region, while financial institutions such as Standard Bank and First National Bank also have significant IT departments. The automotive industry is another major sector that employs IT professionals, with companies like Toyota and Volkswagen having operations in the province.
Career growth opportunities are plentiful for IT professionals in the Western Cape, with many companies offering training and development programs to help employees upskill and reskill. With experience, professionals can move into senior roles such as technical lead or manager, or transition into related fields like business analysis or consulting. The region’s entrepreneurial spirit also makes it an ideal location for startups, providing opportunities for IT professionals to launch their own businesses or join innovative companies that are shaping the future of technology.
This information provides general career guidance. Actual salaries and requirements vary by employer.
GO APPLY NOW
Safe & secure application process
Explore More Opportunities
Get Similar Job Alerts
Job Seeker Tip
Dress professionally for interviews, even if the company has a casual dress code.
How to Apply
Click “GO APPLY NOW” to visit the company’s application page.
Follow their instructions carefully.
JVR Jobs connects you with employers – we don’t process applications directly.
Latest Job Opportunities
Pretoria East: Hotel Accountant posted by Network Finance
This is not your typical finance role - this is where numbers meet nuance, and spreadsheets meet service. A well-established…
View JobPietermaritzburg: Administrator posted by Riseup Management
We are seeking a reliable and organized Administrator to join our team. The ideal candidate will be responsible for managing…
View JobMpumalanga: Provincial Manager – Insurance posted by Network Finance
Our client is a respected player within the business and commercial shortterm insurance space. This confidential Provincial Manager role is…
View JobJohannesburg: Full Stack Senior Developer posted by Hire Resolve
Role OverviewAn established technology-driven organization is seeking a Senior Full Stack Developer to design, build, and deploy scalable applications using...
View JobGauteng: Junior Accountant posted by Network Finance
Job & Company Description:The successful candidate will support the finance team across core accounting functions, assisting with financial reporting,...
View JobWestern Cape: Conveyancing Secretary (RMB Bonds) posted by ARCS
Duties & ResponsibilitiesManage conveyancing transactions end-to-end, including residential and commercial property transfers.Prepare and maintain accurate...
View Job
Browse Employers
Job Alerts