Johannesburg: Data Engineer (Integration for Data Science Team) posted by PBT Group

PBT Group is seeking a skilled Data Engineer to join a growing Data Science team responsible for designing, developing, and optimising data pipelines and integration frameworks to support advanced analytics and machine learning initiatives. The successful candidate will play a key role in ensuring seamless data flow, scalability, and reliability across cloud and on-premise environments.

Key Responsibilities:

• Design, build, and maintain robust data pipelines for ingestion, transformation, and delivery of structured and unstructured data.
• Collaborate closely with data scientists, analysts, and business stakeholders to ensure data solutions meet analytical and operational needs.
• Optimise existing ETL/ELT processes for performance, scalability, and cost efficiency.
• Integrate data from multiple source systems (including APIs, databases, and third-party applications) into AWS and Databricks environments.
• Implement data quality, monitoring, and validation frameworks to ensure high standards of data integrity.
• Support the deployment and operationalisation of machine learning models and data products.
• Work in Agile or DevOps-driven environments using CI/CD pipelines and version control tools.

Skills & Experience Required:

• 4+ years experience as a Data Engineer, preferably within financial services or insurance.
• Strong expertise in AWS (Lambda, S3, Glue, Redshift, EMR) and Databricks.
• Advanced proficiency in Python for ETL/ELT development and automation.
• Experience with SQL and data modelling for analytical and operational databases.
• Exposure to data orchestration tools (e.g., Airflow, Step Functions) and streaming technologies (Kafka advantageous).
• Familiarity with Salesforce, TIA, or other insurance-related data systems would be highly beneficial.
• Experience working in Agile environments with Git-based version control and CI/CD tools.

Preferred Qualifications:

• Degree in Computer Science, Information Systems, Data Engineering, or related field.
• AWS Certified Data Engineer / Databricks Certified Data Engineer Associate (advantageous).

* In order to comply with the POPI Act, for future career opportunities, we require your permission to maintain your personal details on our database. By completing and returning this form you give PBT your consent

* If you have not received any feedback after 2 weeks, please consider you application as unsuccessful.