Johannesburg: Senior Data Engineer posted by OttoBauthentic
Posted on 2025-08-25 00:00:00
Employer | OttoBauthentic |
---|---|
Category | Other IT/Computer |
Location | Gauteng / Johannesburg |
Job Summary
Job Summary:
- To lead the design, development, and governance of the companys enterprise data infrastructure, transitioning from the current SSIS-based ETL environment to a modern, scalable, Azure-based cloud data warehouse.
- This role is strategic and collaborative, requiring close engagement with business leaders, BI developers, analysts, and IT teams to ensure data solutions are business-aligned, governance-compliant, and ready for advanced analytics.
- As a senior member of the team, the role will mentor junior data engineers, influence architectural decisions, and champion best practices across the organisation.
Key Responsibilities:
Data Warehouse Architecture & Leadership
- Lead the architectural design and implementation of the new Azure-based data warehouse.
Oversee the optimisation of the existing SSIS-based ETL environment during the transition phase.
Establish long-term data platform strategy in collaboration with BI and IT leadership.
Data Governance & Compliance
- Own the data governance framework, ensuring standards for data quality, security, lineage, and access control are embedded in all solutions
- Partner with compliance and legal teams to meet regulatory requirements for data storage and processing.
- Champion the use of data cataloguing and metadata management tools.
Collaboration & Stakeholder Engagement
- Work directly with senior stakeholders across business units to translate needs into actionable technical solutions.
- Serve as the primary point of contact between the BI team, engineering, and external vendors for data infrastructure matters.
- Facilitate workshops, architectural reviews, and cross-team solution design sessions.
Technical Delivery & Mentorship
- Lead the build, testing, and deployment of robust ETL/ELT pipelines for multi-source integration.
- Ensure smooth migration of historical and real-time data to the new warehouse with minimal downtime.
- Mentor and support junior and mid-level engineers in technical best practices and solution delivery.
Performance Monitoring & Continuous Improvement
- Implement platform monitoring solutions to track and optimise performance.
- Drive continuous improvement in architecture, tooling, and governance processes
Required Skills and Qualifications:
EDUCATION
Mandatory:
- Bachelors degree in Computer Science, Information Systems, Data Engineering, or related field.
Preferred:
- Masters degree in Data Engineering, Computer Science, or related discipline.
- Business Management or Project Management certification to support stakeholder engagement and project oversight.
- Azure Data Engineer Associate or equivalent cloud certification.
- Data governance certification (DAMA, DCAM, or equivalent).
EXPERIENCE & SKILLS/PHYSICAL COMPETENCIES
Technical Experience
Mandatory:
- 5+ years in data engineering, with experience in data warehouse design and development.
- Strong hands-on experience with SSIS for ETL processes.
- Proven expertise in Azure Data Platform components (Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, Data Lake Storage).
- Strong SQL skills (T-SQL preferred).
- Experience implementing data governance principles, including data quality frameworks, security/access controls, and metadata management.
- Experience with data modeling (Kimball/Star Schema/Snowflake).
- Proficient in performance tuning and troubleshooting data processes.
Preferred:
- Experience with Python or other scripting languages for data processing and automation.
- Knowledge of Azure Purview or other data catalog solutions.
- Knowledge of Azure DevOps, CI/CD pipelines for data solutions.
- Power BI integration experience with Azure datasets.
Physical & Technical Competencies
- Ability to design and optimize complex ETL/ELT workflows.
- Strong understanding of data governance frameworks and compliance requirements.
- Proficient in working with large-scale data sets and high-volume data pipelines.
- Strong problem-solving skills with a focus on automation and efficiency.
- Proficient in version control tools (e.g., Git).
- Expertise in optimising data platforms for scale and performance.
- Ability to manage competing priorities across multiple projects
Click Go Apply to apply online!
Get Similar Job Alerts
More jobs in Johannesburg
More jobs in Gauteng
Browse Other IT/Computer Jobs
Browse OttoBauthentic Jobs
Apply directly for this position. Please read all instructions carefully.
We do not process job applications; we simply aggregate and display job listings.
More related positions
Johannesburg: Full Stack PHP Developer posted by Goldman Tech
Job DescriptionWe have an amazing opportunity for a Full Stack PHP Developer to work Remotely!We require a candidate withbull 3 year tertiary qualification...
View Job
Full Stack PHP Developer
Johannesburg: Copywriter posted by Goldman Tech
Job DescriptionWe have an amazing opportunity for a Copywriter at a reputable Bank in Johannesburg! A successful candidate will have 5 years copywriting...
View Job
Copywriter
Johannesburg: Full Stack Developer posted by Goldman Tech
Job DescriptionWe have an amazing remote opportunity for a Full Stack Developer!We require a candidate withbull BSc. Computer Sciences or National Diploma...
View Job
Full Stack Developer
Johannesburg: Data Engineer posted by Goldman Tech
Job DescriptionWe have an amazing opportunity for a Data Engineer in JohannesburgWe require a candidate withbull 3 year IT related degreebull 5-10 years...
View Job
Data Engineer
Johannesburg: Senior Product & Pricing Specialist posted by Goldman Tech
Job DescriptionWe have an amazing opportunity for an Insurance Company.We require a candidate withbull The following experience and qualification will be...
View Job
Senior Product & Pricing Specialist
Johannesburg: C# Developer posted by Goldman Tech
Job DescriptionWe have an amazing opportunity for a C Developer in Johannesburg!We require a candidate withbull Highly proficient in understanding and...
View Job
C# Developer
Johannesburg: Native iOS Developer posted by Goldman Tech
Job DescriptionWe have an amazing opportunity for a Native iOS Developer to work remotely!We require a candidate withbull Experience building iOS apps using...
View Job
Native iOS Developer
Johannesburg: Native Android Developer posted by Goldman Tech
Job DescriptionWe have an amazing opportunity for a Native Android Developer to work remotely!We require a candidate withbull Experience building Android...
View Job
Native Android Developer
Johannesburg: Senior IFRS Manager posted by Goldman Tech
Job DescriptionIf you have a keen interest for IFRS and are a qualified CASA with 5 years post article IFRS experience, then this the perfect opportunity...
View Job
Senior IFRS Manager
Johannesburg: Data Manager posted by Goldman Tech
Job DescriptionWe have an amazing opportunity for a Data Manager in JohannesburgWe require a candidate withbull Experience as a Data Managerbull...
View Job
Data Manager
Johannesburg: Senior Front End Developer posted by Goldman Tech
Job DescriptionWe have an amazing opportunity for Senior Front End Developer in JohannesburgWe require a candidate withbull Bachelors Degreebull 7 Years...
View Job
Senior Front End Developer
Johannesburg: General Tertiary Management posted by Smartstuff Solutions
Nationwide call for Tertiary Manager to apply. Please keep an eye on our Edustaff Facebook or LinkedIn page for up-to-date job listings.RequirementsReliable...
View Job
General Tertiary Management
Johannesburg: General Lecturing/Facilitation posted by Smartstuff Solutions
Nationwide call for Lecturer or facilitators to apply. Please keep an eye on our Edustaff Facebook or LinkedIn page for up-to-date job...
View Job
General Lecturing/Facilitation
Johannesburg: C#/Fullstack Developer posted by Goldman Tech
Job DescriptionWe have an amazing opportunity for a CFullstack Developer in Johannesburg!We require a candidate withbull BSc. Computer Sciences or National...
View Job
C#/Fullstack Developer
Johannesburg: Senior Front End Developer posted by Goldman Tech
Job DescriptionWe have an amazing opportunity for a Front End Developer in Johannesburg!We require a candidate withbull BSc. Computer Sciences or National...
View Job
Senior Front End Developer
Johannesburg: Full Stack Developer posted by Goldman Tech
Job DescriptionWe have an amazing opportunity for a Full Stack Developer!We require a candidate withbull BSc. Computer Sciences or National Diploma in...
View Job
Full Stack Developer
Johannesburg: Senior Java Developer posted by Goldman Tech
Job DescriptionWe have an amazing opportunity for a Senior Java developer in Johannesburg!We require a candidate withbull BSc. Computer Sciences or National...
View Job
Senior Java Developer
Johannesburg: Audit Senior posted by Goldman Tech
Job DescriptionRecently completed your articles and looking for a post article role? Stand-Out Staffing can help! One of our clients is looking for an...
View Job
Audit Senior
Johannesburg: Senior Data Analyst posted by Goldman Tech
Job DescriptionOne of our clients in Johannesburg is searching for an innovative senior data analyst to join their team. We require a candidate withbull...
View Job
Senior Data Analyst
Johannesburg: General Worker posted by Telebest
Our client has an exciting opportunity for a General Worker.RequirementsYou must reside close to or inGugulethtuPhilippiBelharElsies RiverBishop...
View Job
General Worker
Johannesburg: Data Analyst and Social Media Specialist posted by Goldman Tech
Job DescriptionWe have an amazing opportunity for a Data Analyst and Social Media Specialist in JohannesburgWe require a candidate withbull Relevant...
View Job
Data Analyst and Social Media Specialist
Johannesburg: Senior Developer – .NET, JSON, MSSQL posted by Goldman Tech
Job DescriptionWe have an amazing opportunity for a Senior Developer in JohannesburgWe require a candidate withbull Relevant IT qualificationbull 8 years...
View Job
Senior Developer – .NET, JSON, MSSQL
Johannesburg: React Native Developer posted by Goldman Tech
Job DescriptionWe have an amazing remote opportunity for a React Native Developer!We require a candidate withbull BSc Computer Sciences or National Diploma...
View Job
React Native Developer
Johannesburg: Senior DevOps engineer posted by Goldman Tech
Job DescriptionWe have an amazing remote opportunity for a Senior DevOps Engineer!We require a candidate withbull BSc Computer Sciences or National Diploma...
View Job
Senior DevOps engineer
Johannesburg: AVBOB Sales Team Leader posted by CallForce
Sales Team Leader Cape TownLead and manage a team of Call Centre Sales Agents to achieve exceptional results.Min 2 years contact Centre Team Leader...
View Job
AVBOB Sales Team Leader