Data Engineer: BI: BPO: Cape Town CBD: Perm The call is for a Data Engineer to lead the development, maintenance, support, and integration of our expanding array of data sources into Azure-hosted SQL data warehouse, and the Power BI platform In this role, you will oversee the technical aspects of Reporting & BI solutions within the Technology team at, providing robust reporting capabilities to support Commercial, Operational, and Finance functions You will possess a deep understanding of data structure, analysis, modelling, and management to drive a technical agenda and data roadmap. Your focus will be on designing and enhancing the data platform primarily using Azure cloud technologies like ADF, Azure Synapse Analytics, and Power BI Premium features The client is experiencing ongoing growth and requires continual enhancement of our dataset, analysis, and reporting capabilities to achieve our vision of becoming the cruise industry’s retail partner of choice Reporting across supply chain, finance, commercial, and operational areas is essential, making a background in retail or wholesaling business highly beneficial Key Performance Areas: Data Warehouse Optimisation: • Performance Tuning: Analyse, optimise, and refactor existing stored procedures, ETL jobs, and data workflows to improve performance and reduce load times on the current data warehouse • Capacity Management: Clean up and enhance the efficiency of the current Power BI Premium (P1) instance, ensuring optimal resource allocation and utilization as data volumes and complexity grow • Job Scheduling & Monitoring: Review and maintain the scheduling of data jobs to ensure timeliness and reliability, improving operational processes to meet evolving business needs • Data Quality & Governance: Implement data quality checks, governance, and performance monitoring for both ETL processes and reporting outputs • Operational Support: Provide ongoing support for the existing data platform, responding to and resolving performance issues, data quality concerns, and user queries • Migration Leadership & Futureproofing: • Cloud Migration Strategy: Lead and actively execute the long-term migration of the on-premises data warehouse to Microsoft Fabric, including hands-on development and implementation of a robust strategy for transitioning datasets, ETL pipelines, and reporting solutions to the cloud • ETL & Pipeline Development: Build scalable ETL processes using Azure Data Factory, Azure Synapse, and other Fabric-native tools, ensuring a smooth integration between the on-prem and future cloud environments • Cloud Infrastructure Design: Design and implement Azure-based data architecture, leveraging tools like Azure Data Lake, Azure Synapse Analytics, and Fabric’s data capabilities to future-proof the platform • Azure Expertise: Utilize Azure tools such as Synapse Analytics, Logic Apps, and Azure Functions to streamline data processing and orchestration across the business End-User Reporting & Analytics: • Power BI Optimisation: Lead optimization efforts in Power BI, leveraging Power BI Premium features such as incremental refresh, paginated reports, and composite models to enhance reporting performance and scalability • DAX and Data Modelling: Write advanced DAX and perform complex data modelling within Power BI to support high-quality, dynamic reporting • Self-Service BI: Empower stakeholders to build their own reports and dashboards by enhancing data accessibility and developing self-service capabilities Essential Knowledge, Skills, and Experience: • Data Warehouse Expertise: Extensive experience in maintaining and optimizing on-premises SQL Server data warehouses, focusing on stored procedures, indexing, partitioning, and load performance • Azure Cloud Proficiency: Deep understanding of Azure cloud tools such as Azure Synapse Analytics, Azure Data Lake, Azure Data Factory, and Logic Apps • Microsoft Fabric: Hands-on experience with Microsoft Fabric or similar modern cloud platforms, with a strong focus on data migration strategies and ETL development • Advanced SQL & Python: Proficiency in writing advanced SQL queries, stored procedures, and Python scripts for data manipulation, pipeline development, and automation • ETL & Data Pipelines: Experience with ETL tools (both on-prem like SSIS, and cloud-based like Azure Data Factory) for creating, optimising, and maintaining data pipelines • Power BI Premium: Skilled in Power BI Premium, including data modelling, DAX, performance tuning, and advanced reporting features like composite models and incremental refresh? Data Governance & Security: Strong understanding of data governance, security best practices, and compliance requirements (GDPR) • Experience working with Agile methodologies • Stakeholder Communication: Excellent communication skills, capable of collaborating with both technical and non-technical stakeholders to translate business needs into effective data solutions Advantageous Experience: • Experience with Microsoft Dynamics 365 Business Central • Experience of defining and operating within data management best practice frameworks • Experience working in a Retail environment Apply:
