Job Description
Were hiring an experienced Azure Data Engineer to design, build, and scale our nextgeneration data platform for private lending. Youll own robust ETL/ELT pipelines using Azure Data Factory, Databricks (Delta Lake), Synapse Analytics, and ADLS Gen2integrating structured and semistructured data from core lending systems, CRM, payment gateways, credit bureaus, and thirdparty REST APIs. Youll collaborate with data scientists, BI developers, and risk/compliance teams to deliver analytics for risk modeling, portfolio performance, collections, and regulatory reporting.
What Youll Do (Key Responsibilities)
- Design & Build Pipelines: Develop scalable, secure ADF pipelines and Databricks notebooks for batch and nearrealtime ingestion and transformations; implement medallion architecture (Bronze/Silver/Gold) on ADLS Gen2/Delta.
- REST API Integrations: Implement robust API ingestion with OAuth2, pagination (cursor/offset), retry/backoff, error handling, idempotent upserts, and incremental watermarks.
- Data Modeling & ELT: Build curated fact/dimension models (loan, repayment, collateral, delinquency) optimized for Synapse/Power BI; implement SCD Type 2, partitioning, and schema evolution.
- SQL Excellence: Author highperformance TSQL (stored procedures, views, indexing strategies, MERGE/upserts) for transformations, reconciliations, and regulatory extracts.
- OnPrem to Cloud: Modernize/replace SSIS packages with ADF/Data Flows or Databricks; orchestrate dependencies and schedules.
- CDC & Streaming: Implement CDC from SQL Server or file drops (Auto Loader), handling latearriving data and deduplication.
- Security & Governance: Apply Managed Identity, Key Vault, RBAC/ACLs, encryption at rest/in transit, and PII controls; integrate with Purview for lineage and catalog.
- Observability: Configure Log Analytics, dashboards, and alerting for ADF/Databricks/Synapse; drive reliability and cost optimization.
- DevOps: Use Azure DevOps (Git + YAML pipelines) for CI/CD across ADF/Databricks/Synapse; implement environment promotion and configuration as code.
- Stakeholder Collaboration: Partner with product, risk, finance, and compliance teams to translate requirements into robust data solutions and SLAs.
Requirements
- 68 years in Data Engineering with at least 3+ years on Azure (ADF, Databricks, Synapse, ADLS Gen2).
- Strong SQL/TSQL: complex joins, window functions, dynamic SQL, stored procedures, performance tuning, and MERGE/upserts.
- Handson with SQL Server and SSIS (migration/modernization to ADF preferred).
- Proven REST API integration experience: authentication (OAuth2, client credentials), pagination, throttling/rate limits, retries, and incremental ingestion.
- Expertise with Databricks (PySpark) and Delta Lake (ACID, time travel, schema evolution, optimize/vacuum).
- Experience building data models and curated layers for BI/analytics; familiarity with Synapse Serverless/Dedicated.
- Solid grasp of data quality (validations, reconciliations), error handling, and observability.
- Strong understanding of data security (PII, masking, encryption, access controls) and complianceoriented design.
- CI/CD with Azure DevOps (repos, branching, pull requests, pipelines).
- Excellent communication and ownership mindset in crossfunctional environments.
NicetoHave (Good to Bring)
- Domain knowledge in lending/fintech, e.g., loan origination/servicing, delinquency, collections, vintage/roll rate analytics, regulatory reporting.
- Python for orchestration/helpers, Power BI exposure, or Event Hub/Functions for event ingestion.
- Purview (glossary, lineage), Great Expectations/Deequlike data quality frameworks.
- Cost optimization (cluster sizing, partitioning/file size best practices, serverless vs dedicated tradeoffs).
- Experience with infrastructureascode (Bicep/Terraform) is a plus.
How to Apply
Click the green “Go Apply” button below to apply directly online with the employer.
About Other IT/Computer Jobs in Gauteng
The IT and computer industry is one of the most dynamic and growing sectors in Gauteng, with a thriving job market that offers a wide range of opportunities for career advancement.
In terms of salary ranges, IT professionals in Gauteng can expect to earn anywhere from R800 000 per annum for junior positions to over R2 million for senior executives. The average salary for software engineers is around R1.5 million, while data analysts can earn between R900 000 and R1.2 million. With experience and skills, IT professionals in Gauteng can expect significant salary increases, with some roles offering bonuses and benefits that can increase their overall remuneration.
To succeed in the IT industry in Gauteng, candidates need to possess a range of key skills, including programming languages such as Java, Python, and C++, as well as experience with databases, cloud computing, and cybersecurity. Strong problem-solving skills, attention to detail, and excellent communication skills are also essential for success in this field. Additionally, knowledge of ITIL (Information Technology Infrastructure Library) and Agile methodologies can be highly valued by employers.
Several major companies and industries in Gauteng are currently hiring IT professionals, including technology firms such as Microsoft, IBM, and Oracle, as well as banks and financial institutions like Standard Bank and Nedbank. The finance industry is also a significant employer of IT staff, with roles ranging from software development to data analytics and cybersecurity.
Career growth opportunities are abundant in the IT industry in Gauteng, with many companies investing heavily in employee training and development programs. With experience and skills, IT professionals can move into senior leadership positions or start their own businesses, while also pursuing further education and certifications. The Johannesburg Stock Exchange (JSE) is also a significant employer of IT staff, with roles ranging from software development to data analytics and cybersecurity.
Overall, the IT industry in Gauteng offers a wide range of exciting career opportunities for job seekers with the right skills and experience. With salaries that are competitive with those offered by major companies globally, there has never been a better time to pursue a career in this dynamic and rapidly evolving field.
This information provides general career guidance. Actual salaries and requirements vary by employer.
GO APPLY NOW
Safe & secure application process
Explore More Opportunities
Get Similar Job Alerts
Job Seeker Tip
Create a professional email address for job hunting - avoid nicknames or casual addresses.
How to Apply
Click “GO APPLY NOW” to visit the company’s application page.
Follow their instructions carefully.
JVR Jobs connects you with employers – we don’t process applications directly.
Latest Job Opportunities
Kempton Park: Fitter & Turner posted by Wipcorp Project Management
Fitter & Turner Qualified Fitter & Turner Knowledge of Pneumatics, Electrical & Mechanics essential Able to work under pressure &…
View JobMilnerton: Vehicle Sales Executive posted by Stiles Recruit
We are seeking a motivated and results-driven Used Vehicle Sales Executive to join our Automotive Group. The successful candidate will…
View JobPretoria: Financial Controller (FN24) / Finansiële Kontroleerder (FN24) posted by Werkie
(Eng= Financial Controller Our client is seeking a detail-oriented and reliable Financial Controller to join their finance team. This role…
View JobJohannesburg: Security Technician & Installer posted by HR Group
We are seeking an experienced and reliable Security Technician and Installer to join our team. The successful candidate will be…
View JobGauteng: Security Technician & Installer posted by HR Group
We are seeking an experienced and reliable Security Technician and Installer to join our team. The successful candidate will be…
View JobEkurhuleni: Code 14 with PrDP & DGP posted by Dynamic Outsourced Solutions Pty. Ltd
We are looking for 30x Code 14 Drivers with PrDP & Hazchem Minimum of 5 years driving experience of which…
View Job
Browse Employers
Job Alerts