South Africa: Senior Cloud Data Engineer – Remote posted by Recruit-It
Posted on 2025-04-30 00:00:00
| Employer | Recruit-It |
|---|---|
| Category | Automotive Technician |
| Location | South Africa / South Africa |
Job Summary
Data Engineering & Cloud Solutions
– Architect, build, and optimize scalable and cloud-agnostic data solutions using Azure, Databricks, Spark, Lakehouse, and Delta Lake tables.
– Develop, implement, and maintain big data pipelines for ingesting, processing, and storing large volumes of structured and unstructured data.
– Manage and optimize data lake and data warehouse architectures for performance, cost, and scalability.
Cloud & DevOps
– Work within Azure environments (Azure Synapse, Data Factory, ADLS, etc.) to develop and maintain cloud-based data solutions.
– Implement best DevOps practices for CI/CD pipelines, infrastructure-as-code, and automation.
– Utilize Azure DevOps and Git for managing code repositories, version control, and continuous integration/deployment.
– Ensure high levels of security, compliance, and data governance across data engineering processes.
Big Data Processing & Development
– Utilize Spark, Databricks, and distributed computing to process and analyse large datasets efficiently.
– Write advanced Python and T-SQL scripts for data transformations, ETL/ELT processes, and real-time data processing.
– Optimize performance for data pipelines and SQL queries for efficiency and cost-effectiveness.
– Experience with Graph databases is a big advantage.
Collaboration & Leadership
– Work closely with data scientists, analysts, and business stakeholders to understand data requirements and develop solutions that meet business objectives.
– Lead initiatives to enhance data engineering capabilities, introduce new technologies, and drive best practices.
– Mentor junior engineers, conduct code reviews, and contribute to building a culture of technical excellence.
– Communicate effectively with technical and non-technical stakeholders, translating complex data concepts into actionable insights.
Required Qualifications:
– 6+ years of extensive experience.
– Education / Degrees: Computer science degree or comparable data engineering certification in one of the cloud platforms.
Minimum required skills and experience:
– Extensive experience in cloud-based data engineering, with expertise in Azure (Azure Synapse, Azure Data Factory, ADLS, etc.).
– Strong expertise in cloud-agnostic data tools such as Databricks, Spark, Delta Lake, and Lakehouse architectures.
– Advanced proficiency in T-SQL and Python for developing complex data pipelines, transformations, and optimizations.
– Hands-on experience in big data processing, ETL/ELT, and data pipeline orchestration.
– Solid understanding of data modelling, warehouse design, and data lakehouse architecture.
– Experience in setting up, managing, and processing with Azure DevOps (or similar DevOps tools).
– Strong knowledge of DevOps, CI/CD, Git, and infrastructure-as-code for automated deployments.
– Excellent verbal and written communication skills, with the ability to collaborate across teams and explain complex data concepts clearly.
– Ability to work independently on high-impact projects while maintaining a team-oriented approach.
Added Advantage
– Experience with containerization technologies (Docker, Kubernetes) for data processing workloads.
– Knowledge of data security, encryption, and compliance regulations related to big data.
– Exposure to machine learning and AI pipelines within data engineering workflows.
– Experience working with multi-cloud environments (AWS, GCP) alongside Azure.
Why you’ll love working for this company.
The company believes in taking care of their team and creating an environment where you can thrive. As part of our company, you’ll enjoy:
– Flexible Working Arrangements: Whether you’re a night owl or an early bird, they offer hybrid and remote options to suit your lifestyle.
– Comprehensive Benefits: From a wellness program to home office reimbursements and continuous learning opportunities, they have got you covered.
– Team Culture: Fun team-building activities, regular socials, and a supportive, inclusive culture that values transparency, accountability, and work-life balance.
– Performance Incentives: Competitive salaries, ESOP, and recognition for your hard work.
Click Go Apply to apply online!
Get Similar Job Alerts
More jobs in South Africa
More jobs in South Africa
Browse Automotive Technician Jobs
Browse Recruit-It Jobs
Apply directly for this position. Please read all instructions carefully.
We do not process job applications; we simply aggregate and display job listings.
More related positions
Umhlanga: HR Specialist posted by SUNLINE SUPPLY CHAIN SOUTH AFRICA(PTY) LTD
1. Support organizational stuff by establishing a recruiting and interviewing program, analyzing exit interviews and recommending changes2. Enhance the...
View Job
HR Specialist
Gauteng: Business Development Mananger – Urgently Needed posted by Sodexo Southern Africa
Join Our Dynamic Sales Team at Sodexo Southern Africa!Are you passionate about building relationships and introducing businesses to a company that truly...
View Job
Business Development Mananger – Urgently Needed
Durban South: Admin Analyst Assistant – Urgently needed posted by South African Inland Logistics
We are seeking a highly skilled and detail-oriented Admin Analyst Assistant to join our team. The ideal candidate must be exceptionally proficient in...
View Job
Admin Analyst Assistant – Urgently needed
George: Administrative Assistant posted by The National Employers Association of South Africa
The National Employers Association of SA NEASA seeks the services of an Administration Assistant in George. Minimum requirementsFluent in both English and...
View Job
Administrative Assistant
Johannesburg West: Technical Sales Executive Welding posted by the recruitment agency of south africa
Technical Sales Executive Welding Welding ConsumablesLocation Honeydew, South AfricaSalary R20,000 CommissionIndustry Welding Welding ConsumablesAre you...
View Job
Technical Sales Executive Welding
Johannesburg West: Senior Signage Installer – Urgently needed posted by the recruitment agency of south africa
Senior Signage Installer Kya Sands, JohannesburgSalary Market-related based on experienceWere looking for a skilled Senior Signage Installer with 5 years...
View Job
Senior Signage Installer – Urgently needed
South Africa: Farm Manager – Sub Tropical Fruits (AVOCADOS)
Minimum requirements Relevant DegreeDiploma required Previous experience in Farm Management with subtropical fruits, specifically Avocados is required...
View Job
Farm Manager – Sub Tropical Fruits (AVOCADOS)
South Africa: Bookkeeper
Responsibilities include keeping financial records updated, preparing reports and reconciliation bank statements. Required outputs Functional -...
View Job
Bookkeeper
South Africa: Front of House Manager
Set in the heart of a pristine private nature reserve, this exclusive luxury lodge offers a seamless blend of world-class hospitality and immersive...
View Job
Front of House Manager
South Africa: Digital Marketing Data Analyst
Epping Industrial, Cape Town R30,000 R35,000 per month Are you a data-driven professional with a sharp eye for patterns and trends? Were looking for an...
View Job
Digital Marketing Data Analyst
South Africa: Business Development Manager
Job Advertisement Business Development Manager Location Remote Anywhere in South Africa Salary R25,000 - R30,000 per month Working Hours 8am - 5pm UK Time...
View Job
Business Development Manager
South Africa: NDT Technician Level 2 (Vanderbijlpark)
The NDT Technician Level 2 must have a Matric N3 and NDT Level II Certification, UT, MT, PT Certification. 5 to 10 years experience having worked in a...
View Job
NDT Technician Level 2 (Vanderbijlpark)
South Africa: Online Sales Key Account Manager (CPT)
ENVIRONMENT A dynamic Mobile Specialist seeks a highly confident, proactive digitally savvy individual to join their Sales team in Cape Town as an Online...
View Job
Online Sales Key Account Manager (CPT)
South Africa: Logistics Manager (CPT Onsite)
ENVIRONMENT MANAGE the Logistics Department including all deliveries, dispatching and personnel as the next Logistics Manager sought by a dynamic...
View Job
Logistics Manager (CPT Onsite)
South Africa: Receptionist / Guest Relations
Reception Duties Customer Service Reception Greeting and Welcoming Greet members and guests warmly and professionally. Answering Inquiries Answer phone...
View Job
Receptionist / Guest Relations
South Africa: Automation Technician
Employment Type Permanent, Full-Time Salary Benefits CTC Negotiable R2,000 monthly medical aid contribution 7.5 company contribution to provident fund Use...
View Job
Automation Technician
South Africa: Laboratory Technician
Key Performance Areas Testing and administering of raw material and finished product samples Working, maintaining and generating reports from the NIR...
View Job
Laboratory Technician
South Africa: Customer Success Agent – GERMAN SPEAKING – Onsite – CPT
A Germany-based company dedicated to driving innovation for growth is looking for a German-speaking not negotiable Customer Success Agent to join their Cape...
View Job
Customer Success Agent – GERMAN SPEAKING – Onsite – CPT
South Africa: SENIOR HOUSEKEEPERING MANAGER (LIVE-IN)
RedCat Recruitment is seeking an experienced SENIOR HOUSEKEEPERING MANAGER LIVE-IN for a well-established, growing concern, position based in the...
View Job
SENIOR HOUSEKEEPERING MANAGER (LIVE-IN)
South Africa: OPERATIONS MANAGER (RETAIL, FOODS & BEVERAGE) – KZN MIDLANDS
RedCat Recruitment is seeking an experienced OPERATIONS MANAGER RETAIL, FOODS BEVERAGE for a well-established, growing concern, position based in the...
View Job
OPERATIONS MANAGER (RETAIL, FOODS & BEVERAGE) – KZN MIDLANDS
South Africa: Inventory Co-ordinator
Raw Material Intake Capturing and management of PORs Stock Take Planning and coordinating of Raw Material General Inventory Administration Reports daily,...
View Job
Inventory Co-ordinator
South Africa: Clearing and Forwarding Manager
Clearing and Forwarding Manager Airport Industria Well established Clearing and Forwarding company are looking for a Clearing and Forwarding Manager....
View Job
Clearing and Forwarding Manager
South Africa: Debtors Clerk
Our well-established client in the retail industry is looking for a Debtors Clerk to join their team. Duties and responsibilities include but are not...
View Job
Debtors Clerk
South Africa: Revenue Accountant – Century City
The Revenue Accountants role is to ensure that a companys revenue is accurately tracked, billed and reported, providing transparency for stakeholders and...
View Job
Revenue Accountant – Century City
South Africa: Retail Debtors Finance Consultant
REQUIREMENTS Matric, with relevant tertiary qualification advantageous Customerfocused to understand and address customer concerns Highly organised as to...
View Job
Retail Debtors Finance Consultant