| Date | 2024-06-11 |
|---|---|
| Job Title | Data Engineer |
| Employer | More Information |
| Salary | |
| Category | It Computing Software |
| Location |
North Johannesburg / Sandton |
Job Summary
Job Purpose The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Company Data Architecture Roadmap, to advance technical thought leadership for the Enterprise, deliver fit for purpose data products, and support data initiatives. In addition, Data Engineers enhance the data infrastructure of the bank to enable advanced analytics, machine learning and artificial intelligence by providing clean, usable data to stakeholders. They also create data pipelines, Ingestion, provisioning, streaming, self service, API and solutions around big data that support the Bank`s strategy to become a data driven organisation. Job Responsibilities Responsible for the maintenance, improvement, cleaning, and manipulation of data in the bank`s operational and analytics databases. Data Infrastructure: Build and manage scalable, optimised, supported, tested, secure, and reliable data infrastructure eg using Infrastructure and Databases (DB2, PostgreSQL, MSSQL, HBase, NoSQL, etc), Data Lakes Storage (Azure Data Lake Gen 2), Cloud-based solutions (SAS , Azure Databricks, Azure Data Factory, HDInsight), Data Platforms (SAS, Ab Initio, Denodo, Netezza, Azure Cloud). Ensure data security and privacy in collaboration with Information Security, CISO and Data Governance Data Pipeline Build (Ingestion, Provisioning, Streaming and API): Build and maintain data pipelines to: create data pipelines for data integration (Data Ingestion, Data Provisioning and Data Streaming) utilising both On Premise tool sets and Cloud Data Engineering tool sets. efficiently extract data (Data Acquisition) from Golden Sources, Trusted sources and Writebacks with data integration from multiple sources, formats and structures. load the Company Data Warehouse (Data Reservoir, Atomic Data Warehouse, Enterprise Data Mart) provide data to the respective Lines of Business Marts, Regulatory Marts and Compliance Marts through self service data virtualization. provide data to applications or Company Data consumers transform data to a common data model for reporting and data analysis, and to provide data in a consistent, useable format to Company data stakeholders handle big data technologies (Hadoop), streaming (KAFKA) and data Replication (IBM Inphosphere Data Replication) drive utilization of data integration tools ( Ab Initio) and Cloud data integration tools (Azure Data Factory and Azure Data Bricks) Data Modelling and Schema Build: In collaboration with Data Modelers, create data models and database schemas on the Data Reservoir, Data Lake, Atomic Data Warehouse and Enterprise Data Marts. Company Data Warehouse Automation: Automate, monitor and improve the performance of data pipelines. Collaboration: Collaborate with Data Analysts, Software Engineers, Data Modelers, Data Scientists` Scrum Masers and Data Warehouse teams as part of a squad to contribute to the data architecture detail designs and take ownership of Epics end-to-end and ensure that data solutions deliver business value. Data Quality and Data Governance: Ensure that reasonable data quality checks are implemented in the data pipelines to maintain a high level of data accuracy, consistency and security. Performance and Optimisation: Ensure the performance of the Nedbank data warehouse, integration patterns, batch and real time jobs, streaming and API`s. API Development: Build API`s that enable the Data Driven Organisation, ensuring that the data warehouse is optimised for API`s by collaborating with Software Engineers. Essential Qualifications – NQF Level Advanced Diplomas/National 1st Degrees Preferred Qualification Field of Study: BCom, BSc, BEng Preferred Certifications Cloud (Azure, AWS), DEVOPS or Data engineering certification. Any Data Science certification will be an added advantage, Coursera, Udemy, SAS Data Scientist certification, Microsoft Data Scientist. Minimum Experience Level Total number of years of experience:3 – 6 years Type of experience: Experienced at working independently within a squad and has the demonstrated knowledge and skills to deliver data outcomes without supervision. Experience designing, building, and maintaining data warehouses and data lakes. Experience with big data technologies such as Hadoop, Spark, and Hive. Experience with programming languages such as Python, Java, and SQL. Experience with relational databases and NoSQL databases. Experience with cloud computing platforms such as AWS, Azure, and GCP. Experience with data visualization tools. Result-driven, analytical creative thinker, with demonstrated ability for innovative problem solving. Technical / Professional Knowledge Cloud Data Engineering (Azure , AWS, Google) Data Warehousing Databases (PostgreSQL, MS SQL, IBM DB2, HBase, MongoDB) Programming (Python, Java, SQL) Data Analysis and Data Modelling Data Pipelines and ETL tools (Ab Initio, ADB, ADF, SAS ETL) Agile Delivery Problem solving skills
Data Engineer position available in North Johannesburg, Sandton. This job position was posted by . The job has been posted on 2024-06-11 in the It Computing Software category
Click Go Apply to apply online!
You might also like to look at the available jobs in the same area.
Apply directly for this position
Some posts have contact information included with other instructions. All applicants are urged to read the instructions carefully.
We will list jobs at the bottom of each job, so feel free to scroll down and continue your search.
We do not accept any job applications and merely offer the service of daily jobs being mined and displayed on our job portal.
Each job post has a link to take you directly to the original post to apply on their website or the original website where the post came from.
Here are some more related positions
Pietermaritzburg: Urgent Vacancy Jnr. Developer €“ Data Engineer Camperdown, Kzn – Ms Sql Essential To Post posted by Doncour Recruitment
URGENT VACANCYJNR. DEVELOPER DATA ENGINEERCAMPERDOWN, KZNResponsible for assisting the IT and IS support personnel in solving technical problems when required.The comprehensive documentation of new and existing systems at a technical level development of
View Job
Urgent Vacancy Jnr. Developer €“ Data Engineer Camperdown, Kzn – Ms Sql Essential To Post
Johannesburg: Azure Data Engineer – Johannesburg – Up To R1mil Per Annum
A long serving bank known as Africa``s biggest lender of assets and financial services group committed to providing banking insurance and asset management services have an open role for a Cloud Data Engineer to execute data engineering duties according to
View Job
Azure Data Engineer – Johannesburg – Up To R1mil Per Annum
Pretoria: Aws Data Engineer (Senior) 2517
ESSENTIAL SKILLS REQUIREMENTS: Exceptional experience/understanding (in order of importance): Terraform Python 3x SQL - Oracle/PostgreSQL Py Spark Boto3 ETL Docker Linux / Unix Big Data Powershell / Bash Experience in working with Enterprise Collaboration
View Job
Aws Data Engineer (Senior) 2517
Johannesburg: Data Engineer
What you will be doing / What we are looking for: Data Engineer skill is required to enable the data lifecycle within EDS, namely the ability to integrate data between source system (golden/trusted) and the target database (LOB), hence provide good quality
View Job
Data Engineer
Johannesburg: Intermediate Data Engineer – Johannesburg – Up To R700k Per Annum
A company at the forefront of innovation in the telecommunications industry, priding themselves in providing cutting-edge services and solutions that enhance connectivity and empowering their clients seek the services of an Intermediate Data Engineer who w
View Job
Intermediate Data Engineer – Johannesburg – Up To R700k Per Annum
Johannesburg: Azure Data Engineer – Johannesburg – R800k Up To R1mil Per Annum
A long serving bank known as Africa``s biggest lender of assets and financial services group committed to providing banking insurance and asset management services have an open role for a Data Engineer to execute data engineering duties according to the st
View Job
Azure Data Engineer – Johannesburg – R800k Up To R1mil Per Annum
Pretoria: 2050 – Aws Data Engineer
ESSENTIAL SKILLS REQUIREMENTS: Above average experience/understanding (in order of importance): e.g. Technical Skills / Technology Terraform Python 3x SQL - Oracle/PostgreSQL Py Spark Boto3 ETL Docker Linux / Unix Big Data Powershell / Bash BMW Cloud Data
View Job
2050 – Aws Data Engineer
Stellenbosch: Senior Data Engineer
Required Qualifications: Bachelor`s or Honours degree in Computer Science, Software Engineering, Information Systems, or a related field. 4 to 5 years of experience in data engineering, database administration, or a related field. Proficiency in SQL and ex
View Job
Senior Data Engineer
Johannesburg: Tj 415904 – Etl Developer/Data Engineer (Office Based)
Employer Description IT consulting company with the focus on BI & Data Management Job Description Contribute to the design, build and implementation of the mapping, ETL programming from the source systems to the Data Warehouse. Provide world class services
View Job
Tj 415904 – Etl Developer/Data Engineer (Office Based)
Johannesburg: Data Engineer – Johannesburg – Up To R900k
A Group providing value conscious mass markets in Southern Africa and creating opportunities and comfortable lifestyles, through its diversified retail and consumer finance businesses are in search of a Data Engineer with the capabilities of utilising data
View Job
Data Engineer – Johannesburg – Up To R900k
Johannesburg: Cloud Engineer: Database Services (Hybrid)
Job Responsibilities Engage and collaborate with Infrastructure Designers and Platform Owners to review and approve cloud template and patterns Conduct logical deployments of cloud configuration/s Automate cloud services Collaborate with Public Cloud Provi
View Job
Cloud Engineer
Midrand: Cloud Database Engineer (Senior)
ESSENTIAL SKILLS REQUIREMENTS: - Experience with Oracle database architecture, automation, and performance tuning. - Expert knowledge of cloud architectures with a focus on databases. - Experience with Oracle Cloud Infrastructure, autonomous database on sh
View Job
Cloud Database Engineer (Senior)
Midrand: Cloud Database Engineer (Senior)
Essential Skills Requirements: - Analytical Expertise: Highly skilled in cloud database engineering. - Migration Experience: Critical role in migrating on-prem workloads to OCI, Azure, and AWS platforms. - Design & Implementation: Ability to design and imp
View Job
Cloud Database Engineer (Senior)
Johannesburg: Cloud Engineer – Database Services
a Giant in the banking sector is on the search for a Cloud Engineer (Database Services) to join their team and to work with world class technologies. To implement and maintain the the company`s private and hybrid cloud environments in line with their Cloud
View Job
Cloud Engineer – Database Services
Johannesburg: Aws Data Cloud Engineer (Big Data Engineer)
A leader in the insurance space is on the lookout for a AWS Data Cloud Engineer (big Data Engineer) Knowledge /Qualifications High knowledge in AWS – security groups, permissions, VPC, roles, services. Experience developing engineering applications in C
View Job
Aws Data Cloud Engineer (Big Data Engineer)
Johannesburg: Aws Data Cloud Engineer
What you will be doing: Coordinate/Prioritize the work that the Developers and PO Assist with cross-team projects that involve development AWS practices are followed with sound security and governance. Coordinate with the cloud COE team for any AWS account
View Job
Aws Data Cloud Engineer
Johannesburg: Cloud Engineer: Database Services
Job Purpose To implement and maintain the companys private and hybrid cloud environments in line with company`s Cloud Strategy in order to optimise IT expenditure and deliver efficiencies through automation. Job Responsibilities Engage and collaborate with
View Job
Cloud Engineer
Johannesburg: Senior Cloud Engineer: Database Services
Job Responsibilities Engage and collaborate with Infrastructure Designers and Platform Owners to review and approve cloud template and patterns Conduct logical deployments of cloud configuration/s Automate cloud services Collaborate with Public Cloud Provi
View Job
Senior Cloud Engineer
Johannesburg: Junior Data Engineer
A Leader in the Financial and Banking sector is on the look-out for a Junior Data Engineer. The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Company`s Data Architecture Roadmap, to advance
View Job
Junior Data Engineer
Pretoria: Cloud Database Engineer – 2509
ESSENTIAL SKILLS REQUIREMENTS: · We are looking for a highly skilled, analytical Cloud Database Engineer to join our team at BMW Hub South Africa. You will play a critical role in migrating our on-Prem workloads to our databases hosted on OCI (Oracle Cloud
View Job
Cloud Database Engineer – 2509
Midrand: Junior Data Engineer
The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the companys Data Architecture Roadmap, to advance technical thought leadership for the Enterprise, deliver fit for purpose data products, and
View Job
Junior Data Engineer
Sandown: Cloud Engineer: Database Services
Job Purpose To implement and maintain the Companies private and hybrid cloud environments in line with Companies Cloud Strategy in order to optimise IT expenditure and deliver efficiencies through automation. Job Responsibilities Engage and collaborate wit
View Job
Cloud Engineer
Johannesburg: Azure Data Engineer – Johannesburg – R900k Up To R1.1 Mil Per Annum
A long serving bank known as Africa``s biggest lender of assets and financial services group committed to providing banking insurance and asset management services have an open role for a Data Engineer to execute data engineering duties according to the st
View Job
Azure Data Engineer – Johannesburg – R900k Up To R1.1 Mil Per Annum
Sandown: Junior Data Engineer
Job Purpose The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Company Data Architecture Roadmap, to advance technical thought leadership for the Enterprise, deliver fit for purpose data pro
View Job
Junior Data Engineer
Middelburg: Data Engineer
Job Description: The integration of data from multiple sources: organized, disorganized, structured and/or unstructured, into a centralized data repository. Creating and evolving data models, schemas and repositories to efficiently store and process data,
View Job
Data Engineer