| Date | 2024-06-08 |
|---|---|
| Job Title | Data Engineer Python (Cpt Hybrid) |
| Employer | Datafin More Information |
| Salary | 0 |
| Category | It Computer |
| Location |
Western Cape / Cape Town |
Job Summary
Cape Town – Western Cape
- Extracting data from current sources
- Data storing/transition for all data gathered for analytical purposes.
- Transformation: Cleaning, structuring, and formatting the data sets to make data consumable for processing or analysis.
- An all-round Data Engineer, understand what is required from the users and deliver an appropriate data driven technical solution
- Contribute to strategic design of the architecture of a data platform.
- Develop data systems tools, customize and manage integration tools, databases, warehouses, and analytical systems.
- Data pipeline maintenance/testing.
- Machine Learning algorithm deployment. Machine Learning models designed by Data Scientists, deployed into production environments, managing computing resources and setting up monitoring tools.
- Manage data and meta-data storage, structured for efficiency, quality and performance.
- Track pipeline stability.
- Monitor the overall performance and stability of the systems.
- Keep track of related infrastructure costs and manage these as efficiently as possible, continuously balancing performance and cost.
- Minimum of a Bachelor`s Degree in a Scientific or Engineering related field.
- Certification or experience with Agile or other development methodologies – Agile, Kanban or Scrum
- Ideally busy with or obtained AWS Certifications.
- Implementing data pipelines using cloud infrastructure and services.
- Intermediate to Advanced R, Python or SQL optimization, developing ETL strategies.
- Infrastructure: AWS (Kinesis, API Gateway, S3, DMS).
- Dev Tools: Git, Docker, Elastic Container Service (ECS), Elastic Kubernetes Service (EKS).
- Ability to conduct systems analysis and prepare requirement specifications concerning data-related business processes and systems.
- AWS analytics architecture experience will be a real advantage.
- Willingness to learn new technology and skills, figure it out attitude
- Dynamic, driven by results. Enjoy getting things done.
- A proactive, results-oriented, and can-do attitude is highly desirable
- Self-starter with the ability to successfully plan, organize, and execute assigned initiatives with minimal guidance and direction.
- Strong listening, problem-solving and analytical skills.
- Willing to take the initiative.
- Excellent written and verbal communication skills.
- Exhibits close attention to detail and is a champion for accuracy.
- High level of Integrity.
- Proven ability to meet deadlines, ability to multi-task effectively
- The ability and willingness to do a variety of different tasks.
Data Engineer Python (Cpt Hybrid) position available in Western Cape, Cape Town. This job position was posted by Datafin. The job has been posted as a premium ad on 2024-06-08 at 16:10:34 in the It Computer category
Click Go Apply to apply online!
You might also like to look at the available jobs in the same area.
Apply directly on jobmail for this position
Some posts have contact information included with other instructions. All applicants are urged to read the instructions carefully.
We will list jobs at the bottom of each job, so feel free to scroll down and continue your search.
We do not accept any job applications and merely offer the service of daily jobs being mined and displayed on our job portal.
Each job post has a link to take you directly to the original post to apply on their website or the original website where the post came from.
Here are some more related positions
Pietermaritzburg: Urgent Vacancy Jnr. Developer €“ Data Engineer Camperdown, Kzn – Ms Sql Essential To Post posted by Doncour Recruitment
URGENT VACANCYJNR. DEVELOPER DATA ENGINEERCAMPERDOWN, KZNResponsible for assisting the IT and IS support personnel in solving technical problems when required.The comprehensive documentation of new and existing systems at a technical level development of
View Job
Urgent Vacancy Jnr. Developer €“ Data Engineer Camperdown, Kzn – Ms Sql Essential To Post
Johannesburg: Azure Data Engineer – Johannesburg – Up To R1mil Per Annum
A long serving bank known as Africa``s biggest lender of assets and financial services group committed to providing banking insurance and asset management services have an open role for a Cloud Data Engineer to execute data engineering duties according to
View Job
Azure Data Engineer – Johannesburg – Up To R1mil Per Annum
Pretoria: Aws Data Engineer (Senior) 2517
ESSENTIAL SKILLS REQUIREMENTS: Exceptional experience/understanding (in order of importance): Terraform Python 3x SQL - Oracle/PostgreSQL Py Spark Boto3 ETL Docker Linux / Unix Big Data Powershell / Bash Experience in working with Enterprise Collaboration
View Job
Aws Data Engineer (Senior) 2517
Johannesburg: Data Engineer
What you will be doing / What we are looking for: Data Engineer skill is required to enable the data lifecycle within EDS, namely the ability to integrate data between source system (golden/trusted) and the target database (LOB), hence provide good quality
View Job
Data Engineer
Johannesburg: Intermediate Data Engineer – Johannesburg – Up To R700k Per Annum
A company at the forefront of innovation in the telecommunications industry, priding themselves in providing cutting-edge services and solutions that enhance connectivity and empowering their clients seek the services of an Intermediate Data Engineer who w
View Job
Intermediate Data Engineer – Johannesburg – Up To R700k Per Annum
Johannesburg: Azure Data Engineer – Johannesburg – R800k Up To R1mil Per Annum
A long serving bank known as Africa``s biggest lender of assets and financial services group committed to providing banking insurance and asset management services have an open role for a Data Engineer to execute data engineering duties according to the st
View Job
Azure Data Engineer – Johannesburg – R800k Up To R1mil Per Annum
Pretoria: 2050 – Aws Data Engineer
ESSENTIAL SKILLS REQUIREMENTS: Above average experience/understanding (in order of importance): e.g. Technical Skills / Technology Terraform Python 3x SQL - Oracle/PostgreSQL Py Spark Boto3 ETL Docker Linux / Unix Big Data Powershell / Bash BMW Cloud Data
View Job
2050 – Aws Data Engineer
Stellenbosch: Senior Data Engineer
Required Qualifications: Bachelor`s or Honours degree in Computer Science, Software Engineering, Information Systems, or a related field. 4 to 5 years of experience in data engineering, database administration, or a related field. Proficiency in SQL and ex
View Job
Senior Data Engineer
Johannesburg: Tj 415904 – Etl Developer/Data Engineer (Office Based)
Employer Description IT consulting company with the focus on BI & Data Management Job Description Contribute to the design, build and implementation of the mapping, ETL programming from the source systems to the Data Warehouse. Provide world class services
View Job
Tj 415904 – Etl Developer/Data Engineer (Office Based)
Johannesburg: Data Engineer – Johannesburg – Up To R900k
A Group providing value conscious mass markets in Southern Africa and creating opportunities and comfortable lifestyles, through its diversified retail and consumer finance businesses are in search of a Data Engineer with the capabilities of utilising data
View Job
Data Engineer – Johannesburg – Up To R900k
Johannesburg: Cloud Engineer: Database Services (Hybrid)
Job Responsibilities Engage and collaborate with Infrastructure Designers and Platform Owners to review and approve cloud template and patterns Conduct logical deployments of cloud configuration/s Automate cloud services Collaborate with Public Cloud Provi
View Job
Cloud Engineer
Midrand: Cloud Database Engineer (Senior)
ESSENTIAL SKILLS REQUIREMENTS: - Experience with Oracle database architecture, automation, and performance tuning. - Expert knowledge of cloud architectures with a focus on databases. - Experience with Oracle Cloud Infrastructure, autonomous database on sh
View Job
Cloud Database Engineer (Senior)
Midrand: Cloud Database Engineer (Senior)
Essential Skills Requirements: - Analytical Expertise: Highly skilled in cloud database engineering. - Migration Experience: Critical role in migrating on-prem workloads to OCI, Azure, and AWS platforms. - Design & Implementation: Ability to design and imp
View Job
Cloud Database Engineer (Senior)
Johannesburg: Cloud Engineer – Database Services
a Giant in the banking sector is on the search for a Cloud Engineer (Database Services) to join their team and to work with world class technologies. To implement and maintain the the company`s private and hybrid cloud environments in line with their Cloud
View Job
Cloud Engineer – Database Services
Johannesburg: Aws Data Cloud Engineer (Big Data Engineer)
A leader in the insurance space is on the lookout for a AWS Data Cloud Engineer (big Data Engineer) Knowledge /Qualifications High knowledge in AWS – security groups, permissions, VPC, roles, services. Experience developing engineering applications in C
View Job
Aws Data Cloud Engineer (Big Data Engineer)
Johannesburg: Aws Data Cloud Engineer
What you will be doing: Coordinate/Prioritize the work that the Developers and PO Assist with cross-team projects that involve development AWS practices are followed with sound security and governance. Coordinate with the cloud COE team for any AWS account
View Job
Aws Data Cloud Engineer
Johannesburg: Cloud Engineer: Database Services
Job Purpose To implement and maintain the companys private and hybrid cloud environments in line with company`s Cloud Strategy in order to optimise IT expenditure and deliver efficiencies through automation. Job Responsibilities Engage and collaborate with
View Job
Cloud Engineer
Johannesburg: Senior Cloud Engineer: Database Services
Job Responsibilities Engage and collaborate with Infrastructure Designers and Platform Owners to review and approve cloud template and patterns Conduct logical deployments of cloud configuration/s Automate cloud services Collaborate with Public Cloud Provi
View Job
Senior Cloud Engineer
Johannesburg: Junior Data Engineer
A Leader in the Financial and Banking sector is on the look-out for a Junior Data Engineer. The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Company`s Data Architecture Roadmap, to advance
View Job
Junior Data Engineer
Pretoria: Cloud Database Engineer – 2509
ESSENTIAL SKILLS REQUIREMENTS: · We are looking for a highly skilled, analytical Cloud Database Engineer to join our team at BMW Hub South Africa. You will play a critical role in migrating our on-Prem workloads to our databases hosted on OCI (Oracle Cloud
View Job
Cloud Database Engineer – 2509
Midrand: Junior Data Engineer
The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the companys Data Architecture Roadmap, to advance technical thought leadership for the Enterprise, deliver fit for purpose data products, and
View Job
Junior Data Engineer
Sandown: Cloud Engineer: Database Services
Job Purpose To implement and maintain the Companies private and hybrid cloud environments in line with Companies Cloud Strategy in order to optimise IT expenditure and deliver efficiencies through automation. Job Responsibilities Engage and collaborate wit
View Job
Cloud Engineer
Johannesburg: Azure Data Engineer – Johannesburg – R900k Up To R1.1 Mil Per Annum
A long serving bank known as Africa``s biggest lender of assets and financial services group committed to providing banking insurance and asset management services have an open role for a Data Engineer to execute data engineering duties according to the st
View Job
Azure Data Engineer – Johannesburg – R900k Up To R1.1 Mil Per Annum
Sandown: Junior Data Engineer
Job Purpose The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Company Data Architecture Roadmap, to advance technical thought leadership for the Enterprise, deliver fit for purpose data pro
View Job
Junior Data Engineer
Middelburg: Data Engineer
Job Description: The integration of data from multiple sources: organized, disorganized, structured and/or unstructured, into a centralized data repository. Creating and evolving data models, schemas and repositories to efficiently store and process data,
View Job
Data Engineer