Date | 2024-11-02 |
---|---|
Job Title | Gcp Data Engineer |
Employer | More Information |
Salary | |
Category | It Computing Software |
Location |
Cape Town Region / Cape Town City Centre |
Job Summary
Our team is seeking an experienced Google Cloud Platform (GCP) Data Engineer with a passion for building and optimising data pipelines, architectures, and data sets on GCP. This role involves collaborating closely with data analysts, data scientists, and other stakeholders to ensure high-quality data availability for advanced analytics and machine learning initiatives. Key
Responsibilities:
Design, build, and maintain scalable data pipelines and ETL processes on GCP to support a variety of data applications, including analytics, reporting, and machine learning. Implement and manage data warehouses and data lakes using GCP services such as BigQuery, Cloud Storage, Cloud Dataflow, and Cloud Composer . Develop, maintain, and enhance data models in line with business requirements, optimising for performance and scalability. Collaborate with cross-functional teams to understand business needs, translate them into technical solutions, and provide data access solutions tailored to specific use cases. Conduct regular performance tuning, capacity management, and data quality checks to ensure the efficiency, security, and reliability of data infrastructure. Implement security best practices, including data encryption, access control, and compliance with organisational and regulatory standards. Develop and maintain comprehensive documentation on data architecture, data models, and processes. Qualifications: Bachelor’s Degree in Computer Science, Information Systems, Engineering, or a related field. 3 years of experience as a Data Engineer with hands-on expertise in designing, building, and optimising data architectures on GCP. Proficiency in SQL and Python for data transformation, automation, and integration. Strong knowledge of GCP tools : BigQuery, Cloud Dataflow, Cloud Storage, Cloud Composer (Apache Airflow), Pub/Sub, and Cloud Functions. Experience with data modelling, ETL processes , and data warehousing concepts. Experience with Apache Kafka or other streaming platforms is beneficial. Familiarity with CI/CD tools and DevOps practices for data pipelines, such as Docker, Terraform, or Kubernetes, is advantageous. Skills: Analytical and problem-solving skills: Ability to diagnose complex data issues, recommend and implement solutions efficiently. Attention to detail and commitment to data quality: Ensures that data is accurate, reliable, and adheres to company standards. Communication and collaboration skills: Strong written and verbal communication abilities, capable of working well with both technical and non-technical stakeholders. Self-motivated and adaptable: Able to work independently in a fast-paced environment, with a proactive approach to learning and adopting new technologies. Preferred Competencies: Certifications in Google Cloud (e.g., Professional Data Engineer) are a plus. Experience with machine learning workflows and integration with data pipelines. Knowledge of data governance principles and experience implementing data quality frameworks. Why Join Us: This role offers the opportunity to work with cutting-edge cloud technology within a dynamic and collaborative environment. You’ll have the chance to make a significant impact on our data strategy and contribute to innovative projects that push the boundaries of data engineering on GCP. If you’re a dedicated GCP Data Engineer with a vision for data-driven success, we’d love to hear from you
Gcp Data Engineer position available in Cape Town Region, Cape Town City Centre. This job position was posted by . The job has been posted on 2024-11-02 in the It Computing Software category
Click Go Apply to apply online!
You might also like to look at the available jobs in the same area.
Apply directly for this position
Some posts have contact information included with other instructions. All applicants are urged to read the instructions carefully.
We will list jobs at the bottom of each job, so feel free to scroll down and continue your search.
We do not accept any job applications and merely offer the service of daily jobs being mined and displayed on our job portal.
Each job post has a link to take you directly to the original post to apply on their website or the original website where the post came from.
Here are some more related positions
Cape Town: Gcp Data Engineer posted by PBT Group
Our team is seeking an experienced Google Cloud Platform (GCP) Data Engineer with a passion for building and optimising data pipelines, architectures, and data sets on GCP. This role involves collaborating closely with data analysts, data scientists, and o
View Job
Gcp Data Engineer
Cape Town City Centre: Gcp Data Engineer
Our team is seeking an experienced Google Cloud Platform (GCP) Data Engineer with a passion for building and optimising data pipelines, architectures, and data sets on GCP. This role involves collaborating closely with data analysts, data scientists, and o
View Job
Gcp Data Engineer
Cape Town: Software Engineer (Azure, Aws, Gcp, C#, Angular, Sql) posted by Datafin
Software Engineer (Azure, AWS, GCP, C#, Angular, SQL)IT - Software DevelopmentCape Town - Western CapeENVIRONMENT: ASSIST in architectural design and engineering an N-tier cloud-native technology platform as the next Software Engineer sought to join the te
View Job
Software Engineer (Azure, Aws, Gcp, C#, Angular, Sql)
Email Alerts
Click the button below and submit your email to receive email alerts with the latest jobs.
This service is offered by Result Generation
We do not save your information, and your email is the only information we forward to the service.
If you wish to unsubscribe, please click here