Menu Close

Gauteng: Data Engineer (Senior) 1053 posted by Opensource

Job Description

Essential Skills

  • Strong hands-on experience with Python (3.x) and PySpark for large-scale data processing
  • Minimum 3+ years working with AWS services such as Athena, Glue, Lambda, S3, and ECS
  • Experience with NoSQL (DynamoDB) and relational databases (Oracle/PostgreSQL), including advanced Oracle SQL
  • Proven experience with Oracle Cloud Infrastructure (OCI) services
  • Expertise in data formats and schema design including Parquet, AVRO, JSON, XML and CSV
  • Solid experience building ETL pipelines using AWS Glue or similar tools
  • Experience with Docker and containerisation (Kubernetes/OpenShift advantageous)
  • Strong scripting skills (Bash, PowerShell) and familiarity with Linux/Unix environments
  • Hands-on experience with data quality frameworks and validation techniques
  • Familiarity with DevOps practices, including Terraform/CloudFormation, CI/CD pipelines, Git, and Jenkins

Role & Responsibilities
 

  • Design, build, and maintain scalable data pipelines and ETL workflows
  • Develop Python and PySpark applications for data transformation at scale
  • Implement and optimise data lakes and data warehouses on cloud platforms
  • Ensure data quality, integrity, and consistency through testing and validation
  • Translate business requirements into technical data models and specifications
  • Review and propose solution architectures and design alternatives
  • Manage and support cloud infrastructure and CI/CD pipelines
  • Produce and maintain technical documentation, runbooks, and artefacts
  • Support production environments, including monitoring, troubleshooting, and incident management
  • Collaborate with BI teams to optimise data for tools such as Tableau and Business Objects
  • Mentor and support team members, contributing to knowledge sharing and capability building
  • Actively participate in Agile ceremonies and continuous improvement initiatives

Must Haves (Non-Negotiable)
 

  • Minimum 3–5 years’ experience as a Data Engineer
  • Proven expertise in Python, PySpark, and cloud-based data engineering (AWS and/or OCI)
  • Strong experience in ETL development and data pipeline design
  • Solid understanding of data modelling and schema design (non low-code approaches)
  • Hands-on experience with both relational and NoSQL databases
  • Experience with cloud infrastructure, CI/CD pipelines, and DevOps practices
  • Ability to work in cross-functional teams and deliver in Agile environments

Advantageous Skills

  • Experience with Kafka, AWS Kinesis, or streaming data platforms
  • Knowledge of AWS Redshift, EMR, and other analytical/warehouse solutions
  • Familiarity with enterprise cloud data frameworks (e.g., BMW Cloud Data Hub or similar)
  • Experience with Java/JEE and application servers
  • Exposure to monitoring tools such as CloudWatch and Grafana
  • AWS certifications (e.g., AWS Certified Cloud Practitioner)
  • Experience building and integrating REST APIs
  • Experience with MongoDB or other NoSQL technologies
  • Understanding of BI schema design and reporting optimisation

Qualifications

  • Relevant degree in IT, Computer Science, Engineering, or equivalent practical experience
  • 3–5 years of hands-on experience in data engineering roles
  • Cloud certifications such as AWS or Oracle Cloud certifications are highly desirable
  • Advanced degrees or specialised data engineering certifications are advantageous

How to Apply

Click the green “Go Apply” button below to apply directly online with the employer.

About International Beauty/Wellness Jobs in Gauteng

The international beauty and wellness industry is a growing sector in Gauteng, South Africa, offering various career opportunities for individuals passionate about the field. Typically, job seekers in this industry are drawn to roles that involve working with people, developing new products, or managing operations in fast-paced environments. Generally, jobs in this sector require a strong understanding of the global market and a keen eye for innovation.

Salaries in the international beauty and wellness industry vary widely depending on factors such as experience, company size, and industry sector. While it is difficult to provide an exact salary range, it is common for entry-level positions to fall within the R200 000 – R400 000 per annum bracket, while senior roles can command salaries ranging from R600 000 – R1 million per annum or more, depending on the specific company and industry requirements. It’s essential to note that these figures are broad estimates and may vary significantly based on individual circumstances.

Common skills required for roles in the international beauty and wellness industry include excellent communication and interpersonal skills, a strong understanding of product development and formulation, knowledge of skincare and haircare principles, experience with inventory management and supply chain logistics, proficiency in English (with some languages also being beneficial), a keen eye for detail, and a passion for staying up-to-date with industry trends. Additionally, many employers place a high value on creative thinking, problem-solving skills, and the ability to work independently.

The industry is commonly found in various sectors, including the technology industry, where companies like Google and Microsoft often employ professionals in this field, financial services sector, manufacturing sector, as well as retail and hospitality industries. Other emerging sectors such as e-commerce and wellness retreats are also gaining traction. Career development opportunities abound, with many employers investing in training and development programs to help employees progress within the company or transition into new roles.

For those interested in pursuing a career in international beauty and wellness, it’s essential to consider developing transferable skills that can be applied across various industries and companies. Building a strong network of contacts in the industry, staying up-to-date with industry trends, and being proactive in seeking out new opportunities will serve you well in this field.


This information provides general career guidance. Actual salaries and requirements vary by employer.



GO APPLY NOW

Safe & secure application process


Get Job Alerts

Never miss a job! Get daily alerts matching your preferences.

📧 Why Subscribe?

  • Get notified instantly when new jobs match your criteria
  • No registration required - just your email
  • Daily digest of relevant opportunities
  • Free forever - never miss your dream job
  • Unsubscribe anytime with one click
We'll never share your email with anyone
Leave blank for all locations
We'll send you a daily summary of new matching jobs
🔒 Privacy Guaranteed
Your email is safe with us. We only send job alerts and never spam. Unsubscribe anytime with one click. No registration, no account required.


Jobseeker Tip

Apply early, keep your CV ready, and search using both job title and location. Example: Admin Johannesburg.

Interview tips

How to Apply

Click “GO APPLY NOW” to visit the company’s application page.
Follow their instructions carefully.

JVR Jobs connects you with employers – we don’t process applications directly.

Browse Employers

View All

Job Alerts


Share this to someone who needs a job:
Posted in Jobs in Gauteng, Jobs in South Africa

More Jobs in Your Area