Job Description
About the Role
As a Senior Data Engineer at Crayon Technologies Ltd, you will play a crucial role in developing and optimizing data pipelines and managing data solutions within our cloud-based services. You will collaborate with cross-functional teams to ensure the success of data-driven projects while leveraging your expertise in cloud platforms and agile methodologies.
Key Responsibilities
- Develop and maintain ETL/ELT pipelines using Apache Airflow and PySpark
- Design database schemas and dimensional models to support data normalization
- Develop and manage data warehouses, data lakes, and data lakehouses
- Work with relational and NoSQL databases including Azure SQL, PostgreSQL, MongoDB, and Google Firestore
- Handle various data file formats such as Avro, CSV, Parquet, and Delta
- Create and manage APIs for data integration with an understanding of REST and microservices architecture
- Ensure codebase maintenance and optimization using Git for version control
- Implement integration testing and quality assurance procedures
- Collaborate with team members for technical design support and project delivery
- Integrate new data sources to meet evolving business requirements
Requirements
- Bachelor’s degree in Computer Science, Data Science, or related field
- Minimum of 5 years of experience in data engineering and cloud computing
- Proficiency in Python and SQL, particularly PostgreSQL or SQL Server
- Experience with Apache Airflow, PySpark, and Databricks
- Knowledge of cloud platforms, with a focus on Azure
- Understanding of data warehousing, dimensional modelling, and big data file formats
- Familiarity with APIs, REST, and microservices
- Demonstrated experience in managing projects effectively in a cloud ecosystem
- Ability to lead technical teams and mentor in an Agile environment
Qualifications
(No qualifications mentioned in the original job description)
Salary & Benefits
(No salary or benefits information provided)
How to Apply
Click the green “Go Apply” button below to apply directly online with the employer.
About IT / Computing / Software Jobs in South Africa
The IT and computing industry in South Africa is rapidly growing, driven by the increasing demand for digital transformation and technological advancements. Typically, this growth translates to a strong job market for professionals with skills in software development, data analysis, and cybersecurity. Generally, the sector offers a wide range of career opportunities across various industries.
In terms of salary expectations, IT and computing professionals in South Africa can generally expect to earn salaries that are on par with or slightly above the national average. However, it’s essential to note that salaries can vary significantly depending on factors such as experience, company size, industry sector, and specific job requirements. Typically, experienced professionals in high-demand areas like artificial intelligence, cloud computing, or cybersecurity tend to earn higher salaries than those in entry-level positions. Nonetheless, salaries are often within the range of R600 000 to R1 million per annum for mid-level roles, with senior positions potentially exceeding R2 million.
Common skills required for IT and computing roles in South Africa include programming languages such as Java, Python, or C++, proficiency in software development methodologies like Agile or Scrum, experience with data analysis tools like Tableau or Power BI, and familiarity with cloud-based technologies like AWS or Azure. Additionally, knowledge of cybersecurity principles, network administration, and database management are highly valued skills.
The IT and computing industry is a significant sector across various industries, including financial services, technology, manufacturing, and healthcare. Many companies in these sectors require skilled professionals to develop, implement, and maintain their digital solutions. Typically, the finance industry requires specialized IT talent for areas like risk management, compliance, and anti-money laundering.
For those looking to pursue a career in IT and computing, common career progression paths include working as an individual contributor, moving into team leadership roles, or taking on senior technical positions. Many professionals also choose to specialize in emerging technologies like artificial intelligence, blockchain, or the Internet of Things (IoT). With ongoing training and development, individuals can stay up-to-date with the latest industry trends and advancements, positioning themselves for success in this rapidly evolving field.
This information provides general career guidance. Actual salaries and requirements vary by employer.
GO APPLY NOW
Safe & secure application process
Explore More Opportunities
Get Similar Job Alerts
Job Seeker Tip
Keep copies of job descriptions for positions you apply to - they're useful for interview prep.
How to Apply
Click “GO APPLY NOW” to visit the company’s application page.
Follow their instructions carefully.
JVR Jobs connects you with employers – we don’t process applications directly.
Latest Job Opportunities
Centurion: Account Executive posted by The Recruitment Pig
The CompanyOur client is a reliable provider of fleet management systems, they supply advanced telematics systems to major South African…
View JobCape Town: Kitchen Manager posted by Stratogo
If you have not received feedback within two weeks, please consider your application unsuccessful. We are committed to locating the…
View JobGauteng: Financial Accountant posted by SydSen Recruit
A well-established company based in Pretoria (Hermanstad) is seeking a detail-oriented and reliable Financial Accountant to join their team. The…
View JobJohannesburg North: Financial Accountant posted by Network Finance
Our client, based in Pretoria North, forms part of a longestablished manufacturing operation with roots dating back several decades, known…
View JobPretoria: Technician posted by Hire Resolve
We are seeking an experienced Technician to manage and supervise maintenance operations at our facilities in Cullinan, Pretoria. The role…
View JobAlberton: INTERNAL SALES – BUILDING MATERIALS (ALBERTON, JOHANNESBURG) posted by MPRTC Recruitment
Requirements:Grade 12 (postmatric qualification in sales, business, or administration advantageous)Proven sales experience, preferably within the building...
View Job
Browse Employers
Job Alerts