Job Description
About the Role
The Databricks Developer is a key role focused on designing and implementing scalable data pipelines for Crayon Technologies Ltd. The successful candidate will transform raw data into analytics-ready datasets and support AI workloads using the Databricks platform, collaborating closely with data engineering, integration, and cloud architecture teams to further enterprise-level data projects.
Key Responsibilities
- Develop, maintain, and optimize ETL/ELT pipelines using Databricks, PySpark, and Spark SQL
- Work on batch and streaming data processing using Delta Lake and structured streaming
- Design and maintain data models aligned to Lakehouse principles and implement Delta Lake tables
- Integrate Databricks pipelines into enterprise CI/CD platforms
- Develop unit tests, data quality checks, and validation frameworks to ensure pipeline reliability
Requirements
- Proficiency with Databricks and Spark, including Databricks Workflows and Notebooks
- Strong knowledge of Python (primary), SQL, and Scala (nice-to-have)
- Experience with cloud platforms, particularly Azure Databricks, or AWS/GCP equivalents
- Understanding of data engineering tools such as Airflow, Kafka, and Databricks Repos
Qualifications
- Formal education/certifications not specified in the original job description.
How to Apply
Click the green “Go Apply” button below to apply directly online with the employer.
About IT / Computing / Software Jobs in Gauteng
In Gauteng, the IT and computing industry is a significant contributor to the province’s economy, with a steady demand for skilled professionals. Typically, this field is characterized by rapid technological advancements, innovative projects, and a high level of job satisfaction among employees. Generally, career prospects in this sector are strong, with a range of opportunities available across various industries.
Salaries for IT and computing professionals in Gauteng can vary widely depending on factors such as experience, company size, and industry sector. While it is common to see salaries ranging from R400 000 to R1,200 000 per annum, these figures are only a general guideline and actual salaries may differ significantly. For instance, senior executives or technical leads with extensive experience may command higher salaries, while entry-level positions may start at lower levels.
Common skills required for IT and computing roles in Gauteng include proficiency in programming languages such as Java, Python, or C++, knowledge of cloud platforms like AWS or Azure, and experience with agile development methodologies. Additionally, understanding of data analysis and interpretation, cybersecurity principles, and IT project management are often essential. Familiarity with popular software applications, such as Microsoft Office 365 or Google Workspace, is also beneficial.
The financial services sector, technology industry, manufacturing sector, and government departments are among the common industries that employ IT and computing professionals in Gauteng. These sectors require a range of skills and expertise, from data analysis to network administration, making them attractive options for career development.
For those seeking a career in IT and computing, there are numerous opportunities for professional growth and development. Typically, career progression involves moving into senior roles or specialized positions, such as technical lead, solutions architect, or data scientist. Opportunities for further education and training, such as certifications or postgraduate studies, can also enhance job prospects. Generally, a strong understanding of industry trends, networking, and continuous learning are essential for success in this field.
This information provides general career guidance. Actual salaries and requirements vary by employer.
GO APPLY NOW
Safe & secure application process
Explore More Opportunities
Get Similar Job Alerts
Job Seeker Tip
Join professional associations in your field to expand your network and knowledge.
How to Apply
Click “GO APPLY NOW” to visit the company’s application page.
Follow their instructions carefully.
JVR Jobs connects you with employers – we don’t process applications directly.
Latest Job Opportunities
Cape Winelands: Fitter and Turner x 3 posted by LRHR Ltd t/a Lotus HR and Recruitment
KEY REQUIREMENTS TO MEET FOR CONSIDERATION: You will have completed a trade test as Fitter and Turner, coupled with 3-5…
View JobCape Town Region: Administrator – Projects posted by Bidvest Prestige
Job Title: Administrator Location: Western Cape Company: Bidvest Prestige Job Type: Full-time Summary: We are looking for a detail-oriented and…
View JobPietermaritzburg: Part-Time Shop Assistant posted by Toys R Us & Babies R Us South Africa
Introduction Retail Shop Assistant Welcome to the Toys R Us world of awwwesome, where we want your little ones imaginations…
View JobPretoria North: Parts Salesperson (Counter and Telesales) posted by Masterparts
Masterparts Pretoria North (Montana) Parts Salesperson (Counter and Telesales) Masterparts is a large automotive spares wholesaler and retailer that has...
View JobKwaZulu-Natal: Engineer Managed Services posted by MSP Staffing LTD
An opportunity exists for a skilled IT professional to manage and maintain IT infrastructure across multiple client environments. The role…
View JobSandton: Student Support Advisor posted by digital school of marketing
The Student Support Advisor is responsible for providing academic, administrative, and learner support services to students enrolled in the institution…
View Job
Browse Employers
Job Alerts