Data Engineer - 0122Jordan HR • Midrand, South Africa

Data Engineer - 0122

Jordan HR • Midrand, South Africa

14 hours ago

Job description

Our client is seeking a hands-on Data Engineer with strong experience in building scalable data pipelines and analytics solutions on Databricks. They will design, implement, and maintain end-to-end data flows, optimize performance, and collaborate with data scientists, analytics, and business stakeholders to turn raw data into trusted insights.

ESSENTIAL SKILLS :

Expertise with Apache Spark (PySpark), Databricks notebooks, Delta Lake, and SQL
Strong programming skills in Python for data processing
Experience with cloud data platforms (Azure) and their Databricks offerings; familiarity with object storage (ADLS)
Proficient in building and maintaining ETL / ELT pipelines, data modeling, and performance optimization
Knowledge of data governance, data quality, and data lineage concepts
Experience with CI / CD for data pipelines, and orchestration tools (GitHub Actions, Asset Bundles or Databricks jobs)
Strong problem-solving skills, attention to detail, and ability to work in a collaborative, cross-functional team

ADVANTAGEOUS SKILLS :

Experience with streaming data (Structured Streaming, Kafka, Delta Live Tables).

Familiarity with materialized views, streaming tables, data catalogs and metadata management.

Knowledge of data visualization and BI tools (Splunk, Power BI, Grafana).

Experience with data security frameworks and compliance standards relevant to the industry.

Certifications in Databricks or cloud provider platforms.

QUALIFICATIONS / EXPERIENCE :

Bachelors or Masters degree in Computer Science, Data Engineering, Information Systems, or a related field.

3+ years of hands-on data engineering experience.

Key Responsibilities :

Design, develop, test, and maintain robust data pipelines and ETL / ELT processes on Databricks (Delta Lake, Spark, SQL, Python / Scala / SQL notebooks)

Architect scalable data models and data vault / dimensional schemas to support reporting, BI, and advanced analytics

Implement data quality, lineage, and governance practices; monitor data quality metrics and resolve data issues proactively

Collaborate with Data Platform Engineers to optimize cluster configuration, performance tuning, and cost management in cloud environments (Azure Databricks)

Build and maintain data ingestion from multiple sources (RDBMS, SaaS apps, files, streaming queues) using modern data engineering patterns (CDC, event-driven pipelines, change streams, Lakeflow Declarative Pipelines)

Ensure data security and compliance (encryption, access controls) in all data pipelines

Develop and maintain CI / CD pipelines for data workflows; implement versioning, testing, and automated deployments

Create a job alert for this search

Data Engineer • Midrand, South Africa

Related jobs

Data Engineer

Network Contracting • Johannesburg, South Africa

Job & Company Description : .Im looking for Data Engineers with solid hands-on experience designing and building scalable data solutions. You will work with clients in Financial Services, Telecomm...Show more

Last updated: 7 days ago • Promoted

Data Engineer - 0122

Jordan HR • Midrand, South Africa

Last updated: 4 hours ago • Promoted • New!

AWS Data Engineer – Centurion / Hybrid – R1.2m PA

E-Merge • Pretoria, South Africa

Were a team of curious minds and caffeine-fueled builders on a mission to turn raw data into real-world impact.We believe in pipelines that dont leak, schemas that actually make sense, and dashboar...Show more

Last updated: 30+ days ago • Promoted

Data Engineer (Remote Position) - Cape Town, Western Cape

Glasshouse Recruiting • WorkFromHome, Gauteng, South Africa

Remote

Tertiary degree in BSc Computer Science, B.IT or Informatics related degrees, Mathematics, Applied Mathematics, Actuarial Science or an Engineering degree. Understanding and working experience in da...Show more

Last updated: 17 days ago • Promoted

Data Engineer-3

FNB Namibia • Johannesburg, Gauteng, South Africa

Data Engineer-3 page is loaded## Data Engineer-3locations : Johannesburgtime type : Full timeposted on : Posted Todaytime left to apply : End Date : November 28, 2025 (6 days left to apply)job r...Show more

Last updated: 30+ days ago • Promoted

Ab Initio Data Engineer

PBT Group • Johannesburg, South Africa

PBT Group, leading Data Specialists, has an opening for an experienced Ab Initio ETL Developer in Johannesburg.Plan and analyse complex business requirements and implement technology enabled soluti...Show more

Last updated: 13 days ago • Promoted

Data Engineer-3

Spane4all • Johannesburg, Gauteng, South Africa

Last updated: 2 days ago • Promoted

Data Engineer

PBT Group • Johannesburg, South Africa

The successful candidate will work closely with senior stakeholders to design, develop, and maintain robust data pipelines and cloud-based solutions. This role requires a strong understanding of.Pro...Show more

Last updated: 30+ days ago • Promoted

Senior Specialist : Data Engineer

Liberty Group Limited • Johannesburg, Gauteng, South Africa

Insurance and Asset Management is best positioned to provide comprehensive investment and asset management offerings, as well as insurance solutions, to our African clients.Our goal is to meet our ...Show more

Last updated: 4 days ago • Promoted

Data Engineer - 2053

Jordan Hr • Pretoria, Gauteng, South Africa

Data Engineer with Degree and Certified AWS Cloud Practitioner or similar and knowledge of data formats such as Parquet AVRO JSON XML CSV etc. REST APIs required for a reputable global company based...Show more

Last updated: 15 days ago • Promoted

Lead Data Engineer (12 month contract) | Centurion

The Recruitment Council • Centurion, Gauteng, South Africa

Are you ready to take charge of cutting-edge data initiatives and lead a high-performing team? Our client is looking for a Lead Data Engineer to drive the design, development, and enhancement of en...Show more

Last updated: 30+ days ago • Promoted

Lead Data and AI Engineer

Boardroom Appointments • Sandton, South Africa

Drive the vision, execution, and continuous improvement of the company's data and AI team.Mentor a high-performing team, instilling best practices and innovative thinking.Align projects with busine...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Oostelike Personeel Konsultante • Centurion, South Africa

Legal requirements : Must be a South African Citizen with a clean criminal background and ITC (no bad debt) - checks will be done on shortlisted applicants. Appointment : Permanent, full-time position...Show more

Last updated: 30+ days ago • Promoted

Data Engineer-3

RMB Nigeria Limited • Johannesburg, Gauteng, South Africa

Last updated: 2 days ago • Promoted

Data Engineer-3

Rmbwestport • Johannesburg, Gauteng, South Africa

Last updated: 30+ days ago • Promoted

Data Engineer

Bizmod • Pretoria, Gauteng, South Africa

A leading financial institution is seeking a Senior Data Engineer / Analyst to join a multi‑year IT transformation programme aimed at renewing and modernising its financial surveillance systems.Def...Show more

Last updated: 2 days ago • Promoted

Data Engineer - 1967

Jordan HR • Pretoria, South Africa

One of our clients in IT is looking to hire a Data Engineer to join their team.Strong data engineering skills, including Python coding and data ingestion (ELT, Kafka, Apahe Spark).Familiarity with ...Show more

Last updated: 4 hours ago • Promoted • New!

Senior Data Engineer

Datonomy Solutions • Centurion, South Africa

We are seeking a Senior Data Engineer to join our team based in Centurion.The Senior Data Engineer is responsible for designing, building, and maintaining robust, scalable data pipelines and platfo...Show more

Last updated: 5 days ago • Promoted