Data Engineer - 0122Jordan HR • Midrand, South Africa

Data Engineer - 0122

Jordan HR • Midrand, South Africa

1 day ago

Job description

Our client is seeking a hands-on Data Engineer with strong experience in building scalable data pipelines and analytics solutions on Databricks. They will design, implement, and maintain end-to-end data flows, optimize performance, and collaborate with data scientists, analytics, and business stakeholders to turn raw data into trusted insights.

ESSENTIAL SKILLS :

Expertise with Apache Spark (PySpark), Databricks notebooks, Delta Lake, and SQL
Strong programming skills in Python for data processing
Experience with cloud data platforms (Azure) and their Databricks offerings; familiarity with object storage (ADLS)
Proficient in building and maintaining ETL / ELT pipelines, data modeling, and performance optimization
Knowledge of data governance, data quality, and data lineage concepts
Experience with CI / CD for data pipelines, and orchestration tools (GitHub Actions, Asset Bundles or Databricks jobs)
Strong problem-solving skills, attention to detail, and ability to work in a collaborative, cross-functional team

ADVANTAGEOUS SKILLS :

Experience with streaming data (Structured Streaming, Kafka, Delta Live Tables).

Familiarity with materialized views, streaming tables, data catalogs and metadata management.

Knowledge of data visualization and BI tools (Splunk, Power BI, Grafana).

Experience with data security frameworks and compliance standards relevant to the industry.

Certifications in Databricks or cloud provider platforms.

QUALIFICATIONS / EXPERIENCE :

Bachelors or Masters degree in Computer Science, Data Engineering, Information Systems, or a related field.

3+ years of hands-on data engineering experience.

Key Responsibilities :

Design, develop, test, and maintain robust data pipelines and ETL / ELT processes on Databricks (Delta Lake, Spark, SQL, Python / Scala / SQL notebooks)

Architect scalable data models and data vault / dimensional schemas to support reporting, BI, and advanced analytics

Implement data quality, lineage, and governance practices; monitor data quality metrics and resolve data issues proactively

Collaborate with Data Platform Engineers to optimize cluster configuration, performance tuning, and cost management in cloud environments (Azure Databricks)

Build and maintain data ingestion from multiple sources (RDBMS, SaaS apps, files, streaming queues) using modern data engineering patterns (CDC, event-driven pipelines, change streams, Lakeflow Declarative Pipelines)

Ensure data security and compliance (encryption, access controls) in all data pipelines

Develop and maintain CI / CD pipelines for data workflows; implement versioning, testing, and automated deployments

Create a job alert for this search

Data Engineer • Midrand, South Africa

Related jobs

Data Engineer- Ab Initio

Fourier IT Innovation (Pty) Ltd • Centurion, Gauteng, South Africa

Quick Apply

South African company with over 21 years of experience delivering exceptional professionalism, deep technical knowledge, and a passion for innovation. Our team thrives on pushing boundaries—both as ...Show more

Last updated: 30+ days ago

Senior Data Engineer (Contract) GautengHybrid ISB903245

iSanqa Resourcing • Midrand, Gauteng, South Africa

Ready to transform raw data into intelligent insights that power next-generation automotive security solutions.Step into the future of data engineering and join a team where your expertise in machi...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

Network1 • Centurion, Gauteng, South Africa

Are you a seasoned Data Engineer and visionary professional ready to lead high-impact projects in a dynamic data-driven environment Were looking for a technically strong Senior Data Engineer to joi...Show more

Last updated: 30+ days ago • Promoted

Specialist Data Engineer

Absa Group Limited • Randburg, ZA

Job title : Specialist Data Engineer.Job Location : Gauteng, Randburg.Work embedded as a member of squad OR; across multiple squads to produce, test, document and review algorithms & data specific ...Show more

Last updated: 14 days ago • Promoted

Data Engineer

HR Genie • Sandton, South Africa

At Fedgroup, our in-house system powers everything from secured investments and life insurance to impact farming and beyond. Our versatile platform is central to our success, complemented by an app ...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Oostelike Personeel Konsultante • Centurion, South Africa

Legal requirements : Must be a South African Citizen with a clean criminal background and ITC (no bad debt) - checks will be done on shortlisted applicants. Appointment : Permanent, full-time position...Show more

Last updated: 30+ days ago • Promoted

Data Engineer - AWS

Psybergate (Pty) LTD • Centurion, South Africa

Design, develop and maintain complex data pipelines from multiple sources into a central data platform / lakehouse.Ensure reliability, scalability, and maintainability of pipelines.Optimize data flow...Show more

Last updated: 23 days ago • Promoted

Senior Data Engineer

Datonomy Solutions • Centurion, South Africa

We are seeking a Senior Data Engineer to join our team based in Centurion.The Senior Data Engineer is responsible for designing, building, and maintaining robust, scalable data pipelines and platfo...Show more

Last updated: 6 days ago • Promoted