This job offer is not available in your country.

Senior Data Engineer

DigiOutsourceCape Town, ZA

30+ days ago

Job description

Job title : Senior Data Engineer

Job Location : Western Cape, Cape Town

Deadline : October 14, 2025

Quick Recommended Links

Jobs by Location
Job by industries

Why we need you

We’re on a mission to create extraordinary experiences for our customers, and we believe that your unique skills, passion and superdrive will help us achieve our vision.

As a Senior Data Engineer in our Fintech ecosystem, you'll be a key driver in our transition from an on-premises data infrastructure to modern, scalable cloud lake house architecture.

Your expertise in SQL querying, query optimization, stored procedures, data modelling, and streaming will support current operations while enabling the transformation into a cloud-first strategy.

You’ll play a critical role in designing and implementing a future-ready data platform that powers innovative financial solutions, ensuring seamless integration of real-time and batch processing with the latest technologies.

Additionally, you’ll mentor and train junior team members, fostering their development and ensuring the team’s success in this transformative journey.

What you’ll be doing

Designing, developing, and optimizing robust data pipelines for on-premises and hybrid cloud environments.

Leading efforts to migrate data and systems from on-premises databases to a cloud lake house architecture.

Developing scalable data models for cloud-based storage and processing.

Implementing and managing streaming data solutions using platforms like Kafka or RabbitMQ.

Collaborating with cross-functional teams to integrate data from multiple sources into a unified data platform.

Optimizing query performance and database structures to meet evolving business needs.

Building and maintaining robust ETL / ELT processes to support cloud-native architectures.

Driving the adoption of modern data lake house technologies such as Delta Lake, Apache Iceberg, or Apache Hudi.

Mentoring and training junior team members to build their expertise in cloud data engineering.

Staying updated on emerging cloud and lake house technologies to guide the data architecture evolution.

Essential skills you’ll bring to the table

The necessary skills that we require for this role include :

Bachelor’s degree in computer science, Data Engineering, Information Systems, or a related field.

8+ years of experience in data engineering or related roles.

Relevant certifications (e.g., AWS Certified Data Analytics Specialty, Microsoft Certified : Azure Data Engineer, or Databricks Certified Data Engineer).

Strong expertise in SQL, including querying, optimization, and writing stored procedures.

Proven experience in cloud-based data platforms such as AWS Redshift, Azure Synapse, or Google BigQuery.

Knowledge of cloud lake house technologies (e.g., Delta Lake, Apache Iceberg, or Apache Hudi).

Hands-on experience with streaming platforms such as Kafka or RabbitMQ.

Expertise in data modelling for both on-premises and cloud-based systems.

Proficiency in Python, Java, or Scala for data engineering tasks.

Experience with CI / CD practices for data pipelines in a cloud environment.

Familiarity with data governance and security best practices in cloud environments.

Strong leadership and mentoring skills, with experience guiding junior team members.

Desirable skills you’ve got up your sleeve

It would be great if you also have some of the following skills :

Tools : AWS, Azure, GCP, Terraform, Docker, Kubernetes

Experience with big data technologies such as Hadoop, Spark, or Flink, especially in a cloud context.

Knowledge of containerization tools like Docker and orchestration platforms such as Kubernetes.

Expertise in monitoring and observability tools for cloud data pipelines.

Certification in cloud platforms or lake house technologies (e.g., AWS Data Analytics Specialty, Databricks Certified Data Engineer).

Background in implementing real-time analytics and event-driven architectures in the cloud.

Understanding of cost optimization strategies for cloud-based data infrastructure.

Experience in managing hybrid environments during migration from on-prem to cloud.

Hands-on experience with serverless computing in cloud such as Lambda Functions.

Hands-on experience with cloud analytics platforms such as Big Query or Databricks

Proficiency in C# for general engineering tasks.

Hashicorp Terraform for IaC workloads

Automation using shell scripts (Powershell, Bash etc)

Research / Data Analysis jobs

Create a job alert for this search

Senior Data Engineer • Cape Town, ZA

Related jobs

Promoted

AWS Data Engineer

PBT GroupCape Town, South Africa

Ready to take your data engineering career to new heights?.Architect modern data analytics frameworks.Translate complex requirements into scalable, secure, high-performance pipelines.Build & optimi...Show moreLast updated: 30+ days ago

Promoted

Data Engineer (Python)

PBT GroupCape Town, South Africa

PBT Group is seeking a Data Engineer with strong Python experience.The role involves end-to-end development, including fetching and manipulating data from multiple sources, as well as designing and...Show moreLast updated: 30+ days ago

Senior Data Engineer

AiRCape Town, Western Cape, South Africa

Quick Apply

The Data Engineering team is building a secure, resilient, and cost-effective data platform that empowers everyone in the business to be an analyst. This is an opportunity to shape best practices, i...Show moreLast updated: 4 days ago

Promoted

Senior Data Engineer

Network RecruitmentCape Town, South Africa

Design, build, and maintain scalable data pipelines and ETL processes.Develop and optimize data models, ensuring data quality, accuracy, and accessibility. Collaborate with cross-functional teams to...Show moreLast updated: 26 days ago

Promoted

Senior Data Engineer – Cape Town – HYBRID – R900 PH

E-MergeCape Town, South Africa

Our client is on the hunt for a.We are young and still innovating like a startup.Our mission? To use the power of data to unlock smarter financial futures for millions across Africa.Bachelor''s or ...Show moreLast updated: 30+ days ago

Senior Data Engineer

Kuda Technologies LtdCape Town, Western Cape, ZA

Remote

Quick Apply

Kuda is a money app for Africans on a mission to make financial services accessible, affordable and rewarding for every African on the planet. We’re a tribe of passionate and diverse people who drea...Show moreLast updated: 30+ days ago

Promoted

Senior Cloud Data Engineer

Mindworx ConsultingCape Town, South Africa

Relevant software engineering degree at least at Honours level (Master's preferred).Data skills (Traditional SQL and No-SQL). Cloud experience (Google Cloud Platform preferred).Experience with sourc...Show moreLast updated: 14 days ago

Promoted

AWS Data Engineer – Cape Town - R800k to R1mil per annum

E-MergeCape Town, South Africa

A leader in intelligence automation offering specialised software and services aimed at leveraging advances in machine learning and artificial intelligence. Design, build, and manage scalable data p...Show moreLast updated: 30+ days ago

Promoted

Senior Software Engineer - Data Science (CH1148)

CapitalHStellenbosch, South Africa

Our client is a medium-sized engineering company based in Stellenbosch, specializes in the design, development, integration, implementation, and support of complex hardware and software systems.The...Show moreLast updated: 30+ days ago

Promoted

Senior Backend Engineer

WatersEdge SolutionsCape Town, South Africa

Bring your backend engineering expertise to a high-impact role shaping the future of digital healthcare.As a Senior Backend Engineer, you’ll design, build, and maintain the APIs and infrastructure ...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Communicate RecruitmentStellenbosch, South Africa

As a Data Engineer, youll take command of scalable data pipelines and architectures using GCP tools like BigQuery, Dataflow, Pub / Sub, and Cloud Storage. Youll partner with data scientists and analys...Show moreLast updated: 11 days ago

Promoted

Data Engineer (Cape Town)

IOCOCape Town, South Africa

We are seeking an experienced Data Engineer to join our iOCO Digital team.The ideal candidate will have at least 5 years of proven expertise in the Microsoft stack, with strong skills in Azure Data...Show moreLast updated: 30+ days ago

Promoted

Data Engineer (EE ONLY) (CPT Onsite)

Datafin IT RecruitmentCape Town, South Africa

DESIGN, develop and implement scalable and robust processes to support cloud applications and solutions as the next Data Engineer sought by a leading Supply Chain Group. This role includes extractin...Show moreLast updated: 30+ days ago

Promoted

Intermediate Data Engineer

Network RecruitmentCape Town, South Africa

Design, develop, and maintain efficient data pipelines and ETL processes.Build and optimize data models to ensure accuracy, accessibility, and performance. Collaborate with software development and ...Show moreLast updated: 26 days ago

Promoted

Data Scientist / Senior Software Engineer

Communicate RecruitmentStellenbosch, South Africa

Join a fellowship devoted to crafting scalable, world-shaping solutions for industries across the realms.Architect, forge, and deploy machine learning and AI constructs within mighty, distributed s...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Network RecruitmentStellenbosch, South Africa

Design and implement scalable data pipelines and architectures leveraging GCP services such as Dataflow, BigQuery, Pub / Sub, and Cloud Storage. Build and maintain ETL processes to integrate and trans...Show moreLast updated: 24 days ago

Promoted

Data Engineer

Communicate RecruitmentStellenbosch, South Africa

Minimum 5 years orchestrating the infernal symphony of data engineering ideally in the underworlds of credit, lending, or fintech. A degree in Computer Science, Engineering, Mathematics, or similar...Show moreLast updated: 30+ days ago

Promoted

Data Engineer (GCP)

PBT GroupCape Town, South Africa

Join Our Team as a Google Cloud Platform (GCP).Are you passionate about building powerful data pipelines, optimising architectures, and enabling advanced analytics and machine learning? We’re looki...Show moreLast updated: 11 days ago

Promoted

Data Engineer

Datonomy SolutionsParow, South Africa

Design, develop, and maintain robust ETL / ELT data pipelines as part of our enterprise data platform.This role supports the organizations data-driven decision-making by enabling scalable, high-quali...Show moreLast updated: 30+ days ago

Promoted

SQL Data Engineer – Cape Town – R650k to R850k per annum

E-MergeCape Town, South Africa

A leader in intelligence automation offering specialised software and services aimed at leveraging advances in machine learning and artificial intelligence is looking for a skilled.In this role, yo...Show moreLast updated: 30+ days ago