Talent.com
Senior Data Engineer

Senior Data Engineer

Dis-Chem LifeWorkFromHome, Gauteng, South Africa
8 days ago
Job description

Join to apply for the Data Engineer role at Dis-Chem Life

Purpose of the Role : The Data Engineer is the architect and builder of Dis-Chem Life’s data foundation, creating the infrastructure that turns raw information into a strategic asset. This role goes far beyond moving data from A to B, it is about designing high-performance, future-proof systems that make data accurate, accessible, and truly powerful. By developing best-in-class data pipelines, warehouse systems, architecture, and governance frameworks the Data Engineer enables the entire organisation—from actuarial, data science and analytics teams to general operations—to work with clean, structured, and reliable datasets at scale while protecting our customers’ data privacy as stipulated in the POPI Act. Solving hard engineering problems, building resilient ingestion frameworks, handling messy and complex source systems, optimising cloud architecture for cost and performance, and ensuring that every downstream user can focus on insight and innovation rather than wrangling. The ultimate purpose is to build and continuously evolve a scalable, intelligent data platform that grows with Dis-Chem Life’s ambitions, fuels advanced analytics and modelling, unlocks automation, and sets a new benchmark for how data drives customer intelligence and operational excellence in the South African insurance industry.

Summary Of The Role

The Data Engineer is responsible for designing, implementing, and maintaining the core technical solutions that keep Dis-Chem Life’s running at peak performance. This includes building scalable and resilient data ingestion frameworks, integrating complex source systems, and optimising cloud architecture for both performance and cost efficiency. The role requires deep hands-on experience with modern data engineering tools, ETL / ELT processes, workflow orchestration, and cloud platforms. Strong problem-solving skills, precision, and the ability to collaborate seamlessly with analytics, AI, and automation teams are essential. The Data Engineer continuously drives improvements in data processes and platform efficiency, ensuring the organisation can rely on high-quality, reliable data to make faster, smarter, and more impactful decisions.

Benefits

  • Competitive salary
  • Direct and significant influence over building the company’s data backbone as we are still in early development stages.
  • Exposure to advanced analytics and AI projects with real-world business impact
  • Access to modern cloud, orchestration, and automation technologies
  • Hybrid working model with flexibility and autonomy
  • Will be working with interesting datasets comprising health data, customer behaviour, payments, retail spend, etc.

Key Responsibilities

  • Build & Maintain Data Pipelines, Architecture, and Software
  • Design, develop, optimise, and monitor scalable ETL / ELT pipelines and warehouse systems
  • Implement, monitor, and maintain reporting and analytics software
  • Architect robust, future-proof data infrastructure to support advanced analytics, AI, and automation
  • Ensure performance, reliability, and security across all data systems
  • Ensure Data Quality, Reliability & Accessibility
  • Implement rigorous data quality validation, monitoring, and governance to guarantee data integrity
  • Deliver clean, well-structured datasets that downstream teams can confidently use
  • Minimise time spent on data cleaning and wrangling for actuaries, data scientists, and operational BI analysts
  • Enable AI, Analytics & Automation
  • Prepare AI-ready datasets with consistency, scalability, and timeliness in mind
  • Collaborate with data scientists to build feature pipelines for predictive modelling
  • Support advanced automation workflows and real-time data requirements
  • Scale Data Architecture
  • Design and optimise best-in-class data architecture to be capable of handling increasing data volumes and complexity
  • Leverage cloud-native solutions to enable rapid scaling, flexibility, and cost efficiency
  • Continuously enhance data infrastructure performance and reduce operational costs
  • Handle Complex Engineering Challenges
  • Own the technical work of data ingestion, transformation, and orchestration
  • Solve challenging engineering problems to allow teams to focus on insights, models, and decisions
  • Act as the go-to expert for ensuring data is accessible, accurate, and usable
  • Collaboration & Knowledge Sharing
  • Work closely with analysts, actuaries, and data scientists to understand evolving data needs
  • Document data flows, definitions, and system processes to ensure transparency and reusability
  • Mentor colleagues and promote best-practice data engineering across the organisation
  • Soft Skills

  • Obsessed with clean, high-quality data and how it drives better models / decisions
  • Collaborative mindset, thriving at the intersection of engineering and analytics
  • Strong communicator, able to explain complex engineering choices to non-technical users
  • Detail-driven but pragmatic, balancing precision with speed in delivery
  • Curious, innovative, and always seeking ways to improve
  • Technical Skills

  • Data Architecture - design and implementation of scalable, maintainable data systems, defining data flows, and establishing architectural patterns for enterprise-scale solutions
  • Advanced SQL - extraction, transformation, and optimisation
  • Python Programming - strong skills (pandas, PySpark) for data pipelines and scientific workflows
  • Big Data Frameworks - hands-on experience with at least one major framework (Hadoop, Spark, Kafka, Elastic Stack, or Databricks)
  • Database Expertise - proficiency across relational, NoSQL, time-series, and graph databases
  • Data Modelling - dimensional modelling, normalisation, star / snowflake schemas, and designing efficient data structures for analytical workloads
  • Data Lifecycle Management - end-to-end data management including ingestion, storage, processing, archival, retention policies, and data quality monitoring
  • Data Science Integration - familiarity with feature stores, model-serving pipelines
  • ETL / ELT Tools - hands-on experience with tools like dbt, Windmill, Airflow, Fivetran
  • Cloud Platforms - experience with AWS, Azure, or GCP and modern warehouses (Snowflake, BigQuery, Redshift)
  • Streaming Data - knowledge of real-time data processing (Kafka, Spark, Flink)
  • Infrastructure Management - experience with Docker, Kubernetes, container orchestration
  • APIs & Integrations - understanding of APIs, integrations, and data interoperability
  • Version Control - Git and CI / CD practices for production data pipelines
  • Data Governance - familiarity with governance and compliance (POPIA, FAIS)
  • Experience

  • 3–5 years in a Data Engineering or related technical role
  • Proven ability to deliver clean, scalable pipelines supporting analytics and AI
  • Hands-on work with cloud-native and warehouse systems
  • Experience collaborating with Data Science teams to deliver AI / ML-ready datasets
  • Exposure to regulated industries (insurance / finance) advantageous
  • Qualifications

  • Bachelor’s degree in Data Engineering, Computer Science, Information Systems, or related field
  • Cloud certifications (AWS, Azure, GCP) or Data Engineering credentials preferred
  • Advanced SQL and Python certifications are advantageous
  • #J-18808-Ljbffr

    Create a job alert for this search

    Senior Data Engineer • WorkFromHome, Gauteng, South Africa

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    One SparkJohannesburg, South Africa
    The Senior Data Engineer is the architect and builder of Dis-Chem Lifes data foundation, creating the infrastructure that turns raw information into a strategic asset. This role goes far beyond movi...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Network RecruitmentPretoria, South Africa
    A leading investment firm is looking for a Data Engineer to help design, develop, and maintain data platform technologies that support business operations and analytics. Youll collaborate with cross...Show moreLast updated: 8 days ago
    • Promoted
    AWS Cloud Data Engineer

    AWS Cloud Data Engineer

    OttoBauthenticPretoria, South Africa
    In this role, you’ll architect and maintain.BI dashboards, and AI-driven decision-making.This role is ideal for someone who thrives in. Degree or diploma in Computer Science, Information Systems, En...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer / Data Scientist – Midrand / Semi-Remote – R600 PH

    Data Engineer / Data Scientist – Midrand / Semi-Remote – R600 PH

    E-MergePretoria, South Africa
    Remote
    Data Engineers and Data Scientists.Data Engineer / Data Scientist.You will design, build, and deploy data-driven solutions that enable smarter decisions across vehicle development, production, logi...Show moreLast updated: 30+ days ago
    • Promoted
    Intermediate or Senior AWS Data Engineer – Johannesburg – up to R900k per annum

    Intermediate or Senior AWS Data Engineer – Johannesburg – up to R900k per annum

    E-MergeJohannesburg, South Africa
    A Technology and Business Consulting Firm that was founded through a combination of technology, data, financial and actuarial science principles. Intermediate or Senior AWS Data Engineer.You will wo...Show moreLast updated: 30+ days ago
    • Promoted
    SENIOR DATA ENGINEER (AZURE) - FULLY REMOTE - UP TO R1.1M PER ANNUM

    SENIOR DATA ENGINEER (AZURE) - FULLY REMOTE - UP TO R1.1M PER ANNUM

    E-MergeJohannesburg, South Africa
    Remote
    A forward-thinking technology solutions company dedicated to delivering cutting-edge digital transformation services to clients worldwide is seeking an experienced Senior Data Engineer (Azure) to j...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer – Centurion / Hybrid – R1.2m PA

    AWS Data Engineer – Centurion / Hybrid – R1.2m PA

    E-MergePretoria, South Africa
    Were a team of curious minds and caffeine-fueled builders on a mission to turn raw data into real-world impact.We believe in pipelines that dont leak, schemas that actually make sense, and dashboar...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Dina Gates Recruitment (Pty) LtdKempton Park, South Africa
    We are seeking a skilled Azure Data Engineer with a minimum of 2 years of experience to join our dynamic data team.The ideal candidate will have a strong background in SQL, Microsoft Azure, data wa...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    PBT GroupJohannesburg, South Africa
    PBT Group is seeking an experienced.The successful candidate will have a proven background in designing, building, and optimising large-scale data pipelines within the. Azure Data Factory, Spark, an...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IOCOJohannesburg, South Africa
    As a Data Engineer at iOCO, you’ll be part of a team that designs and delivers innovative data solutions across industries. You’ll work hands-on with modern cloud platforms to build secure, scal...Show moreLast updated: 27 days ago
    • Promoted
    Data Streaming Platform Engineer – Midrand / Semi-Remote – R650 PH

    Data Streaming Platform Engineer – Midrand / Semi-Remote – R650 PH

    E-MergePretoria, South Africa
    Remote
    Our client is currently seeking a.Data Streaming Platform Engineer.Youll work with cutting-edge technologies to power connected vehicle systems, predictive maintenance, manufacturing analytics, and...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Egineer

    Senior Data Egineer

    Pro Tem RecruitmentJohannesburg, South Africa
    To lead the design, development, and governance of the company’s enterprise data infrastructure, transitioning from the current SSIS-based ETL environment to a modern, scalable, Azure-based cloud d...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Creative Leadership SolutionsPretoria, South Africa
    Minimum education (essential) : .BSc in Computer Science, Engineering or relevant field.Minimum applicable experience (years) : . Required nature of experience : .Experience with SQL Server and Azure Syna...Show moreLast updated: 23 days ago
    • Promoted
    SENIOR DevOps Engineer – Midrand / Semi-Remote – R650 PH

    SENIOR DevOps Engineer – Midrand / Semi-Remote – R650 PH

    E-MergePretoria, South Africa
    Remote
    Lead architecture and implementation.Fluent English-speaking, including Business reading and writing.Information Technology Qualification. IT Observability Systems like Grafana, Prometheus, Nagios.E...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    OttoBauthenticJohannesburg, South Africa
    To lead the design, development, and governance of the company’s enterprise data infrastructure, transitioning from the current SSIS-based ETL environment to a modern, scalable, Azure-based cloud d...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Network RecruitmentCenturion, South Africa
    Join a forward-thinking organisation at the forefront of Telematics, Fleet Management, and Data Reporting.This is a high-visibility Technical Lead role where your expertise in Data Engineering, Azu...Show moreLast updated: 22 days ago
    • Promoted
    Senior Data Operations Engineer

    Senior Data Operations Engineer

    WatersEdge SolutionsJohannesburg, South Africa
    Are you a seasoned data professional who thrives in modernising data operations and enabling data-driven decision-making? A well-established organisation is looking for a.Senior Data Operations Eng...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Architect

    Senior Data Architect

    Stafflink Recruitment SolutionsPretoria, South Africa
    The Senior Data Architect is responsible for designing, implementing, and managing data and AI architecture solutions that support the organisation''s strategic objectives.KPIs including but not li...Show moreLast updated: 30+ days ago