Talent.com
Data Engineer (Integration for Data Science Team)

Data Engineer (Integration for Data Science Team)

PBT GroupJohannesburg, Gauteng, South Africa
3 days ago
Job description

PBT Group is seeking a skilled Data Engineer to join a growing Data Science team responsible for designing, developing, and optimising data pipelines and integration frameworks to support advanced analytics and machine learning initiatives. The successful candidate will play a key role in ensuring seamless data flow, scalability, and reliability across cloud and on-premise environments.

Key Responsibilities

  • Design, build, and maintain robust data pipelines for ingestion, transformation, and delivery of structured and unstructured data.
  • Collaborate closely with data scientists, analysts, and business stakeholders to ensure data solutions meet analytical and operational needs.
  • Optimise existing ETL / ELT processes for performance, scalability, and cost efficiency.
  • Integrate data from multiple source systems (including APIs, databases, and third-party applications) into AWS and Databricks environments.
  • Implement data quality, monitoring, and validation frameworks to ensure high standards of data integrity.
  • Support the deployment and operationalisation of machine learning models and data products.
  • Work in Agile or DevOps-driven environments using CI / CD pipelines and version control tools.

Skills & Experience Required

  • 4+ years’ experience as a Data Engineer, preferably within financial services or insurance.
  • Strong expertise in AWS (Lambda, S3, Glue, Redshift, EMR) and Databricks .
  • Advanced proficiency in Python for ETL / ELT development and automation.
  • Experience with SQL and data modelling for analytical and operational databases.
  • Exposure to data orchestration tools (e.g., Airflow, Step Functions) and streaming technologies (Kafka advantageous).
  • Familiarity with Salesforce , TIA , or other insurance-related data systems would be highly beneficial.
  • Experience working in Agile environments with Git-based version control and CI / CD tools.
  • Preferred Qualifications

  • Degree in Computer Science, Information Systems, Data Engineering, or related field.
  • AWS Certified Data Engineer / Databricks Certified Data Engineer Associate (advantageous).
  • #J-18808-Ljbffr

    Create a job alert for this search

    Data Engineer • Johannesburg, Gauteng, South Africa

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    One SparkJohannesburg, South Africa
    The Senior Data Engineer is the architect and builder of Dis-Chem Lifes data foundation, creating the infrastructure that turns raw information into a strategic asset. This role goes far beyond movi...Show moreLast updated: 17 days ago
    • Promoted
    Data Science Team Lead TBD

    Data Science Team Lead TBD

    Outsource SA Solutions (pTY) LtdCenturion, Gauteng, South Africa
    Collaborate closely with the data science manager to establish and execute the team's technical vision, strategy, and goals. Provide effective leadership to the data science team, fostering a collab...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Standard Bank GroupJohannesburg, Gauteng, South Africa
    Standard Bank Group is a leading Africa-focused financial services group, and an innovative player on the global stage, that offers a variety of career-enhancing opportunities – plus the chance to ...Show moreLast updated: 1 day ago
    • Promoted
    Data Scientist (Integration for Data Science Team)

    Data Scientist (Integration for Data Science Team)

    PBT GroupJohannesburg, South Africa
    Data Science team driving innovation through advanced analytics and machine learning solutions.The successful candidate will apply data science techniques to extract insights, automate decision-mak...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer / Data Scientist – Johannesburg – up to R600k per annum

    Data Engineer / Data Scientist – Johannesburg – up to R600k per annum

    E-MergeJohannesburg, South Africa
    Data Engineer / Data Scientist to drive data-driven insights.This onsite role involves end-to-end data lifecycle management : building robust data pipelines, developing advanced analytical and ML / AI...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer II

    Data Engineer II

    WesbankJohannesburg, Gauteng, South Africa
    Data Engineer II page is loaded## Data Engineer IIlocations : Johannesburgtime type : Full timeposted on : Posted Todaytime left to apply : End Date : November 13, 2025 (6 days left to apply)job...Show moreLast updated: 30+ days ago
    • Promoted
    Intermediate Data Engineer

    Intermediate Data Engineer

    NTT DATA, Inc.WorkFromHome, Gauteng, South Africa
    Join a company that is pushing the boundaries of what is possible.We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society.Our wo...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer / Scientist – Johannesburg – up to R580 per hour

    Data Engineer / Scientist – Johannesburg – up to R580 per hour

    E-MergeJohannesburg, South Africa
    A dynamic global group with a focus on innovation topics as well as comprehensive IT solutions and Global Team collaboration driving experiences with a deep insight into the compliance and IT Metho...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer / Lead - Hybrid

    Data Engineer / Lead - Hybrid

    Recruitment Dynamix (Pty) LtdJohannesburg, South Africa
    Data Lead (Engineer) to take ownership of the organisations data infrastructure, cloud environments, and IT services.This pivotal role will ensure that their data ecosystem is secure, scalable, r...Show moreLast updated: 4 days ago
    • Promoted
    Intermediate Data Engineer

    Intermediate Data Engineer

    k0deHutSandton, Gauteng, South Africa
    About the job Intermediate Data Engineer.We are seeking a talented and experienced.As a key member of our team, you will play a crucial role in designing, building, testing, deploying, and monitori...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Concord EFSJohannesburg, Gauteng, South Africa
    About the Company : Khonology is a digital services company focused on software development, Application Support, data analytics and engineering. We are looking for a skilled Data Engineer to join ou...Show moreLast updated: 4 days ago
    • Promoted
    Senior / Lead Platform Engineer (Databrick)

    Senior / Lead Platform Engineer (Databrick)

    TymeXJohannesburg, Gauteng, South Africa
    TymeX Johannesburg, Gauteng, South Africa.DevSecOps, DataOps, and ML infrastructure.You will build, integrate and operate platforms on. Architect and implement end‑to‑end data and ML platforms : data...Show moreLast updated: 10 days ago
    • Promoted
    Intermediate Senior Data Engineer (Databricks)

    Intermediate Senior Data Engineer (Databricks)

    AICA ConsultancyCenturion, Gauteng, South Africa
    We are looking for a Data Engineer who is certified in Databricks (required) to join our team.In this role you will be designing, developing, and optimizing scalable data pipelines and workflows on...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer / Lead - Hybrid

    Data Engineer / Lead - Hybrid

    Recruitment Dynamix (Pty) LtdJohannesburg, Gauteng, South Africa
    Data Lead (Engineer) to take ownership of the organisations data infrastructure, cloud environments, and IT services.This pivotal role will ensure that their data ecosystem is secure, scalable, rel...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer II

    Data Engineer II

    FirstRand Namibia LimitedJohannesburg, Gauteng, South Africa
    Data Engineer II page is loaded## Data Engineer IIlocations : Johannesburgtime type : Full timeposted on : Posted Todaytime left to apply : End Date : November 13, 2025 (6 days left to apply)job...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer II

    Data Engineer II

    RMB Nigeria LimitedJohannesburg, Gauteng, South Africa
    Data Engineer II page is loaded## Data Engineer IIlocations : Johannesburgtime type : Full timeposted on : Posted Todaytime left to apply : End Date : November 13, 2025 (6 days left to apply)job...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    OttoBauthenticJohannesburg, South Africa
    To lead the design, development, and governance of the company’s enterprise data infrastructure, transitioning from the current SSIS-based ETL environment to a modern, scalable, Azure-based cloud d...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer II

    Data Engineer II

    RmbwestportJohannesburg, Gauteng, South Africa
    Data Engineer II page is loaded## Data Engineer IIlocations : Johannesburgtime type : Full timeposted on : Posted Todaytime left to apply : End Date : November 13, 2025 (6 days left to apply)job...Show moreLast updated: 30+ days ago