Talent.com
Senior Azure Data Engineer
Senior Azure Data EngineerPBT Group • Johannesburg, Gauteng, South Africa
Senior Azure Data Engineer

Senior Azure Data Engineer

PBT Group • Johannesburg, Gauteng, South Africa
30+ days ago
Job description

Be part of our team of Data Specialists and embark on a career of the future!

PBT Group is seeking an experienced Senior Data Engineer to accelerate delivery on an existing data platform project and mentor a team of junior engineers. The successful candidate will have a proven background in designing, building, and optimising large-scale data pipelines within the Azure ecosystem , particularly leveraging Azure Data Factory, Spark, and Data Lake technologies.

This role requires both hands-on technical expertise and strong leadership capabilities to guide best practices, improve performance, and ensure data quality and governance standards are met.

Key Responsibilities

  • Design, develop, and maintain robust data pipelines and ETL processes within the Azure environment.
  • Optimise data workflows for scalability, reliability, and performance using Spark and Azure Data Lake.
  • Collaborate with cross-functional teams (data analysts, architects, and business stakeholders) to translate requirements into efficient data solutions.
  • Implement data quality frameworks and monitor data integrity across systems.
  • Provide technical guidance, mentorship, and peer reviews for junior and intermediate data engineers.
  • Troubleshoot and resolve data-related issues, ensuring smooth operational continuity.
  • Participate in solution design discussions and contribute to architectural decisions.

Technical Skills & Experience

  • Core Technologies :
  • Azure Data Factory (ADF)

  • Azure Data Lake / Data Lakehouse concepts
  • Apache Spark / PySpark
  • ETL / ELT design and orchestration
  • Data modelling and optimisation for analytical workloads
  • Experience with structured and unstructured data sources
  • Additional Experience (advantageous) :
  • Azure Synapse, Databricks, SQL Server, or Power BI integration

  • CI / CD pipelines and DevOps data deployment practices
  • Soft Skills :
  • Strong problem-solving and analytical skills

  • Proven ability to work independently and collaboratively
  • Excellent communication and mentorship abilities
  • Ideal Candidate Profile

    A technically skilled, self-driven professional who thrives in dynamic environments and enjoys improving data systems and empowering teams. You should bring a strong Azure data engineering foundation, hands-on Spark experience, and a genuine passion for data performance and quality.

  • In order to comply with the POPI Act, for future career opportunities, we require your permission to maintain your personal details on our database. By completing and returning this form you give PBT your consent
  • If you have not received any feedback after 2 weeks, please consider you application as unsuccessful.
  • Skills

    Healthcare Financial Services Information Technology (IT)

    #J-18808-Ljbffr

    Create a job alert for this search

    Senior Data Engineer • Johannesburg, Gauteng, South Africa

    Related jobs
    Data Engineer (Azure) - 6 month contract

    Data Engineer (Azure) - 6 month contract

    Ace Staffing • Johannesburg, South Africa
    Bryanston, Johannesburg (Hybrid / remote).Contract : 6 months starting asap / 1 July 2025.A leading digital strategy and technology services company is seeking a skilled. This role involves designing, bu...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer - 0122

    Data Engineer - 0122

    Jordan HR • Midrand, South Africa
    Our client is seeking a hands-on Data Engineer with strong experience in building scalable data pipelines and analytics solutions on Databricks. They will design, implement, and maintain end-to-end ...Show more
    Last updated: 1 day ago • Promoted
    Intermediate or Senior AWS Data Engineer – Johannesburg – up to R900k per annum

    Intermediate or Senior AWS Data Engineer – Johannesburg – up to R900k per annum

    E-Merge • Johannesburg, South Africa
    A Technology and Business Consulting Firm that was founded through a combination of technology, data, financial and actuarial science principles. Intermediate or Senior AWS Data Engineer.You will wo...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CloudSmiths • Johannesburg, Gauteng, South Africa
    Are you a highly skilled Senior Data Engineer ready to lead and innovate in a dynamic cloud-driven environment Were looking for a pivotal team member to design develop and maintain cutting-edge dat...Show more
    Last updated: 30+ days ago • Promoted
    AWS Developer Cryptography (Senior)

    AWS Developer Cryptography (Senior)

    Khonology (Pty) Ltd • Randburg, GP, ZA
    The Cloud Security Engineer is responsible for designing, building, and maintaining secure, scalable cloud infrastructure primarily on AWS, with integration across Azure environments.This role ensu...Show more
    Last updated: 30+ days ago
    Senior Data Engineer

    Senior Data Engineer

    Network1 • Centurion, Gauteng, South Africa
    Are you a seasoned Data Engineer and visionary professional ready to lead high-impact projects in a dynamic data-driven environment Were looking for a technically strong Senior Data Engineer to joi...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer (Contract) GautengHybrid ISB903245

    Senior Data Engineer (Contract) GautengHybrid ISB903245

    iSanqa Resourcing • Midrand, Gauteng, South Africa
    Ready to transform raw data into intelligent insights that power next-generation automotive security solutions.Step into the future of data engineering and join a team where your expertise in machi...Show more
    Last updated: 30+ days ago • Promoted
    Data and Analytics Lead

    Data and Analytics Lead

    Afrizan People Intelligence • Nigel, Gauteng, South Africa
    Are you a data leader ready to shape the future of enterprise analytics in a fast-paced evolving environment.A prominent client is seeking a. This is a key leadership role responsible for guiding a ...Show more
    Last updated: 28 days ago • Promoted
    Lead Data and AI Engineer

    Lead Data and AI Engineer

    Boardroom Appointments • Sandton, South Africa
    Drive the vision, execution, and continuous improvement of the company's data and AI team.Mentor a high-performing team, instilling best practices and innovative thinking.Align projects with busine...Show more
    Last updated: 30+ days ago • Promoted
    Intermediate Senior Data Engineer (Databricks)

    Intermediate Senior Data Engineer (Databricks)

    AICA Consultancy • Centurion, Gauteng, South Africa
    We are looking for a Data Engineer who is certified in Databricks (required) to join our this role you will be designing developing and optimizing scalable data pipelines and workflows on Databric...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    HR Genie • Sandton, South Africa
    At Fedgroup, our in-house system powers everything from secured investments and life insurance to impact farming and beyond. Our versatile platform is central to our success, complemented by an app ...Show more
    Last updated: 30+ days ago • Promoted
    Applications Engineer

    Applications Engineer

    Boardroom Appointments • Kempton Park, South Africa
    Work with suppliers to create detailed technical requirements, including system architecture, hardware, software, and data, ensuring risk management, quality considerations, and product deployment ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Oostelike Personeel Konsultante • Centurion, South Africa
    Legal requirements : Must be a South African Citizen with a clean criminal background and ITC (no bad debt) - checks will be done on shortlisted applicants. Appointment : Permanent, full-time position...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer : AWS / Azure

    Data Engineer : AWS / Azure

    People Source • Johannesburg, South Africa
    You will work within a team solving complex problems to deliver real business value across a wide range of industries such as mining, telcos, retail and financial services.You will help develop bes...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Ntice Sourcing Solutions • Johannesburg, Gauteng, South Africa
    As a Senior Data Engineer youll be a key contributor to the design development and optimization of data pipelines and platforms. Youll work closely with data scientists analysts and software enginee...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer Python & Machine Learning (Contract) GautengHybrid ISB1101236

    Senior Data Engineer Python & Machine Learning (Contract) GautengHybrid ISB1101236

    iSanqa Resourcing • Midrand, Gauteng, South Africa
    Architect advanced data pipelines and AI-powered solutions for enterprise-scale automotive systems!.Lead the design and deployment of sophisticated data ingestion frameworks using Python Apache Spa...Show more
    Last updated: 12 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IDBASE SOFTWARE • Johannesburg, South Africa
    We are seeking a highly skilled Senior Data Engineer to join our dynamic data team.You will be responsible for designing, building, and maintaining robust and scalable data pipelines and architectu...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Datonomy Solutions • Centurion, South Africa
    We are seeking a Senior Data Engineer to join our team based in Centurion.The Senior Data Engineer is responsible for designing, building, and maintaining robust, scalable data pipelines and platfo...Show more
    Last updated: 6 days ago • Promoted