Talent.com
Senior Data Engineer | Remote-First, Azure Databricks

Senior Data Engineer | Remote-First, Azure Databricks

Human AccentMilnerton, Western Cape, South Africa
3 days ago
Job type
  • Remote
Job description

Showing 19 Senior Data Engineer jobs in Johannesburg

Johannesburg, Gauteng The Legends Agency

Posted 20 days ago

Job Description

About Our Client

Our client is a specialist data and technology consultancy, delivering innovative solutions that empower financial services businesses to make smarter, faster decisions. With a strong focus on advanced analytics, AI integration, and cloud-first design, the team partners with leading insurers and financial institutions to drive transformation. They offer a collaborative, remote-first culture where your expertise will directly impact business outcomes.

The Role : Data Engineer (Contractor)

This contract role is key to designing, building, and maintaining high-quality, secure, and scalable data solutions for a leading insurance client. You\'ll work across modern data platforms and cloud environments, enabling accurate insights and supporting analytics and machine learning initiatives. The role is initially a 12-month contract, with strong potential to extend based on performance and project needs.

Key Responsibilities

  • Apply 3+5 years of experience as a Data Engineer to deliver robust, efficient data solutions.
  • Develop, maintain, and optimize data pipelines using Azure Databricks.
  • Integrate and manage Oracle databases to ensure optimal security and performance.
  • Write and optimize SQL, applying strong data modeling principles.
  • Collaborate with cross-functional teams to ensure data quality, accessibility, and scalability.
  • Support machine learning and analytical initiatives in the insurance domain.
  • Monitor, troubleshoot, and enhance existing data infrastructure.

About You

  • 3 to 5 years of hands-on Data Engineering experience.
  • Proven experience working with Oracle database environments.
  • Solid SQL and data modeling capabilities.
  • Experience in insurance or broader financial services is advantageous.
  • Strong problem-solving mindset, with the ability to work independently in a remote-first setup.
  • Collaborative team player with excellent communication skills.
  • Is this job a match or a miss?

    Johannesburg, Gauteng The Legends Agency

    Posted 16 days ago

    Job Description

    Remote (South Africa) | R18,000 - R25,000 per month depending on experience | 8am-5pm SAST

    About Our Client

    Our client is an international software development company, creator of Quintessence, a specialist data toolkit widely used by asset management firms in South Africa and now expanding into the UK. Their mission is to transform investment research processes through smarter data integration and modelling. The team is young, dynamic, and passionate about tackling complex data challenges while delivering customised solutions tailored to client needs.

    The Role : Client Support Data Engineer

    As a Client Support Data Engineer, you will provide technical and analytical support to ensure client implementations of Quintessence run smoothly and meet SLA requirements. You will work closely with both internal teams and clients, troubleshooting issues, managing data requirements, and building solutions that enhance reliability, efficiency, and usability. This is a client-facing technical role with significant opportunity to grow your expertise in financial data integration and analytics.

    Key Responsibilities

  • Minimum 2 years of experience in data analysis, modelling, and troubleshooting
  • Configure and implement Quintessence software for client environments
  • Provide 2nd Tier client support, including data enhancements and issue resolution
  • Understand and manage client data requirements within the financial markets
  • Build and maintain end-to-end data service solutions and integrations
  • Develop queries combining multiple data sources while ensuring data integrity
  • Recommend improvements to data reliability, efficiency, and quality
  • Provide structured feedback to development teams on functionality and issues
  • Design user interfaces for data uploads and visualisation
  • About You

  • 2+ years of experience working with data in a technical support or engineering role
  • Degree in Statistics, Mathematics, Engineering, Informatics, or related field
  • Strong SQL and Excel skills, plus experience in a programming language such as Python (essential)
  • Exposure to data visualisation tools (Power BI, Tableau, or QlikView) (advantageous)
  • Knowledge of APIs, ETL processes, or data warehousing (advantageous)
  • Background in financial services or asset management (distinct advantage)
  • Client-focused mindset with excellent communication skills
  • Ability to multitask, manage competing priorities, and meet deadlines
  • Is this job a match or a miss?

    Johannesburg, Gauteng Visi Select

    Posted today

    Job Description

    temporary

    We’re Hiring : AWS Data Engineer (6-Month Contract) Location : Remote (supporting an international client) Contract Duration : 6 Months (Immediate Start) Compensation : R95,000 – R110,000 per month

    We’re looking for an experienced AWS Data Engineer (Intermediate to Senior) to join our client’s global team. You’ll be building and optimising scalable data pipelines, ensuring performance, reliability, and security across cloud-based systems.

    What you’ll do : Design & optimise data pipelines and ETL processes; Work with AWS services : S3, Glue, Redshift, DBT, Spark, Terraform; Support cloud integration and modernisation projects; Ensure system performance, monitoring & reliability; Enforce data security, governance, and compliance standards; Collaborate with global, cross-functional teams

    What we’re looking for : 5+ years’ experience as a Data Engineer (Intermediate–Senior); Hands-on expertise in AWS data services; Strong SQL, data modelling, and pipeline management skills; Familiarity with CI / CD, Git, and infrastructure-as-code; Excellent collaboration and problem-solving skills

    Why join? Competitive contract compensation (R95k – R110k / month); Work with cutting-edge AWS technologies; Collaborate with international teams on high-impact projects

    If you’re ready to make an impact as an AWS Data Engineer, apply today — or share this opportunity with someone in your network!

    Is this job a match or a miss?

    Johannesburg, Gauteng A 1L Realization (Pty) Ltd

    Posted 16 days ago

    Job Description

    Education :

  • Bachelor of Science, Computer Science, Big Data, Database Administration or related fields.
  • Evidence of strong skills in Data pipeline building.
  • Experiences :

  • Proven experience (3+ years) in Advanced Data Engineering
  • Big Data On-premises and Cloud Data Pipeline (M. Fabric) deployment
  • API Development and Deployment and advantage
  • Strong technical skills in data manipulation, analysis, and visualization tools such as SQL, Python, R or Power BI.
  • Knowledge of database systems (e.g., Oracle, Teradata, or Snowflake) and cloud data platforms (e.g., AWS, Azure, or GCP).
  • Excellent communication and stakeholder management skills, with the ability to translate technical concepts into actionable insights for non-technical audiences.
  • Experience in the telecommunications / Financial Services or Fintech Companies or related fields is a plus.
  • Advanced analytical skills with the ability to translate data into actionable insights and strategic recommendations.
  • Demonstrated ability to collaborate effectively with cross-functional teams and external partners to achieve business objectives.
  • Excellent written and verbal communication skills. Understanding emerging markets
  • Experience at the management level in the financial sector
  • Willing and flexible to travel within Africa
  • Is this job a match or a miss?

    Bedfordview, Gauteng R - R Y On Point HR & Talent Solutions

    Posted today

    Job Description

    Job Purpose

    The Data Engineer will be responsible for driving, designing and building scalable ETL systems for a big data warehouse to implement robust & trustworthy data to support high performing ML algorithms, predictive models and support real-time data visualisation requirements across the organisation to enable self-help analytics.

  • Systematic solution design of the ETL and data pipeline inline with business user specifications
  • Develop and implement ETL pipelines aligned to the approved solution design
  • Ensure data governance and data quality assurance standards are upheld
  • Deal with customers in a customer centric manner
  • Effective Self-Management and Team work
  • Qualifications

  • Completed IT Related Degree
  • Experience Requirement

  • 5-10 years\' Experience and understanding in designing and developing data warehouses according to the Kimball methodology.
  • Adept at design and development of ETL processes. SQL development experience, preferably SAS data studio and AWS
  • experience

  • The ability to ingest / output CSV, JSON and other flat file types and any related data sources. Proficient in Python or R or willingness to learn.
  • Experience within Retail, Financial Services and Logistics environments.
  • Must have Key Skills / Technologies :

  • Primary Technologies (outside SAP) :
  • AWS and Redshift

  • Data Source :
  • SAP (ERP system)

  • Credit Modeling :
  • SAS (most current models in production)

  • Nice to have :
  • Python

    Is this job a match or a miss?

    Posted today

    Job Description

    Summary

    At Fedgroup, our in-house system powers everything from secured investments and life insurance to impact farming and beyond. Our versatile platform is central to our success, complemented by an app that empowers users to manage their financial futures with ease. In this role, you\'ll engage with diverse stakeholders, including business owners, project managers, developers, and tech partners (IOT, ML, ICT). We stay practical while leveraging battle-tested, advanced technologies to drive innovation.

    What To Expect

    Database Engineering / Management

  • Work with on-site MSSQL 2022 databases to extract, transform, and load data as needed
  • Assist the Data Lead with doing performance analysis and tuning
  • Data Collection and Analysis

  • Gather, clean, and analyse large datasets to identify trends, patterns, and insights
  • Utilize statistical methods to interpret data and generate meaningful reports
  • Reporting and Visualization

  • Develop and maintain interactive dashboards and reports for key stakeholders
  • Communicate complex data findings in a clear and understandable manner
  • Data Quality Assurance

  • Implement and maintain data quality processes to ensure accuracy and reliability
  • Collaborate with cross-functional teams to address data discrepancies and issues
  • What You\'ll Bring

    Qualifications and Experience

  • Bachelor\'s degree in a quantitative field (e.g., Statistics, Mathematics, Computer Science) or equivalent experience
  • Proven experience as a Data Engineer or in a related role with 5 years\' experience
  • Proficient in data analysis tools and languages. (Most importantly Microsoft T-SQL)
  • Experience with data visualization tools
  • Industry-specific knowledge in finance is not necessary but will be beneficial
  • Experience with open-source data pipeline ETL tools will be beneficial
  • Analytical mindset with a keen attention to detail
  • Strong communication skills, both verbal and written
  • Adaptability and willingness to learn new technologies and techniques
  • Is this job a match or a miss?

    Posted today

    Note : This is a representative sample of the many postings; the original content contains additional listings and sections.

    #J-18808-Ljbffr

    Create a job alert for this search

    Senior Data Engineer • Milnerton, Western Cape, South Africa

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Communicate RecruitmentCape Town, South Africa
    As a Data Engineer, youll take command of scalable data pipelines and architectures using GCP tools like BigQuery, Dataflow, Pub / Sub, and Cloud Storage. Youll partner with data scientists and analys...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Azure Data Engineer OnSite Cape Town

    Azure Data Engineer OnSite Cape Town

    Ioco Digital Lty PtyCape Town, Western Cape, South Africa
    A technology solutions provider is seeking an experienced Data Engineer in Cape Town to design and maintain data pipelines within the Microsoft ecosystem. The ideal candidate will have over 5 years ...Show moreLast updated: 21 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    IOCOCape Town, South Africa
    We are seeking an experienced Data Engineer to join our iOCO Digital team.The ideal candidate will have at least 5 years of proven expertise in the Microsoft stack, with strong skills in Azure Data...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Lead Data Engineer — Azure, PySpark & Airflow

    Lead Data Engineer — Azure, PySpark & Airflow

    CircanaCape Town, Western Cape, South Africa
    A global market research company is seeking a Lead Data Engineer to support their new Private Cloud clients.The ideal candidate will have 8+ years of experience and strong expertise in Azure, PySpa...Show moreLast updated: 21 hours ago
    • Promoted
    Data Engineer : Azure, Synapse & Power BI Lead

    Data Engineer : Azure, Synapse & Power BI Lead

    Isilumko StaffingCape Town, Western Cape, South Africa
    A staffing agency is seeking a Data Engineer in Cape Town to lead the development and optimization of data platforms using Azure technologies and Power BI. The role involves overseeing reporting cap...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer - Scalable Analytics & Dashboards (Remote)

    Data Engineer - Scalable Analytics & Dashboards (Remote)

    QwiliWorkFromHome, Western Cape, South Africa
    Remote
    A technology company in Cape Town is seeking a dedicated individual to build and maintain data infrastructure.The role involves automating reports and collaborating with the software team for data ...Show moreLast updated: 3 days ago
    • Promoted
    Senior Software Engineer - Data Science (CH1148)

    Senior Software Engineer - Data Science (CH1148)

    CapitalHStellenbosch, South Africa
    Our client is a medium-sized engineering company based in Stellenbosch, specializes in the design, development, integration, implementation, and support of complex hardware and software systems.The...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Senior Data Engineer - 100% REMOTE - R1.1M PA

    Azure Senior Data Engineer - 100% REMOTE - R1.1M PA

    E-Merge It RecruitmentWorkFromHome, Western Cape, South Africa
    Remote
    We are looking for a Senior Data Engineer with a blend of technical skill and creative problem‑solving to help us scale our data solutions. You will work within a team solving complex problems to de...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer (Snowflake, DBT)

    Senior Data Engineer (Snowflake, DBT)

    PBT GroupCape Town, South Africa
    We are seeking a highly skilled.The ideal candidate will have strong experience with.This role involves building and optimizing data pipelines, ensuring high data quality, and supporting scalable d...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    AWS Data Engineer – Scale Pipelines & Lakehouses

    AWS Data Engineer – Scale Pipelines & Lakehouses

    Zensar TechnologiesCape Town, Western Cape, South Africa
    A leading technology firm is seeking an AWS Data Engineer in Western Cape, Cape Town.This role requires a strong background in AWS services and expertise in data modeling and transformation using D...Show moreLast updated: 21 hours ago
    • Promoted
    Senior Data Platform Engineer — Real-Time Pipelines (Remote)

    Senior Data Platform Engineer — Real-Time Pipelines (Remote)

    MoonPayWorkFromHome, Western Cape, South Africa
    Remote
    A leading crypto infrastructure company in Cape Town seeks a Senior Data Engineer to lead complex data engineering projects, develop real-time data pipelines, and mentor engineering teams.The ideal...Show moreLast updated: 1 day ago
    • Promoted
    Remote Azure Data Engineer : Pipelines & Security

    Remote Azure Data Engineer : Pipelines & Security

    Enablesa T / A Enablesa Pty LtdWorkFromHome, Western Cape, South Africa
    Remote
    A national client is seeking an experienced Data Engineer to join their team remotely.The ideal candidate will have a bachelor's degree in Computer Science and proven experience in Azure, designing...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Communicate RecruitmentStellenbosch, South Africa
    Minimum 5 years orchestrating the infernal symphony of data engineering ideally in the underworlds of credit, lending, or fintech. A degree in Computer Science, Engineering, Mathematics, or similar...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer | Remote-First, Azure Databricks

    Senior Data Engineer | Remote-First, Azure Databricks

    Human AccentStellenbosch, Western Cape, South Africa
    Remote
    Showing 19 Senior Data Engineer jobs in Johannesburg.Johannesburg, Gauteng The Legends Agency.Our client is a specialist data and technology consultancy, delivering innovative solutions that empowe...Show moreLast updated: 3 days ago
    • Promoted
    Senior Azure Data Engineer - Remote, Spark & Pipelines

    Senior Azure Data Engineer - Remote, Spark & Pipelines

    E-Merge It RecruitmentWorkFromHome, Western Cape, South Africa
    Remote
    A leading IT recruitment agency in South Africa seeks a Senior Data Engineer to help scale data solutions across industries including mining, telcos, and retail. The ideal candidate will have over 8...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Analytics Engineer — Remote Contract (2.5mo)

    Senior Data Analytics Engineer — Remote Contract (2.5mo)

    Global Technical TalentWorkFromHome, Western Cape, South Africa
    Remote
    A national auto insurance provider is seeking a Senior Engineer – Data Analytics to design and optimize data analytics solutions supporting enterprise-scale operations. This role requires expertise ...Show moreLast updated: 1 day ago
    • Promoted
    Remote Data Engineer : Lakehouse Pipelines & AI Solutions

    Remote Data Engineer : Lakehouse Pipelines & AI Solutions

    A38A7Ccc-Bffb-4Fde-9A77-3F4B59Df0F2FWorkFromHome, Western Cape, South Africa
    Remote
    A technology firm specializing in data solutions is seeking a fully remote Data Engineer to develop lakehouses and reporting solutions. The ideal candidate has over 3 years of data engineering exper...Show moreLast updated: 1 day ago
    • Promoted
    Senior Software Engineer - Data Science (Ch1148)

    Senior Software Engineer - Data Science (Ch1148)

    CapitalHStellenbosch, Western Cape, South Africa
    Our client is a medium-sized engineering company based in Stellenbosch, specializes in the design, development, integration, implementation, and support of complex hardware and software systems.The...Show moreLast updated: 1 day ago