Talent.com
Senior Data Engineer | Remote-First, Azure Databricks

Senior Data Engineer | Remote-First, Azure Databricks

Human AccentMiddelburg, Mpumalanga, South Africa
3 days ago
Job type
  • Remote
Job description

Showing 19 Senior Data Engineer jobs in Johannesburg

Johannesburg, Gauteng The Legends Agency

Posted 20 days ago

Job Description

About Our Client

Our client is a specialist data and technology consultancy, delivering innovative solutions that empower financial services businesses to make smarter, faster decisions. With a strong focus on advanced analytics, AI integration, and cloud-first design, the team partners with leading insurers and financial institutions to drive transformation. They offer a collaborative, remote-first culture where your expertise will directly impact business outcomes.

The Role : Data Engineer (Contractor)

This contract role is key to designing, building, and maintaining high-quality, secure, and scalable data solutions for a leading insurance client. You\'ll work across modern data platforms and cloud environments, enabling accurate insights and supporting analytics and machine learning initiatives. The role is initially a 12-month contract, with strong potential to extend based on performance and project needs.

Key Responsibilities

  • Apply 3+5 years of experience as a Data Engineer to deliver robust, efficient data solutions.
  • Develop, maintain, and optimize data pipelines using Azure Databricks.
  • Integrate and manage Oracle databases to ensure optimal security and performance.
  • Write and optimize SQL, applying strong data modeling principles.
  • Collaborate with cross-functional teams to ensure data quality, accessibility, and scalability.
  • Support machine learning and analytical initiatives in the insurance domain.
  • Monitor, troubleshoot, and enhance existing data infrastructure.

About You

  • 3 to 5 years of hands-on Data Engineering experience.
  • Proven experience working with Oracle database environments.
  • Solid SQL and data modeling capabilities.
  • Experience in insurance or broader financial services is advantageous.
  • Strong problem-solving mindset, with the ability to work independently in a remote-first setup.
  • Collaborative team player with excellent communication skills.

    • Is this job a match or a miss?

    Johannesburg, Gauteng The Legends Agency

    Posted 16 days ago

    Job Description

    Remote (South Africa) | R18,000 - R25,000 per month depending on experience | 8am-5pm SAST

    About Our Client

    Our client is an international software development company, creator of Quintessence, a specialist data toolkit widely used by asset management firms in South Africa and now expanding into the UK. Their mission is to transform investment research processes through smarter data integration and modelling. The team is young, dynamic, and passionate about tackling complex data challenges while delivering customised solutions tailored to client needs.

    The Role : Client Support Data Engineer

    As a Client Support Data Engineer, you will provide technical and analytical support to ensure client implementations of Quintessence run smoothly and meet SLA requirements. You will work closely with both internal teams and clients, troubleshooting issues, managing data requirements, and building solutions that enhance reliability, efficiency, and usability. This is a client-facing technical role with significant opportunity to grow your expertise in financial data integration and analytics.

    Key Responsibilities

  • Minimum 2 years of experience in data analysis, modelling, and troubleshooting
  • Configure and implement Quintessence software for client environments
  • Provide 2nd Tier client support, including data enhancements and issue resolution
  • Understand and manage client data requirements within the financial markets
  • Build and maintain end-to-end data service solutions and integrations
  • Develop queries combining multiple data sources while ensuring data integrity
  • Recommend improvements to data reliability, efficiency, and quality
  • Provide structured feedback to development teams on functionality and issues
  • Design user interfaces for data uploads and visualisation

    • About You

  • 2+ years of experience working with data in a technical support or engineering role
  • Degree in Statistics, Mathematics, Engineering, Informatics, or related field
  • Strong SQL and Excel skills, plus experience in a programming language such as Python (essential)
  • Exposure to data visualisation tools (Power BI, Tableau, or QlikView) (advantageous)
  • Knowledge of APIs, ETL processes, or data warehousing (advantageous)
  • Background in financial services or asset management (distinct advantage)
  • Client-focused mindset with excellent communication skills
  • Ability to multitask, manage competing priorities, and meet deadlines

    • Is this job a match or a miss?

    Johannesburg, Gauteng Visi Select

    Posted today

    Job Description

    temporary

    We’re Hiring : AWS Data Engineer (6-Month Contract) Location : Remote (supporting an international client) Contract Duration : 6 Months (Immediate Start) Compensation : R95,000 – R110,000 per month

    We’re looking for an experienced AWS Data Engineer (Intermediate to Senior) to join our client’s global team. You’ll be building and optimising scalable data pipelines, ensuring performance, reliability, and security across cloud-based systems.

    What you’ll do : Design & optimise data pipelines and ETL processes; Work with AWS services : S3, Glue, Redshift, DBT, Spark, Terraform; Support cloud integration and modernisation projects; Ensure system performance, monitoring & reliability; Enforce data security, governance, and compliance standards; Collaborate with global, cross-functional teams

    What we’re looking for : 5+ years’ experience as a Data Engineer (Intermediate–Senior); Hands-on expertise in AWS data services; Strong SQL, data modelling, and pipeline management skills; Familiarity with CI / CD, Git, and infrastructure-as-code; Excellent collaboration and problem-solving skills

    Why join? Competitive contract compensation (R95k – R110k / month); Work with cutting-edge AWS technologies; Collaborate with international teams on high-impact projects

    If you’re ready to make an impact as an AWS Data Engineer, apply today — or share this opportunity with someone in your network!

    Is this job a match or a miss?

    Johannesburg, Gauteng A 1L Realization (Pty) Ltd

    Posted 16 days ago

    Job Description

    Education :

  • Bachelor of Science, Computer Science, Big Data, Database Administration or related fields.
  • Evidence of strong skills in Data pipeline building.

    • Experiences :

  • Proven experience (3+ years) in Advanced Data Engineering
  • Big Data On-premises and Cloud Data Pipeline (M. Fabric) deployment
  • API Development and Deployment and advantage
  • Strong technical skills in data manipulation, analysis, and visualization tools such as SQL, Python, R or Power BI.
  • Knowledge of database systems (e.g., Oracle, Teradata, or Snowflake) and cloud data platforms (e.g., AWS, Azure, or GCP).
  • Excellent communication and stakeholder management skills, with the ability to translate technical concepts into actionable insights for non-technical audiences.
  • Experience in the telecommunications / Financial Services or Fintech Companies or related fields is a plus.
  • Advanced analytical skills with the ability to translate data into actionable insights and strategic recommendations.
  • Demonstrated ability to collaborate effectively with cross-functional teams and external partners to achieve business objectives.
  • Excellent written and verbal communication skills. Understanding emerging markets
  • Experience at the management level in the financial sector
  • Willing and flexible to travel within Africa

    • Is this job a match or a miss?

    Bedfordview, Gauteng R - R Y On Point HR & Talent Solutions

    Posted today

    Job Description

    Job Purpose

    The Data Engineer will be responsible for driving, designing and building scalable ETL systems for a big data warehouse to implement robust & trustworthy data to support high performing ML algorithms, predictive models and support real-time data visualisation requirements across the organisation to enable self-help analytics.

  • Systematic solution design of the ETL and data pipeline inline with business user specifications
  • Develop and implement ETL pipelines aligned to the approved solution design
  • Ensure data governance and data quality assurance standards are upheld
  • Deal with customers in a customer centric manner
  • Effective Self-Management and Team work

    • Qualifications

  • Completed IT Related Degree

    • Experience Requirement

  • 5-10 years\' Experience and understanding in designing and developing data warehouses according to the Kimball methodology.
  • Adept at design and development of ETL processes. SQL development experience, preferably SAS data studio and AWS

    • experience

  • The ability to ingest / output CSV, JSON and other flat file types and any related data sources. Proficient in Python or R or willingness to learn.
  • Experience within Retail, Financial Services and Logistics environments.

    • Must have Key Skills / Technologies :

  • Primary Technologies (outside SAP) :

    • AWS and Redshift

  • Data Source :

    • SAP (ERP system)

  • Credit Modeling :

    • SAS (most current models in production)

  • Nice to have :

    • Python

    Is this job a match or a miss?

    Posted today

    Job Description

    Summary

    At Fedgroup, our in-house system powers everything from secured investments and life insurance to impact farming and beyond. Our versatile platform is central to our success, complemented by an app that empowers users to manage their financial futures with ease. In this role, you\'ll engage with diverse stakeholders, including business owners, project managers, developers, and tech partners (IOT, ML, ICT). We stay practical while leveraging battle-tested, advanced technologies to drive innovation.

    What To Expect

    Database Engineering / Management

  • Work with on-site MSSQL 2022 databases to extract, transform, and load data as needed
  • Assist the Data Lead with doing performance analysis and tuning

    • Data Collection and Analysis

  • Gather, clean, and analyse large datasets to identify trends, patterns, and insights
  • Utilize statistical methods to interpret data and generate meaningful reports

    • Reporting and Visualization

  • Develop and maintain interactive dashboards and reports for key stakeholders
  • Communicate complex data findings in a clear and understandable manner

    • Data Quality Assurance

  • Implement and maintain data quality processes to ensure accuracy and reliability
  • Collaborate with cross-functional teams to address data discrepancies and issues

    • What You\'ll Bring

    Qualifications and Experience

  • Bachelor\'s degree in a quantitative field (e.g., Statistics, Mathematics, Computer Science) or equivalent experience
  • Proven experience as a Data Engineer or in a related role with 5 years\' experience
  • Proficient in data analysis tools and languages. (Most importantly Microsoft T-SQL)
  • Experience with data visualization tools
  • Industry-specific knowledge in finance is not necessary but will be beneficial
  • Experience with open-source data pipeline ETL tools will be beneficial
  • Analytical mindset with a keen attention to detail
  • Strong communication skills, both verbal and written
  • Adaptability and willingness to learn new technologies and techniques

    • Is this job a match or a miss?

    Posted today

    Note : This is a representative sample of the many postings; the original content contains additional listings and sections.

    #J-18808-Ljbffr

    Create a job alert for this search

    Senior Data Engineer • Middelburg, Mpumalanga, South Africa

    Related jobs
    Account Executive

    Account Executive

    DevFindersGroblersdal, LP, ZA
    We are a fast-growing Cleaning company dedicated to providing outstanding service to our clients.We’re seeking a proactive and customer-focused. This role is ideal for someone who thrives in a B2C s...Show moreLast updated: 30+ days ago
    • Promoted
    Site Manager

    Site Manager

    Chart IndustriesMiddelburg, Mpumalanga, South Africa
    Howden a Chart Industries Company is a leading global engineering business who focuses on providing mission-critical air and gas handling products to our clients helping them to increase their envi...Show moreLast updated: 30+ days ago
    B2C Sales Associate

    B2C Sales Associate

    DevFindersClewer, MP, ZA
    We are a dynamic Residential and End of Tenancy Cleaning company, committed to delivering exceptional cleaning services to our clients. We are looking for a vibrant, customer-centric.The ideal candi...Show moreLast updated: 30+ days ago
    Business Development Manager

    Business Development Manager

    DevFindersOgies, MP, ZA
    Residential and end-of-tenancy services.Our focus is on delivering exceptional cleaning solutions with a customer-first approach. We’re looking for a vibrant and results-driven.This role suits someo...Show moreLast updated: 30+ days ago
    Sales Development Representative

    Sales Development Representative

    DevFindersGroblersdal, LP, ZA
    Residential and End of Tenancy services.As we continue to grow, we’re looking for a confident and enthusiastic.Sales Development Representative. Reach out to warm leads provided by the company and c...Show moreLast updated: 30+ days ago
    • Promoted
    Planner

    Planner

    Chart IndustriesMiddelburg, Mpumalanga, South Africa
    Howden a Chart Industries Company is a global leader in air and gas handling products services and solutions.Howdens core focus is on providing quality solutions for air and gas handling and has ov...Show moreLast updated: 30+ days ago