Talent.com
No longer accepting applications
Senior Data Engineer | Remote-First, Azure Databricks

Senior Data Engineer | Remote-First, Azure Databricks

Human AccentBoksburg, Gauteng, South Africa
3 days ago
Job type
  • Remote
Job description

Showing 19 Senior Data Engineer jobs in Johannesburg

Johannesburg, Gauteng The Legends Agency

Posted 20 days ago

Job Description

About Our Client

Our client is a specialist data and technology consultancy, delivering innovative solutions that empower financial services businesses to make smarter, faster decisions. With a strong focus on advanced analytics, AI integration, and cloud-first design, the team partners with leading insurers and financial institutions to drive transformation. They offer a collaborative, remote-first culture where your expertise will directly impact business outcomes.

The Role : Data Engineer (Contractor)

This contract role is key to designing, building, and maintaining high-quality, secure, and scalable data solutions for a leading insurance client. You\'ll work across modern data platforms and cloud environments, enabling accurate insights and supporting analytics and machine learning initiatives. The role is initially a 12-month contract, with strong potential to extend based on performance and project needs.

Key Responsibilities

  • Apply 3+5 years of experience as a Data Engineer to deliver robust, efficient data solutions.
  • Develop, maintain, and optimize data pipelines using Azure Databricks.
  • Integrate and manage Oracle databases to ensure optimal security and performance.
  • Write and optimize SQL, applying strong data modeling principles.
  • Collaborate with cross-functional teams to ensure data quality, accessibility, and scalability.
  • Support machine learning and analytical initiatives in the insurance domain.
  • Monitor, troubleshoot, and enhance existing data infrastructure.

About You

  • 3 to 5 years of hands-on Data Engineering experience.
  • Proven experience working with Oracle database environments.
  • Solid SQL and data modeling capabilities.
  • Experience in insurance or broader financial services is advantageous.
  • Strong problem-solving mindset, with the ability to work independently in a remote-first setup.
  • Collaborative team player with excellent communication skills.
  • Is this job a match or a miss?

    Johannesburg, Gauteng The Legends Agency

    Posted 16 days ago

    Job Description

    Remote (South Africa) | R18,000 - R25,000 per month depending on experience | 8am-5pm SAST

    About Our Client

    Our client is an international software development company, creator of Quintessence, a specialist data toolkit widely used by asset management firms in South Africa and now expanding into the UK. Their mission is to transform investment research processes through smarter data integration and modelling. The team is young, dynamic, and passionate about tackling complex data challenges while delivering customised solutions tailored to client needs.

    The Role : Client Support Data Engineer

    As a Client Support Data Engineer, you will provide technical and analytical support to ensure client implementations of Quintessence run smoothly and meet SLA requirements. You will work closely with both internal teams and clients, troubleshooting issues, managing data requirements, and building solutions that enhance reliability, efficiency, and usability. This is a client-facing technical role with significant opportunity to grow your expertise in financial data integration and analytics.

    Key Responsibilities

  • Minimum 2 years of experience in data analysis, modelling, and troubleshooting
  • Configure and implement Quintessence software for client environments
  • Provide 2nd Tier client support, including data enhancements and issue resolution
  • Understand and manage client data requirements within the financial markets
  • Build and maintain end-to-end data service solutions and integrations
  • Develop queries combining multiple data sources while ensuring data integrity
  • Recommend improvements to data reliability, efficiency, and quality
  • Provide structured feedback to development teams on functionality and issues
  • Design user interfaces for data uploads and visualisation
  • About You

  • 2+ years of experience working with data in a technical support or engineering role
  • Degree in Statistics, Mathematics, Engineering, Informatics, or related field
  • Strong SQL and Excel skills, plus experience in a programming language such as Python (essential)
  • Exposure to data visualisation tools (Power BI, Tableau, or QlikView) (advantageous)
  • Knowledge of APIs, ETL processes, or data warehousing (advantageous)
  • Background in financial services or asset management (distinct advantage)
  • Client-focused mindset with excellent communication skills
  • Ability to multitask, manage competing priorities, and meet deadlines
  • Is this job a match or a miss?

    Johannesburg, Gauteng Visi Select

    Posted today

    Job Description

    temporary

    We’re Hiring : AWS Data Engineer (6-Month Contract) Location : Remote (supporting an international client) Contract Duration : 6 Months (Immediate Start) Compensation : R95,000 – R110,000 per month

    We’re looking for an experienced AWS Data Engineer (Intermediate to Senior) to join our client’s global team. You’ll be building and optimising scalable data pipelines, ensuring performance, reliability, and security across cloud-based systems.

    What you’ll do : Design & optimise data pipelines and ETL processes; Work with AWS services : S3, Glue, Redshift, DBT, Spark, Terraform; Support cloud integration and modernisation projects; Ensure system performance, monitoring & reliability; Enforce data security, governance, and compliance standards; Collaborate with global, cross-functional teams

    What we’re looking for : 5+ years’ experience as a Data Engineer (Intermediate–Senior); Hands-on expertise in AWS data services; Strong SQL, data modelling, and pipeline management skills; Familiarity with CI / CD, Git, and infrastructure-as-code; Excellent collaboration and problem-solving skills

    Why join? Competitive contract compensation (R95k – R110k / month); Work with cutting-edge AWS technologies; Collaborate with international teams on high-impact projects

    If you’re ready to make an impact as an AWS Data Engineer, apply today — or share this opportunity with someone in your network!

    Is this job a match or a miss?

    Johannesburg, Gauteng A 1L Realization (Pty) Ltd

    Posted 16 days ago

    Job Description

    Education :

  • Bachelor of Science, Computer Science, Big Data, Database Administration or related fields.
  • Evidence of strong skills in Data pipeline building.
  • Experiences :

  • Proven experience (3+ years) in Advanced Data Engineering
  • Big Data On-premises and Cloud Data Pipeline (M. Fabric) deployment
  • API Development and Deployment and advantage
  • Strong technical skills in data manipulation, analysis, and visualization tools such as SQL, Python, R or Power BI.
  • Knowledge of database systems (e.g., Oracle, Teradata, or Snowflake) and cloud data platforms (e.g., AWS, Azure, or GCP).
  • Excellent communication and stakeholder management skills, with the ability to translate technical concepts into actionable insights for non-technical audiences.
  • Experience in the telecommunications / Financial Services or Fintech Companies or related fields is a plus.
  • Advanced analytical skills with the ability to translate data into actionable insights and strategic recommendations.
  • Demonstrated ability to collaborate effectively with cross-functional teams and external partners to achieve business objectives.
  • Excellent written and verbal communication skills. Understanding emerging markets
  • Experience at the management level in the financial sector
  • Willing and flexible to travel within Africa
  • Is this job a match or a miss?

    Bedfordview, Gauteng R - R Y On Point HR & Talent Solutions

    Posted today

    Job Description

    Job Purpose

    The Data Engineer will be responsible for driving, designing and building scalable ETL systems for a big data warehouse to implement robust & trustworthy data to support high performing ML algorithms, predictive models and support real-time data visualisation requirements across the organisation to enable self-help analytics.

  • Systematic solution design of the ETL and data pipeline inline with business user specifications
  • Develop and implement ETL pipelines aligned to the approved solution design
  • Ensure data governance and data quality assurance standards are upheld
  • Deal with customers in a customer centric manner
  • Effective Self-Management and Team work
  • Qualifications

  • Completed IT Related Degree
  • Experience Requirement

  • 5-10 years\' Experience and understanding in designing and developing data warehouses according to the Kimball methodology.
  • Adept at design and development of ETL processes. SQL development experience, preferably SAS data studio and AWS
  • experience

  • The ability to ingest / output CSV, JSON and other flat file types and any related data sources. Proficient in Python or R or willingness to learn.
  • Experience within Retail, Financial Services and Logistics environments.
  • Must have Key Skills / Technologies :

  • Primary Technologies (outside SAP) :
  • AWS and Redshift

  • Data Source :
  • SAP (ERP system)

  • Credit Modeling :
  • SAS (most current models in production)

  • Nice to have :
  • Python

    Is this job a match or a miss?

    Posted today

    Job Description

    Summary

    At Fedgroup, our in-house system powers everything from secured investments and life insurance to impact farming and beyond. Our versatile platform is central to our success, complemented by an app that empowers users to manage their financial futures with ease. In this role, you\'ll engage with diverse stakeholders, including business owners, project managers, developers, and tech partners (IOT, ML, ICT). We stay practical while leveraging battle-tested, advanced technologies to drive innovation.

    What To Expect

    Database Engineering / Management

  • Work with on-site MSSQL 2022 databases to extract, transform, and load data as needed
  • Assist the Data Lead with doing performance analysis and tuning
  • Data Collection and Analysis

  • Gather, clean, and analyse large datasets to identify trends, patterns, and insights
  • Utilize statistical methods to interpret data and generate meaningful reports
  • Reporting and Visualization

  • Develop and maintain interactive dashboards and reports for key stakeholders
  • Communicate complex data findings in a clear and understandable manner
  • Data Quality Assurance

  • Implement and maintain data quality processes to ensure accuracy and reliability
  • Collaborate with cross-functional teams to address data discrepancies and issues
  • What You\'ll Bring

    Qualifications and Experience

  • Bachelor\'s degree in a quantitative field (e.g., Statistics, Mathematics, Computer Science) or equivalent experience
  • Proven experience as a Data Engineer or in a related role with 5 years\' experience
  • Proficient in data analysis tools and languages. (Most importantly Microsoft T-SQL)
  • Experience with data visualization tools
  • Industry-specific knowledge in finance is not necessary but will be beneficial
  • Experience with open-source data pipeline ETL tools will be beneficial
  • Analytical mindset with a keen attention to detail
  • Strong communication skills, both verbal and written
  • Adaptability and willingness to learn new technologies and techniques
  • Is this job a match or a miss?

    Posted today

    Note : This is a representative sample of the many postings; the original content contains additional listings and sections.

    #J-18808-Ljbffr

    Create a job alert for this search

    Senior Data Engineer • Boksburg, Gauteng, South Africa

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    One SparkJohannesburg, South Africa
    The Senior Data Engineer is the architect and builder of Dis-Chem Lifes data foundation, creating the infrastructure that turns raw information into a strategic asset. This role goes far beyond movi...Show moreLast updated: 30+ days ago
    • Promoted
    AI Engineer

    AI Engineer

    Network1Centurion, Gauteng, South Africa
    IT infrastructure environments.This role is responsible for ensuring the stability scalability and security of all IT systems and supporting power infrastructure while overseeing vendors internal g...Show moreLast updated: 17 days ago
    • Promoted
    Intermediate or Senior AWS Data Engineer – Johannesburg – up to R900k per annum

    Intermediate or Senior AWS Data Engineer – Johannesburg – up to R900k per annum

    E-MergeJohannesburg, South Africa
    A Technology and Business Consulting Firm that was founded through a combination of technology, data, financial and actuarial science principles. Intermediate or Senior AWS Data Engineer.You will wo...Show moreLast updated: 30+ days ago
    • Promoted
    SENIOR DATA ENGINEER (AZURE) - FULLY REMOTE - UP TO R1.1M PER ANNUM

    SENIOR DATA ENGINEER (AZURE) - FULLY REMOTE - UP TO R1.1M PER ANNUM

    E-MergeJohannesburg, South Africa
    Remote
    A forward-thinking technology solutions company dedicated to delivering cutting-edge digital transformation services to clients worldwide is seeking an experienced Senior Data Engineer (Azure) to j...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CloudSmithsJohannesburg, Gauteng, South Africa
    Are you a highly skilled Senior Data Engineer ready to lead and innovate in a dynamic cloud-driven environment Were looking for a pivotal team member to design develop and maintain cutting-edge dat...Show moreLast updated: 30+ days ago
    AWS Developer Cryptography (Senior)

    AWS Developer Cryptography (Senior)

    Khonology (Pty) LtdRandburg, GP, ZA
    The Cloud Security Engineer is responsible for designing, building, and maintaining secure, scalable cloud infrastructure primarily on AWS, with integration across Azure environments.This role ensu...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Network1Centurion, Gauteng, South Africa
    Are you a seasoned Data Engineer and visionary professional ready to lead high-impact projects in a dynamic data-driven environment Were looking for a technically strong Senior Data Engineer to joi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer (Contract) GautengHybrid ISB903245

    Senior Data Engineer (Contract) GautengHybrid ISB903245

    iSanqa ResourcingMidrand, Gauteng, South Africa
    Ready to transform raw data into intelligent insights that power next-generation automotive security solutions.Step into the future of data engineering and join a team where your expertise in machi...Show moreLast updated: 30+ days ago
    • Promoted
    Data and Analytics Lead

    Data and Analytics Lead

    Afrizan People IntelligenceNigel, Gauteng, South Africa
    Are you a data leader ready to shape the future of enterprise analytics in a fast-paced evolving environment.A prominent client is seeking a. This is a key leadership role responsible for guiding a ...Show moreLast updated: 25 days ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    PBT GroupJohannesburg, South Africa
    PBT Group is seeking an experienced.The successful candidate will have a proven background in designing, building, and optimising large-scale data pipelines within the. Azure Data Factory, Spark, an...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data and AI Engineer

    Lead Data and AI Engineer

    Boardroom AppointmentsSandton, South Africa
    Drive the vision, execution, and continuous improvement of the company's data and AI team.Mentor a high-performing team, instilling best practices and innovative thinking.Align projects with busine...Show moreLast updated: 30+ days ago
    • Promoted
    Senior BI Developer - Hybrid

    Senior BI Developer - Hybrid

    Profession HubSandton, South Africa
    Our client is searching for a Senior BI Developer with strong technical skills and business acumen to join our team.The ideal candidate should be proficient in data analysis, reporting, and visuali...Show moreLast updated: 16 days ago
    • Promoted
    Intermediate Senior Data Engineer (Databricks)

    Intermediate Senior Data Engineer (Databricks)

    AICA ConsultancyCenturion, Gauteng, South Africa
    We are looking for a Data Engineer who is certified in Databricks (required) to join our this role you will be designing developing and optimizing scalable data pipelines and workflows on Databric...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    HR GenieSandton, South Africa
    At Fedgroup, our in-house system powers everything from secured investments and life insurance to impact farming and beyond. Our versatile platform is central to our success, complemented by an app ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Oostelike Personeel KonsultanteCenturion, South Africa
    Legal requirements : Must be a South African Citizen with a clean criminal background and ITC (no bad debt) - checks will be done on shortlisted applicants. Appointment : Permanent, full-time position...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer : AWS / Azure

    Data Engineer : AWS / Azure

    People SourceJohannesburg, South Africa
    You will work within a team solving complex problems to deliver real business value across a wide range of industries such as mining, telcos, retail and financial services.You will help develop bes...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Ntice Sourcing SolutionsJohannesburg, Gauteng, South Africa
    As a Senior Data Engineer youll be a key contributor to the design development and optimization of data pipelines and platforms. Youll work closely with data scientists analysts and software enginee...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Datonomy SolutionsCenturion, South Africa
    We are seeking a Senior Data Engineer to join our team based in Centurion.The Senior Data Engineer is responsible for designing, building, and maintaining robust, scalable data pipelines and platfo...Show moreLast updated: 2 days ago