Talent.com
Senior Data Engineer | Remote-First, Azure Databricks
Senior Data Engineer | Remote-First, Azure DatabricksHuman Accent • Pinetown, KwaZulu-Natal, South Africa
No longer accepting applications
Senior Data Engineer | Remote-First, Azure Databricks

Senior Data Engineer | Remote-First, Azure Databricks

Human Accent • Pinetown, KwaZulu-Natal, South Africa
5 days ago
Job type
  • Remote
Job description

Showing 19 Senior Data Engineer jobs in Johannesburg

Johannesburg, Gauteng The Legends Agency

Posted 20 days ago

Job Description

About Our Client

Our client is a specialist data and technology consultancy, delivering innovative solutions that empower financial services businesses to make smarter, faster decisions. With a strong focus on advanced analytics, AI integration, and cloud-first design, the team partners with leading insurers and financial institutions to drive transformation. They offer a collaborative, remote-first culture where your expertise will directly impact business outcomes.

The Role : Data Engineer (Contractor)

This contract role is key to designing, building, and maintaining high-quality, secure, and scalable data solutions for a leading insurance client. You\'ll work across modern data platforms and cloud environments, enabling accurate insights and supporting analytics and machine learning initiatives. The role is initially a 12-month contract, with strong potential to extend based on performance and project needs.

Key Responsibilities

  • Apply 3+5 years of experience as a Data Engineer to deliver robust, efficient data solutions.
  • Develop, maintain, and optimize data pipelines using Azure Databricks.
  • Integrate and manage Oracle databases to ensure optimal security and performance.
  • Write and optimize SQL, applying strong data modeling principles.
  • Collaborate with cross-functional teams to ensure data quality, accessibility, and scalability.
  • Support machine learning and analytical initiatives in the insurance domain.
  • Monitor, troubleshoot, and enhance existing data infrastructure.

About You

  • 3 to 5 years of hands-on Data Engineering experience.
  • Proven experience working with Oracle database environments.
  • Solid SQL and data modeling capabilities.
  • Experience in insurance or broader financial services is advantageous.
  • Strong problem-solving mindset, with the ability to work independently in a remote-first setup.
  • Collaborative team player with excellent communication skills.
  • Is this job a match or a miss?

    Johannesburg, Gauteng The Legends Agency

    Posted 16 days ago

    Job Description

    Remote (South Africa) | R18,000 - R25,000 per month depending on experience | 8am-5pm SAST

    About Our Client

    Our client is an international software development company, creator of Quintessence, a specialist data toolkit widely used by asset management firms in South Africa and now expanding into the UK. Their mission is to transform investment research processes through smarter data integration and modelling. The team is young, dynamic, and passionate about tackling complex data challenges while delivering customised solutions tailored to client needs.

    The Role : Client Support Data Engineer

    As a Client Support Data Engineer, you will provide technical and analytical support to ensure client implementations of Quintessence run smoothly and meet SLA requirements. You will work closely with both internal teams and clients, troubleshooting issues, managing data requirements, and building solutions that enhance reliability, efficiency, and usability. This is a client-facing technical role with significant opportunity to grow your expertise in financial data integration and analytics.

    Key Responsibilities

  • Minimum 2 years of experience in data analysis, modelling, and troubleshooting
  • Configure and implement Quintessence software for client environments
  • Provide 2nd Tier client support, including data enhancements and issue resolution
  • Understand and manage client data requirements within the financial markets
  • Build and maintain end-to-end data service solutions and integrations
  • Develop queries combining multiple data sources while ensuring data integrity
  • Recommend improvements to data reliability, efficiency, and quality
  • Provide structured feedback to development teams on functionality and issues
  • Design user interfaces for data uploads and visualisation
  • About You

  • 2+ years of experience working with data in a technical support or engineering role
  • Degree in Statistics, Mathematics, Engineering, Informatics, or related field
  • Strong SQL and Excel skills, plus experience in a programming language such as Python (essential)
  • Exposure to data visualisation tools (Power BI, Tableau, or QlikView) (advantageous)
  • Knowledge of APIs, ETL processes, or data warehousing (advantageous)
  • Background in financial services or asset management (distinct advantage)
  • Client-focused mindset with excellent communication skills
  • Ability to multitask, manage competing priorities, and meet deadlines
  • Is this job a match or a miss?

    Johannesburg, Gauteng Visi Select

    Posted today

    Job Description

    temporary

    We’re Hiring : AWS Data Engineer (6-Month Contract) Location : Remote (supporting an international client) Contract Duration : 6 Months (Immediate Start) Compensation : R95,000 – R110,000 per month

    We’re looking for an experienced AWS Data Engineer (Intermediate to Senior) to join our client’s global team. You’ll be building and optimising scalable data pipelines, ensuring performance, reliability, and security across cloud-based systems.

    What you’ll do : Design & optimise data pipelines and ETL processes; Work with AWS services : S3, Glue, Redshift, DBT, Spark, Terraform; Support cloud integration and modernisation projects; Ensure system performance, monitoring & reliability; Enforce data security, governance, and compliance standards; Collaborate with global, cross-functional teams

    What we’re looking for : 5+ years’ experience as a Data Engineer (Intermediate–Senior); Hands-on expertise in AWS data services; Strong SQL, data modelling, and pipeline management skills; Familiarity with CI / CD, Git, and infrastructure-as-code; Excellent collaboration and problem-solving skills

    Why join? Competitive contract compensation (R95k – R110k / month); Work with cutting-edge AWS technologies; Collaborate with international teams on high-impact projects

    If you’re ready to make an impact as an AWS Data Engineer, apply today — or share this opportunity with someone in your network!

    Is this job a match or a miss?

    Johannesburg, Gauteng A 1L Realization (Pty) Ltd

    Posted 16 days ago

    Job Description

    Education :

  • Bachelor of Science, Computer Science, Big Data, Database Administration or related fields.
  • Evidence of strong skills in Data pipeline building.
  • Experiences :

  • Proven experience (3+ years) in Advanced Data Engineering
  • Big Data On-premises and Cloud Data Pipeline (M. Fabric) deployment
  • API Development and Deployment and advantage
  • Strong technical skills in data manipulation, analysis, and visualization tools such as SQL, Python, R or Power BI.
  • Knowledge of database systems (e.g., Oracle, Teradata, or Snowflake) and cloud data platforms (e.g., AWS, Azure, or GCP).
  • Excellent communication and stakeholder management skills, with the ability to translate technical concepts into actionable insights for non-technical audiences.
  • Experience in the telecommunications / Financial Services or Fintech Companies or related fields is a plus.
  • Advanced analytical skills with the ability to translate data into actionable insights and strategic recommendations.
  • Demonstrated ability to collaborate effectively with cross-functional teams and external partners to achieve business objectives.
  • Excellent written and verbal communication skills. Understanding emerging markets
  • Experience at the management level in the financial sector
  • Willing and flexible to travel within Africa
  • Is this job a match or a miss?

    Bedfordview, Gauteng R - R Y On Point HR & Talent Solutions

    Posted today

    Job Description

    Job Purpose

    The Data Engineer will be responsible for driving, designing and building scalable ETL systems for a big data warehouse to implement robust & trustworthy data to support high performing ML algorithms, predictive models and support real-time data visualisation requirements across the organisation to enable self-help analytics.

  • Systematic solution design of the ETL and data pipeline inline with business user specifications
  • Develop and implement ETL pipelines aligned to the approved solution design
  • Ensure data governance and data quality assurance standards are upheld
  • Deal with customers in a customer centric manner
  • Effective Self-Management and Team work
  • Qualifications

  • Completed IT Related Degree
  • Experience Requirement

  • 5-10 years\' Experience and understanding in designing and developing data warehouses according to the Kimball methodology.
  • Adept at design and development of ETL processes. SQL development experience, preferably SAS data studio and AWS
  • experience

  • The ability to ingest / output CSV, JSON and other flat file types and any related data sources. Proficient in Python or R or willingness to learn.
  • Experience within Retail, Financial Services and Logistics environments.
  • Must have Key Skills / Technologies :

  • Primary Technologies (outside SAP) :
  • AWS and Redshift

  • Data Source :
  • SAP (ERP system)

  • Credit Modeling :
  • SAS (most current models in production)

  • Nice to have :
  • Python

    Is this job a match or a miss?

    Posted today

    Job Description

    Summary

    At Fedgroup, our in-house system powers everything from secured investments and life insurance to impact farming and beyond. Our versatile platform is central to our success, complemented by an app that empowers users to manage their financial futures with ease. In this role, you\'ll engage with diverse stakeholders, including business owners, project managers, developers, and tech partners (IOT, ML, ICT). We stay practical while leveraging battle-tested, advanced technologies to drive innovation.

    What To Expect

    Database Engineering / Management

  • Work with on-site MSSQL 2022 databases to extract, transform, and load data as needed
  • Assist the Data Lead with doing performance analysis and tuning
  • Data Collection and Analysis

  • Gather, clean, and analyse large datasets to identify trends, patterns, and insights
  • Utilize statistical methods to interpret data and generate meaningful reports
  • Reporting and Visualization

  • Develop and maintain interactive dashboards and reports for key stakeholders
  • Communicate complex data findings in a clear and understandable manner
  • Data Quality Assurance

  • Implement and maintain data quality processes to ensure accuracy and reliability
  • Collaborate with cross-functional teams to address data discrepancies and issues
  • What You\'ll Bring

    Qualifications and Experience

  • Bachelor\'s degree in a quantitative field (e.g., Statistics, Mathematics, Computer Science) or equivalent experience
  • Proven experience as a Data Engineer or in a related role with 5 years\' experience
  • Proficient in data analysis tools and languages. (Most importantly Microsoft T-SQL)
  • Experience with data visualization tools
  • Industry-specific knowledge in finance is not necessary but will be beneficial
  • Experience with open-source data pipeline ETL tools will be beneficial
  • Analytical mindset with a keen attention to detail
  • Strong communication skills, both verbal and written
  • Adaptability and willingness to learn new technologies and techniques
  • Is this job a match or a miss?

    Posted today

    Note : This is a representative sample of the many postings; the original content contains additional listings and sections.

    #J-18808-Ljbffr

    Create a job alert for this search

    Senior Data Engineer • Pinetown, KwaZulu-Natal, South Africa

    Related jobs
    Senior Customer Service Consultant

    Senior Customer Service Consultant

    Tower Group • Cato Ridge, South Africa
    Our client a leader in the steel industry is seeking a highly experienced.Senior Customer Service Consultant to join their team based in Cato ridge . Bachelor's degree in Commercial or equivalent Di...Show more
    Last updated: 30+ days ago • Promoted
    Data and Analytics Team Lead (Business Intelligence / Mentorship Focus) - Durban – up to R900k

    Data and Analytics Team Lead (Business Intelligence / Mentorship Focus) - Durban – up to R900k

    E-Merge • Durban, South Africa
    Join a data-driven solutions company with industry-specific expertise for a.The client is searching for a dynamic and experienced. This role blends hands-on technical expertise in.Lead end-to-end de...Show more
    Last updated: 30+ days ago • Promoted
    Senior Azure Engineer

    Senior Azure Engineer

    HR Genie • Mount Edgecombe, South Africa
    We are seeking a highly skilled Senior Azure Engineer with 510 years of experience to lead the engineering, automation, and administration of our Azure cloud infrastructure.This role is critical to...Show more
    Last updated: 30+ days ago • Promoted
    Operations Administrator | Remote

    Operations Administrator | Remote

    DevFinders • Craigieburn, KZN, ZA
    Remote
    Want to work remotely for a UK-based company while doing what you love? We’re searching for someone who thrives on organisation and enjoys keeping things running smoothly behind the scenes.As our R...Show more
    Last updated: 8 days ago
    Sales Consultant

    Sales Consultant

    One Spark • Pinetown, South Africa
    Welcome to the frontline of protection.At Dis-Chem Life, we are doing it differently.We are putting Sales Consultants inside the busiest health and wellness stores in South Africa.We are looking fo...Show more
    Last updated: 30+ days ago • Promoted
    Business Development Manager

    Business Development Manager

    DevFinders • Bazley, KZN, ZA
    Residential and end-of-tenancy services.Our focus is on delivering exceptional cleaning solutions with a customer-first approach. We’re looking for a vibrant and results-driven.This role suits someo...Show more
    Last updated: 30+ days ago
    Senior DevOps Engineer – Durban – R1m PA

    Senior DevOps Engineer – Durban – R1m PA

    E-Merge • Durban, South Africa
    Are you the type who doesnt just fix problems you automate them out of existence?.Do you get a kick out of watching clean pipelines flow and servers hum like a well-tuned race car?.Its your chance...Show more
    Last updated: 30+ days ago • Promoted
    Developer

    Developer

    Invictus Education Group • Umhlanga Rocks, NL, za
    Quick Apply
    We are seeking a motivated and detail-oriented.The ideal candidate will have a strong understanding of.This role is perfect for someone with solid programming fundamentals, analytical thinking, and...Show more
    Last updated: 25 days ago
    Qlik Sense Developer

    Qlik Sense Developer

    Pro Stop Recruitment Services • morningside, KwaZulu-Natal, South Africa
    Work closely with stakeholders to understand business goals, challenges, and opportunities.Translate business questions into clear, data-driven requirements and KPIs. Explore data sources, assess da...Show more
    Last updated: 30+ days ago • Promoted
    Junior Data Analyst

    Junior Data Analyst

    Growth Resourcing • Umhlanga, KwaZulu-Natal, ZA
    Quick Apply
    Growth Resourcing is seeking a detail-oriented and analytical Junior Data Analyst to join our team.In this role, you will support key data-driven decision-making processes by collecting, processing...Show more
    Last updated: 8 hours ago • New!
    Sales and Technical Manager

    Sales and Technical Manager

    Boardroom Appointments • Pinetown, South Africa
    Customer service & sales support creating client centricity.Build strong relationships with customers personally and professional. Manage sales budget and gross margin.Attend to customer complai...Show more
    Last updated: 30+ days ago
    SENIOR DEVOPS ENGINEER DURBAN / CAPE TOWN (HYBRID) @ R1M PER ANNUM

    SENIOR DEVOPS ENGINEER DURBAN / CAPE TOWN (HYBRID) @ R1M PER ANNUM

    E-Merge • Durban, South Africa
    A privately‑held betting software development powerhouse specializing in high‑performance platforms across Africa is looking for a Senior DevOps Engineer to join their high-performing team.You will...Show more
    Last updated: 30+ days ago • Promoted
    Senior Inbound Consultant

    Senior Inbound Consultant

    Tower Group • Westville, South Africa
    Our client, a leader in the travel and Tourism industry is URGENTLY seeking an experienced Senior Inbound Consultant to join their team based in Durban. DMC or tour operating environment.Comprehensi...Show more
    Last updated: 30+ days ago • Promoted
    Financial Advisor

    Financial Advisor

    One Spark • Dolphin Coast / Ballito, South Africa
    You became a Financial Advisor to make a difference, to help people make informed decisions for them and their loved ones. At Dis-Chem Life, we are giving you the platform to do just that.Welcome to...Show more
    Last updated: 30+ days ago • Promoted
    Junior Data Analyst | Ballito

    Junior Data Analyst | Ballito

    The Recruitment Council • Ballito, South Africa
    The Recruitment Council seeks a motivated Data Analyst with 6 months to 2 years of experience to support our recruitment and business development teams. This role drives success by analyzing data, m...Show more
    Last updated: 30+ days ago • Promoted
    Sales Development Representative

    Sales Development Representative

    DevFinders • Amandawe, KZN, ZA
    Residential and End of Tenancy services.As we continue to grow, we’re looking for a confident and enthusiastic.Sales Development Representative. Reach out to warm leads provided by the company and c...Show more
    Last updated: 30+ days ago