Talent.com
Big Data Support Engineer
Big Data Support EngineerAbsa Group Limited • ZA
Big Data Support Engineer

Big Data Support Engineer

Absa Group Limited • ZA
6 days ago
Job description

Job Location : , Gauteng, South Africa

Application Deadline : January 31, 2026

Job Description

  • In this role, you will be part of the Data Operations team that is responsible for supporting all the applications on the Hadoop ecosystem. This role expands in maintaining changes on datasets and optimisation activities on all applications, including new development. They therefore need to understand basic programming to enable them to manage Big Data and to transfer all data to Hadoop.

Education : Bachelor’s degree in Computer Science, Information Systems or related field.

Job Experience & Skills Required :

  • 2+ years’ experience working in Big data environment, optimising and building big data pipelines, architectures and data sets with e.g. Java, Scala, Python, Hadoop, Apache Spark and Kafka
  • Familiarity with Hadoop ecosystem and its components
  • Good knowledge of the concepts of Hadoop
  • Solid experience in a working environment in Big Data development utilising SQL or Python
  • Experience in Big Data development using Spark
  • Experience in Hadoop, HDFS and MapReduce
  • Experience in database design, development and data modelling
  • The following additional knowledge, skills and attributes are preferred :

  • Good knowledge in back-end programming, specifically java
  • Experience with development in a Linux environment and its basic commands
  • Ability to write reliable, manageable, and high-performance code
  • Should have basic knowledge of SQL, database structures, principles, and theories
  • Knowledge of workflow / schedulers
  • Strong collaboration and communication skills
  • Strong analytical and problem solving skills
  • Responsibilities

  • Support pipelines end to end
  • Build enhancements and new developments
  • Build and deploy new data pipelines
  • Identify optimisation opportunities
  • Improvement on recovery time in case of prod failures
  • Test prototypes and oversee handover to the Data Operations teams
  • Attend and contribute to regular team and User meetings
  • Responsible for the actual coding or programming of Hadoop applications
  • High-speed querying
  • Education

  • Bachelor's Degree : Information Technology
  • End Date : January 21, 2026

    Create a job alert for this search

    Data Engineer • ZA

    Similar jobs
    Specialist Support Engineer

    Specialist Support Engineer

    Absa Group Limited • ZA
    Accountability : Credit Risk Management : .To take ownership and control of credit risk related work on a defined portfolio of Global Corporates Credit Risk team clients against which Absa Group Ltd h...Show more
    Last updated: 2 days ago • Promoted
    Senior Data Science Consultant

    Senior Data Science Consultant

    Recru-it • South Africa
    Our client is seeking a full-time Senior Data Science Consultant with strong data science and consulting expertise to join their dynamic and growing Data Science team. As part of the company Data Sc...Show more
    Last updated: 12 days ago • Promoted
    Data Product Manager

    Data Product Manager

    Recru-it • South Africa
    Our client is a Data Product Manager to execute and optimize data products on their B2B data marketplace platform.You'll be responsible for managing the product lifecycle of data solutions that con...Show more
    Last updated: 30+ days ago • Promoted
    IT Infrastructure and Deployment Engineer - Remote

    IT Infrastructure and Deployment Engineer - Remote

    JenRec Recruitment • Remote, South Africa
    Remote
    The successful candidate will manage Linux-based environments, oversee deployments of the companys platform into customer infrastructure, maintain PostgreSQL databases (including replication), and ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Motorola Solutions • ZA
    As a Senior Data Engineer at RapidDeploy, a Motorola Solutions Company, you will have the hands-on opportunity to work in tandem with experienced engineers to deliver high-quality and robust soluti...Show more
    Last updated: 2 days ago • Promoted
    Full-Stack Data Engineer (SA Remote)

    Full-Stack Data Engineer (SA Remote)

    NIVA Health • ZA
    Remote
    Quick Apply
    This role is for you if you enjoy building real data solutions end-to-end — not just one piece of the puzzle.At NIVA Health, we’re growing our data capability and looking for a.You won’t be boxed i...Show more
    Last updated: 14 days ago
    Intune System Engineer

    Intune System Engineer

    Recru-it • South Africa
    Manage and support application patching and packaging processes.Oversee Windows and Microsoft patching to ensure compliance and security. Utilise SCCM and Intune for deployment, monitoring, and trou...Show more
    Last updated: 6 days ago • Promoted
    RAN Automation Engineer - fully remote

    RAN Automation Engineer - fully remote

    JenRec Recruitment • fully remote, South Africa
    Remote
    This fully remote role involves close collaboration with customer teams, technical problem-solving, and end-to-end support for project delivery. If you're confident working across time zones, thrive...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Data Platform Support Engineer

    Cloud Data Platform Support Engineer

    Recru-it • South Africa
    The Cloud Data Platform Support Engineer will play a critical role in ensuring the stability, reliability, and efficiency of the company data platform hosted in Microsoft Azure, with a future visio...Show more
    Last updated: 12 days ago • Promoted
    Senior Full Stack Engineer

    Senior Full Stack Engineer

    Recru-it • South Africa
    Our client is looking for a highly experienced and driven Senior Full Stack Engineer with a strong background in enterprise application development using. This role is perfect for someone who thrive...Show more
    Last updated: 12 days ago • Promoted
    Software Engineer - fully remote

    Software Engineer - fully remote

    JenRec Recruitment • remote, South Africa
    Remote
    Design, develop, and maintain web interfaces and backend components.Debug, troubleshoot, and resolve software issues efficiently. Conduct comprehensive testing to ensure reliability and performance....Show more
    Last updated: 30+ days ago • Promoted
    Junior to Mid Software Engineer (Java Python Cloud) – 100% REMOTE – R600k PA

    Junior to Mid Software Engineer (Java Python Cloud) – 100% REMOTE – R600k PA

    E-Merge • REMOTE, South Africa
    Remote
    We are on a mission to unboring finance.We''re building smart, slick, and scalable software that makes financial services not suck. What you''ll do (besides looking cool on Slack) : .Junior Developer ...Show more
    Last updated: 30+ days ago • Promoted
    IT Infrastructure Engineer - Remote

    IT Infrastructure Engineer - Remote

    JenRec Recruitment • Remote, South Africa
    Remote
    The ideal candidate will manage Linux-based environments, oversee platform deployments into customer infrastructure, maintain PostgreSQL databases (including replication), and ensure the security a...Show more
    Last updated: 30+ days ago • Promoted
    BI Engineer - Fully remote

    BI Engineer - Fully remote

    JenRec Recruitment • Remote, South Africa
    Remote
    You will work closely with stakeholders across the business to support and enhance telecom-focused software products.The ideal candidate is a strong communicator with a passion for data, problem-so...Show more
    Last updated: 30+ days ago • Promoted
    3rd Line Support Engineer – Remote

    3rd Line Support Engineer – Remote

    Accountancy Placements Pietermaritzburg • Any Location, South Africa
    Remote
    Act as the 3rd line escalation point, ensuring prompt resolution of technical issues referred by 2nd line support engineers and project / Account managers. Diagnose and resolve a wide range of softwar...Show more
    Last updated: 17 hours ago • Promoted • New!
    Java Software Engineer – 100% REMOTE – R1m PA

    Java Software Engineer – 100% REMOTE – R1m PA

    E-Merge • REMOTE, South Africa
    Remote
    Were not just building software were reimagining how financial services run in the real world.We create future-fit, rock-solid systems that power asset managers, investment firms, and other financ...Show more
    Last updated: 30+ days ago • Promoted
    Data Product Manager (Remote)

    Data Product Manager (Remote)

    Recru-it • South Africa
    Remote
    Data Product Strategy & Execution.Execute on the data product roadmap, contributing to strategy development under guidance of the Head of Data Product Growth. Manage assigned data product catego...Show more
    Last updated: 14 days ago • Promoted
    Senior Fullstack Software Engineer – React (Next.js) & Java

    Senior Fullstack Software Engineer – React (Next.js) & Java

    The Legends Agency • South Africa
    Senior Fullstack Software Engineer React (Next.Join a Global Engineering Group Building High-Impact, Scalable Software.Remote (South Africa) | Flexible Hours (EU-Aligned) | Market Related Salary.O...Show more
    Last updated: 8 days ago • Promoted