Talent.com
This job offer is not available in your country.
Data Engineer

Data Engineer

AFGRI Group HoldingsCenturion, Gauteng, South Africa
30+ days ago
Job description

Description

This roles responsibility is to design develop and maintain data-based solutions including ensuring that the operationalization of data pipelines and data stores are high-performing efficient organized and reliable given a set of business requirements and constraints.

The Data Engineer will build and maintain secure and compliant data processing pipelines by using different tools and techniques and maintain various data services and frameworks to store and produce cleansed and enhanced datasets for analysis. This includes data store design using different architecture patterns based on business requirements.

The incumbent will help identify and troubleshoot operational and data quality issues and design implement monitor and optimize data platforms to meet the data pipelines. Collaborate with cross-functional teams (internal and external) to ensure effective implementation set-up utilization and governance of the enterprise data platform across the organization.

This role contributes to the complete data function for data analytics business intelligence and advanced analytics. It requires a strong business focus and the individual understands the strategy and direction of the business but focuses on how to underpin that with data.

Requirements

REQUIRED MINIMUM EDUCATION / TRAINING

  • BCom or Bachelors degree in Information Technology / Computer Science / Engineering (IT) or similar
  • Data Engineering tools (Azure Data Engineer) certification will be an added advantage
  • ITIL or COBIT certification will be an added advantage

REQUIRED MINIMUM WORK EXPERIENCE

  • 2 4 years of working experience in an IT environment
  • Experience in working on IT enterprise Azure-based data solutions
  • Experience with Python and SQL
  • Experience in gathering requirements and transitioning them to designs and outcomes
  • Experience working in the Agri sector will be an advantage
  • KEY PERFORMANCE AREAS

  • Ensure the scalability of solutions
  • Continuously improve business data environment design and efficiencies
  • Deliver business benefits from advanced analytics
  • Ensure the managed data (business intelligence) is fit for purpose relative to customer needs
  • Design and develop end-to-end data solutions on the Data platform ensuring optimal performance scalability and reliability.
  • Collaborate with data architects data analysts and business stakeholders to understand data requirements define data models and implement data integration solutions.
  • Implement data pipelines data lakes and data warehouses.
  • Develop and maintain ETL / ELT processes to extract transform and load data from various sources into Azure data platforms.
  • Design and optimise data schemas tables and indexes for efficient data storage and retrieval.
  • Perform data profiling data cleansing and data quality assessments to ensure data accuracy and consistency.
  • Develop and implement data security and privacy measures ensuring compliance with relevant regulations (e.g. POPIA).
  • Monitor and troubleshoot data pipelines identifying and resolving performance bottlenecks data inconsistencies and system issues.
  • Collaborate with DevOps teams to implement CI / CD pipelines and ensure smooth deployment and release management of data solutions.
  • Stay up to date with the latest data technologies trends and best practices and provide recommendations for continuous improvement.
  • TECHNICAL KNOWLEDGE / COMPETENCIES

  • Microsoft Azure Data Suite
  • Data and Business intelligence enablement knowledge
  • Business intelligence rendering tools
  • Working knowledge of Project Management Tools
  • Excellent verbal and written communication skills
  • IT Security would be an added advantage
  • BEHAVIOURAL COMPETENCIES

  • Analytical ability
  • Attention to detail
  • Ability to tie together technologies and architectures to address requirements
  • Planning and organising
  • Strong communication skills
  • Teamwork
  • Change Agent
  • Work under pressure
  • Assertiveness
  • Interpersonal skills
  • Closing date : 15 August 2025

    Please note that correspondence will be limited to shortlisted candidates only. Applicants who have not heard from us within 30 days of the closing date may assume that their applications have been unsuccessful and are hereby thanked for their interest.

    The filling of this position will be aligned with AFGRIs Employment Equity Policy.

    Applicants are informed that in order to consider any application for employment we will have to process their personal information. A law known as the Protection of Personal Information Act 4 of 2013 (POPIA) provides that when one processes anothers personal information such collection retention dissemination and use of that persons personal information must be done in a lawful and transparent manner.

    In order to give effect to this right we are under a duty to provide you with a number of details pertaining to the processing of your personal information. These details are housed under the HR Processing Notice which can be accessed and viewed on the AFGRI Group website which HR Processing Notice we request you kindly download and read.

    Work Level

    Junior Management

    Job Type

    Permanent

    Salary

    Market Related

    EE Position

    Location

    Centurion

    Required Experience :

    Junior IC

    Key Skills

    Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

    Employment Type : Full-Time

    Experience : years

    Vacancy : 1

    #J-18808-Ljbffr

    Create a job alert for this search

    Data Engineer • Centurion, Gauteng, South Africa

    Related jobs
    • Promoted
    Data Engineer (Azure) - 6 month contract

    Data Engineer (Azure) - 6 month contract

    Ace StaffingJohannesburg, South Africa
    Bryanston, Johannesburg (Hybrid / remote).Contract : 6 months starting asap / 1 July 2025.A leading digital strategy and technology services company is seeking a skilled. This role involves designing, bu...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer – Johannesburg - R800k to R1mil per annum

    AWS Data Engineer – Johannesburg - R800k to R1mil per annum

    E-MergeJohannesburg, South Africa
    A leader in intelligence automation offering specialised software and services aimed at leveraging advances in machine learning and artificial intelligence. Design, build, and manage scalable data p...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer (SAS to Databricks) – Johannesburg – R800k to R1mil per annum

    Data Engineer (SAS to Databricks) – Johannesburg – R800k to R1mil per annum

    E-MergeJohannesburg, South Africa
    Join a leading finance and insurance company thats modernizing its data landscape.Migrate and modernize legacy SAS data pipelines to scalable, cloud-based solutions in Databricks.Design and impleme...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer / Data Scientist – Midrand / Semi-Remote – R600 PH

    Data Engineer / Data Scientist – Midrand / Semi-Remote – R600 PH

    E-MergePretoria, South Africa
    Remote
    Data Engineers and Data Scientists.Data Engineer / Data Scientist.You will design, build, and deploy data-driven solutions that enable smarter decisions across vehicle development, production, logi...Show moreLast updated: 30+ days ago
    • Promoted
    AI and Analytics Engineer – Centurion – R700k to R900k per annum

    AI and Analytics Engineer – Centurion – R700k to R900k per annum

    E-MergePretoria, South Africa
    Were looking for a sharp, business-savvy.Youll work at the intersection of advanced analytics, machine learning, and engineeringenabling better, faster, and future-focused decisions across the busi...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer – Centurion / Hybrid – R1.2m PA

    AWS Data Engineer – Centurion / Hybrid – R1.2m PA

    E-MergePretoria, South Africa
    Were a team of curious minds and caffeine-fueled builders on a mission to turn raw data into real-world impact.We believe in pipelines that dont leak, schemas that actually make sense, and dashboar...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer – Johannesburg – R1.2mil up to R1.5mil per annum

    Lead Data Engineer – Johannesburg – R1.2mil up to R1.5mil per annum

    E-MergeJohannesburg, South Africa
    An international client is seeking a hands-on.This is a high-impact role where you''ll shape and scale our data platform to power strategic initiatives across the business.Reporting directly to the...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Dina Gates Recruitment (Pty) LtdKempton Park, South Africa
    We are seeking a skilled Azure Data Engineer with a minimum of 2 years of experience to join our dynamic data team.The ideal candidate will have a strong background in SQL, Microsoft Azure, data wa...Show moreLast updated: 24 days ago
    Data Engineer- Ab Initio

    Data Engineer- Ab Initio

    Fourier IT Innovation (Pty) LtdCenturion, Gauteng, South Africa
    Quick Apply
    South African company with over 21 years of experience delivering exceptional professionalism, deep technical knowledge, and a passion for innovation. Our team thrives on pushing boundaries—both as ...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Absa Group LimitedRandburg, ZA
    Job title : Lead Data Engineer.Job Location : Gauteng, Randburg.Leveraging a thorough understanding of the business data requirements & own data subject matter expertise (ahead of trend), set data ...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Data Engineer

    Big Data Data Engineer

    PBT GroupJohannesburg, South Africa
    We are seeking a skilled Data Engineer to design and develop scalable data pipelines that ingest raw, unstructured JSON data from source systems and transform it into clean, structured datasets wit...Show moreLast updated: 25 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Recruitment Dynamix (Pty) LtdPretoria, South Africa
    Leading, well establishied business has an interestin and stimulating opportunity for an experienced Data Engineer.Help stakeholders understand the data through exploration.Build and maintain secur...Show moreLast updated: 26 days ago
    • Promoted
    Data Streaming Platform Engineer – Midrand / Semi-Remote – R650 PH

    Data Streaming Platform Engineer – Midrand / Semi-Remote – R650 PH

    E-MergePretoria, South Africa
    Remote
    Our client is currently seeking a.Data Streaming Platform Engineer.Youll work with cutting-edge technologies to power connected vehicle systems, predictive maintenance, manufacturing analytics, and...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Network RecruitmentJohannesburg, South Africa
    Lead the architectural design and implementation of the new Azure-based data warehouse.Own the data governance framework, ensuring standards for data quality, security, and access control are embed...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Oostelike Personeel KonsultanteCenturion, South Africa
    Legal requirements : Must be a South African Citizen with a clean criminal background and ITC (no bad debt) - checks will be done on shortlisted applicants. Appointment : Permanent, full-time position...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer – Johannesburg – R530 to R630 per hour

    AWS Data Engineer – Johannesburg – R530 to R630 per hour

    E-MergeJohannesburg, South Africa
    An IT South Africa Hub delivering cutting-edge IT solutions to the global Group and specialising in innovative and comprehensive IT services, including Development and Operations for.IT methodology...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer : AWS / Azure

    Data Engineer : AWS / Azure

    People SourceJohannesburg, South Africa
    You will work within a team solving complex problems to deliver real business value across a wide range of industries such as mining, telcos, retail and financial services.You will help develop bes...Show moreLast updated: 30+ days ago
    • Promoted
    AI Engineer – Midrand / Centurion -Semi – Remote – R650 PH

    AI Engineer – Midrand / Centurion -Semi – Remote – R650 PH

    E-MergePretoria, South Africa
    Remote
    Our client in the Motor industry is currently in search for an.German engineering precision with cutting-edge artificial intelligence. AI models that powers the next-generation technologies.From sma...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Architect

    Senior Data Architect

    Stafflink Recruitment SolutionsPretoria, South Africa
    The Senior Data Architect is responsible for designing, implementing, and managing data and AI architecture solutions that support the organisation''s strategic objectives.KPIs including but not li...Show moreLast updated: 30+ days ago
    • Promoted
    AI Engineer – Johannesburg – up to R700 per hour

    AI Engineer – Johannesburg – up to R700 per hour

    E-MergePretoria, South Africa
    IT solutions for the global Group.We focus on innovation and excellence across a range of technologies seeks for a versatile. This role encompasses a wide range of responsibilities, from creating da...Show moreLast updated: 30+ days ago