Talent.com
Data Engineer

Data Engineer

Top Vitae RecruitmentGqeberha, Eastern Cape, South Africa
6 days ago
Job description

FUNCTIONAL DEFINITION AND RESPONSIBILITY

The Data Engineer is responsible for developing, maintaining, and optimising the data systems and operational pipelines that support the company’s market research and analytics processes. The role ensures that data flows seamlessly from collection through transformation to reporting, enabling timely, accurate, and actionable insights for clients. This position bridges technical development and operational efficiency, ensuring data reliability, process automation, and continuous improvement across the data lifecycle.

RESPONSIBILITIES

Data Systems Development and Maintenance

  • Design, build, and maintain data pipelines and ETL processes for efficient ingestion, transformation, and storage of large, multi-source datasets.
  • Develop automation solutions that improve data quality, integrity, and processing efficiency across the research workflow.
  • Maintain and enhance database systems, ensuring data consistency, accuracy, and optimal performance.
  • Develop APIs and integration scripts to connect internal platforms with third-party data sources and tools.

Operational Data Management

  • Monitor data workflows to ensure timely delivery and availability for analysis and reporting.
  • Diagnose and resolve issues in data processing and system performance.
  • Implement process controls and error handling to minimise downtime and data discrepancies.
  • Support data validation and reconciliation to maintain confidence in reporting outputs.
  • Collaboration and Stakeholder Support

  • Work closely with research, data analytics and data science to understand operational needs and deliver scalable data solutions.
  • Translate data and workflow requirements into robust, maintainable technical systems.
  • Provide technical input into data architecture, governance, and process improvement initiatives.
  • Document data flows, system configurations, and development procedures for operational continuity.
  • Innovation and Continuous Improvement

  • Identify opportunities to optimise data pipelines and automate manual processes.
  • Evaluate and implement new tools and technologies to improve data efficiency and quality.
  • Contribute to the continuous improvement of data engineering standards, best practices, and workflows.
  • QUALIFICATIONS & EXPERIENCE

  • Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or a related field (or equivalent experience).
  • 3-5 years’ experience in data operations, data engineering, or software development roles.
  • Proven experience in building and maintaining data pipelines and automated workflows.
  • Exposure to market research or data analytics environments is highly advantageous.
  • Experience in managing data within cloud-based or hybrid infrastructures.
  • TECHNICAL SKILLS

  • Proficiency in scripting languages (Python, R, DAX, or equivalent).
  • Expertise in designing and maintaining ETL / ELT pipelines.
  • Proficiency in SQL and data modelling for relational and non-relational databases.
  • Experience with cloud platforms (AWS, Azure, or GCP) and associated data services.
  • Knowledge of BI tools (Power BI, Tableau) and data warehousing concepts.
  • Knowledge of Microsoft Fabric.
  • Knowledge of APIs and systems integration.
  • CORE COMPETENCIES

  • Strong statistical / mathematical skills.
  • Excellent understanding of data operations within a commercial or research environment.
  • Ability to translate business requirements into scalable technical workflows.
  • #J-18808-Ljbffr

    Create a job alert for this search

    Data Engineer • Gqeberha, Eastern Cape, South Africa

    Related jobs
    • Promoted
    Senior AWS Data Engineer - Semi Remote - up to R900 PH 1835520

    Senior AWS Data Engineer - Semi Remote - up to R900 PH 1835520

    E-Merge IT RecruitmentGqeberha, Eastern Cape, South Africa
    Remote
    An AWS Data Engineer with 12 years hands-on data engineering experience is required to join a team of amazing developers creating next generation software systems in a leading manufacturing busines...Show moreLast updated: 30+ days ago
    • Promoted
    Temp Project Engineer

    Temp Project Engineer

    Profile PersonnelKariega, South Africa
    To plan, design, develop and introduce the provision, modification and maintenance of material handling facilities, transport, packaging, processes and systems for the optimal material flow from so...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    NOVGqeberha, Eastern Cape, South Africa
    Are you passionate about leveraging data and analytics to drive operational impact in the energy sector? At NOV, we lead technological innovation to deliver exceptional value to our customers in dr...Show moreLast updated: 18 days ago
    • Promoted
    Server Engineer

    Server Engineer

    ICT EngagePort Elizabeth, South Africa
    Our client is searching for an experienced intermediate S.The ideal candidate will help build, maintain, and troubleshoot, the company's rapidly expanding co-lo and cloud infrastructure.They will w...Show moreLast updated: 5 days ago
    • Promoted
    Engineering Data Controller

    Engineering Data Controller

    Profile PersonnelGqeberha, Eastern Cape, South Africa
    A relevant 3-year diploma or degree in Engineering, Logistics or IT.Proficiency in the following systems is essential : TIS, MBT, AVON, MBV, KVS, Connect, TI-REX, CoRe, COPS.Ability to read and inte...Show moreLast updated: 23 days ago
    • Promoted
    Quality Engineer (Permanent)

    Quality Engineer (Permanent)

    Profile PersonnelPort Elizabeth, South Africa
    To plan, define, and lead all departmental project activities, by ensuring that all units are tracked, processed, audited, reworked and signoff, throughout the various EOL checkpoints and audits ar...Show moreLast updated: 30+ days ago
    • Promoted
    Junior Data Analyst

    Junior Data Analyst

    RMG Recruitment (Pty) LtdGqeberha, Eastern Cape, South Africa
    Junior Data Analyst required in Port Elizabeth.We are seeking a Junior Data Analyst to clean, transform, analyse, and visualize data—often involving advanced tasks like pivot tables, data formattin...Show moreLast updated: 25 days ago
    • Promoted
    Data Manager & Data Reporting Administrator

    Data Manager & Data Reporting Administrator

    Staff Solutions RecruitmentPort Elizabeth, South Africa
    This pivotal role supports the data-driven decision-making by collaborating with IT teams, consultants, and accountants to execute our clients' business analytics strategy.Preference would be that ...Show moreLast updated: 22 days ago
    • Promoted
    Endurance Engineer (1 Year FTC)

    Endurance Engineer (1 Year FTC)

    Abantu Staffing SolutionsKariega, South Africa
    National Diploma / Degree in a suitable engineering field (Electrical / Electronic or Mechatronics preferred).Minimum of 3 years of relevant experience in the automotive industry.Extensive knowledge ...Show moreLast updated: 19 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Top VitaePort Elizabeth, South Africa
    FUNCTIONAL DEFINITION AND RESPONSIBILITY : .The Data Engineer is responsible for developing, maintaining, and optimising the data systems and operational pipelines that support the company’s market r...Show moreLast updated: 9 days ago
    • Promoted
    Trainee Manager

    Trainee Manager

    Jobs2dayUitenhage, South Africa
    We are seeking a dynamic and motivated.This role is part of a structured management training program designed to equip high-potential individuals with the skills, knowledge, and experience required...Show moreLast updated: 30+ days ago
    • Promoted
    Alignment Engineer (Remote - Fulltime) $12.00 / hr

    Alignment Engineer (Remote - Fulltime) $12.00 / hr

    Intelligent Technical SolutionsGqeberha, Eastern Cape, South Africa
    Remote
    Intelligent Technical Solutions, you are expected to perform Client standards and alignment reviews and work proactively towards aligning Clients that are misaligned against our Company standards.M...Show moreLast updated: 30+ days ago
    • Promoted
    AI Systems Administrator

    AI Systems Administrator

    MCIMotherwell, Eastern Cape, South Africa
    MCI is one of the fastest-growing tech-enabled business services companies in the USA, with a strong call center footprint and operations that extend across multiple countries.We deliver Customer E...Show moreLast updated: 12 days ago
    • Promoted
    Data Engineer (Remote) Market related

    Data Engineer (Remote) Market related

    Datafin IT RecruitmentGqeberha, Eastern Cape, South Africa
    Remote
    A leading FinTech company seeks to fill the role of a Data Engineer with a knack for data analysis to join its team.It is a remote role that includes data manipulation, modelling, and being respons...Show moreLast updated: 30+ days ago
    • Promoted
    Facilities Engineer

    Facilities Engineer

    Ace StaffingPort Elizabeth, South Africa
    Automotive / Engineering / Manufacturing.A leading automotive and engineering company is looking for a.Reporting to the Facility Specialist, this role is responsible for managing maintenance activi...Show moreLast updated: 30+ days ago
    • Promoted
    Intermediate Server Engineer

    Intermediate Server Engineer

    Staff Solutions RecruitmentPort Elizabeth, South Africa
    The NOT-SO-TECHNICAL requirements : .This is a fast-paced role : which will suit engineer(s) who are meticulous, self-starters who can take ownership of a task and are confident in seeing a project th...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer I

    Senior Software Engineer I

    LexisNexisGqeberha, Eastern Cape, South Africa
    LexisNexis Legal & Professional, which serves customers in more than 150 countries with 11,800 employees worldwide, is part of RELX, a global provider of information-based analytics and decision to...Show moreLast updated: 23 days ago
    • Promoted
    Homologation Engineer (1 Year FTC)

    Homologation Engineer (1 Year FTC)

    Abantu Staffing SolutionsKariega, South Africa
    Degree in Engineering / Business Law / Marketing.Minimum 5 years of experience in an automotive / engineering environment. Strong communication and organizational skills.Strong Project Management skill...Show moreLast updated: 19 days ago