Job title : Data Engineer
Job Location : Gauteng,
Deadline : November 29, 2025
Quick Recommended Links
- Jobs by Location
- Job by industries
Role Objectives :
The primary objective of this role is to design, develop, and maintain robust and scalable Big Data Pipelines and data architectures, ensuring optimal extraction, transformation, and loading of data across multiple application platforms. The Data Engineer will act as a custodian of data, ensuring compliance with information classification requirements, and enabling data consumers to build and optimize data consumption effectively. This role demands profound technical expertise in Data Engineering, Data Warehouse Design, and advanced analytics, utilizing modern software engineering concepts and BI tools. The Data Engineer will leverage Azure Data Solutions and various data-related programming languages and frameworks to analyze data elements, perform root cause analysis, and collaborate with technology colleagues and data teams to deliver viable data solutions within architectural guidelines.Key Responsibilities :
Responsible for building and maintaining Big Data PipelinesCustodians of data and must ensure that data is shared in line with the information classification requirements on a need-to-know basisExperience using programming skills in data related programming languages and frameworks, such as Python, Spark, SQLExperience with Azure Data Solutions : Azure Data Factory, Azure Data Explorer, Azure DatabricksProfound technical understanding for Data Engineering and Data Warehouse DesignFamiliar with modern software engineering concepts Know-how in advanced analytics and BI Tools.Develop and maintain complete data architecture across several application platformsAnalyze data elements and systemsBuild required infrastructure for optimal extraction, transformation and loading of dataBuild, create, manage and optimize data pipelinesCreate data tooling, enabling data consumers in building and optimizing data consumptionExecute on the design, definition and development of (API's)Develop across several application platformsExperience performing root cause analysis on internal and external data and processesKnowledge of integration patterns, styles, protocols and systemsLiaise and collaborate with technology colleagues and data teams to understand viable data solutions within architectural guidelinesUpdate technical documentation on data extracts and report functionality to facilitate future understanding to the extent required for ongoing support. Respond to user queries, error logging and further enhancement requests to ensure reports are used and serve their intended purpose.Provide OLAP support and end-user training on the various cubes used for reporting downstreamData Modelling - emphasizes on what data is needed and how it should be organized instead of what operations need to be performed on the data. Data Model is like architect's building plan which helps to build a conceptual model and set the relationship between data items. This data capability is required in preparation of the Data Platform implementation, and will also align with the approach taken by Group Data to implement ERWIN as a tool of choice for Data ModellingData Architecture – ensures that we have composed of models, policies, rules or standards that govern which data is collected, and how it is stored, arranged, integrated, and put to use in data systems and in organizations. This data capability is also aligned with the direction that Group Data is taking.Required Knowledge and Experience
Project Related Deliverables and Tasks
Assist the Data Engineering Lead on the below-listed tasks :
Select and implement the appropriate tools, software, applications, and systems to support cloud data technology goals from the chosen MS AzureOversee the mapping of data sources, data movement, interfaces, and analytics, with the goal of ensuring good data quality.Collaborate with Project & Data Stream Leads, Consultants and business unit leaders for all exercises pertaining to the Data PlatformCreate and maintain data model and metadata policies and procedures for functional design.Provide technical recommendations and engage with ETL / BI Architects, Business SMEs and other stakeholders throughout the Solution / Data Architecture and implementation lifecycle and recommend effective solutions to develop high performance and highly scalable data solutions (data marts / warehouse and data mining and advanced analytics)Raise and ensure data-related problems in regard to systems integration, compatibility, and multiple-platform integration areDevelop and implement key components as needed to create testing criteria in order to guarantee the reliability and performance of data architecture. Ensure the testing process incorporates TestDrive a Data Platform environment that enables maintenance of the current and accurate view of the larger data picture, an environment that supports a single version of the truth and is scalable to support future analytical needs.Identify and develop opportunities for data reuse, migration, or retirement and platform upgrades.Communicate with customer, project team in a timely manner and escalates issues & risks appropriately.Required Knowledge, Experience and skills :
Deep knowledge of contemporary architectural principles across the data architectural domainUnderstanding of the enterprise architecture to ensure on-going alignment, driving the technical roadmap for key applications andKnowledge of different SDLC Methodologies, preferably AgileAbility to produce solutions using :Microsoft SQL Integration Services, MS SQL Analysis Services, MS SQL Reporting Services, MS Power BIKnowledge of & Scaled Agile Framework (SAFe) practices will be advantageousExperience of Cloud Services (Azure) isPython5 years+ Experience in cloud computing infrastructure (e.g., MS Azure, Amazon Web Services etc.) and considerations for scalable, distributed systemsEducational Requirements
Matric,BSc Computer Science, Data Informatics, Information Technology, or any other related degreeCloud Certification is a key requirementMicrosoft AWS CertificationResearch / Data Analysis jobs