Job Location : , Gauteng, South Africa
Application Deadline : January 31, 2026
Job Description
- In this role, you will be part of the Data Operations team that is responsible for supporting all the applications on the Hadoop ecosystem. This role expands in maintaining changes on datasets and optimisation activities on all applications, including new development. They therefore need to understand basic programming to enable them to manage Big Data and to transfer all data to Hadoop.
Education : Bachelor’s degree in Computer Science, Information Systems or related field.
Job Experience & Skills Required :
2+ years’ experience working in Big data environment, optimising and building big data pipelines, architectures and data sets with e.g. Java, Scala, Python, Hadoop, Apache Spark and KafkaFamiliarity with Hadoop ecosystem and its componentsGood knowledge of the concepts of HadoopSolid experience in a working environment in Big Data development utilising SQL or PythonExperience in Big Data development using SparkExperience in Hadoop, HDFS and MapReduceExperience in database design, development and data modellingThe following additional knowledge, skills and attributes are preferred :
Good knowledge in back-end programming, specifically javaExperience with development in a Linux environment and its basic commandsAbility to write reliable, manageable, and high-performance codeShould have basic knowledge of SQL, database structures, principles, and theoriesKnowledge of workflow / schedulersStrong collaboration and communication skillsStrong analytical and problem solving skillsResponsibilities
Support pipelines end to endBuild enhancements and new developmentsBuild and deploy new data pipelinesIdentify optimisation opportunitiesImprovement on recovery time in case of prod failuresTest prototypes and oversee handover to the Data Operations teamsAttend and contribute to regular team and User meetingsResponsible for the actual coding or programming of Hadoop applicationsHigh-speed queryingEducation
Bachelor's Degree : Information TechnologyEnd Date : January 21, 2026