Senior Data Engineer
Tando Business SolutionsCape Town, Western Cape, South Africa30+ days ago
Job descriptionEducation Background : Bachelor’s degree in computer science, Business Informatics, Mathematics, Statistics, Engineering, or equivalent. Profession Experience : 4-5 years of relevant data engineering experience. Technical Skills : Experience with structured and unstructured data, different data stores, and traditional RDBMS and data warehouses. Proficiency in cloud tools such as Redshift, Athena, Glue and Lambda. Good programming, performance tuning and troubleshooting skills using programming languages such as python, scala, java and C++ Practical experience with Apache Spark and cloud services (e.g., AWS, Azure, GCP). Experience with version control systems like Git and SVN. Experience with DevOps practices, including CI / CD and Infrastructure as Code. Exposure to AWS Platform environment such as CodePipeline, CodeBuild, CodeDeploy and Management Console Data Engineering : Experience with big data, ETL, and data management processes. Platform Engineering : Experience with cloud platform development and maintenance. Cloud Engineering : Experience with cloud architecture and API development. DevOps : Experience with DevOps practices, architecture, and operation. ML Engineering : Experience with machine learning frameworks and model integration. Data Visualisation : Experience with data visualisation tools and techniques. Soft Skills : Excellent verbal and written communication skills. Strong analytical and problem-solving abilities. Ability to work well in an agile, collaborative team environment. Continuous learning mindset and commitment to professional development. Innovative thinking and adaptability to changing business needs. Analytical Mindset : Demonstrates a strong analytical and problem-solving ability, capable of breaking down complex data issues and devising effective solutions. Collaboration and Communication : Exhibits excellent interpersonal and communication skills, with the ability to articulate complex data concepts to non-technical stakeholders. Must foster a collaborative team environment and efficiently work across different departments. Continuous Learning : Has a strong commitment to continuous professional development, staying ahead of the latest trends and technologies in data engineering and analytics. Willingness to pursue relevant certifications and training. Innovative Thinking : Displays innovative thinking and a proactive approach to identifying and pursuing opportunities to improve data processes and solutions. Comfortable proposing and experimenting with new technologies or methodologies to enhance data capabilities. Adaptability : Demonstrates flexibility in adapting to changing business needs and technology landscapes. Can efficiently manage multiple priorities and adapt strategies in a fast-paced environment. Cultural Fit : Aligns with the organisation’s culture and values, contributing positively to team dynamics and company morale. Demonstrates integrity, accountability, and a strong work ethic.
Application deadline date has been passed for this Job.
A Data Engineer is responsible for designing, developing and implementing scalable and robust processes to support cloud applications and solutions. This role includes extracting, transforming, and consolidating data, developing and maintaining a data platform to support Foods Business Capabilities and thus ensure optimal cloud solutions performance and stability through support and continuous improvements.
KEY OUTCOME
- Assist in designing and implementing scalable and robust processes for ingesting and transforming large data sets.
- Assist in the design and implementation of data pipelines from a variety of data sources and support the maintenance thereof.
- Ingest large, complex data sets that meet functional and non-functional requirements.
- Enable the business to solve the problem of working with large volumes of data in diverse formats, and in doing so, enable innovative solutions.
- Build bulk and delta data patterns for optimal extraction, transformation, and loading of data.
- Supports the organisations cloud strategy and alignment to data architecture and data governance.
- Engineer data in the appropriate formats for downstream consumption for analytics or Enterprise applications.
- Assist in the development of APIs to expose the data to Enterprise Applications and 3rd party vendors.
- Assist in identifying, designing and implementing robust process improvement activities to drive efficiency and automation for greater scalability. This includes looking at new solutions and new ways of working and being on the forefront of emerging technologies.
- Work with various stakeholders across the organisation to understand data requirements and apply technical knowledge of data management to solve key business problems.
- Provide support in the operational environment with all relevant support teams for data services.
- Create and maintain functional requirements and system specifications in support of data architecture and detailed design specifications for current and future designs.
- Support test and deployment of new services and features.
JOB REQUIREMENTS
Strong understanding of data structures, algorithms, and software design.
ADDITIONAL CRITERIA
#J-18808-Ljbffr
Create a job alert for this search
Senior Data Engineer • Cape Town, Western Cape, South Africa
Related jobs
- Promoted
Senior C++ Engineer (Cape Town)
The Legends AgencyCape Town, Western Cape, South Africa Senior C++ Engineer (High Performance Computing).Write and maintain high-performance, production-level C++ code.Build and scale algorithmic features and data pipelines.
Collaborate with data scienti...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
DigiOutsourceCape Town, ZA Job title : Senior Data Engineer.Job Location : Western Cape, Cape Town.We’re on a mission to create extraordinary experiences for our customers, and we believe that your unique skills, passion and...Show moreLast updated: 30+ days ago
- Promoted
AWS Data Engineer
PBT GroupCape Town, South Africa Ready to take your data engineering career to new heights?.Architect modern data analytics frameworks.Translate complex requirements into scalable, secure, high-performance pipelines.Build & optimi...Show moreLast updated: 30+ days ago
- Promoted
Senior Software Engineer â Data Science
Communicate RecruitmentStellenbosch, South Africa A leading tech innovator is seeking a Senior Software Engineer with strong data science expertise to design and implement machine learning and AI features for high-volume, real-time distributed sys...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
IOCOCape Town, South Africa We are seeking an experienced Data Engineer to join our iOCO Digital team.The ideal candidate will have at least 5 years of proven expertise in the Microsoft stack, with strong skills in Azure Data...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Set ConsultingCape Town, South Africa The Data Engineer will support the Digital Delivery Project by designing, developing, and maintaining data systems and digital engineering workflows to enable data-driven project delivery.Design, d...Show moreLast updated: 16 days ago
- Promoted
Senior Data Engineer – Cape Town – HYBRID – R900 PH
E-MergeCape Town, South Africa Our client is on the hunt for a.We are young and still innovating like a startup.Our mission? To use the power of data to unlock smarter financial futures for millions across Africa.Bachelor''s or ...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
WatersEdge SolutionsCape Town, South Africa Hybrid (Century City, Cape Town).WatersEdge Solutions is partnering with a client with an exciting opportunity to work with a cutting-edge data science team at a leading player in the consulting in...Show moreLast updated: 25 days ago
- Promoted
Data Solutions Architect / Senior Data Engineer
PBT GroupCape Town, South Africa Data Solutions Architect / Senior Data Engineer.Data and AI team working on an innovative cloud-based data warehousing and AI solution.
RAG (Retrieval-Augmented Generation).You’ll play a leading rol...Show moreLast updated: 24 days ago
- Promoted
Senior Analytics Engineer
Sanlam GroupCape Town, ZA Job title : Senior Analytics Engineer.Job Location : Western Cape, Cape Town.As an analytics engineer your work is a canvas for change, painted with the data you create and the insights you enable....Show moreLast updated: 13 days ago
- Promoted
Senior Data Engineer (Snowflake, DBT)
PBT GroupCape Town, South Africa We are seeking a highly skilled.The ideal candidate will have strong experience with.This role involves building and optimizing data pipelines, ensuring high data quality, and supporting scalable d...Show moreLast updated: 24 days ago
- Promoted
Senior Data Engineer
Mindworx ConsultingCape Town, South Africa Relevant software engineering degree at least at Honours level (Master's preferred).Data skills (Traditional SQL and No-SQL).
Experience with source control (Git).You will be exposed to these in our...Show moreLast updated: 27 days ago
- Promoted
AWS - Data Engineer
Pure PlacementsCape Town, South Africa Hybrid – Cape Town / Johannesburg.The client is on a mission to establish one of Africa’s leading engineering hubs.As part of this vision, they’re looking for a seasoned AWS Data Engineer to help d...Show moreLast updated: 24 days ago
- Promoted
Data Engineer
Datonomy SolutionsCape Town, South Africa We are seeking a Data Engineer, with retail experience to join our team based in Cape Town.Initial 12-month contract, onsite.
Design, implement and maintain robust ETL / ELT data pipelines that consti...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Communicate RecruitmentStellenbosch, South Africa Pipeline Crafting : Advanced ETL / ELT design, batch & stream processing (Spark, Flink, Beam).Cloud Endurance : Hands-on experience with AWS (Redshift, Glue, Kinesis), Azure (Data Factory, Synapse)...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
KudaCape Town, ZA Job title : Senior Data Engineer.Job Location : Western Cape, Cape Town.We are expanding our reach and seeking a visionary Senior Data Engineer to spearhead our data engineering efforts, driving in...Show moreLast updated: 16 days ago
- Promoted
Data Engineer (Senior-Level)
IOCOCape Town, South Africa At iOCO, we design and maintain robust data infrastructure that powers intelligent business solutions.We are seeking a Senior Data Engineer to lead the design, integration, and optimization of comp...Show moreLast updated: 12 days ago
- Promoted
Lead Data Engineer
IOCOCape Town, South Africa In this role you will be responsible for developing and optimizing scalable data pipelines, ensuring high data quality, and managing robust data infrastructure to support reliable, efficient and co...Show moreLast updated: 17 days ago