Talent.com
Senior Data Engineer Century City
Senior Data Engineer Century CityHr On Site • Cape Town, Western Cape, South Africa
Senior Data Engineer Century City

Senior Data Engineer Century City

Hr On Site • Cape Town, Western Cape, South Africa
5 days ago
Job description

Role Overview

The role operates within a cross‑functional, agile development team working across various technologies.

The key responsibilities of this role will focus on creating and maintaining data solutions.

This will include development activities such as the implementation of ETL processes, the creation of reports, ensuring high levels of data availability and integrity.

We are therefore seeking an energetic and committed individual that is a self‐starter and who works well independently as well as within a team context.

Your knowledge of, and experience in this area, together with your ability to learn new technologies, will be invaluable and of the utmost importance to help ensure progress and the successful implementation of these solutions.

Duties & Responsibilities

  • Design, develop, schedule, deploy and monitor data pipelines
  • Optimize, improve, and validate data pipelines
  • Design and deploy data table structures, forms, reports, and queries
  • Produce ad‑hoc queries and develop reports to support business needs
  • Develop security aware cloud data solutions
  • Process data into various storage formats such as Parquet, JSON, Avro
  • Apply appropriate engines to data processing such as Graph, Relational, NoSQL
  • Create and maintain technical documentation
  • Help inform and drive data architecture initiatives and strategies
  • Engage with business representatives regarding data solution initiatives

Desired Experience & Qualifications

  • Bachelor's degree with a focus on data management (e.g. Information Systems, Statistics, Data Engineering)
  • A minimum of 5 years' experience working as a data engineer utilizing visual pipeline designers such as SSIS, Talend, Informatica or Azure Data Factory
  • A minimum of 2 years data engineering in a commercial cloud environment like Azure
  • Advanced proficiency in the SQL language
  • SQL Query optimization skills
  • Experience in at least two DBMS's such as Postgres, MySQL or MSSQL
  • Experience in loading data from diverse sources
  • Experience in the development, implementation and monitoring of ETL processes
  • Experience in database administration, maintenance and optimization
  • A sound understanding of data management principles including data quality assurance and data governance
  • Experience in source code and version control systems
  • Experience in master data management and the implementation and maintenance thereof
  • Experience in Azure data technologies is very advantageous
  • Database administration
  • Bash or PowerShell scripting
  • Data Engineering certifications from Google, Azure or AWS
  • Demonstrated interest in the claims and healthcare IT space
  • Interested?

    We encourage all candidates to read through the job description clearly and properly before applying and submitting your CV for perusal.

    We appreciate all submissions and will reply to each one as soon as possible.

    #J-18808-Ljbffr

    Create a job alert for this search

    Senior Data Engineer • Cape Town, Western Cape, South Africa

    Related jobs
    Senior Data Engineer I

    Senior Data Engineer I

    LexisNexis • WorkFromHome, Western Cape, South Africa
    LexisNexis Legal & Professional provides legal, regulatory, and business information and analytics that help customers increase their productivity, improve decision-making, achieve better outcomes,...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer I

    Senior Data Engineer I

    Relx • Cape Town, Western Cape, South Africa
    LexisNexis Legal & Professional provides legal, regulatory, and business information and analytics that help customers increase their productivity, improve decision-making, achieve better outcomes,...Show more
    Last updated: 29 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Hire Resolve • Cape Town, Western Cape, South Africa
    Hire Resolve is currently seeking a highly skilled Data Engineer to join their client's internationally based team.Their Data Engineer will be based in Cape Town with the Data Team, who work on a h...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Communicate Recruitment • Cape Town, South Africa
    As a Data Engineer, youll take command of scalable data pipelines and architectures using GCP tools like BigQuery, Dataflow, Pub / Sub, and Cloud Storage. Youll partner with data scientists and analys...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Kuda • Cape Town, Western Cape, South Africa
    Job title : Senior Data Engineer.Job Location : Western Cape, Cape Town.We are expanding our reach and seeking a visionary Senior Data Engineer to spearhead our data engineering efforts, driving in...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer (Cape Town)

    Senior Data Engineer (Cape Town)

    Wearerival • Cape Town, Western Cape, South Africa
    Cape Town-based Senior Data Engineer to join our Media & Data team.This isn’t a role for someone who wants to do “business as usual. Our clients come to us because they need.As a Senior Data Enginee...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tando Business Solutions • Cape Town, Western Cape, South Africa
    Application deadline date has been passed for this Job.A Data Engineer is responsible for designing, developing and implementing scalable and robust processes to support cloud applications and solu...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    iLaunch • Cape Town, Western Cape, South Africa
    Leading Financial Services Group requires a Senior Software Data Engineer who will be responsible for developing Machine Learning Artefacts and Insights. Build configurable data ingestion platforms ...Show more
    Last updated: 21 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Sana Commerce • WorkFromHome, Western Cape, South Africa
    At Sana Commerce, we’re committed to creating an inclusive environment because we know our diverse workforce is one of our greatest strengths. What started in 2007 with a pizza and a plan has grown ...Show more
    Last updated: 25 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CloudDevs • WorkFromHome, Western Cape, South Africa
    Are you a highly skilled Senior Data Engineer ready to lead and innovate in a dynamic, cloud-driven environment? We’re looking for a pivotal team member to design, develop, and maintain cutting‑edg...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Recru-it • Cape Town, South Africa
    Own the companies GCP-based Data Platform (BigQuery, Cloud Functions, Composer, Dataflow, Pub / Sub, etc.Architect, build, and manage robust ETL / ELT pipelines to ingest structured and unstructured da...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    PBT Group • Cape Town, Western Cape, South Africa
    Senior Data Engineer job vacancy in Cape Town.We are looking for a highly skilled Senior Data Engineer to join our team for a cloud migration initiative centered on Snowflake.The ideal candidate wi...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Lifecheq • WorkFromHome, Western Cape, South Africa
    You’ll take ownership of our analytics data layer and work closely with our Platform and ML squads.Your job is to build a fast, clean, and reliable system that integrates backend data from an event...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Digis Corp • WorkFromHome, Western Cape, South Africa
    Digis is a European company with 200 employees, founded 9 years ago.We have grown from a startup into a reliable partner for our clients, combining the best of product and outsourcing services.You ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    MoonPay • WorkFromHome, Wes-Kaap, South Africa
    MoonPay City of Cape Town, Western Cape, South Africa.This is a hands-on technical leadership role with the opportunity to shape the future of our data platform. You will be responsible for designin...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Sana • WorkFromHome, Western Cape, South Africa
    At Sana Commerce, we’re committed to creating an inclusive environment because we know our diverse workforce is one of our greatest strengths. What started in 2007 with a pizza and a plan has grown ...Show more
    Last updated: 24 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Equal Experts • WorkFromHome, Western Cape, South Africa
    Equal Experts is an innovative consultancy specialising in the delivery of custom software solutions for blue‑chip enterprise and public‑sector clients across a range of industry sectors.We work on...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saratoga • WorkFromHome, Western Cape, South Africa
    Join our Technical Consulting team as a Senior Data Engineer where you will lead and design enterprise-scale data warehouses leveraging the Microsoft Data Platform, SQL Server, Kimball methodology,...Show more
    Last updated: 30+ days ago • Promoted