Talent.com
Data Engineer (Fintech)
Data Engineer (Fintech)Black Pen Recruitment • Cape Town, Western Cape, South Africa
Data Engineer (Fintech)

Data Engineer (Fintech)

Black Pen Recruitment • Cape Town, Western Cape, South Africa
30+ days ago
Job description

Our client is a technology company solving payments problems for businesses. Their mission is to help businesses in Africa become profitable, envied, and loved. They provide a suite of products to help businesses accept payments online and offline, manage their operations, and grow their business. Our client is driven by a commitment to excellence, innovation, and customer satisfaction.

Role Overview

Data engineering with our client focuses on building and extending platforms for managing data at scale. This involves data ingestion, processing, storage and egress. Data engineers are also responsible for creating and maintaining the infrastructure our data platforms run on.

Data engineers operate across a diverse tech stack. They are expected to be adaptable and drawn to learning new skills and technologies.

The role requires a proactive individual who can work independently and collaboratively within a remote-first environment, has a strong software engineering background with good experience building and maintaining data pipelines, expertise in Python and experience in streaming technologies.

Job Type : Permanent / Full time

Location : Cape Town, South Africa

Workplace : Hybrid

Department : Data Engineering

Reports To : Data Engineering Lead

Requirements

  • Educational Background : Bachelor's degree in Computer Science, Engineering or a related field.
  • Programming Skills : Proficiency in Python is essential. Knowledge of JavaScript and Scala is advantageous.
  • Data Engineering Experience : Minimum of 3 years of experience in data engineering roles, with a focus on building and managing data pipelines.
  • Software Engineering Experience : Minimum of 2 years experience in software and / or application development roles (can be concurrent with data engineering experience)
  • Streaming Technologies : Hands-on experience with Kafka, Debezium, and Kafka Connect.
  • Data pipeline orchestration tools : Proficiency in a data pipeline orchestration tool or suitable workflow orchestration tool like Apache Airflow (preferred), Databricks, Dagster or Airbyte.
  • Database Expertise : Strong understanding and hands-on experience working with various database technologies, including MySQL, PostgreSQL, MongoDB and Redshift (BigQuery and SingleStore advantageous)
  • Infrastructure Tools : Experience with Terraform, Kubernetes, and Helm for infrastructure management.
  • Cloud Computing : Solid knowledge of cloud computing concepts, with experience in AWS services being advantageous.
  • SQL Proficiency : Ability to write complex SQL queries across different dialects.
  • Testing Practices : Familiarity with unit and integration testing methodologies.
  • CI / CD Pipelines : Experience in setting up and maintaining CI / CD pipelines.
  • Data Science Tools : Exposure to analytical systems and basic data science tooling.
  • Familiarity with basic machine learning and analytical modelling concepts is advantageous.
  • BI Reporting Platforms : Exposure to self-service reporting tools like Tableau, Looker and DOMO.
  • Communication : Good verbal and written communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.
  • Team Collaboration : Demonstrated ability to work collaboratively within a team and across departments.
  • Adaptability : Comfortable working in a fast-paced environment with changing priorities, technologies and tooling. Life-long learners will do well here.
  • Problem-Solving : Strong analytical and problem-solving skills.

Responsibilities

  • Data Pipeline Development : Design, develop, and maintain robust data pipelines using ETL and ELT methodologies to process and integrate data from various sources into a data lake, a central data warehouse, operational data stores, analytical data marts and various application interfaces.
  • Streaming Data Processing : Implement and manage real-time data streaming solutions utilising Kafka, Debezium, Kafka Connect.
  • Workflow Orchestration : Build, schedule and maintain custom workflows using Apache Airflow to ensure timely and accurate data processing and delivery.
  • Database Management : Work with a variety of database technologies, including relational databases (MySQL, PostgreSQL), NoSQL databases (MongoDB) and analytical / big data systems (Redshift, BigQuery, SingleStore).
  • Infrastructure as Code : Employ tools like Terraform, Kubernetes, and Helm to manage and provision infrastructure efficiently.
  • CI / CD Implementation : Develop and maintain continuous integration and deployment pipelines to streamline development processes.
  • Testing and Quality Assurance : Conduct unit and integration testing to ensure high code quality, data integrity and system reliability.
  • Collaboration : Engage with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data needs and deliver solutions.
  • Documentation : Maintain clear and comprehensive documentation of data processes, workflows and systems.
  • Monitoring and Support : Monitoring system performance and addressing faults and failures in production systems as part of an on-call rotation
  • Company Core Values

  • Transparency : They encourage open sharing of work, seeking feedback and having honest conversations promptly.
  • Clear Communication : They simplify ideas, communicate directly and confirm understanding to ensure clarity.
  • Kindness : They value positive vibes, generosity and empathy, both within the team and with customers.
  • High Standards : They insist on delivering consistent excellence, taking ownership and striving to be domain experts.
  • Pursue Growth and Learning : They view every situation as a learning opportunity, encouraging experimentation and continuous improvement.
  • Embrace the Mission : They find joy in their work and recognise the company's broader impact.
  • Create a job alert for this search

    Data Engineer • Cape Town, Western Cape, South Africa

    Related jobs
    AWS Data Engineer

    AWS Data Engineer

    PBT Group • Cape Town, South Africa
    Ready to take your data engineering career to new heights?.Architect modern data analytics frameworks.Translate complex requirements into scalable, secure, high-performance pipelines.Build & optimi...Show more
    Last updated: 30+ days ago • Promoted
    Head AI and Data Engineer

    Head AI and Data Engineer

    Recru-it • Cape Town, South Africa
    Help Us Turn Big Data into Revenue Clarity.We are seeking to employ a Senior Data Engineer as the Head of Data Platform & AI to take ownership of our full data infrastructure and elevate the ar...Show more
    Last updated: 27 days ago • Promoted
    Mid-Senior Data Engineer

    Mid-Senior Data Engineer

    Communicate Recruitment • Cape Town, South Africa
    Dataflow, BigQuery, Pub / Sub, and Cloud Storage.Santas sleigh isnt the only thing that needs flawless routing.Develop ETL processes that transform chaotic data into clean, structured formatslike tur...Show more
    Last updated: 23 hours ago • Promoted
    Data Engineer

    Data Engineer

    Kuda • Cape Town, ZA
    Job Location : Western Cape, Cape Town.We are expanding and seeking a Data Engineer to join our ranks and champion growth. With a passion for data-driven decision-making, you will play a pivotal rol...Show more
    Last updated: 26 days ago • Promoted
    Data Engineer

    Data Engineer

    IOCO • Cape Town, South Africa
    We are seeking an experienced Data Engineer to join our iOCO Digital team.The ideal candidate will have at least 5 years of proven expertise in the Microsoft stack, with strong skills in Azure Data...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    WatersEdge Solutions • Cape Town, South Africa
    Hybrid (Century City, Cape Town).WatersEdge Solutions is partnering with a client with an exciting opportunity to work with a cutting-edge data science team at a leading player in the consulting in...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    PBT Group • Cape Town, South Africa
    The successful candidate will work closely with senior stakeholders to design, develop, and maintain robust data pipelines and cloud-based solutions. This role requires a strong understanding of.Pro...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer (Mid-Level)

    Data Engineer (Mid-Level)

    IOCO • Cape Town, South Africa
    At iOCO, we use robust data pipelines to power intelligent solutions and business insights.We are seeking a Mid-Level Data Engineer to develop, maintain, and optimize ETL processes, ensuring high-q...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer – Cape Town – HYBRID – R900 PH

    Senior Data Engineer – Cape Town – HYBRID – R900 PH

    E-Merge • Cape Town, South Africa
    Our client is on the hunt for a.We are young and still innovating like a startup.Our mission? To use the power of data to unlock smarter financial futures for millions across Africa.Bachelor''s or ...Show more
    Last updated: 30+ days ago • Promoted
    Data Architect

    Data Architect

    wePlace • Cape Town, South Africa
    Define the technology solution for the Data and Analytics (D&A) environment, ensuring it meets both current and future technology needs. Support and oversee the development of detailed technical...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Communicate Recruitment • Cape Town, South Africa
    As a Data Engineer, youll take command of scalable data pipelines and architectures using GCP tools like BigQuery, Dataflow, Pub / Sub, and Cloud Storage. Youll partner with data scientists and analys...Show more
    Last updated: 30+ days ago • Promoted
    Head AI and Data Engineer

    Head AI and Data Engineer

    Hire Resolve • Cape Town, ZA
    Job title : Head AI and Data Engineer.Job Location : Western Cape, Cape Town.A leading Digital Intelligence & Big Data company is seeking an experienced Head AI and Data Engineer to take full owner...Show more
    Last updated: 18 days ago • Promoted
    Cloud Data Platform Support Engineer

    Cloud Data Platform Support Engineer

    WatersEdge Solutions • Cape Town, South Africa
    Cloud Infrastructure | Data Engineering | Azure.WatersEdge Solutions is seeking a technically astute.Cloud Data Platform Support Engineer. If you're passionate about performance tuning, incident res...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer (Snowflake, DBT)

    Senior Data Engineer (Snowflake, DBT)

    PBT Group • Cape Town, South Africa
    We are seeking a highly skilled.The ideal candidate will have strong experience with.This role involves building and optimizing data pipelines, ensuring high data quality, and supporting scalable d...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Datonomy Solutions • Cape Town, South Africa
    We are seeking a Data Engineer, with retail experience to join our team based in Cape Town.Initial 12-month contract, onsite. Design, implement and maintain robust ETL / ELT data pipelines that consti...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer (GCP)

    Data Engineer (GCP)

    PBT Group • Cape Town, South Africa
    Join Our Team as a Google Cloud Platform (GCP).Are you passionate about building powerful data pipelines, optimising architectures, and enabling advanced analytics and machine learning? We’re looki...Show more
    Last updated: 30+ days ago • Promoted
    BI Data Engineer : MIcrosoftDynamics 365 : Business Central : Cape Town : Perm Positions

    BI Data Engineer : MIcrosoftDynamics 365 : Business Central : Cape Town : Perm Positions

    Isilumko Staffing (JHB) • Cape Town, South Africa
    Data Engineer : BI : BPO : Cape Town CBD : Perm.The call is for a Data Engineer to lead the development, maintenance, support, and integration of our expanding array of data sources into.Azure-hosted S...Show more
    Last updated: 13 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Kuda • Cape Town, ZA
    Job title : Senior Data Engineer.Job Location : Western Cape, Cape Town.We are expanding our reach and seeking a visionary Senior Data Engineer to spearhead our data engineering efforts, driving in...Show more
    Last updated: 30+ days ago • Promoted