Talent.com
Data Engineer (Fintech)

Data Engineer (Fintech)

Black Pen RecruitmentCape Town, Western Cape, South Africa
12 days ago
Job description

Our client is a technology company solving payments problems for businesses. Their mission is to help businesses in Africa become profitable, envied, and loved. They provide a suite of products to help businesses accept payments online and offline, manage their operations, and grow their business. Our client is driven by a commitment to excellence, innovation, and customer satisfaction.

Role Overview

Data engineering with our client focuses on building and extending platforms for managing data at scale. This involves data ingestion, processing, storage and egress. Data engineers are also responsible for creating and maintaining the infrastructure our data platforms run on.

Data engineers operate across a diverse tech stack. They are expected to be adaptable and drawn to learning new skills and technologies.

The role requires a proactive individual who can work independently and collaboratively within a remote-first environment, has a strong software engineering background with good experience building and maintaining data pipelines, expertise in Python and experience in streaming technologies.

Job Type : Permanent / Full time

Location : Cape Town, South Africa

Workplace : Hybrid

Department : Data Engineering

Reports To : Data Engineering Lead

Requirements

  • Educational Background : Bachelor's degree in Computer Science, Engineering or a related field.
  • Programming Skills : Proficiency in Python is essential. Knowledge of JavaScript and Scala is advantageous.
  • Data Engineering Experience : Minimum of 3 years of experience in data engineering roles, with a focus on building and managing data pipelines.
  • Software Engineering Experience : Minimum of 2 years experience in software and / or application development roles (can be concurrent with data engineering experience)
  • Streaming Technologies : Hands-on experience with Kafka, Debezium, and Kafka Connect.
  • Data pipeline orchestration tools : Proficiency in a data pipeline orchestration tool or suitable workflow orchestration tool like Apache Airflow (preferred), Databricks, Dagster or Airbyte.
  • Database Expertise : Strong understanding and hands-on experience working with various database technologies, including MySQL, PostgreSQL, MongoDB and Redshift (BigQuery and SingleStore advantageous)
  • Infrastructure Tools : Experience with Terraform, Kubernetes, and Helm for infrastructure management.
  • Cloud Computing : Solid knowledge of cloud computing concepts, with experience in AWS services being advantageous.
  • SQL Proficiency : Ability to write complex SQL queries across different dialects.
  • Testing Practices : Familiarity with unit and integration testing methodologies.
  • CI / CD Pipelines : Experience in setting up and maintaining CI / CD pipelines.
  • Data Science Tools : Exposure to analytical systems and basic data science tooling.
  • Familiarity with basic machine learning and analytical modelling concepts is advantageous.
  • BI Reporting Platforms : Exposure to self-service reporting tools like Tableau, Looker and DOMO.
  • Communication : Good verbal and written communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.
  • Team Collaboration : Demonstrated ability to work collaboratively within a team and across departments.
  • Adaptability : Comfortable working in a fast-paced environment with changing priorities, technologies and tooling. Life-long learners will do well here.
  • Problem-Solving : Strong analytical and problem-solving skills.

Responsibilities

  • Data Pipeline Development : Design, develop, and maintain robust data pipelines using ETL and ELT methodologies to process and integrate data from various sources into a data lake, a central data warehouse, operational data stores, analytical data marts and various application interfaces.
  • Streaming Data Processing : Implement and manage real-time data streaming solutions utilising Kafka, Debezium, Kafka Connect.
  • Workflow Orchestration : Build, schedule and maintain custom workflows using Apache Airflow to ensure timely and accurate data processing and delivery.
  • Database Management : Work with a variety of database technologies, including relational databases (MySQL, PostgreSQL), NoSQL databases (MongoDB) and analytical / big data systems (Redshift, BigQuery, SingleStore).
  • Infrastructure as Code : Employ tools like Terraform, Kubernetes, and Helm to manage and provision infrastructure efficiently.
  • CI / CD Implementation : Develop and maintain continuous integration and deployment pipelines to streamline development processes.
  • Testing and Quality Assurance : Conduct unit and integration testing to ensure high code quality, data integrity and system reliability.
  • Collaboration : Engage with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data needs and deliver solutions.
  • Documentation : Maintain clear and comprehensive documentation of data processes, workflows and systems.
  • Monitoring and Support : Monitoring system performance and addressing faults and failures in production systems as part of an on-call rotation.
  • Company Core Values

  • Transparency : They encourage open sharing of work, seeking feedback and having honest conversations promptly.
  • Clear Communication : They simplify ideas, communicate directly and confirm understanding to ensure clarity.
  • Kindness : They value positive vibes, generosity and empathy, both within the team and with customers.
  • High Standards : They insist on delivering consistent excellence, taking ownership and striving to be domain experts.
  • Pursue Growth and Learning : They view every situation as a learning opportunity, encouraging experimentation and continuous improvement.
  • Embrace the Mission : They find joy in their work and recognise the company's broader impact.
  • #J-18808-Ljbffr

    Create a job alert for this search

    Data Engineer • Cape Town, Western Cape, South Africa

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    SapicsWorkFromHome, Wes-Kaap, South Africa
    Gauteng / Western Cape (Work remotely with regular in-person meetings).The appointee will report to the Support Manager.The Data Engineer is responsible for designing, building, and maintaining sca...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    PBT GroupCape Town, South Africa
    Ready to take your data engineering career to new heights?.Architect modern data analytics frameworks.Translate complex requirements into scalable, secure, high-performance pipelines.Build & optimi...Show moreLast updated: 30+ days ago
    • Promoted
    Databricks Data Engineer

    Databricks Data Engineer

    iO AssociatesCape Town, Western Cape, South Africa
    Day rate up to £180 / day (~ZAR 4,100 / day).Our client is a leading technology company at the forefront of innovation in data engineering and analytics. They are committed to creating a dynamic and inc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer Data & Technology • Cape Town, South Africa •

    Data Engineer Data & Technology • Cape Town, South Africa •

    MakeheroesWorkFromHome, Western Cape, South Africa
    Heroes buys, operates, and scales baby and juvenile brands.We are ambitious multi‑brand developers combining operational excellence with customer‑centricity to support parents and children through ...Show moreLast updated: 19 days ago
    • Promoted
    Data Engineer

    Data Engineer

    PBT GroupCape Town, South Africa
    PBT Group is seeking skilled Data Engineers for opportunities in Cape Town.The successful candidates will be responsible for the effective movement, collection, integration, storage, and provisioni...Show moreLast updated: 30+ days ago
    • Promoted
    Full Stack Data Engineer - Cape Town

    Full Stack Data Engineer - Cape Town

    CollinsonCape Town, Western Cape, South Africa
    The Full-Stack Data Engineer will play a critical role in Collinson's efforts to deliver secure by design customer‑centric global solutions with a focus on hands‑on execution.As a key member of the...Show moreLast updated: 19 days ago
    • Promoted
    Data Engineer

    Data Engineer

    TrimbleWorkFromHome, Western Cape, South Africa
    Transporeon is a SaaS company founded in 2000 in Ulm, Germany.The company provides logistics solutions across several areas, including buying and selling logistics services, organizing shipment exe...Show moreLast updated: 25 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IOCOCape Town, South Africa
    We are seeking an experienced Data Engineer to join our iOCO Digital team.The ideal candidate will have at least 5 years of proven expertise in the Microsoft stack, with strong skills in Azure Data...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Cape Town

    Data Engineer - Cape Town

    DLK GroupCape Town, Western Cape, South Africa
    We require a Data Engineer and this is an office-based position.Modifying the database structure, as necessary, from information given by application developers. Enrolling users and maintaining syst...Show moreLast updated: 30+ days ago
    • Promoted
    Full Stack Data Engineer - Cape Town Technology & Data • Cape Town •

    Full Stack Data Engineer - Cape Town Technology & Data • Cape Town •

    Collinson GroupCape Town, Western Cape, South Africa
    The Full-Stack Data Engineer will play a critical role in Collinson's efforts to deliver secure by design customer‑centric global solutions with a focus on hands‑on execution.As a key member of the...Show moreLast updated: 1 day ago
    • Promoted
    Cloud Data Engineer Cape Town

    Cloud Data Engineer Cape Town

    Xcede GroupCape Town, Western Cape, South Africa
    An exceptional company within the media industry is looking for a Cloud Data Engineer to join their vibrant team.They are located in Cape Town, and this is a hybrid position.The client will also co...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer (GCP)

    Data Engineer (GCP)

    PBT GroupCape Town, Western Cape, South Africa
    Data Engineer (GCP) job vacancy in Cape Town.Are you passionate about building powerful data pipelines, optimising architectures, and enabling advanced analytics and machine learning? We’re looking...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Datonomy SolutionsCape Town, South Africa
    We are seeking a Data Engineer, with retail experience to join our team based in Cape Town.Initial 12-month contract, onsite. Design, implement and maintain robust ETL / ELT data pipelines that consti...Show moreLast updated: 30+ days ago
    • Promoted
    Engineer : Data X2

    Engineer : Data X2

    WoolworthsCape Town, Western Cape, South Africa
    FMCG, Retail, Wholesale and Supply Chain.Data Engineer who will assist in designing and implementing scalable and robust processes to support the data engineering capability.This role will be respo...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer (Fintech)

    Data Engineer (Fintech)

    Black Pen RecruitmentCape Town, Western Cape, South Africa
    Our client is a technology company solving payments problems for businesses.Their mission is to help businesses in Africa become profitable, envied, and loved. They provide a suite of products to he...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Media24 LtdCape Town, ZA
    Job Location : Western Cape, Cape Town.Join our team to design and build scalable data infrastructure that processes vast volumes of data daily, enabling real-time analytics and ML models that dire...Show moreLast updated: 23 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Set ConsultingCape Town, South Africa
    The Data Engineer will support the Digital Delivery Project by designing, developing, and maintaining data systems and digital engineering workflows to enable data-driven project delivery.Design, d...Show moreLast updated: 22 days ago
    • Promoted
    Senior Data Engineer Cape Town

    Senior Data Engineer Cape Town

    Hire ResolveCape Town, Western Cape, South Africa
    Hire Resolve is currently seeking a highly skilled Data Engineer to join their client's internationally based team.Their Data Engineer will be based in Cape Town with the Data Team, who work on a h...Show moreLast updated: 30+ days ago