Talent.com
This job offer is not available in your country.
Distributed Systems Engineer – Vector Database(Prototype)

Distributed Systems Engineer – Vector Database(Prototype)

HI Technology & InnovationCape Town, South Africa
30+ days ago
Job description

About the Role

HI Technology & Innovation is collaborating with a pioneering database company to evolve a single-threaded, command-line vector database proof-of-concept, originally written in C#, into a demonstrable, parallelized prototype. We’re looking for an experienced Distributed or Parallel Processing Engineer to lead the development of a lightweight “controller + wrapper” layer that adds multi-instance orchestration, parallelism, and query merging capabilities to the current system.

This is a high-impact, fast-paced role ideal for someone with strong distributed systems thinking and a pragmatic, get-it-done engineering mindset.

What You’ll Tackle

  • Design and implement a wrapper / controller layer around the existing single-threaded vector DB POC.
  • Enable sharding and parallel loading of large vector datasets across multiple instances.
  • Implement logic to dispatch and coordinate parallel queries , aggregate candidate vectors, apply a pluggable distance metric (e.g., Euclidean, cosine similarity, SAD / Manhattan), and merge and sort results before returning to the caller.
  • Expose both command-line and REST interfaces to interact with the system.
  • Output clear timing metrics to demonstrate speed-ups from parallel execution.
  • Deliver a working, testable prototype —production-ready polish is not required.

What We’re Looking For

  • Deep expertise in distributed computing and parallel processing , including MapReduce-style design patterns, data sharding, and inter-process communication (IPC).
  • Proven track record as a senior engineer who can work independently, move quickly, and deliver results with minimal oversight.
  • Strong problem-solving skills and practical experience building distributed systems and prototypes.
  • Comfort working across multiple languages and runtimes. Choose whatever tech stack gets the job done fastest (Python, C#, C, etc.).
  • Ability to clearly demonstrate and benchmark performance improvements.
  • Engagement Snapshot

  • Timeline : Short-term, estimated 5–10 days of focused work.
  • Start Date : ASAP
  • Location : Remote
  • Deliverables : Fully functional parallel prototype with CLI + REST interfaces, benchmark metrics, and sharded query support.
  • Ready to build something fast and clever? Apply now and help bring this proof-of-concept to life.

    Create a job alert for this search

    System Engineer • Cape Town, South Africa

    Related jobs
    • Promoted
    • New!
    Senior Systems Developer

    Senior Systems Developer

    MSP Staffing LTDCape Town, Western Cape, South Africa
    Exciting opportunity for a Senior Systems Developer to design, develop, and maintain software systems, including integration projects, that enhance business efficiency and service delivery.This rol...Show moreLast updated: 11 hours ago
    • Promoted
    Senior Backend Engineer (Cape Town)

    Senior Backend Engineer (Cape Town)

    The Legends AgencyCape Town, Western Cape, South Africa
    Senior Backend Software Developer.Hybrid (2-4 days in office / week) .We seek a Senior Backend Developer with a strong technical background and a passion for real-world problem-solving.You'll contrib...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Storage Systems Engineer

    Storage Systems Engineer

    Six Sense ConsultingCape Town, South Africa
    National Diploma in Information Technology, Computer Science, Software Engineering, Information Systems, Electronic Engineering, or equivalent qualifications coupled with 7 years experience.BTech / B...Show moreLast updated: 6 hours ago
    • Promoted
    Data Center Genset Engineer

    Data Center Genset Engineer

    FACTCape Town, South Africa
    We are seeking a skilled and experienced.The successful candidate will be responsible for the installation, maintenance, and troubleshooting of diesel generator sets (DG) in a data center environme...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Compute Systems Engineer

    Senior Compute Systems Engineer

    Six Sense ConsultingCape Town, South Africa
    BTech in Computer Science, Software Engineering, Information Systems, Electronic.Engineering or equivalent qualifications coupled with 13 years experience,. BENG / MTech in Computer Science, Software ...Show moreLast updated: 6 hours ago
    • Promoted
    IT Systems Engineer

    IT Systems Engineer

    TruworthsCape Town, ZA
    Job title : IT Systems Engineer.Job Location : Western Cape, Cape Town.Job Description .We have an exciting IT Systems Engineer role available in our 3rd-line POS support team.The...Show moreLast updated: 6 days ago
    • Promoted
    Systems Engineering Specialist

    Systems Engineering Specialist

    The Hiring HouseCape Town, South Africa
    Leading and advising the technical team on the execution of the engineering Design, Assembly, Integration and Verification activities. Performing Engineering & Contract Management to deliver the...Show moreLast updated: 30+ days ago
    • Promoted
    Java System Integration Engineer – Cape Town - R1.2m Per annum

    Java System Integration Engineer – Cape Town - R1.2m Per annum

    E-MergeCape Town, South Africa
    Become a member of a team enthusiastic about the challenges posed by integrating complex systems comprising diverse components and subsystems CURRENTLY in search for. You will contribute to the desi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer - Radar Systems

    Senior Software Engineer - Radar Systems

    JenRec RecruitmentCape Town, South Africa
    R&D team developing award-winning consumer radar products used by cyclists, golfers, and drivers worldwide.Youll be at the cutting edge of. Lead software and algorithm development for next-gener...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    SKA Mid – Senior Compute Systems Engineer

    SKA Mid – Senior Compute Systems Engineer

    South African Radio Astronomy ObservatoryCape Town, ZA
    Job title : SKA Mid – Senior Compute Systems Engineer.Job Location : Western Cape, Cape Town.The SKA-Mid Senior Computer Systems Engineer, will lead the compute and storage systems team for SKA-Mid...Show moreLast updated: 3 hours ago
    • Promoted
    Platform Engineer / Devops - CPT

    Platform Engineer / Devops - CPT

    DataFinCape Town, Western Cape, South Africa
    Join a team of scientists, engineers, and computer scientists working on the world’s largest and most advanced radio telescope project, as they seek a Platform Engineer to contribute to the develop...Show moreLast updated: 4 days ago
    • Promoted
    • New!
    Senior Compute Systems Engineer

    Senior Compute Systems Engineer

    Kamo PlacementsCape Town, South Africa
    Contribute to the global design and implementation of scalable and fault tolerant infrastructure systems that support engineering and operational needs. Contribute to the deployment, configuration, ...Show moreLast updated: 6 hours ago
    Linux and Devops Engineer

    Linux and Devops Engineer

    RM Staffing B.V.Cape Town, WC, ZA
    We are seeking a highly skilled.The ideal candidate will have deep expertise in.Linux systems administration, automation, cloud infrastructure, and CI / CD pipelines. This role requires hands-on techn...Show moreLast updated: 4 days ago
    • Promoted
    Engineer : Mission Systems

    Engineer : Mission Systems

    RareCruitCape Town, South Africa
    BSc / BEng Degree in Computer Science or Engineering.Proficient in Python, Java, C++ and other general-purpose programming languages (or passion for Python).Show moreLast updated: 13 days ago
    • Promoted
    DevOps Engineer (Kubernetes / OpenTofu / GitLab CI)

    DevOps Engineer (Kubernetes / OpenTofu / GitLab CI)

    Pure PlacementsCape Town, South Africa
    Cape Town (Century City), Hybrid (3 days in office).R 720,000 – R 960,000 Annual CTC.The Role : Key Responsibilities & Daily Duties. We are seeking a seasoned DevOps Engineer to be the driving force ...Show moreLast updated: 27 days ago
    • Promoted
    Lead Hardware Development Engineer - Systems (Somerset West)

    Lead Hardware Development Engineer - Systems (Somerset West)

    JenRec RecruitmentCape Town, South Africa
    The successful candidate will take the lead in the development of complex electronic systemsincluding flight control units, embedded computing platforms, and other advanced subsystemsprimarily for ...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Storage Systems Engineer

    Storage Systems Engineer

    Kamo PlacementsCape Town, South Africa
    Administer, maintain, and support enterprise storage platforms across on-premises and cloud environments.Support enterprise backup, restore, and disaster recovery operations.Investigate, troublesho...Show moreLast updated: 6 hours ago
    • Promoted
    Aerospace Systems Engineer

    Aerospace Systems Engineer

    JenRec RecruitmentCape Town, South Africa
    With a small yet highly skilled team of experts, they specialize in design, simulation, assembly, integration, and testing. They are currently seeking an Aerospace Systems Engineer to lead system de...Show moreLast updated: 30+ days ago