Talent.com
Senior Data Engineer

Senior Data Engineer

Queer NetworksCape Town, Western Cape, South Africa
8 days ago
Job description

Hornet ( Queer Networks ) is the worlds leading queer tech company providing a digital home for gay men to safely connect with each other anytime anywhere. Amplifying the radical affirmative power of the queer community with cutting-edge technology Queer Networks serves the LGBTQ community with products such as the gay chat app Hornet with over 100 million users worldwide the gay live-streaming app Hornet Live and HornetX a map-based web app for gay guys. Our diverse team spans the world bringing together various perspectives and incredible talent.

Do you want to join Hornet We are looking for a Senior Data Engineer at Hornet starting immediately.

Your Tasks

In this role you will be the owner of Hornets raw data layer ensuring that downstream Analytics & AI applications can build on a consistent and trustworthy foundation. You will design and maintain the pipelines that bring our user product and monetization data into BigQuery while enforcing standards that guarantee quality scalability and reliability.

  • Own the ingestion of raw data from Firebase back-end / front-end systems and external partners into BigQuery.
  • Design build and maintain robust ETL / ELT pipelines that are efficient evolvable and scalable to TB-scale workloads.
  • Implement data contracts schema enforcement and quality checks at the ingestion layer to prevent downstream issues.
  • Proactively monitor and debug pipelines ensuring resilient idempotent ingestion processes.
  • Optimize data storage and query performance in BigQuery balancing cost efficiency and scalability.
  • Collaborate with cross-functional teams to integrate new data sources and align pipeline development with analytics needs.
  • Contribute to engineering best practices documenting processes reviewing code and mentoring colleagues where appropriate.
  • Partner with the AI Engineer on aligning ingestion with broader architectural standards and long-term infrastructure goals.

Your Profile & Experience

Required Qualifications

  • 5 years of Data Engineering experience with a proven track record of delivering reliable scalable data pipelines.
  • Strong expertise in SQL (BigQuery preferred) and Python for production-ready data workflows.
  • Deep knowledge of cloud data warehouses and orchestration frameworks (e.g. Mage / Airflow).
  • Experience implementing data contracts schema enforcement and data quality frameworks.
  • Strong problem-solving skills with a focus on pipeline reliability scalability and cost optimization.
  • Familiarity with CI / CD practices and version control systems (GitHub).
  • Excellent communication skills and ability to collaborate effectively with analytics and engineering peers.
  • Bachelors degree in Computer Science Engineering or related field.
  • Preferred Qualifications

  • Familiarity with event-driven architectures and data for experimentation or ML pipelines.
  • Prior work with subscriptions ad-tech or social networking platforms.
  • Understanding of data governance privacy and security best practices.
  • Our Benefits

  • You will be part of our mission to provide a safe space for the LGBTQ community.
  • Work alongside an innovative and passionate Data-Analytics-AI squad pushing the boundaries of whats possible.
  • Enjoy a flexible remote-first work environment with teammates across the world.
  • We offer you an open contract with monthly invoicing or employment depending on circumstances.
  • Do you want to become a part of Hornet To apply please submit your resume. We do not ask for cover letters but we give bonus points to candidates who can articulate their passion for our mission in a concise (1-2 sentence) statement. We are looking forward to hearing from you! Do not hesitate to reach out if you have any questions. We are proud to foster a workplace free from discrimination. We strongly believe that diversity of experience perspectives and backgrounds will lead to a better environment for our team members and a better product for our users and community.

    Required Experience :

    Senior IC

    Key Skills

    Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

    Employment Type : Full-Time

    Experience : years

    Vacancy : 1

    Create a job alert for this search

    Senior Data Engineer • Cape Town, Western Cape, South Africa

    Related jobs
    • Promoted
    Senior Engineer – Data Analytics

    Senior Engineer – Data Analytics

    Global Technical TalentWorkFromHome, Western Cape, South Africa
    Senior Engineer – Data Analytics.Alternate / Related Job Titles.Senior Data Engineer (Snowflake / Power BI).Senior Engineer – Data Analytics. Data Analytics Center of Excellence (CoE).Snowflake, dbt...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Manager

    Senior Data Manager

    CXIBellville, Western Cape, South Africa
    CXI Bellville, Western Cape, South Africa.This is a high-impact leadership role where you’ll turn complex commercial, customer, and industry data into clear insights that influence decision-making ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Communicate RecruitmentCape Town, South Africa
    As a Data Engineer, youll take command of scalable data pipelines and architectures using GCP tools like BigQuery, Dataflow, Pub / Sub, and Cloud Storage. Youll partner with data scientists and analys...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    ZepzWorkFromHome, Western Cape, South Africa
    Zepz powers two leading global remittance brands, WorldRemit and Sendwave, to build the next generation of cross-border payments. Serving over 9 million customers across 4,000 corridors, Zepz is tra...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Senior Data Engineer Century City

    Senior Data Engineer Century City

    Hr On SiteCape Town, Western Cape, South Africa
    The role operates within a cross‑functional, agile development team working across various technologies.The key responsibilities of this role will focus on creating and maintaining data solutions.T...Show moreLast updated: 14 hours ago
    • Promoted
    Senior Analytics Engineer

    Senior Analytics Engineer

    Sanlam GroupCape Town, ZA
    Job title : Senior Analytics Engineer.Job Location : Western Cape, Cape Town.As an analytics engineer your work is a canvas for change, painted with the data you create and the insights you enable....Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer (Snowflake, DBT)

    Senior Data Engineer (Snowflake, DBT)

    PBT GroupCape Town, South Africa
    We are seeking a highly skilled.The ideal candidate will have strong experience with.This role involves building and optimizing data pipelines, ensuring high data quality, and supporting scalable d...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Architect & Engineer : Cloud, Big Data, ETL

    Data Architect & Engineer : Cloud, Big Data, ETL

    Communicate ITCape Town, Western Cape, South Africa
    A tech company in South Africa is seeking a skilled Data Architect to define and implement scalable, high-performance data frameworks. The role requires expertise in cloud platforms like AWS, Azure,...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    AirCape Town, Western Cape, South Africa
    OverviewThe Data Engineering team is building a secure, resilient, and cost-effective data platform that empowers everyone in the business to be an analyst. Enable every team to make confident, data...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Senior Data Engineer | Remote-First, Azure Databricks

    Senior Data Engineer | Remote-First, Azure Databricks

    AnanziWorkFromHome, Western Cape, South Africa
    Remote
    Senior Data Engineer (Contractor) – Legends Agency.Our client is a specialist data and technology consultancy, delivering innovative solutions that empower financial services businesses to make sma...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Senior Data Engineer : Build Scalable ETL & Cloud Pipelines

    Senior Data Engineer : Build Scalable ETL & Cloud Pipelines

    Hr On SiteCape Town, Western Cape, South Africa
    A leading tech firm in Cape Town is seeking an experienced Data Engineer to design and monitor data pipelines, optimize processes, and develop reports to support business needs.You will have at lea...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Senior Data Engineer & Architect : Cloud Data Pipelines

    Senior Data Engineer & Architect : Cloud Data Pipelines

    TrimbleWorkFromHome, Western Cape, South Africa
    A technology company is looking for a Staff Data Engineer / Data Architect with expertise in AWS and Azure.This remote role involves designing and implementing cloud-based data solutions, ensuring ...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Senior Data Engineer (ML / AI)

    Senior Data Engineer (ML / AI)

    SanaCape Town, Western Cape, South Africa
    At Sana Commerce, we’re committed to creating an inclusive environment because we know our diverse workforce is one of our greatest strengths. What started in 2007 with a pizza and a plan has grown ...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Queer NetworksWorkFromHome, Western Cape, South Africa
    Hornet ( Queer Networks ) is the world’s leading queer tech company providing a digital home for gay men to safely connect with each other anytime, anywhere. Amplifying the radical affirmative power...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Senior Data Engineer | Remote-First, Azure Databricks

    Senior Data Engineer | Remote-First, Azure Databricks

    Human AccentWorkFromHome, Western Cape, South Africa
    Remote
    Showing 19 Senior Data Engineer jobs in JohannesburgJohannesburg, Gauteng The Legends AgencyPosted 20 days agoJob Description. Our client is a specialist data and technology consultancy, delivering ...Show moreLast updated: 15 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Communicate RecruitmentStellenbosch, South Africa
    Minimum 5 years orchestrating the infernal symphony of data engineering ideally in the underworlds of credit, lending, or fintech. A degree in Computer Science, Engineering, Mathematics, or similar...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer (Senior-Level)

    Data Engineer (Senior-Level)

    IOCOCape Town, South Africa
    At iOCO, we design and maintain robust data infrastructure that powers intelligent business solutions.We are seeking a Senior Data Engineer to lead the design, integration, and optimization of comp...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer - Azure Databricks (Remote)

    Senior Data Engineer - Azure Databricks (Remote)

    AnanziWorkFromHome, Western Cape, South Africa
    Remote
    A leading data consultancy in Johannesburg is seeking a Senior Data Engineer (Contractor) to design, build, and maintain scalable data solutions for a prominent insurance client.The ideal candidate...Show moreLast updated: 15 hours ago