Talent.com
Senior Data Engineer
Senior Data EngineerQueer Networks • WorkFromHome, Western Cape, South Africa
Senior Data Engineer

Senior Data Engineer

Queer Networks • WorkFromHome, Western Cape, South Africa
2 days ago
Job description

Hornet ( Queer Networks ) is the world’s leading queer tech company providing a digital home for gay men to safely connect with each other anytime, anywhere. Amplifying the radical affirmative power of the queer community with cutting‑edge technology, Queer Networks serves the LGBTQ community with products such as the gay chat app Hornet with over 100 million users worldwide, the gay live‑streaming app Hornet Live, and HornetX, a map‑based web app for gay guys. Our diverse team spans the world, bringing together various perspectives and incredible talent.

Do you want to join Hornet? We are looking for a Senior Data Engineer at Hornet starting immediately.

Your Tasks

In this role you will be the owner of Hornets raw data layer, ensuring that downstream analytics & AI applications can build on a consistent and trustworthy foundation. You will design and maintain the pipelines that bring our user product and monetization data into BigQuery while enforcing standards that guarantee quality, scalability, and reliability.

  • Own the ingestion of raw data from Firebase back‑end / front‑end systems and external partners into BigQuery.
  • Design, build and maintain robust ETL / ELT pipelines that are efficient, evolvable and scalable to TB‑scale workloads.
  • Implement data contracts, schema enforcement, and quality checks at the ingestion layer to prevent downstream issues.
  • Proactively monitor and debug pipelines, ensuring resilient, idempotent ingestion processes.
  • Optimize data storage and query performance in BigQuery, balancing cost efficiency and scalability.
  • Collaborate with cross‑functional teams to integrate new data sources and align pipeline development with analytics needs.
  • Contribute to engineering best practices : document processes, review code, and mentor colleagues where appropriate.
  • Partner with the AI Engineer on aligning ingestion with broader architectural standards and long‑term infrastructure goals.

Your Profile & Experience

Required Qualifications

  • 5 years of Data Engineering experience with a proven track record of delivering reliable, scalable data pipelines.
  • Strong expertise in SQL (BigQuery preferred) and Python for production‑ready data workflows.
  • Deep knowledge of cloud data warehouses and orchestration frameworks (e.g. Mage / Airflow).
  • Experience implementing data contracts, schema enforcement and data quality frameworks.
  • Strong problem‑solving skills with a focus on pipeline reliability, scalability and cost optimization.
  • Familiarity with CI / CD practices and version control systems (GitHub).
  • Excellent communication skills and ability to collaborate effectively with analytics and engineering peers.
  • Bachelor’s degree in Computer Science, Engineering or related field.
  • Preferred Qualifications

  • Familiarity with event‑driven architectures and data for experimentation or ML pipelines.
  • Prior work with subscriptions ad‑tech or social networking platforms.
  • Understanding of data governance, privacy and security best practices.
  • Our Benefits

  • You will be part of our mission to provide a safe space for the LGBTQ community.
  • Work alongside an innovative and passionate Data‑Analytics‑AI squad pushing the boundaries of what’s possible.
  • Enjoy a flexible, remote‑first work environment with teammates across the world.
  • We offer an open contract with monthly invoicing or employment depending on circumstances.
  • Do you want to become a part of Hornet? To apply, please submit your resume. We do not ask for cover letters, but we give bonus points to candidates who can articulate their passion for our mission in a concise (1‑2 sentence) statement. We are looking forward to hearing from you! If you have any questions, feel free to reach out. We are proud to foster a workplace free from discrimination and strongly believe that diversity of experience, perspectives and backgrounds will lead to a better environment for our team members and a better product for our users and community.

    Key Skills

    Apache Hive, S3, Hadoop, Redshift, Spark, AWS, Apache Pig, NoSQL, Big Data, Data Warehouse, Kafka, Scala

    Employment Type

    Full‑Time

    #J-18808-Ljbffr

    Create a job alert for this search

    Senior Data Engineer • WorkFromHome, Western Cape, South Africa

    Related jobs
    Software Engineer - Data Services

    Software Engineer - Data Services

    AiR • Stellenbosch, South Africa
    Quick Apply
    Software Engineer Data Services & Analytics.We are seeking a Software Engineer with a strong data focus to help build and enhance our next-generation data services platform.This role will invol...Show more
    Last updated: 30+ days ago
    Data Scientist

    Data Scientist

    Communicate Recruitment • Stellenbosch, South Africa
    A fast-growing tech innovator is looking for a Senior Software Engineer with deep data science expertise to design, build, and productionize machine learning and AI capabilities in high-throughput,...Show more
    Last updated: 30+ days ago • Promoted
    Lead Generator

    Lead Generator

    HR Genie • Table View, South Africa
    Researcher Corporate Meeting Development.Basic Salary : R12,000 R20,000 per month (based on experience).Computer & Internet Allowance : R1,000 per month. Bonus : 2% on paid-up deals (meetings per...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Communicate Recruitment • Cape Town, South Africa
    As a Data Engineer, youll take command of scalable data pipelines and architectures using GCP tools like BigQuery, Dataflow, Pub / Sub, and Cloud Storage. Youll partner with data scientists and analys...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Sabenza IT & Recruitment • Cape Town, Western Cape, South Africa
    The Senior Data Engineer is responsible for designing developing and maintaining advanced data architectures and pipelines that enable data-driven decision-making across the organization.This role ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Outsourced CFO • Cape Town, Western Cape, South Africa
    Outsourced CFOs technology vision.This individual will be responsible for executing the vision for the organizations technology solutions and systems ensuring alignment with strategic goals.The rol...Show more
    Last updated: 26 days ago • Promoted
    Senior Data Engineer (Snowflake, DBT)

    Senior Data Engineer (Snowflake, DBT)

    PBT Group • Cape Town, South Africa
    We are seeking a highly skilled.The ideal candidate will have strong experience with.This role involves building and optimizing data pipelines, ensuring high data quality, and supporting scalable d...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Sana Commerce • Cape Town, Western Cape, South Africa
    Data Pipeline Development & Infrastructure.Design build and maintain .Data Solutions & AI-Driven Applications.ML recommenders search functionality and AI-enhanced features.Commerce-rel...Show more
    Last updated: 22 days ago • Promoted
    Data Analyst

    Data Analyst

    Communicate Recruitment • Stellenbosch, South Africa
    Turn messy data into meaningful insights.Build dashboards so beautiful our execs might look at them.Work with cross-functional teams to solve business problems using data-driven magic.Identify tren...Show more
    Last updated: 22 days ago • Promoted
    Senior Support Engineer Technician

    Senior Support Engineer Technician

    West Coast Personnel • milnerton, Western Cape, South Africa
    Looking to join a cutting-edge IT services and solutions company in Milnerton? My client specializes in providing customized technology solutions that empower businesses to operate efficiently and ...Show more
    Last updated: 30+ days ago • Promoted
    SENIOR QUANTITY SURVEYOR - Western Cape (Offices in Durbanville, Contermanskloof)

    SENIOR QUANTITY SURVEYOR - Western Cape (Offices in Durbanville, Contermanskloof)

    HR Genie • Durbanville, South Africa
    SENIOR QUANTITY SURVEYOR - Western Cape (Offices in Durbanville, Contermanskloof).Our Client, a reputable and established Commercial Construction firm. Senior QS to join their expanding QS team.Play...Show more
    Last updated: 30+ days ago • Promoted
    Real Estate Branch Manager – Simon's Town

    Real Estate Branch Manager – Simon's Town

    Time Personnel • Simons Town, South Africa
    Seasoned, with in-depth knowledge and experience in Real Estate.Degree / Diploma in Sales / Marketing or relevant business qualification advantageous. Valid, Full Status FFC ESSENTIAL.Knowledge and unde...Show more
    Last updated: 8 days ago • Promoted
    Data Engineer

    Data Engineer

    Communicate Recruitment • Stellenbosch, South Africa
    Minimum 5 years orchestrating the infernal symphony of data engineering ideally in the underworlds of credit, lending, or fintech. A degree in Computer Science, Engineering, Mathematics, or similar...Show more
    Last updated: 30+ days ago • Promoted
    Data Quality Analyst

    Data Quality Analyst

    iStaff Recruitment • Stellenbosch, South Africa
    Grade 12 required; Diploma / Degree in Information Systems, Quality, Data Science, or Food Technology preferred.LIMS / ERP / QMS, or spec control (food / bev advantageous). Experience with SAGE / SAP, LIMS, p...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer (Senior-Level)

    Data Engineer (Senior-Level)

    IOCO • Cape Town, South Africa
    At iOCO, we design and maintain robust data infrastructure that powers intelligent business solutions.We are seeking a Senior Data Engineer to lead the design, integration, and optimization of comp...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Queer Networks • Cape Town, Western Cape, South Africa
    Amplifying the radical affirmative power of the queer community with cutting-edge technology Queer Networks serves the LGBTQ community with products such as the gay chat app Hornet with over 100 mi...Show more
    Last updated: 10 days ago • Promoted
    Senior Solar Design Engineer – Permanent | Hybrid | Western Cape, South Africa

    Senior Solar Design Engineer – Permanent | Hybrid | Western Cape, South Africa

    Oxyon Human Capital Solutions • Stellenbosch, South Africa
    Your expertise will drive engineering excellence from pre-development through execution phases.You'll work closely with global teams, contribute to standardisation efforts, and mentor junior engine...Show more
    Last updated: 30+ days ago • Promoted
    Intermediate Software Engineer

    Intermediate Software Engineer

    Poimaine • Stellenbosch, South Africa
    Intermediate Software Engineer.You will solve technical problems confidently, collaborate on design and implementation decisions, and provide guidance to junior developers.This role allows you to d...Show more
    Last updated: 30+ days ago • Promoted