Talent.com
Senior Data Engineer

Senior Data Engineer

CloudSmithsJohannesburg, Gauteng, South Africa
30+ days ago
Job description

Are you a highly skilled Senior Data Engineer ready to lead and innovate in a dynamic cloud-driven environment Were looking for a pivotal team member to design develop and maintain cutting-edge data solutions ensuring scalability reliability and top-tier performance. If you have a strong background in data engineering a proven track record in leading technical teams and thrive in an agile setting we want to hear from you.

What Youll Be Doing :

  • Building and maintaining efficient ETL / ELT pipelines using tools like Apache Airflow and PySpark.
  • Developing robust database schemas dimensional models (Kimball / Inmon) and supporting data normalisation for both relational and NoSQL databases.
  • Contributing to the development and maintenance of our data warehouses data lakes and data lakehouses.
  • Working with diverse database systems including Azure SQL PostgreSQL Google BigQuery MongoDB and Google Firestore.
  • Handling structured semi-structured and big data file formats such as Avro CSV Parquet ORC and Delta.
  • Developing and maintaining APIs for seamless data integration and workflows with a solid understanding of REST and microservices architectures.
  • Overseeing codebase maintenance and optimisation leveraging Git for version control.
  • Implementing thorough integration testing and ensuring high-quality deliverables for all new data processing scenarios.
  • Providing technical design and coding assistance to team members ensuring successful project milestones.
  • Assessing and integrating new data sources to meet evolving business needs.

What Were Looking For :

  • Strong proficiency in Python and SQL (PostgreSQL or SQL Server preferred).
  • Hands-on experience with Apache Airflow and PySpark.
  • Familiarity with Databricks is essential
  • Working knowledge of cloud platforms such as Azure GCP or AWS.
  • Experience with data warehousing concepts dimensional modelling and database normalisation.
  • Understanding of big data file formats like Avro Parquet ORC and Delta.
  • Proficiency in working with APIs REST and microservices architectures.
  • Education & Experience :

  • A Bachelors degree in Computer Science Data Science or related fields.
  • 5 years of progressive experience in data engineering cloud computing and technology implementation.
  • Experience managing multi-shore projects and working within cloud ecosystems (SaaS / PaaS).
  • Proven experience leading technical teams and mentoring team members.
  • What you will get out :

  • Youll get to develop your skill set
  • A competitive industry benchmark compensation
  • Flexible working hours and a remote office setting
  • Youll be part of a rapidly growing business
  • Work with the absolute masters in the industry and catch some of their energy vibe and passion for what we do
  • Great coffee every day and samoosa Fridays (in-office of course)
  • Plenty of company-sponsored learning; certifications and incentives
  • Work Hard. Play Hard. Work-Life Balance
  • No working on your birthday (free day off)
  • Required Experience :

    Senior IC

    Key Skills

    Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

    Employment Type : Full-Time

    Experience : years

    Vacancy : 1

    Create a job alert for this search

    Senior Data Engineer • Johannesburg, Gauteng, South Africa

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    One SparkJohannesburg, South Africa
    The Senior Data Engineer is the architect and builder of Dis-Chem Lifes data foundation, creating the infrastructure that turns raw information into a strategic asset. This role goes far beyond movi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer : Build Scalable Pipelines & APIs

    Senior Data Engineer : Build Scalable Pipelines & APIs

    Liberty Group LimitedJohannesburg, Gauteng, South Africa
    A financial services provider in Johannesburg is seeking a Senior Specialist : Data Engineer to design and optimize data pipelines while ensuring compliance with architecture standards.Candidates sh...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Human AccentJohannesburg, Gauteng, South Africa
    Showing 19 Senior Data Engineer jobs in Johannesburg.Johannesburg, Gauteng The Legends Agency.Our client is a specialist data and technology consultancy, delivering innovative solutions that empowe...Show moreLast updated: 30+ days ago
    • Promoted
    Intermediate or Senior AWS Data Engineer – Johannesburg – up to R900k per annum

    Intermediate or Senior AWS Data Engineer – Johannesburg – up to R900k per annum

    E-MergeJohannesburg, South Africa
    A Technology and Business Consulting Firm that was founded through a combination of technology, data, financial and actuarial science principles. Intermediate or Senior AWS Data Engineer.You will wo...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Azure Data Engineer - Remote, Spark & Pipelines

    Senior Azure Data Engineer - Remote, Spark & Pipelines

    E-Merge It RecruitmentWorkFromHome, Gauteng, South Africa
    Remote
    A leading IT recruitment agency in South Africa seeks a Senior Data Engineer to help scale data solutions across industries including mining, telcos, and retail. The ideal candidate will have over 8...Show moreLast updated: 2 days ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    PBT GroupJohannesburg, South Africa
    PBT Group is seeking an experienced.The successful candidate will have a proven background in designing, building, and optimising large-scale data pipelines within the. Azure Data Factory, Spark, an...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Engineer – Data Analytics

    Senior Engineer – Data Analytics

    Global Technical TalentWorkFromHome, Gauteng, South Africa
    Senior Engineer – Data Analytics.Alternate / Related Job Titles.Senior Data Engineer (Snowflake / Power BI).Senior Engineer – Data Analytics. Data Analytics Center of Excellence (CoE).Snowflake, dbt...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer : Lead Data Platform & Analytics

    Senior Data Engineer : Lead Data Platform & Analytics

    Network1Gauteng, South Africa
    A leading technology solutions firm in Gauteng is seeking a Senior Data Engineer to lead high-impact projects in a dynamic data-driven environment. The ideal candidate will have 5 years of experienc...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer : Platform & Analytics Lead

    Senior Data Engineer : Platform & Analytics Lead

    Network1Centurion, Gauteng, South Africa
    A leading technology firm in Centurion is seeking a Senior Data Engineer to lead high-impact projects in data engineering. The successful candidate will design and maintain large-scale data products...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tenth Revolution GroupCity of Johannesburg Metropolitan Municipality, Gauteng, South Africa
    Providing expert Data Contractors across South Africa to help teams scale fast | Flexible.Hybrid (3 days in-office, 2 days remote). Lead the design and development of scalable ETL systems and data p...Show moreLast updated: 2 days ago
    • Promoted
    Senior Specialist : Data Engineer

    Senior Specialist : Data Engineer

    Liberty Group LimitedJohannesburg, Gauteng, South Africa
    Insurance and Asset Management is best positioned to provide comprehensive investment and asset management offerings, as well as insurance solutions, to our African clients.Our goal is to meet our ...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Harambee Youth Employment AcceleratorJohannesburg, Gauteng, South Africa
    Senior Data Engineer – Johannesburg.Help build technology that changes lives.The Harambee Software Development team is looking for an exceptional Senior Data Engineer to join our dynamic team based...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Datonomy SolutionsCenturion, South Africa
    We are seeking a Senior Data Engineer to join our team based in Centurion.The Senior Data Engineer is responsible for designing, building, and maintaining robust, scalable data pipelines and platfo...Show moreLast updated: 2 days ago
    • Promoted
    Azure Senior Data Engineer - 100% REMOTE - R1.1M PA

    Azure Senior Data Engineer - 100% REMOTE - R1.1M PA

    E-Merge It RecruitmentWorkFromHome, Gauteng, South Africa
    Remote
    We are looking for a Senior Data Engineer with a blend of technical skill and creative problem‑solving to help us scale our data solutions. You will work within a team solving complex problems to de...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Scrums.comWorkFromHome, Gauteng, South Africa
    Direct message the job poster from Scrums.Talent Acquisition Partner @Scrums.Tech Recruitment | CPUT Human Resource Management Alumni | SABPP Member. Formerly SovTech), we believe the future of soft...Show moreLast updated: 9 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Network1Gauteng, South Africa
    Are you a seasoned Data Engineer and visionary professional ready to lead high-impact projects in a dynamic data-driven environment?. We're looking for a technically strong Senior Data Engineer to j...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    AustellJohannesburg, Gauteng, South Africa
    Are you a Data Engineering leader with a passion for shaping modern, scalable cloud data platforms?.Join our Business Intelligence team and play a key role in driving the transition from legacy SSI...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer | Remote-First, Azure Databricks

    Senior Data Engineer | Remote-First, Azure Databricks

    Human AccentBoksburg, Gauteng, South Africa
    Remote
    Showing 19 Senior Data Engineer jobs in Johannesburg.Johannesburg, Gauteng The Legends Agency.Our client is a specialist data and technology consultancy, delivering innovative solutions that empowe...Show moreLast updated: 3 days ago