Talent.com
Data Engineer

Data Engineer

Level-UpJohannesburg, South Africa
30+ days ago
Job type
  • Quick Apply
Job description

We are seeking a skilled Data Engineer to design, develop, optimize, and manage robust, highly available data analytics infrastructure, reports, and data models. This role drives the delivery of high-quality data analytics solutions for data ingestion, storage, consumption, and management to generate actionable insights. Reporting to the Technical Team Lead and Software Development Manager, you will play a critical role in advancing our data capabilities.

Key Responsibilities

  • Data Pipeline Development : Build and maintain scalable data pipelines for efficient data ingestion, processing, and storage.
  • ETL Processes : Develop and automate ETL workflows to integrate data from diverse sources seamlessly.
  • Database Management : Manage SQL and NoSQL databases to handle structured and unstructured data effectively.
  • Data Quality Assurance : Ensure data integrity, consistency, and security through proactive monitoring.
  • Collaboration : Partner with data scientists, analysts, and software engineers to enable data-driven decision-making.
  • Documentation : Create clear, detailed documentation for data workflows, architectures, and processes.
  • Performance Optimization : Enhance database performance through tuning, query optimization, and indexing.
  • Cloud & Big Data Technologies : Support and expand expertise in cloud-based platforms like AWS, Azure, or Google Cloud.

Key Performance Indicators

  • Pipeline Efficiency : Percentage of data pipelines executed on schedule.
  • Data Accuracy : Reduction in data errors and inconsistencies.
  • ETL Performance : Improved speed and efficiency of ETL processes.
  • Query Performance : Reduced database query response times.
  • Collaboration Success : Number of effective collaborations with data scientists and analysts.
  • Code & Documentation Quality : Adherence to coding standards and comprehensive documentation.

    • Qualifications & Experience

  • Bachelors or Honours Degree in Engineering, Data Science, Computer Science, or Information Systems.
  • 3 - 5 years in data engineering, analytics, or data management roles.
  • 3+ years working with sales, channel, or business development teams.
  • 3+ years delivering customer-facing projects.
  • 3+ years in the cybersecurity industry.
  • 3+ years using agile methodologies for project delivery.

    • Systems & Proficiency

  • Certification in AWS, Microsoft, or other Business Intelligence technologies.
  • Expertise in Databricks and Python Notebooks.
  • Advanced skills in Power BI, DAX, Advanced Excel, Python, SQL Server, and SQL Scripting.
  • Proficiency in creating technical architectures, entity relationship diagrams, and process flow diagrams.
  • Strong command of Microsoft Office.

    • Skills & Competencies

  • Ability to manage multiple programs, balancing strategic planning with fast-paced execution.
  • Strong communication, negotiation, and consensus-building skills with stakeholders and teams.
  • Exceptional presentation skills, comfortable presenting to executive leadership.
  • Superior analytical, organizational, and time-management abilities.
  • Thrives in high-pressure environments and adapts quickly to new skills.
  • Trusted to handle confidential information with discretion.
  • Self-motivated, team-oriented, with a structured approach and proactive ownership of tasks.
    • Create a job alert for this search

    Data Engineer • Johannesburg, South Africa