Talent.com
Swan iT Recruitment Ltd
Data EngineerSwan iT Recruitment Ltd • Cape Town, Western Cape, ZA
Search for other jobs
Data Engineer

Data Engineer

Swan iT Recruitment Ltd • Cape Town, Western Cape, ZA
30+ days ago
Job description

Duties & Responsibilities

  • Design and develop scalable data pipelines and ETL (Extract, Transform, Load) processes to collect, process, and integrate data from various sources into a centralized data warehouse or data lake.
  • Implementing data models, schemas, and database structures to organize and optimize data storage for efficient data retrieval, writing and analysis.
  • Collaborating with quantitative and analysts to understand their data requirements and provide them with the necessary infrastructure and tools for data exploration, analysis, and visualization.
  • Ensuring data quality and consistency by implementing data validation, cleaning, and transformation procedures.
  • Monitoring and maintaining the performance, availability, and security of data systems, including database servers, data warehouses, and data processing frameworks.
  • Troubleshooting and resolving data-related issues and performance bottlenecks in collaboration with the investment teams.
  • Evaluating and integrating new data technologies, tools, and frameworks to improve data infrastructure and processing capabilities.
  • Documenting data pipelines, workflows, and technical specifications to facilitate knowledge sharing and maintain system.
  • Keeping up-to-date with industry trends, best practices, and emerging technologies in the field of data engineering.

General:

  • Assist and collaborate on team wide projects.
  • Contribute to the analytics platform to know what is required from a Data Engineering perspective.
  • Assist and investigate ad-hoc data related queries.

Desired Experience & Qualification

REQUIRED EXPERIENCE

  • Up to 3 years’ experience with a specific focus in database management, data analysis and have produced ETL processes at scale are essential.
  • Basic understanding of financial instruments and markets.
  • Exceptional skill and experience in Python and SQL.

REQUIRED QUALIFICATIONS

  • University Post Graduate Degree (Computer Science/Information Systems/Maths/Stats/Business Science/Actuarial).
  • Strong programming skills in Python and SQL.

KEY COMPETENCIES

  • Excellent interpersonal skills, excellent communication skills oral and written.
  • Aptitude in decision-making and problem-solving.
  • Strong work ethic, self-motivated, driven and results oriented.
  • Ability to listen and respond to new ideas, input and diverse perspectives.
  • High levels of self-confidence, assertive as well as healthy levels of EQ.
  • Energetic problem-solver.
  • Structured work style, attention to detail and accuracy is of the utmost importance.

#J-18808-Ljbffr

Create a job alert for this search

Data Engineer • Cape Town, Western Cape, ZA