Talent.com
Datafin IT Recruitment
Data Engineer (Python, PySpark, Azure/AWS) (CPT)Datafin IT Recruitment • Cape Town, South Africa
Data Engineer (Python, PySpark, Azure/AWS) (CPT)

Data Engineer (Python, PySpark, Azure/AWS) (CPT)

Datafin IT Recruitment • Cape Town, South Africa
30+ days ago
Job description

ENVIRONMENT:

PLAY a key role in delivering trusted data products that enable investment, operational, and client-facing decision-making across an innovative Investment Management firm seeking a skilled, curious, and passionate Data Engineer. You will help drive the evolution of the enterprise data platform in this hands-on where you will work with structured and unstructured data, implement robust data pipelines, and contribute to data quality, governance, and observability practices that ensure confidence in the firm’s data products. The role will suit an Engineer with experience designing, building, and operating modern data platforms in production environments. You will require a Degree in Computer Science/Engineering/Maths or related quantitative field, 4 years suitable experience including strong Python, PySpark, Azure/AWS or GCP and experience utilising Azure Pipelines, GitHub Actions, or Jenkins.

DUTIES:

· Own data products from ingestion through to trusted consumption, ensuring data is reliable, accessible, and fit for purpose.

· Design, build, and operate scalable ELT and ETL pipelines across structured and unstructured data sources.

· Develop and maintain modern cloud-based data platforms using industry-standard Engineering practices and tooling.

· Implement data quality, governance, and observability capabilities to ensure trust in data products.

· Deliver data solutions through CI/CD pipelines and Infrastructure-as-Code, contributing to a robust and maintainable Engineering ecosystem.

· Evaluate and apply emerging technologies, including AI and LLM-based tooling, to improve Engineering productivity and business outcomes.

REQUIREMENTS:

Qualifications –

· Degree in Computer Science, Engineering, Mathematics, Science, or a related quantitative field.

Experience/Skills –

· At least 4 years of experience building, deploying, and operating data pipelines in production environments.

· Strong Python and PySpark skills, with a solid understanding of modern Data Engineering practices.

· Hands-on experience with a major cloud platform such as Azure, AWS, or GCP.

· Experience building and maintaining CI/CD pipelines using tools such as Azure Pipelines, GitHub Actions, or Jenkins.

ATTRIBUTES:

· The ability to build and maintain meaningful relationships.

· Able to ‘approach and own’ and continuously looks for opportunities to develop.

· A strong belief in doing the right thing.

· Can recognise and embrace change.

Create a job alert for this search

Data Engineer (Python, PySpark, Azure/AWS) (CPT) • Cape Town, South Africa

Similar jobs

Service Sales Executive

EmplyfyBlouberg, WC, ZA

We’re looking for an ambitious.Our customers are already looking for cleaning services — your job is to understand what they need, present the right solution and turn the enquiry into a booking.You... Show more

Data Engineer (Python, SQL, PostgreSQL, Node.js) – (In Office) CPT

Datafin RecruitmentCape Town, ZA

An Investment company is searching for an innovative Data Engineer to join their growing team in Durbanville, Cape Town.If you're passionate about building scalable data solutions, solving complex ... Show more

 • Promoted

B2C Sales Consultant

EmplyfyAtlantis, WC, ZA

We’re a growing UK-based cleaning company specialising in.Residential End of Tenancy cleaning.If you’re driven by targets, enjoy speaking to customers and know how to turn a conversation into a sal... Show more

Data Integration Engineer

Salt South AfricaCape Town, ZA

Our client is looking for a Data Integration Engineer who is passionate about backend engineering, distributed systems, and cloud-native architectures.This is a hands-on role where you’ll design an... Show more

 • Promoted

Data Engineer

PBT GroupCape Town, Western Cape, ZA

PBT Group is seeking a Data Engineer to join our Cape Town-based consulting team on a contract basis.We are looking for a well-rounded end-to-end Data Engineer with solid practical experience acros... Show more

 • Promoted

Software Development Engineer

AmazonCape Town, ZA

Join our team of innovative Software Engineers and build the next generation service platforms for AWS, EC2 and our customers.These services are key components of the Amazon Elastic Compute Cloud (... Show more

 • Promoted

Senior BI Engineer

AiRCape Town, Western Cape, South Africa
Quick Apply

Help us empower millions across Africa by building the data foundation for a leading fintech platform.You'll design and implement BI solutions that drive critical business decisions.BI Engineering ... Show more

Principal Data Engineer (Databricks)

Vivo EnergyCape Town, Western Cape, ZA

Role Overview Reporting to the Data & Analytics Lead, the Principal Data Engineer is a hands‑on role, combining the building and optimisation of production data pipelines with the technical leaders... Show more

 • Promoted

Data Engineer (Mid–Senior)

Hire ResolveCape Town, ZA

A Data & AI Intelligence consultancy company is looking for a highly motivated and experienced Data Engineer to join a collaborative team of Product Owners, Data Engineers, and Machine Learning... Show more

 • Promoted

Senior Software Development Engineer

AmazonCape Town, ZA

Come help us build automation that manages millions of hosts for Amazon.The Managed Fleets team abstracts host and fleet management away from thousands of service teams across Amazon, freeing up en... Show more