We are seeking an experienced Senior Data Engineer to join a high-impact greenfield data platform initiative within the healthcare and medical scheme administration environment.
This is a highly technical, delivery-focused role responsible for building the future-state MVP and establishing the foundational architecture, engineering standards and reusable patterns required to support the long-term scalability and automation of the data platform.
The successful candidate will be comfortable working independently, translating business and analytics requirements into robust technical solutions, and operating within a POPIA-sensitive health-data environment.
Key Responsibilities
- Design and build the future-state data platform MVP, including scalable data pipelines and transformation processes.
- Develop and implement automated data ingestion and integration patterns.
- Build robust and reusable Snowflake data models aligned to business and analytics requirements.
- Develop transformation workflows using dbt, applying modern analytics engineering practices.
- Implement data ingestion using Fivetran and establish reliable integration patterns.
- Design and implement automated data quality checks, testing and validation frameworks.
- Establish monitoring and controls to ensure data accuracy, reliability, availability and performance.
- Apply CI/CD practices across data and analytics engineering workflows.
- Implement and promote DataOps practices to improve automation, deployment, monitoring and operational reliability.
- Support migration from legacy reporting processes to the target-state data architecture.
- Establish reusable engineering standards, frameworks, patterns and documentation for future phases of the platform.
- Develop and support the Power BI reporting layer required for the MVP.
- Collaborate with business, analytics and technical stakeholders to translate requirements into scalable technical solutions.
- Ensure solutions are designed with appropriate security, governance, metadata management and POPIA considerations.
- Provide technical guidance and knowledge transfer to Medscheme staff, supporting the sustainable adoption of the new platform.
- Troubleshoot technical issues and continuously improve the performance, scalability and reliability of the data platform.
Requirements
Required Technical Skills
The successful candidate must have strong, hands-on experience with the following technologies and disciplines:
- Snowflake
- dbt
- AWS
- Fivetran
- Power BI
#J-18808-Ljbffr