Be part of our team of Data Specialists and embark on a career of the future!
PBT Group is seeking an experienced Senior Data Engineer to accelerate delivery on an existing data platform project and mentor a team of junior engineers. The successful candidate will have a proven background in designing, building, and optimising large-scale data pipelines within the Azure ecosystem , particularly leveraging Azure Data Factory, Spark, and Data Lake technologies.
This role requires both hands-on technical expertise and strong leadership capabilities to guide best practices, improve performance, and ensure data quality and governance standards are met.
Key Responsibilities
- Design, develop, and maintain robust data pipelines and ETL processes within the Azure environment.
- Optimise data workflows for scalability, reliability, and performance using Spark and Azure Data Lake.
- Collaborate with cross-functional teams (data analysts, architects, and business stakeholders) to translate requirements into efficient data solutions.
- Implement data quality frameworks and monitor data integrity across systems.
- Provide technical guidance, mentorship, and peer reviews for junior and intermediate data engineers.
- Troubleshoot and resolve data-related issues, ensuring smooth operational continuity.
- Participate in solution design discussions and contribute to architectural decisions.
Technical Skills & Experience
Core Technologies :Azure Data Factory (ADF)
Azure Data Lake / Data Lakehouse conceptsApache Spark / PySparkETL / ELT design and orchestrationData modelling and optimisation for analytical workloadsExperience with structured and unstructured data sourcesAdditional Experience (advantageous) :Azure Synapse, Databricks, SQL Server, or Power BI integration
CI / CD pipelines and DevOps data deployment practicesSoft Skills :Strong problem-solving and analytical skills
Proven ability to work independently and collaborativelyExcellent communication and mentorship abilitiesIdeal Candidate Profile
A technically skilled, self-driven professional who thrives in dynamic environments and enjoys improving data systems and empowering teams. You should bring a strong Azure data engineering foundation, hands-on Spark experience, and a genuine passion for data performance and quality.
In order to comply with the POPI Act, for future career opportunities, we require your permission to maintain your personal details on our database. By completing and returning this form you give PBT your consentIf you have not received any feedback after 2 weeks, please consider you application as unsuccessful.Skills
Healthcare Financial Services Information Technology (IT)
#J-18808-Ljbffr