Data Engineer
Location: Bedfordview, Johannesburg | Hybrid Employment Type: Permanent | Full-Time Industry: Data Engineering | Applied AI | Financial Services Ready to take your Data Engineering career into the world of AI? WatersEdge Solutions is partnering with an established financial services business to find a technically strong, curious and motivated Data & AI Engineer to join a growing Data and AI team. This is an exciting opportunity for someone who enjoys building reliable data solutions, solving complex problems and exploring how Artificial Intelligence can create real business value. The role combines hands-on Data Engineering (approximately 65%) with Applied AI (35%), with the AI component expected to grow over time. You'll work with modern Microsoft technologies, contribute to meaningful data projects and gain exposure to the development and operation of an internally governed AI platform. And here's the exciting part: You don't need to be an AI expert! If you have strong Data Engineering foundations, practical experience with SQL Server, Microsoft Fabric and Python, and a genuine interest in AI, the team is happy to help you develop your expertise. What You'll Be Doing: Data Engineering & Development Design, develop and maintain reliable ETL/ELT data pipelines. Work with SQL Server, Azure SQL and Microsoft Fabric to build and support data integration solutions. Write, optimise and troubleshoot complex T‑SQL queries, stored procedures and data transformations. Develop and maintain Microsoft Fabric pipelines, Lakehouse/Warehouse solutions and Dataflow Gen2 processes. Support data warehousing, dimensional modelling and Medallion Architecture. Manage pipeline scheduling, monitoring, troubleshooting and performance. Ensure data accuracy, consistency and quality across reporting, analytics and AI applications. Applied AI & Automation Support the development and ongoing operation of an internal AI platform. Develop Python scripts for data preparation, automation and system integrations. Help prepare and manage datasets used by AI applications. Contribute to practical AI solutions involving intelligent search, summarisation, classification and information extraction. Gain exposure to AI technologies such as Retrieval-Augmented Generation (RAG), embeddings and retrieval systems. Assist with evaluating AI-generated outputs to ensure accuracy, quality and responsible use. Collaboration & Production Support Work with Git and Azure DevOps for source control and deployments. Support solutions from development and testing through to production. Troubleshoot technical issues and continuously improve existing processes. Collaborate with technical colleagues, analysts and business stakeholders. Maintain clear technical documentation and follow data security and governance standards. What We're Looking For: Essential Requirements 3+ years of hands-on experience in Data Engineering, ETL/ELT, Analytics Engineering, Database Development or a closely related technical role. Strong SQL Server and T‑SQL experience , including complex queries, joins, CTEs, stored procedures and query optimisation. Practical Microsoft Fabric experience , having worked with pipelines, Lakehouse/Warehouse solutions, Dataflow Gen2 or Fabric notebooks. Working Python knowledge for data processing, scripting, automation or integrations. Understanding of data warehousing, incremental loading, staging and dimensional modelling. Practical exposure to AI or LLM‑assisted tools, with the ability to assess their outputs. Familiarity with Git, source control and structured deployment processes. Strong analytical, troubleshooting and problem‑solving skills. Good understanding of data quality, security and responsible data handling. A proactive attitude, attention to detail and willingness to learn new technologies. Important: You don't need a formal Machine Learning or Data Science background. The business is looking for someone with solid Data Engineering experience who is excited to develop their Applied AI capabilities. Nice to Have (Not Essential!) PySpark or advanced Python experience. Power BI, SSRS or semantic data modelling. Azure DevOps and CI/CD pipelines. API integrations and enterprise data ingestion. RAG, vector search, embeddings or Azure AI Services. Microsoft Fabric certifications, particularly DP-700. A relevant IT, Computer Science or Engineering qualification. Experience in financial services or another regulated industry. What's In It for You? The best of both worlds: Build on your Data Engineering expertise while gaining valuable Applied AI experience. Modern technology: Work with Microsoft Fabric, SQL Server, Azure SQL, Python and emerging AI tools. Career development: Learn from an experienced technical team with opportunities to expand your skills. Meaningful projects: Contribute to real-world data and AI solutions that support business decisions and automation. Ownership and impact: Take responsibility for your solutions from development through to production. Collaborative culture: Join a supportive team that values curiosity, innovation, accountability and continuous learning. Hybrid flexibility: Enjoy a permanent hybrid opportunity based in Bedfordview, Johannesburg. Sound Like Your Kind of Opportunity? You don't need to know everything about AI today. You just need the right foundations and the curiosity to learn. Please Note: If you have not been contacted within 10 working days consider your application unsuccessful. #J-18808-Ljbffr