SENIOR DATA ENGINEER – REMOTE

Responsibilities

• Create and / or extend existing data models to include the data for consumption by the Analytics teams.
• Apply the relevant business and technical rules in the ETL jobs to correctly move data.
• Use the SDLC as defined including testing and aligning to release management in CCBA.
• Must produce design documents that can be reviewed Design Authority.
• Build must align to Standards as defined by Enterprise Architecture.
• Includes KT, Hypercare and PGLS of work delivered.
• Design, develop, and maintain ETL pipelines using Azure Data Factory and Databricks.
• Implement data movement and transformation across cloud, on-premises, and hybrid systems.
• Ensure seamless data exchange and integration using Azure Synapse Analytics, Azure Data Lake, and SQL Server.
• Develop and consume RESTful and SOAP APIs for real-time and batch data integration.
• Work with API gateways and secure authentication methods (OAuth, JWT, API keys, certificates).
• Apply data validation, cleansing, and enrichment techniques.
• Execute reconciliation processes to ensure data accuracy and completeness.
• Adhere to data governance and security compliance standards.
• Troubleshoot ETL failures and optimize SQL queries and stored procedures.
• Provide operational support and enhancements for existing data pipelines.
• Partner with data analysts, business analysts, and stakeholders to understand data needs.
• Document data workflows, mappings, and ETL processes for maintainability.
• Share best practices and mentor junior engineers.

Experience

#J-18808-Ljbffr