Azure Data Engineer

Job Title: Azure Data Engineer
Location: London (2-3 days on site)
Department: Data & Engineering

About the Role
Are you passionate about modernising data platforms and working with cutting-edge Microsoft technologies? We’re looking for an experienced Azure Data Engineer to play a critical role in migrating and integrating enterprise data into scalable, cloud-first environments. You’ll work closely with cross-functional teams to build robust data pipelines and workflows across Azure and Microsoft Dynamics 365, leveraging the latest tools to ensure performance, consistency, and quality.

Key Responsibilities
Data Migration: Lead the migration of data from legacy big data systems and custom-coded ETL processes into Azure, Dataverse, and Dynamics 365 platforms.

Integration & Aggregation: Consolidate data from diverse SaaS applications and small-scale data sources into centralized Microsoft cloud environments.

Azure Development: Design and develop cloud-based data workflows using Azure Data Factory, Azure Functions, and Logic Apps.

Data Pipelines: Build and maintain scalable pipelines using Azure Data Factory and SSIS with KingswaySoft.

Infrastructure Management: Use Terraform to deploy and manage infrastructure as code (IaC) for consistent, repeatable environments.

CI/CD & Automation: Implement continuous integration and deployment pipelines using Azure DevOps, automating data pipeline deployments.

Code & Version Control: Maintain source code and collaborate effectively using Git.

Monitoring & Optimization: Monitor pipeline health, troubleshoot issues, and improve performance and scalability.

Team Collaboration: Partner with IT, marketing, customer success, and other stakeholders to define data requirements and deliver innovative solutions.

What We’re Looking For
Required:

Bachelors degree in Computer Science, Engineering, or related field.

Proven experience as an Azure Data Engineer or similar role with a focus on data migration and cloud integration.

Deep technical expertise with:

Azure Data Factory, Azure Functions, Logic Apps, Dataverse, and Microsoft Fabric

Terraform for infrastructure provisioning

CI/CD tools such as Azure DevOps

Git for version control

Preferred:

Hands-on experience with Dynamics 365 (D365), KingswaySoft, and the Microsoft Power Platform

Microsoft Azure Data Engineer Associate certification

Soft Skills:

Strong problem-solving capabilities

Clear, effective communication

Ability to collaborate across teams and disciplines