Data Engineer Advisor

Data Engineer Advisor

Role: DevOps / Automation Engineer

Total Experience: 5+ years
Relevant Experience: 3+ years

Role Overview

The DevOps / Automation Engineer will implement version control, deployment pipelines, environment promotion and repeatable configuration for the Microsoft Fabric solution. The role will establish reliable, controlled and auditable release processes across environments, working closely with platform and data engineering teams.

Key Responsibilities

• Implement Git-based version control and branching strategies for supported Fabric artefacts.
• Configure and maintain CI/CD pipelines for deployment and promotion across development, test, UAT and production environments.
• Implement deployment automation for Fabric workspaces, notebooks, pipelines, semantic models and other supported artefacts.
• Configure environment-specific parameters, deployment rules and reusable configuration patterns.
• Implement appropriate authentication, permissions and secure handling of credentials and secrets in deployment workflows.
• Automate release validation, deployment checks, dependency checks and post-deployment verification.
• Support rollback and recovery procedures and maintain deployment traceability.
• Establish repeatable deployment processes and minimise manual configuration differences between environments.
• Troubleshoot pipeline failures, deployment conflicts, permission issues and configuration drift.
• Collaborate with architects, platform engineers, data engineers and QA teams to align release processes with technical and operational requirements.
• Maintain CI/CD documentation, release runbooks and automation scripts.

Required Skills and Experience

• 5+ years of overall IT experience, including 3+ years in DevOps, CI/CD engineering or deployment automation.
• Hands-on experience with Git, Azure DevOps or GitHub and automated deployment pipelines.
• Understanding of Microsoft Fabric deployment capabilities, Git integration and supported CI/CD patterns.
• Experience with environment promotion, branching, release management and configuration management.
• Working knowledge of PowerShell, Python, YAML or similar scripting and pipeline definition languages.
• Understanding of service principals, Microsoft Entra ID, permissions and secure credential management.
• Experience with deployment troubleshooting, release validation and automation documentation.
• Understanding of separation between development, testing and production environments.

Preferred: Experience with Microsoft Fabric deployment pipelines, Fabric REST APIs, Azure DevOps, infrastructure-as-code concepts and automated release governance.

Experience Level

Mid Level