Azure Senior Specialist ID: 2849

Required Skills

The Azure Senior Specialist is the hands-on technical lead who builds, automates and operates Microsoft Fabric and Azure data workloads. You will turn approved architecture into working pipelines, lakehouses, warehouses and semantic models, and own the CI/CD and security automation that ships them. You will lead a pod of 3–6 engineers, troubleshoot production issues and continuously optimise perfo

Key responsibilities

Microsoft Fabric engineering

• Build and maintain Lakehouses, Warehouses and SQL analytics endpoints; implement medallion layers with Delta tables, V-Order, OPTIMIZE/VACUUM and partitioning strategies.
• Develop ingestion and orchestration with Data Factory pipelines, Copy jobs, Dataflows Gen2 and Notebooks (PySpark, Spark SQL); configure OneLake shortcuts and Mirroring for source systems.
• Implement real-time scenarios with Eventstream, Eventhouse and KQL databases, Real-Time dashboards and Activator alerts.
• Build Power BI semantic models (Direct Lake, Import, composite), DAX measures, incremental refresh and RLS/OLS.
• Tune Spark environments (starter pools, custom pools, libraries, high-concurrency sessions) and SQL query performance; monitor capacity consumption with the Fabric Capacity Metrics app and Monitoring hub.
• Execute migrations from Synapse, ADF, SSIS and Databricks: inventory, conversion, reconciliation testing and cutover.
• Configure Fabric Git integration with Azure DevOps Repos or GitHub; enforce branching, pull-request policies and code-review standards for notebooks, pipelines and semantic models (TMDL/PBIP formats).
• Build CI/CD pipelines in Azure DevOps (YAML) or GitHub Actions using Fabric REST APIs, fabric-cicd, deployment pipelines and parameter files for environment promotion.
• Write and maintain Terraform (azurerm, azapi, Microsoft Fabric provider) or Bicep modules for capacities, workspaces, connections, networking, Key Vault and role assignments.
• Implement security gates in pipelines: SAST (CodeQL, SonarQube), secret scanning, IaC scanning (Checkov, Trivy), dependency scanning, unit tests for notebooks (pytest, Great Expectations / data-quality checks) and approval gates.
• Use OIDC / workload identity federation and managed identities; store secrets in Azure Key Vault; eliminate hard-coded credentials.
• Remediate findings from Microsoft Defender for Cloud, DevOps security and pipeline scans within SLA.
• Implement workspace roles, item permissions, OneLake security roles, Entra security groups and service principals per the access model.
• Configure Private Links, Managed Private Endpoints, VNet/on-premises data gateways and trusted workspace access.
• Apply Purview sensitivity labels, DLP policies, scanning and lineage; support periodic access reviews and audit evidence collection.
• Stream Fabric and Azure activity/audit logs to Log Analytics and Microsoft Sentinel; build alerts for failures, throttling and anomalous access.
• Own runbooks, monitoring and alerting (Azure Monitor, Log Analytics, Fabric Monitoring hub); act as L3 escalation for data-platform incidents.
• Drive root-cause analysis, problem management and automation of repetitive operational tasks (PowerShell, Python, Azure CLI, Fabric CLI).
• Track and optimise cost: capacity pause/resume schedules, workload scheduling, storage lifecycle and FinOps reporting.

DevSecOps implementation

Security and governance operations

Operations and reliability