Scrum Master & Technical Manager – Databricks Unity Catalog, Governance & AI/ML Platforms

Key Responsibilities

Databricks Unity Catalog & Governance Delivery

• Lead Agile delivery of Unity Catalog adoption and migration from legacy metastore
• Drive governance‑first implementation including:
  • Centralized metastores
  • Catalog & schema strategy
  • Fine‑grained access controls (RBAC/ABAC)
  • Audit, lineage, and compliance readiness
• Coordinate across data engineering, platform, security, and IAM teams
• Convert complex migration and governance epics into sprint‑ready stories

Agile Execution (Scrum Master)

• Act as Scrum Master for cross‑functional Data, Platform, and AI/ML teams
• Facilitate Scrum ceremonies (Planning, Stand‑ups, Reviews, Retrospectives)
• Remove delivery impediments related to cloud, security, and platform dependencies
• Track and improve Agile metrics (velocity, flow, predictability)
• Coach teams on Agile maturity, DevOps/DataOps, and continuous improvement

Technical & Delivery Management

• Own end‑to‑end delivery for Azure & Databricks platform initiatives
• Collaborate with architects on:
  • Unity Catalog rollout strategy
  • Workspace and environment design
  • Secure platform patterns
• Manage risks, dependencies, and release readiness
• Ensure alignment with enterprise architecture and governance standards

AI/ML Platform Enablement

• Enable Agile delivery of AI/ML workloads on Databricks
• Support governed data access for ML experimentation and production
• Work with Product Owners to structure AI/ML backlogs with clear outcomes
• Balance innovation speed with compliance and security controls

Stakeholder Engagement

• Serve as delivery interface to product, architecture, security, and leadership teams
• Provide clear visibility into schedules, dependencies, and risks
• Drive alignment across multiple teams and programs

Required Skills & Qualifications

Agile & Leadership

• Proven experience as Scrum Master and Delivery / Technical Manager
• Strong expertise in Scrum, Kanban, and enterprise Agile practices
• Experience working in large, cross‑team Agile environments

Technical (Working / Leadership Level)

• Strong understanding of Databricks platform, including:
  • Unity Catalog, permissions, governance concepts
  • Workspace and migration patterns
• Azure data & AI platform exposure
• Experience delivering governance‑heavy data or AI platforms

Tools & Platforms

• Databricks, Azure Data Lake
• Azure DevOps / Jira
• CI/CD and infrastructure‑as‑code concepts (working knowledge)