Job Summary (in List Format):
Role: Data Platform Engineering Lead (with Asset Management experience)
- Lead the design, implementation, and management of enterprise-scale, cloud-native data platforms for Asset Management business functions.
- Architect and oversee Databricks, dbt, AWS Cloud, Terraform, and related technologies to ensure a scalable, secure, and highly available data platform.
- Define and execute platform engineering strategies that align with Enterprise Data Office (EDO) and enterprise architecture standards.
- Establish and enforce reusable frameworks, accelerators, and best practices for platform engineering.
- Drive modernization of cloud-native data and analytics ecosystems.
- Oversee the full platform lifecycle: scalability, availability, reliability, and performance optimization.
- Administer and architect the Databricks platform, including Lakehouse architecture, Delta Lake, Databricks Workflows, Delta Live Tables, Unity Catalog, MLflow, Structured Streaming, Cluster Policies, and Security Controls.
- Lead cloud engineering and automation, leveraging AWS services (S3, ECS, EKS, Lambda, Glue, CloudWatch).
- Develop and manage Infrastructure as Code (IaC) using Terraform; build reusable modules and automate environment provisioning.
- Design and implement CI/CD pipelines using tools like GitHub Actions, GitLab CI/CD, Jenkins, Azure DevOps, Docker, and Kubernetes.
- Enable DevOps and GitOps methodologies to improve deployment velocity, reliability, and operational excellence.
- Establish governance, compliance, and security controls across development, test, and production environments.
- Support integration of APIs and operational workflows for enhanced business functionality.
- Implement and lead Site Reliability Engineering (SRE) practices, including platform SLAs, SLOs, monitoring, observability, and incident management.
- Conduct root cause analysis and implement preventive actions to ensure platform stability and reliability.
- Provide self-service platform capabilities to engineering teams and support asset management business needs.
- Ensure regulatory compliance and support for analytics, reporting, risk management, portfolio management, and investment operations.