Databricks Architecture

Careers at LTM

Databricks Architecture

• Job ID: 889130
• 12 - 18 Years
• 1 Opening
• Raritan - New Jersey - USA

Apply Now

Share with friends

• Share on Facebook
• Share on Linkedin
• Post on X App
• Email your friends

Role description

Solution Architect Databricks Lakehouse Migration AI Modernization

Raritan NJ Onsite

We are seeking an experienced Solution Architect to lead the migration and modernization of enterprisescale data lakes from Azure Databricks to AWS Databricks while transforming the platform into an AIready Lakehouse architecture The role involves defining targetstate architecture migration strategy governance frameworks modernization roadmaps and AIGenAI enablement across largescale data ecosystems

The ideal candidate will have deep expertise in Databricks cloud migration modern data architecture and AIdriven data platforms with experience leading complex enterprise transformation programs involving thousands of data assets and multiple downstream applications

Key Responsibilities

Architecture Strategy

Define endtoend migration strategy from Azure Databricks to AWS Databricks

Design scalable Lakehouse architecture using Medallion principles Bronze Silver Gold

Develop Day1 Business Continuity and Day2 Modernization AI Enablement migration roadmaps

Perform application and dependency assessment across upstream and downstream systems

Establish architecture patterns standards and best practices for cloudnative data platforms

Migration Modernization

Lead migration of data pipelines notebooks Delta tables workflows and data products

Modernize legacy ETLELT frameworks using Databricks native capabilities

Optimize performance scalability security and operational efficiency

Define migration approach for CDC batch streaming and realtime workloads

Drive technology rationalization and tool consolidation initiatives

AIReady Data Platform

Build AIready data foundations leveraging Delta Lake and Unity Catalog

Design data architectures supporting ML GenAI RAG feature stores and advanced analytics

Enable governed data access for data scientists and AI applications

Define semantic models metadata strategies lineage and data discovery frameworks

Establish frameworks for AI governance and responsible AI adoption

Data Governance Security

Architect enterprisewide governance using Unity Catalog

Design data lineage auditing access controls masking and compliance standards

Implement data quality observability and monitoring frameworks

Ensure platform adherence to security and regulatory requirements

Stakeholder Management

Collaborate with business data engineering analytics AI security and cloud teams

Lead architecture review boards and executivelevel discussions

Mentor solution architects technical leads and engineering teams

Drive estimation roadmap planning risk assessment and governance reviews

Required Experience

12 years in Data Analytics

5 years as a Solution Architect or Lead Architect

Proven experience in largescale cloud migration programs

Handson experience with Azure Databricks and AWS Databricks

Experience migrating enterprise Data LakesLakehouses across cloud platforms

Strong understanding of Medallion Architecture and Delta Lake

Experience with Modern Data Platforms supporting AIML workloads

Expertise in enterprise integration and largescale data ecosystems

Technical Skills

Databricks Data Engineering

Databricks Workflows

Delta Lake

Delta Sharing

Unity Catalog

Delta Live Tables

Spark PySpark

Databricks SQL

Structured Streaming

Cloud Platforms

Azure Databricks

AWS Databricks

ADLS Gen2

Amazon S3

IAM

VPC

Glue

Lambda

Redshift good to have

Data Integration

Informatica PowerCenter IDMC

Azure Data Factory

Kafka

CDC Frameworks

API Integration

Eventdriven Architectures

AI Advanced Analytics

GenAI Architecture

RAG Frameworks

Vector Databases

Feature Stores

MLflow

Databricks AIML

Azure OpenAI Amazon Bedrock

DevOps Governance

CICD

Git

Terraform

Infrastructure as Code

Data Quality Frameworks

Data Observability

Security Compliance

Preferred Qualifications

Databricks Certified Professional

AWS Solution Architect Certification

Azure Solution Architect Certification

Experience in Life Sciences Supply Chain Manufacturing or Healthcare domains

Experience leading migration programs involving 1000 datasets and multiple business applications

Key Success Metrics

Successful migration with zero business disruption

Reduction in platform complexity and technical debt

Improved performance and cost optimization

Enterprise adoption of AIready data products

Increased governance lineage and compliance coverage

Accelerated delivery of analytics and GenAI use cases

This JD is tailored for the kind of Azure Databricks AWS Databricks modernization and AIready lakehouse transformation programs reflected in your recent DPSCDL migration initiatives"

Skills

Mandatory Skills : Databricks, Python, SparkSQL

Good to Have Skills : Delta Lake

Other details

Variable Compensation: This position includes a bonus or variable payout component based on individual and organizational performance. Actual compensation within the range will be dependent upon the individual''s skills, experience, performance and internal equity.

Benefits/perks listed below may vary depending on the nature of your employment with LTIMindtree ("LTIM"):

Benefits and Perks:

• Comprehensive Medical Plan Covering Medical, Dental, Vision
• Short Term and Long-Term Disability Coverage
• 401(k) Plan with Company match
• Life Insurance
• Vacation Time, Sick Leave, Paid Holidays
• Paid Paternity and Maternity Leave

The range displayed on each job posting reflects the minimum and maximum salary target for the position across all US locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training. Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation.

Disclaimer: The compensation and benefits information provided herein is accurate as of the date of this posting.

LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.

Benefits

Compensation range: $ 110,000.00 to 160,000.00 per year

View all 1287 role(s)

Apply Now

Share with friends

Toggle Dropdown

• Share on Facebook
• Share on Linkedin
• Share on WhatsApp
• Post on X App
• Email your friends

View more

About LTM

LTM is an AI-centric global technology services company and the Business Creativity partner to the world's largest and most disruptive enterprises. We bring human insights and intelligent systems together to help clients create greater value at the intersection of technology and domain expertise. Our capabilities span integrated operations, transformation, and business AI - enabling new ways of working, new productivity paradigms, and new roads to value. Together with over 87,000 employees across 40 countries and our global network of partners, LTM - a Larsen & Toubro company - owns business outcomes for our clients, helping them not just outperform the market, but to Outcreate it. Please also note that neither LTM nor any of its authorized recruitment agencies/partners charge any candidate registration fee or any other fees from talent (candidates) towards appearing for an interview or securing employment/internship. Candidates shall be solely responsible for verifying the credentials of any agency/consultant that claims to be working with LTM for recruitment. Please note that anyone who relies on the representations made by fraudulent employment agencies does so at their own risk, and LTM disclaims any liability in case of loss or damage suffered as a consequence of the same. Recruitment Fraud Alert - https://www.ltm.com/careers/recruitment-fraud-alert

View more

Wish to submit your profile for future opportunities?

Click here