Senior Azure Databricks

Tata Consultancy Services Ltd

Eden Prairie, MN

JOB DETAILS
SALARY
$100,000–$120,000 Per Year
SKILLS
Analysis Skills, Application Programming Interface (API), Artificial Intelligence (AI), Cisco Unity, Cloud Computing, Continuous Deployment/Delivery, Continuous Integration, Cross-Functional, Data Management, Data Modeling, Data Processing, Data Sets, Database Extract Transform and Load (ETL), Error Handling, GitHub, GraphQL, Information/Data Security (InfoSec), Legal, Loan Funding, Microsoft Windows Azure, Performance Modeling, Performance Tuning/Optimization, Problem Solving Skills, Python Programming/Scripting Language, REST (Representational State Transfer), SQL (Structured Query Language), Scalable System Development, Student Loans
LOCATION
Eden Prairie, MN
POSTED
12 days ago

Role Summary

seeking a Data Engineer with strong hands-on experience in Azure Cloud, Azure Databricks, PySpark, Azure Data Factory (ADF), Delta Lake, and Unity Catalog. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions, with expertise in ETL/ELT processing, data modeling, performance tuning, and data governance. The role requires proficiency in Python, SQL, GitHub, and CI/CD practices, along with experience working with large-scale datasets in enterprise environments. This is an individual contributor role that demands strong analytical and problem-solving skills, the ability to work independently, and ownership of end-to-end solution delivery while collaborating effectively with cross-functional teams and business stakeholders.

Expertise in:

Azure Databricks, PySpark, Delta Lake

Azure Data Factory (ADF) and ADLS Gen2

Experience working on large-scale, cloud-native data platforms (Azure preferred)

Exposure to AI/LLM or agentic frameworks (Databricks AI/ML, Codex, Claude, etc.)

Strong experience building REST or GraphQL APIs

Experience with Kubernetes (AKS preferred) for API deployment

Understanding of API security, contracts, error handling, and performance

Strong understanding of data governance, security, and CI/CD practicesPrimary skill for the API Role with AI Builder

Salary Range: $100,000- $120,000 a year

TCS Employee Benefits Summary:

Discretionary Annual Incentive.

Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.

Family Support: Maternal & Parental Leaves.

Insurance Options: Auto & Home Insurance, Identity Theft Protection.

Convenience & Professional Growth: Commuter Benefits & Certification & amp; Training Reimbursement.

Time Off: Vacation, Time Off, Sick Leave & Holidays.

Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

#LI-SP1

About the Company

T

Tata Consultancy Services Ltd