Role: Lead
Required Skills: Python | Apache Spark
Qualification: BACHELOR OF COMPUTER SCIENCE
Experience: 10 - 20 Years
Function: TECHNOLOGY
Apply By: 2026-12-19
Must Have Technical/Functional Skills
- Databricks Lakehouse Platform
- Delta Lake
- Unity Catalog
- Databricks Workflows
- Databricks SQL
- Delta Live Tables
- MLflow
- Apache Spark
- PySpark
- Data Modeling
- ETL/ELT Architecture
- Streaming Data Processing
- Data Quality Frameworks
- Event-Driven Architectures
Programming
Roles & Responsibilities
- Define and execute the enterprise data platform strategy leveraging Databricks and cloud-native
technologies.
- Establish reference architectures, standards, and engineering best practices.
- Lead technical design reviews and architecture governance forums.
- Create reusable frameworks and accelerators to improve productivity and quality.
- Design and oversee implementation of scalable batch, streaming, and real-time data pipelines.
- Lead development of data products supporting analytics, reporting, data science, and AI
initiatives.
- Ensure high standards for reliability, scalability, observability, security, and maintainability.
- Drive adoption of DataOps, DevOps, and CI/CD practices across engineering teams.
- Define enterprise Lakehouse architecture patterns.
- Establish data models, storage strategies, and data lifecycle management processes.
- Lead implementation of data governance, metadata management, lineage, and access controls.
- Ensure platform compliance with organizational security and regulatory requirements.
- Partner with data science and AI teams to operationalize machine learning workloads.
- Enable model training, deployment, monitoring, and lifecycle management.
- Support GenAI, predictive analytics, and intelligent automation initiatives.
- Build scalable data foundations for AI-driven business capabilities.
- Lead and mentor data engineering teams.
- Manage technical delivery across multiple workstreams and vendors.
- Collaborate with business stakeholders to translate requirements into scalable solutions.
- Provide regular updates to leadership on delivery progress, risks, and architectural decisions.
Generic Managerial Skills
- 12+ years of experience in Data Engineering and Analytics.
- 5+ years of hands-on Databricks experience.
- 3+ years leading enterprise-scale data engineering teams.
- Proven experience building large-scale cloud data platforms.
- Experience leading distributed teams in Agile delivery environments
Salary Range: $130,000-$150,000 a year
TCS Employee Benefits Summary:
Discretionary Annual Incentive.
Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
Family Support: Maternal & Parental Leaves.
Insurance Options: Auto & Home Insurance, Identity Theft Protection.
Convenience & Professional Growth: Commuter Benefits & Certification & amp; Training Reimbursement.
Time Off: Vacation, Time Off, Sick Leave & Holidays.
Legal & Financial Assistance: Legal Assistance, 401K Plan, Perform ance Bonus, College Fund, Student Loan Refinancing.
#LI-SP1