Azure Databricks Data Engineer

Tata Consultancy Services Ltd
  • Saint Louis, MO
  • $110,000–$135,000 Per Year
2 days ago

Job Description

Role: Engineer

Required Skills: Azure

Experience: 8 - 10 Years

Function: TECHNOLOGY

Apply By: 2026-12-06

Must Have Technical/Functional Skills

  • Significant data engineering experience, including substantial hands-on Databricks development
  • experience.
  • Azure Databricks - Strong hands-on experience building production-grade batch pipelines and
  • lakehouse solutions.
  • PySpark / Spark SQL - Advanced transformations, joins, window functions, reusable frameworks,
  • debugging, and performance tuning.
  • Delta Lake - Table design, schema evolution, merge/upsert patterns, optimization, data reliability,
  • and history management.
  • Medallion architecture - Practical delivery experience across source-aligned, conformed, and
  • consumption-ready layers.
  • Data modeling - Fact/dimension design, conformed dimensions, slowly changing dimensions,
  • aggregates, and semantic-consumption considerations.
  • Data quality and testing - Profiling, rule implementation, reconciliation, unit/integration tests,
  • controls, and defect analysis.
  • Azure ecosystem - Working knowledge of Azure Data Lake Storage and relevant Azure
  • integration, identity, monitoring, and DevOps services.
  • DevOps - Git-based development, code reviews, CI/CD, environment promotion, release controls,
  • and automated deployment.
  • Security/governance - Experience implementing least-privilege access and working with catalog,
  • lineage, classification, and row-level security requirements.
  • SQL - Advanced SQL development and query optimization for large analytical datasets.
  • Hands-on exposure to Databricks Lakeflow Spark Declarative Pipelines or Delta Live Tables and
  • the ability to adopt evolving Databricks-native pipeline standards.
  • Experience with Unity Catalog; familiarity with enterprise data-governance and data-quality tooling
  • such as Informatica.
  • Experience with HR data from Workday, Dayforce, PeopleSoft, recruiting, workforce
  • management, or talent systems.
  • Understanding of Power BI consumption patterns, star schemas, refresh needs, aggregates, and
  • performance requirements.
  • Experience creating accelerators, reusable engineering templates, metadata-driven pipelines, or
  • automated test frameworks.
  • Databricks Data Engineer certification or equivalent cloud/data engineering credential.
  • Experience in a blended onshore/offshore Agile delivery model.

Roles & Responsibilities

  • Design and develop scalable batch data pipelines in Azure Databricks using PySpark and Spark
  • SQL.
  • Build and maintain bronze, silver, and gold data structures, including certified fact and dimension
  • data products.
  • Translate business metric definitions, calculation rules, filters, granularity, history, and refresh
  • requirements into technical designs.
  • Create reusable transformations for HR domains such as retention, hiring, transfers, promotions,
  • reviews, hours, and scheduling.
  • Implement data-quality checks, reconciliation, exception handling, auditability, lineage, and
  • technical documentation.
  • Optimize Spark workloads, Delta tables, joins, partitions, file sizes, and cluster usage for
  • performance and cost.
  • Apply enterprise security and governance standards, including Unity Catalog integration,
  • permissions, sensitive-data handling, and support for row-level access patterns.
  • Coordina te with ingestion, data governance, modeling, DevOps, and Power BI teams to define
  • clear data contracts and acceptance criteria.
  • Contribute to CI/CD, source control, automated testing, deployment, operational monitoring, and
  • production-readiness activities.
  • Participate in requirement workshops and explain technical choices clearly to business, HR,
  • analytics, and engineering stakeholders.
  • Support knowledge transfer and mentor participating engineers or analysts

Salary Range-$110,000-$135,000 a year

#LI-KR3

TCS Employee Benefits Summary:

Discretionary Annual Incentive.

Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.

Family Support: Maternal & Parental Leaves.

Insurance Options: Auto & Home Insurance, Identity Theft Protection.

Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.a

Time Off: Vacation, Time Off, Sick Leave & Holidays.

Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing

Numbers & Facts

LocationSaint Louis, MO
Salary$110,000–$135,000 Per Year

Skills

  • Agile Modelingunmatched
  • Analysis Skillsunmatched
  • Cisco Unityunmatched
  • Continuous Deployment/Deliveryunmatched
  • Continuous Integrationunmatched
  • Data Lakeunmatched
  • Data Managementunmatched
  • Data Modelingunmatched
  • Data Qualityunmatched
  • Data Setsunmatched
  • Data Storageunmatched
  • Data Structuresunmatched
  • Database Designunmatched
  • Debugging Skillsunmatched
  • DevOpsunmatched
  • Ecosystemsunmatched
  • Engineeringunmatched
  • Enterprise Protectionunmatched
  • Error Handlingunmatched
  • Informaticaunmatched
  • Integration Testingunmatched
  • Knowledge Transferunmatched
  • Legalunmatched
  • Loan Fundingunmatched
  • Machine Toolunmatched
  • Mentoringunmatched
  • Metadataunmatched
  • Metricsunmatched
  • Microsoft Windows Azureunmatched
  • Peoplesoftunmatched
  • Performance Tuning/Optimizationunmatched
  • Power BIunmatched
  • Query Optimizationunmatched
  • Reconciliationunmatched
  • Recruiting Softwareunmatched
  • SQL (Structured Query Language)unmatched
  • Scalable System Developmentunmatched
  • Source Code/Configuration Management (SCM)unmatched
  • Star Schemaunmatched
  • Student Loansunmatched
  • Technical Writingunmatched
  • Technical/Engineering Designunmatched
  • Test Automationunmatched
  • Test Harnessunmatched
  • Unit Testunmatched

Be found by employers

5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.

Level up your application

Professional resume templates

Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

Free resume templates

Free resume builder

Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

Free resume builder