Data Engineering Lead

Tata Consultancy Services Ltd

New York, NY

JOB DETAILS
SALARY
$135,000–$150,000 Per Year
SKILLS
Amazon Simple Storage Service (S3), Amazon Web Services (AWS), Computer Science, Continuous Deployment/Delivery, Continuous Integration, Cryptography, Data Sets, Docker, GCP (Good Clinical Practices), Git, Legal, Loan Funding, MCP - Microsoft Certified Professional, Microsoft Windows Azure, OAuth, Student Loans
LOCATION
New York, NY
POSTED
18 days ago

You'll need to have:

Bachelor's or advanced degree in Computer Science, Data Engineering, or a related field.

4-15 years of professional data engineering experience.

Strong Python, SQL, and Spark (PySpark) skills, and/or Kafka.

Snowflake (Snowpipe, Tasks, Streams) as a complementary warehouse.

Databricks (Delta formats, workflows, cataloging) or equivalent Spark platforms.

Hands-on experience building ETL/ELT with Prefect (or Airflow), dbt, Spark, and/or Kafka.

Experience onboarding datasets to cloud data platforms (storage, compute, security, governance).

Familiarity with Azure/AWS/GCP data services (e.g., S3/ADLS/GCS; Redshift/BigQuery; Glue/ADF).

Git-based workflows CI/CD and containerization with Docker (Kubernetes a plus).

It is a bonus to have:

Advanced APIM practices (custom policies, OAuth2/JWT, mTLS, private endpoints) and Azure AD integration.

Integrating datasets into MCP tools/providers for LLM/agent applications; familiarity with frameworks such as LangChain or LlamaIndex.

Data observability/quality tools (e.g., Great Expectations, Monte Carlo, Datafold) and strong lineage practices.

Exposure to financial datasets and controls (PII handling, encryption, masking).

TCS Employee Benefits Summary:

Discretionary Annual Incentive.

Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.

Family Support: Maternal & Parental Leaves.

Insurance Options: Auto & Home Insurance, Identity Theft Protection.

Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.

Time Off: Vacation, Time Off, Sick Leave & Holidays.

Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

Salary Range $135,000-$150,000 a year

About the Company

T

Tata Consultancy Services Ltd