Engineer

Python/Spark Developer

Must Have Technical/Functional Skills

Strong hands-on experience with Apache Spark and PySpark. Experience with Big Data ecosystems such as Hadoop, Hive, HDFS, and Kafka. Proficiency in SQL and relational databases. Strong understanding of distributed computing and performance tuning. Experience with version control tools such as Git. Knowledge of Linux/Unix environments. Strong problem-solving and analytical skills.

Additional Requirement:

• Good understanding of GenAI concepts and applications
• Ability to identify opportunities to leverage AI and implement AI-driven solutions where appropriate
• Exposure to Data Products, Metadata Management, Knowledge Graphs, Ontology, or Semantic Technologies will be an added advantage

Roles & Responsibilities:

Develop and maintain data processing applications using Python and Apache Spark (PySpark). Design, build, and optimize ETL/ELT pipelines for large-scale datasets. Process and analyze structured, semi-structured, and unstructured data from multiple sources. Implement data transformation, cleansing, and validation frameworks. Collaborate with Data Engineers, Data Scientists, Business Analysts, and stakeholders to understand business requirements. Optimize Spark jobs for performance, scalability, and reliability. Develop reusable components and data processing frameworks. Monitor and troubleshoot production issues related to Spark applications.

Salary Range - $100,000-$120,000 a year

TCS Employee Benefits Summary:

1. Discretionary Annual Incentive.

2. Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.

3. Family Support: Maternal & Parental Leaves.

Insurance Options: Auto & Home Insurance, Identity Theft Protection.

4. Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.

5. Time Off: Vacation, Time Off, Sick Leave & Holidays.

Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.