Job Description
Role: Engineer
Required Skills: Python
Qualification: BACHELOR OF COMPUTER SCIENCE
Experience: 8 - 10 Years
Function: TECHNOLOGY
Apply By: 2026-10-24
Python/Spark Developer
Must Have Technical/Functional Skills
- Strong hands-on experience with Apache Spark and PySpark.
- Experience with Big Data ecosystems such as Hadoop, Hive, HDFS, and Kafka.
- Proficiency in SQL and relational databases.
- Strong understanding of distributed computing and performance tuning.
- Experience with version control tools such as Git.
- Knowledge of Linux/Unix environments.
- Strong problem-solving and analytical skills.
Additional Requirement:
- Good understanding of GenAI concepts and applications
- Ability to identify opportunities to leverage AI and implement AI-driven solutions where appropriate
- Exposure to Data Products, Metadata Management, Knowledge Graphs, Ontology, or Semantic Technologies will be an added advantage
Roles & Responsibilities:
- Develop and maintain data processing applications using Python and Apache Spark (PySpark).
- Design, build, and optimize ETL/ELT pipelines for large-scale datasets.
- Process and analyze structured, semi-structured, and unstructured data from multiple sources.
- Implement data transformation, cleansing, and validation frameworks.
- Collaborate with Data Engineers, Data Scientists, Business Analysts, and stakeholders to understand business requirements.
- Optimize Spark jobs for performance, scalability, and reliability.
- Develop reusable components and data processing frameworks.
- Monitor and troubleshoot production issues related to Spark applications.
Salary Range - $100,000-$120,000 a year
TCS Employee Benefits Summary:
Discretionary Annual Incentive.
Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
Family Support: Maternal & Parental Leaves.
Insurance Options: Auto & Home Insurance, Identity Theft Protection.
Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
Time Off: Vacation, Time Off, Sick Leave & Holidays.
Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
Numbers & Facts
| Location | Pittsburgh, PA |
| Salary | $100,000–$120,000 Per Year |
Skills
Analysis Skillsunmatched
Apache Hadoopunmatched
Apache Hiveunmatched
Apache Sparkunmatched
Artificial Intelligence (AI)unmatched
Big Dataunmatched
Business Analysisunmatched
Computer Scienceunmatched
Data Processingunmatched
Data Scienceunmatched
Data Setsunmatched
Database Extract Transform and Load (ETL)unmatched
Distributed Computingunmatched
Ecosystemsunmatched
Gitunmatched
HDFS (Hadoop Distributed File System)unmatched
Identify Issuesunmatched
Legalunmatched
Linux Operating Systemunmatched
Loan Fundingunmatched
Metadataunmatched
Ontologyunmatched
Performance Tuning/Optimizationunmatched
Product Managementunmatched
Production Controlunmatched
Python Programming/Scripting Languageunmatched
Relational Databases (RDBMS)unmatched
SQL Databasesunmatched
Software Administrationunmatched
Source Code/Configuration Management (SCM)unmatched
Structured Dataunmatched
Student Loansunmatched
Unix Operating Systemsunmatched
Unstructured Dataunmatched
Level up your application
Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.
Free resume templatesImprove your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.
Free resume builder