$95,000–$115,000 Per Year
Agile Programming Methodologies, Analysis Skills, Apache Hadoop, Apache Hive, Apache Spark, Apiary/Beekeeping, Artificial Intelligence (AI), Best Practices, Big Data, Business Analysis, Business Architecture, Code Reviews, Coding Standards, Data Processing, Data Quality, Data Science, Data Sets, Database Extract Transform and Load (ETL), DevOps, Documentation, Ecosystems, Employee Benefits, Identify Issues, Java, Legal, Loan Funding, Maintain Compliance, Mentoring, Microsoft Product Family, Python Programming/Scripting Language, Reconciliation, Root Cause Analysis, Scalable System Development, Sprint Planning, Structured Data, Student Loans, Technical Leadership, Testing, Unix Operating Systems, Unstructured Data
Must Have Technical/Functional Skills
Primary Skill: PySpark, Hive, Python, SQL
Secondary: Unix, Kafka, Java
Experience: 10+ years
Roles & Responsibilities
We are seeking a highly experienced Hadoop Spark Developer with 10+ years of expertise in Big Data technologies, including PySpark, Hadoop Ecosystem, Hive, and Python. The ideal candidate will be responsible for designing, developing, optimizing, and maintaining large-scale data processing solutions.
Experience with Microsoft Copilot for AI-assisted development and productivity enhancement is highly desirable. The developer should hold a bachelor's or master's degree.
The candidate should possess strong analytical skills, hands-on experience in distributed data processing, and the ability to work closely with business stakeholders, architects, and data engineering teams.
- Design, develop, and maintain scalable Big Data solutions using Hadoop and Spark.
- Build and optimize ETL/ELT pipelines using PySpark, Hive, and Python.
- Process and analyze large datasets in distributed environments.
- Develop high-performance Spark jobs and optimize existing workloads.
- Create and manage Hive tables, partitions, views, and complex queries.
- Implement data quality, data validation, and reconciliation frameworks.
- Perform code reviews and ensure adherence to coding standards and best practices.
- Utilize Microsoft Copilot to accelerate development, automate code generation, troubleshooting, documentation, and testing activities.
- Strong experience building both batch and real-time streaming applications with Kafka.
- Collaborate with Data Architects, Data Scientists, Business Analysts, and DevOps teams.
- Troubleshoot production issues and perform root cause analysis.
- Design data ingestion frameworks for structured, semi-structured, and unstructured data.
- Participate in Agile ceremonies including sprint planning, estimation, and retrospectives.
- Mentor junior developers and provide technical leadership.
TCS Employee Benefits Summary:
Discretionary Annual Incentive.
Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
Family Support: Maternal & Parental Leaves.
Insurance Options: Auto & Home Insurance, Identity Theft Protection.
Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
Time Off: Vacation, Time Off, Sick Leave & Holidays.
Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
Salary Range: $95,000 - 115,000 a year