Tech Lead - Software Engineer

Greetings!.

Job Description: Senior Databricks Engineer (SQL, Python, PySpark)
Experience: 8+ Years
Location: Santa Clara, CA Day1 osnite

In-Person interivew after L1 is clear

We are seeking an experienced Senior Databricks Engineer with strong expertise in Databricks, Python, PySpark, and SQL to design, develop, and optimize large scale data processing solutions. The ideal candidate will have hands on experience building data pipelines, implementing ETL/ELT processes, and working with cloud based data platforms to support analytics and business intelligence initiatives.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks, PySpark, Python, and SQL.
• Build and optimize ETL/ELT frameworks for processing large volumes of structured and unstructured data.
• Develop data ingestion solutions from multiple source systems into cloud data lakes and warehouses.
• Optimize Spark jobs for performance, scalability, and cost efficiency.
• Collaborate with data architects, analysts, and business stakeholders to understand data requirements.
• Implement data quality, validation, and monitoring frameworks.
• Perform data modeling and transformation for reporting and analytics use cases.
• Troubleshoot production issues and provide timely resolutions.
• Follow best practices for coding, testing, version control, and deployment.

Required Skills

• 8+ years of experience in Data Engineering.
• Strong hands on experience with Databricks.
• Expertise in PySpark, Python, and SQL.
• Experience with Spark optimization techniques and performance tuning.
• Strong understanding of data warehousing concepts and dimensional modeling.
• Experience building ETL/ELT pipelines.
• Knowledge of Delta Lake, Spark SQL, and Databricks workflows.
• Experience with Git, CI/CD, and Agile methodologies.
• Strong analytical and problem solving skills.

Preferred Skills

• Experience with cloud platforms such as Azure, AWS, or GCP.
• Knowledge of Azure Data Factory (ADF), Airflow, or other orchestration tools.
• Experience with streaming technologies such as Kafka or Structured Streaming.
• Exposure to Power BI, Tableau, or other analytics tools.
• Databricks or cloud certifications are a plus.

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.

Excellent communication and stakeholder management skills

The pay range for this role is $125k - $130k per annum including any bonuses or variable pay. Tech Mahindra also offers benefits like medical, vision, dental, life, disability insurance and paid time off (including holidays, parental leave, and sick leave, as required by law). Ask our recruiters for more details on our Benefits package. The exact offer terms will depend on the skill level, educational qualifications, experience, and location of the candidate.

Thanks & Regards

Tech Mahindra is an Equal Employment Opportunity employer. We promote and support a diverse workforce at all levels of the company. All qualified applicants will receive consideration for employment without regard to race, religion, color, sex, age, national origin or disability. All applicants will be evaluated solely on the basis of their ability, competence, and performance of the essential functions of their positions with or without reasonable accommodations. Reasonable accommodations also are available in the hiring process for applicants with disabilities. Candidates can request a reasonable accommodation by contacting the company ADA Coordinator at ADA_Accomodations@TechMahindra.com."