Tech Lead (Python + Databricks+ Streamlit)

Indent :PSL304400-12-1
Role : Tech Lead (Python + Databricks+ Streamlit)
Location : Iselin, NJ (Hybrid)
Rate: $65/hr to $67/hr


Position Overview
We are seeking a highly skilled Tech Lead with strong hands-on expertise in Python, Databricks, and Angular(Good to have) to lead the design, development, and implementation of scalable data and application solutions. The ideal candidate will guide engineering teams, architect end-to-end systems, and collaborate across functions to deliver high-quality, enterprise-grade products.Key Responsibilities
Technical Leadership

• Lead a cross-functional engineering team across backend, frontend, and data engineering streams.
• Own the full SDLC: architecture, design, development, code reviews, DevOps pipeline oversight, and production deployment.
• Provide technical direction, mentor developers, enforce coding best practices, and promote engineering excellence.
• Work closely with product owners, architects, and stakeholders to define technical strategy and roadmap.

Backend Engineering (Python)

• Design and build robust microservices, APIs, and data processing frameworks using Python.
• Develop scalable ETL/ELT workflows and backend logic aligned with enterprise data standards.
• Implement best practices in error handling, logging, performance tuning, and automated testing.

Data Engineering (Databricks)

• Build large-scale data pipelines and transformations using Databricks (PySpark/Spark SQL).
• Optimize data workflows for cost, performance, and reliability.
• Collaborate with data architects to define data models, governance, and quality frameworks.
• Integrate Databricks with cloud services (Azure/AWS) for end-to-end data solutions.

Cloud & DevOps

• Work with CI/CD pipelines (Azure DevOps, GitHub Actions, Jenkins, etc.) for automated builds and deployments.
• Ensure seamless deployment and monitoring of applications in cloud environments.
• Drive improvements in observability, reliability, and system health using monitoring tools.

Collaboration & Stakeholder Management

• Partner with business teams to translate requirements into scalable technology solutions.
• Estimate, plan, and track project deliverables.
• Guide teams in Agile development practices (Scrum/Kanban).

Required Skills & Qualifications
Technical Skills

• Strong hands-on experience with Python (Flask/FastAPI/Django desirable).
• Advanced knowledge of Databricks, PySpark, Spark SQL.
• Experience building large-scale distributed systems.
• Strong understanding of cloud platforms (Azure preferred, AWS/GCP acceptable).
• Familiarity with SQL/NoSQL databases (PostgreSQL, MySQL, Cosmos, MongoDB, etc.).
• Experience with Git, CI/CD pipelines, Docker, and containerized deployments.

DISCLAIMER
==========
This e-mail may contain privileged and confidential information which is the property of Persistent Systems Ltd. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Persistent Systems Ltd. does not accept any liability for virus infected mails.