Sign upLog in
See more jobs

Senior Data Engineer / Data Engineering Lead

Tanisha Systems
  • Foster City, CA, CA
  • Quick Apply
25 days ago

Job Description

Senior Data Engineer / Data Engineering Lead
Foster City, CA 94404 (onsite)
Salary Market- Based on experience.
Full-Time / Direct-Hire

Hiring Data Engineering Lead with strong expertise in Databricks on AWS, MDM, and enterprise data integration. Lead the design and delivery of modern data platforms that enable trusted, governed, and scalable data consumption across business functions. Experience in cloud-based data engineering, middleware integrations, data governance, and enterprise-scale analytics solutions. Work closely with business, architecture, analytics, and engineering teams to drive data modernization initiatives. This role will be instrumental in enabling the enterprise data modernization journey. Establish a scalable and governed data foundation that supports advanced analytics, AI/ML initiatives, and business decision-making. Success in this role will directly improve data quality, consistency, and accessibility across critical business domains. The architecture and integration patterns defined by this role will serve as a foundation for future data and digital transformation programs.

Skills / Experience
  • 10+ years of experience in Data Engineering, Data Integration, or Data Platform delivery; hands-on experience with Databricks on AWS; Apache Spark, PySpark, Delta Lake, and Lakehouse architecture
  • Experience designing and implementing enterprise-scale data pipelines; Strong understanding of AWS services such as S3, Glue, Lambda, Redshift, IAM, and CloudWatch
  • Hands-on experience with MDM implementations and integrations; Experience with data quality, data governance, lineage, and master data management processes
  • Strong experience integrating enterprise systems using middleware platforms such as MuleSoft, Boomi, Kafka, or API-based integrations
  • Experience working with structured, semi-structured, and unstructured datasets; Strong SQL and Python development skills
  • Experience with Agile methodologies and DevOps practices; Experience leading distributed teams and managing stakeholder communications
  • Bachelor s Degree or higher in Information Systems, Computer Science, or equivalent experience
  • Skills / Tech Stack Snapshot - Databricks on AWS, Apache Spark, PySpark, Delta Lake, AWS S3, Glue, Lambda, Redshift, MDM Platforms (Informatica MDM, Reltio, Profisee or equivalent), Data Integration & ETL/ELT Frameworks, Middleware Technologies (MuleSoft, Boomi, Kafka, API-led Integrations), Data Warehousing & Data Lake Architecture, Data Governance, MDM, Data Quality & Metadata Management, SQL, Python, Azure DevOps, Jira, Confluence, CI/CD, Agile Delivery

Job / Role Description
  • Lead the design and implementation of Databricks-based data platforms on AWS; Architect scalable Lakehouse solutions supporting enterprise analytics workloads
  • Design and develop complex ETL/ELT pipelines using Databricks, Spark, and Cloud-native services; Drive MDM strategy, implementation, and integration across business applications and data platforms
  • Define data integration patterns using APIs, middleware, event-driven architectures, and messaging frameworks; Establish data governance, metadata management, and data quality frameworks
  • Collaborate with business stakeholders to understand data requirements and translate them into technical solutions; Optimize data processing performance, scalability, and operational monitoring
  • Define CI/CD processes and deployment standards for data engineering assets; Mentor engineering teams and provide technical leadership throughout the project lifecycle
  • Support architecture reviews, solution design discussions, and technical decision-making; Ensure compliance with organizational standards, security requirements, and best practices
  • Facilitate architecture reviews, workshops, and stakeholder discussions; Ability to communicate complex technical concepts to business and executive stakeholders;
  • Stakeholder Management Build strong relationships with business, IT, and external partners; Manage competing priorities and drive consensus among stakeholders; Demonstrate customer-centric and consultative engagement skills.
  • Leadership Skills Lead cross-functional and geographically distributed teams; Mentor and guide engineers and junior architects; Influence technical decisions through collaboration
  • Problem Solving & Analytical Thinking Identify root causes of complex data and integration challenges; Evaluate multiple solution options and recommend optimal approaches; Strong troubleshooting and performance optimization capabilities

Secondary Skills / Good to have
  • Experience with Snowflake or Microsoft Fabric; Exposure to AI/ML enablement using Databricks ML or AWS SageMaker
  • Experience with Unity Catalog and data governance frameworks; Data Mesh and Data Product concepts.
  • Experience with real-time streaming using Kafka or Kinesis; Informatica IDMC, Talend, or Azure Data Factory.
  • Knowledge of healthcare, life sciences, retail, manufacturing, or financial services domains.
  • Exposure to GenAI and enterprise AI adoption initiatives

What Success Looks Like / Expected Outcome Successfully deliver enterprise-scale Databricks capabilities; Establish a governed and scalable Lakehouse architecture for analytics and reporting. Improve master data consistency and data quality across key business domains; Implement standardized integration frameworks and reusable patterns. Establish engineering best practices, automation, and governance processes; Become a trusted advisor for data platform and integration strategy. Enable reliable and efficient data movement across multiple enterprise systems; Achieve stakeholder confidence through consistent delivery and technical leadership

Numbers & Facts

LocationFoster City, CA, CA

Skills

  • AWS Lambdaunmatched
  • Agile Programming Methodologiesunmatched
  • Amazon Simple Storage Service (S3)unmatched
  • Amazon Web Services (AWS)unmatched
  • Apache Sparkunmatched
  • Application Integrationunmatched
  • Application Programming Interface (API)unmatched
  • Architectural Analysisunmatched
  • Artificial Intelligence (AI)unmatched
  • Atlassian JIRAunmatched
  • Automationunmatched
  • Best Practicesunmatched
  • Biologyunmatched
  • Business Architectureunmatched
  • Business Solutionsunmatched
  • Cisco Unityunmatched
  • Cloud Computingunmatched
  • Communication Skillsunmatched
  • Computer Scienceunmatched
  • Continuous Deployment/Deliveryunmatched
  • Continuous Integrationunmatched
  • Cross-Functionalunmatched
  • Data Lakeunmatched
  • Data Managementunmatched
  • Data Processingunmatched
  • Data Qualityunmatched
  • Data Setsunmatched
  • Data Warehousingunmatched
  • Database Extract Transform and Load (ETL)unmatched
  • DevOpsunmatched
  • Enterprise Data Integrationunmatched
  • Financial Servicesunmatched
  • Healthcareunmatched
  • Identify Issuesunmatched
  • Informaticaunmatched
  • Information Technology & Information Systemsunmatched
  • Leadershipunmatched
  • Maintain Complianceunmatched
  • Manufacturingunmatched
  • Manufacturing Data Managementunmatched
  • Master Data Management (MDM)unmatched
  • Mentoringunmatched
  • Metadataunmatched
  • Microsoft Product Familyunmatched
  • Microsoft Windows Azureunmatched
  • Middlewareunmatched
  • Options Analysisunmatched
  • Performance Tuning/Optimizationunmatched
  • Problem Solving Skillsunmatched
  • Project Lifecycleunmatched
  • Python Programming/Scripting Languageunmatched
  • Quality Managementunmatched
  • Regulatory Complianceunmatched
  • Retailunmatched
  • Root Cause Analysisunmatched
  • SQL (Structured Query Language)unmatched
  • Software Engineeringunmatched
  • System Integration (SI)unmatched
  • Team Lead/Managerunmatched
  • Technical Leadershipunmatched
  • Technical Recruitingunmatched
  • Technical/Engineering Designunmatched

Be found by employers

5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.

Level up your application

Professional resume templates

Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

Free resume templates

Free resume builder

Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

Free resume builder