Sign upLog in
See more jobs

Lead Data Engineer : 26-02168

Akraya Inc.
  • San Francisco, CA
  • $65–$68 Per Hour
  • Quick Apply
28 days ago

Job Description

Primary Skills: GCP Data Engineering (Expert), BigQuery, Dataproc & dbt (Expert), ETL/ELT Pipeline Development (Expert), Data Modeling & SQL (Advanced), Supply Chain Data Engineering (Advanced)
Contract Type: W2 Only
Duration: 6+ Months
Location: San Francisco, CA
Pay Range: $65 - $68 on W2

Job Summary:
We are seeking an experienced Lead Data Engineer – Data & AI, Supply Chain to join a high-performing Data & AI organization focused on building modern, cloud-native data platforms that power enterprise analytics and AI initiatives. The ideal candidate will have deep expertise in Google Cloud Platform (GCP), enterprise data engineering, and scalable ETL/ELT solutions, along with experience supporting Supply Chain, Transportation, Sourcing, and Warehouse Management (WMS) domains. This is a hands-on technical leadership role responsible for designing enterprise data products, mentoring engineering teams, and delivering high-quality cloud-based analytics solutions.
Key Responsibilities:
  • Design, develop, and implement scalable enterprise data pipelines and data products on Google Cloud Platform (GCP).
  • Build and optimize cloud-native data solutions using BigQuery, Dataproc, SQL, and dbt.
  • Develop scalable ETL/ELT pipelines to ingest, transform, and publish data from multiple enterprise systems.
  • Design robust data models supporting enterprise reporting, analytics, and AI-driven decision-making.
  • Collaborate with Product Managers, Business Analysts, Solution Architects, Data Architects, and business stakeholders to translate business requirements into technical solutions.
  • Lead technical design discussions, architecture reviews, and code reviews while promoting engineering best practices.
  • Optimize cloud data platforms for performance, scalability, reliability, and cost efficiency.
  • Implement monitoring, testing, CI/CD, and operational best practices for production data pipelines.
  • Develop reusable frameworks, engineering standards, and technical documentation to improve team productivity.
  • Troubleshoot production issues, support continuous improvement initiatives, and mentor junior engineers.
  • Participate in Agile ceremonies including sprint planning, backlog refinement, estimation, and technical planning.
Must-have Skills:
  • 8+ years of Data Engineering experience with demonstrated technical leadership on enterprise-scale projects.
  • Strong hands-on experience with Google Cloud Platform (GCP).
  • Expert-level experience with BigQuery, Dataproc, SQL, and dbt.
  • Strong knowledge of modern ETL/ELT architecture and large-scale cloud data processing.
  • Expertise in data modeling, including dimensional modeling, normalized models, and analytical data warehouse design.
  • Experience building scalable, maintainable cloud-native data pipelines.
  • Strong experience with Git, CI/CD pipelines, and software engineering best practices.
  • Excellent analytical, troubleshooting, and problem-solving skills.
  • Strong communication and collaboration skills with cross-functional technical and business teams.
Nice-to-have Skills:
  • Experience with Apache Airflow for workflow orchestration.
  • Experience integrating enterprise data platforms using Apache Kafka or other streaming technologies.
  • Working knowledge of PySpark for distributed data processing.
  • Proficiency in Python for automation, utilities, and data engineering.
  • Experience implementing data quality frameworks, metadata management, and data governance best practices.
  • Experience supporting AI/ML data platforms and enterprise analytics initiatives.
Preferred Qualifications:
  • Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science, or a related field.
  • Experience within Retail, Apparel, Supply Chain, Transportation, Logistics, Warehouse Management Systems (WMS), or Distribution Center Operations.
  • Proven experience leading technical teams and mentoring engineers in Agile environments.
  • Strong understanding of enterprise data architecture, cloud-native engineering, and modern analytics platforms.
  • Passion for building scalable, reusable, and high-performance data solutions that enable enterprise analytics and AI capabilities.
ABOUT AKRAYA
Akraya is an award-winning IT staffing firm consistently recognized for our commitment to excellence and a thriving work environment. Most recently, we were recognized Stevie Employer of the Year 2025, SIA Best Staffing Firm to work for 2025, Inc 5000 Best Workspaces in US (2025 & 2024) and Glassdoor's Best Places to Work (2023 & 2022)!

Industry Leaders in Tech Staffing
As Talent solutions provider for Fortune 100 Organizations, Akraya's industry recognitions solidify our leadership position in the IT staffing space. We don't just connect you with great jobs, we connect you with a workplace that inspires!

Join Akraya Today!
Let us lead you to your dream career and experience the Akraya difference. Browse our open positions and join our team!

Numbers & Facts

LocationSan Francisco, CA
Salary$65–$68 Per Hour

Skills

  • Agile Programming Methodologiesunmatched
  • Analysis Skillsunmatched
  • Apacheunmatched
  • Apache Kafkaunmatched
  • Artificial Intelligence (AI)unmatched
  • Automationunmatched
  • Backlog Prioritizationunmatched
  • Best Practicesunmatched
  • Business Analysisunmatched
  • Business Operationsunmatched
  • Cloud Architectureunmatched
  • Cloud Computingunmatched
  • Code Reviewsunmatched
  • Communication Skillsunmatched
  • Computer Scienceunmatched
  • Continuous Deployment/Deliveryunmatched
  • Continuous Improvementunmatched
  • Continuous Integrationunmatched
  • Cross-Functionalunmatched
  • Data Managementunmatched
  • Data Modelingunmatched
  • Data Processingunmatched
  • Data Qualityunmatched
  • Data Scienceunmatched
  • Data Warehousingunmatched
  • Database Extract Transform and Load (ETL)unmatched
  • Dimensional Modelingunmatched
  • Distribution Operationsunmatched
  • Distribution Servicesunmatched
  • Engineeringunmatched
  • Enterprise Architectureunmatched
  • Enterprise Data Integrationunmatched
  • GCP (Good Clinical Practices)unmatched
  • Gitunmatched
  • Identify Issuesunmatched
  • Leadershipunmatched
  • Logistics Managementunmatched
  • Mentoringunmatched
  • Metadataunmatched
  • Problem Solving Skillsunmatched
  • Product Designunmatched
  • Product Engineeringunmatched
  • Production Supportunmatched
  • Productivity Managementunmatched
  • Python Programming/Scripting Languageunmatched
  • Requirements Managementunmatched
  • Retailunmatched
  • SQL (Structured Query Language)unmatched
  • Scalable System Developmentunmatched
  • Software Engineeringunmatched
  • Sprint Planningunmatched
  • Streaming Technologyunmatched
  • Supply Chainunmatched
  • Systems Engineeringunmatched
  • Team Lead/Managerunmatched
  • Team Playerunmatched
  • Technical Leadershipunmatched
  • Technical Recruitingunmatched
  • Technical Writingunmatched
  • Technical/Engineering Designunmatched
  • Warehousingunmatched

Be found by employers

5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.

Level up your application

Professional resume templates

Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

Free resume templates

Free resume builder

Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

Free resume builder