Lead Data Engineer – BSS Transformation

Location: New York, NY – Onsite

Job Summary

We are seeking an experienced Lead Data Engineer with 10+ years of data engineering experience and deep expertise in GCP, BigQuery, DBT, SQL, and data architecture. The ideal candidate will be a hands-on technical leader capable of designing scalable data solutions, leading engineering teams, and driving data transformation initiatives.

Key Responsibilities

• Design and lead the development of scalable, secure, and high-performance data pipelines on GCP.

• Architect and implement data solutions using BigQuery and other GCP data services.

• Develop, maintain, and optimize DBT models for data transformation and modeling.

• Write and optimize complex SQL queries for large-scale data processing and analytics.

• Lead data warehousing initiatives focused on scalability, performance, and reliability.

• Translate business requirements into effective technical data solutions.

• Monitor, troubleshoot, and continuously improve data pipelines and data quality.

• Automate data workflows and engineering tasks using Python and scripting tools.

• Implement data governance, security, quality, lineage, and compliance best practices.

• Lead and mentor data engineering teams.

• Establish engineering standards, coding practices, and development best practices.

• Collaborate with data scientists, analysts, business stakeholders, and cross-functional teams.

• Manage project timelines, technical delivery, and overall solution quality.

Required Skills

• 10+ years of experience in Data Engineering or related roles.

• Strong expertise in GCP data engineering frameworks.

• Expert-level SQL skills.

• Advanced experience with DBT for data modeling and transformation.

• Extensive hands-on experience with Google BigQuery.

• Strong understanding of data warehousing architecture and performance optimization.

• Proficiency in Python for automation and data manipulation.

• Experience with Git and CI/CD pipelines.

• Strong data architecture and pipeline development experience.

• Excellent leadership, communication, and stakeholder-management skills.

Preferred Skills

• Apache Airflow / Cloud Composer

• Terraform / Infrastructure as Code

• GCP Professional Data Engineer certification

• Data modernization and cloud migration experience

• Data governance frameworks and tools such as Data Catalog and DLP

Core Skills

GCP | BigQuery | DBT | SQL | Python | Data Engineering | Data Architecture | Data Warehousing | Data Pipelines | Cloud Composer | Airflow | Terraform | CI/CD | Git | Data Governance | Data Quality | Data Security | Performance Optimization