Data Engineering Lead

The Data Engineering Lead is a hands-on technical leader responsible for designing, building, and supporting the data platform that powers analytics, reporting, and AI at Gallagher.

You will lead complex data engineering initiatives while remaining deeply involved in the technology. This includes developing data pipelines, designing integrations, troubleshooting production issues, optimizing performance, reviewing code, and establishing engineering standards.

This is an individual contributor role with technical leadership responsibilities and no direct people management. You will work closely with data engineers, analytics, data science, business, and technology teams to translate business needs into scalable and reliable data solutions.

Hands-On Data Engineering

• Design, develop, test, deploy, and support scalable ETL/ELT pipelines and data integrations.
• Write production-quality SQL and Python/Scala/Spark code for data ingestion, transformation, and processing.
• Build reusable, modular, and reliable data engineering frameworks and pipelines.
• Work across Snowflake, Azure Data Factory, Databricks, Spark, ADLS Gen2, Azure Synapse, and SQL Server/Azure SQL.
• Develop curated datasets and data products supporting analytics, reporting, data science, and AI.
• Troubleshoot complex data, pipeline, integration, and performance issues.
• Optimize pipelines, queries, compute, and storage for performance, reliability, and cost.

Technical Leadership

• Lead technical design and implementation of complex data engineering initiatives.
• Translate business requirements into practical, scalable technical solutions.
• Establish engineering standards for coding, testing, data quality, documentation, security, and deployment.
• Conduct design and code reviews and establish reusable engineering patterns.
• Mentor engineers and provide technical direction without direct management responsibility.
• Identify technical risks, dependencies, and opportunities to simplify or modernize existing solutions.

Data Platform & Reliability

• Design scalable data lake, warehouse, and integration solutions using appropriate data modeling practices.
• Build data quality, monitoring, logging, and observability into production pipelines.
• Own the technical reliability of data pipelines and integrations.
• Lead root-cause analysis and implement permanent fixes for production issues.
• Improve CI/CD, release management, automation, and operational support practices.
• Help reduce technical debt, manual processes, duplicate integrations, and single points of failure.

Business & AI Partnership

• Partner with business, analytics, data science, security, and technology teams to deliver data solutions aligned to business priorities.
• Communicate technical decisions, risks, and tradeoffs clearly to technical and non-technical stakeholders.
• Build data foundations that support AI and advanced analytics, including structured and unstructured data use cases.
• Apply appropriate security, governance, and access controls to enterprise data.

Required Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.
• 7+ years of hands-on data engineering experience, including 3+ years in a technical lead or senior engineering role.
• Strong hands-on experience with Snowflake, Azure Data Factory, Databricks/Spark, ADLS Gen2, and SQL.
• Strong programming experience with Python, Scala, or equivalent.
• Proven experience designing and implementing enterprise ETL/ELT pipelines and data integrations.
• Strong understanding of data lake, data warehouse, and data modeling concepts.
• Experience with production troubleshooting, performance tuning, data quality, and pipeline reliability.
• Experience with CI/CD and modern software engineering practices.
• Ability to lead technical initiatives and influence engineers without direct management authority.
• Strong problem-solving and communication skills.

Preferred Qualifications

• Experience modernizing legacy data platforms and integrations.
• Experience with data observability, lineage, metadata, or governance.
• Experience supporting AI/ML, RAG, semantic search, or other advanced analytics workloads.
• Experience optimizing cloud data platforms for performance and cost.
• Experience working with distributed engineering teams.

#LI-NP1

At Gallagher, we believe supporting our colleagues goes far beyond the role itself. For more information, visit our Benefits page.

• Competitive compensation
• Comprehensive benefits programs designed to support your well-being 
• Career development opportunities and ongoing learning 
• A collaborative, people-first culture with accessible leadership 
• The opportunity to do meaningful work with global reach and local impact 

At Gallagher, we are dedicated to building an inclusive and authentic workplace. If your past experience doesn’t align perfectly, we encourage you to join our Talent Community to stay connected to additional career opportunities. At times, we will consider transferable skills from previous roles.

Gallagher is an affirmative action/equal opportunity employer (Minorities/Females/Veterans/Disabled)