Lead Data Engineer

Expert Technology Services
  • Madison, WI
  • Instant Apply
7 days ago

Job Description

Job Summary (Lead Data Engineer)

- Lead the design, development, and deployment of large-scale data engineering solutions.
- Provide technical leadership and guidance to data engineering teams.
- Architect, build, and maintain enterprise-level ETL/ELT pipelines using Python and Google Cloud Platform (GCP) tools.
- Ensure high performance and scalability of data processing workflows with BigQuery, Dataflow, Dataproc/PySpark, Cloud Composer (Airflow), Pub/Sub, and Cloud Storage.
- Develop and optimize complex SQL queries and data models to support business analytics and data science.
- Collaborate with stakeholders to translate business requirements into robust data solutions.
- Implement CI/CD, DevOps practices, and automated deployment frameworks for data engineering projects.
- Drive initiatives independently from concept through to production, ensuring best practices in coding, testing, and deployment.
- Support data governance, data quality, and compliance requirements as needed.
- Stay current with emerging technologies, especially in cloud data engineering and AI/ML enablement.
- (Preferred) Leverage experience with Snowflake, Databricks, lakehouse architectures, and feature engineering pipelines.
- (Preferred) Contribute to Agile processes within large enterprise environments.

Numbers & Facts

LocationMadison, WI

Skills

  • Agile Programming Methodologiesunmatched
  • Artificial Intelligence (AI)unmatched
  • Best Practicesunmatched
  • Business Analysisunmatched
  • Business Supportunmatched
  • Cloud Computingunmatched
  • Cloud Storageunmatched
  • Continuous Deployment/Deliveryunmatched
  • Continuous Integrationunmatched
  • Data Modelingunmatched
  • Data Processingunmatched
  • Data Qualityunmatched
  • Data Scienceunmatched
  • Database Extract Transform and Load (ETL)unmatched
  • DevOpsunmatched
  • Emerging Technologyunmatched
  • Engineeringunmatched
  • GCP (Good Clinical Practices)unmatched
  • Performance Managementunmatched
  • Python Programming/Scripting Languageunmatched
  • Quality Assurance Methodologyunmatched
  • Query Optimizationunmatched
  • Regulatory Complianceunmatched
  • Requirements Managementunmatched
  • SQL (Structured Query Language)unmatched
  • Software Engineeringunmatched
  • Technical Leadershipunmatched

Be found by employers

5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.

Level up your application

Professional resume templates

Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

Free resume templates

Free resume builder

Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

Free resume builder