Seeking for an Lead ETL Developer to lead a critical data conversion and modernization initiative involving the extraction of data from Google Cloud Platform (GCP) BigQuery and delivery into enterprise SQL-based data warehouse environments. The ideal candidate will have strong hands-on experience with ETL development, Google Cloud Dataform, BigQuery, Medallion Architecture, enterprise data modeling, and data migration. This position will also provide technical leadership, architecture guidance, training, and mentoring to a team of ETL developers.
Responsibilities:
Lead the design, development, testing, and deployment of enterprise ETL and data ingestion pipelines.
Support data migration and conversion from GCP BigQuery to SQL-based enterprise data warehouses.
Design and implement data pipelines using Google Cloud Dataform, BigQuery, and modern ETL technologies.
Apply Medallion Architecture, including Bronze, Silver, and Gold data layers, where applicable.
Extract and integrate historical and real-time data from multiple source systems, including flat files and relational databases.
Transform, cleanse, standardize, and load data into data warehouses, data lakes, and analytical databases.
Design and validate transactional and analytical data models to support downstream applications, reporting, and BI requirements.
Develop comprehensive testing and validation strategies to ensure data accuracy, completeness, integrity, and quality.
Perform source-to-target validation and reconciliation throughout the migration process.
Optimize ETL pipelines for performance, scalability, reliability, and maintainability.
Provide technical leadership and architecture guidance throughout the data conversion lifecycle.
Establish and enforce ETL development standards, coding practices, design patterns, and documentation standards.
Collaborate with business and technical stakeholders to understand and validate data requirements.
Prepare technical documentation, architecture materials, presentations, and project communications.
Communicate technical concepts, migration risks, dependencies, and recommendations to both technical and non-technical stakeholders.
Required Qualifications:
7+ years of hands-on ETL development experience.
Strong experience designing and developing enterprise ETL/data integration pipelines.
Strong hands-on experience with Google Cloud Dataform.
Strong hands-on experience with Google BigQuery.
Experience implementing Medallion Architecture and layered data-processing patterns.
Strong understanding of enterprise data models and ETL pipeline design best practices.
Experience with data migration, data ingestion, transformation, and integration from multiple source systems.
Experience working with SQL-based data warehouse environments.
Experience with modern ETL and reporting/BI tools.
Strong knowledge of data quality, validation, reconciliation, and testing practices.
Proven experience serving as a Technical Lead and guiding a team of 4 or more developers.
Experience optimizing ETL pipelines for performance and scalability.
Strong troubleshooting and problem-solving skills.
Ability to communicate complex technical concepts effectively to both technical and non-technical audiences.
Preferred Qualifications:
Experience with large-scale cloud data migration and modernization projects.
Experience handling both historical and real-time data ingestion.
Experience with data warehouses, data lakes, and analytical databases.
Experience developing transactional and analytical data models.
Experience establishing ETL coding standards, conducting technical reviews, and mentoring development teams.
Numbers & Facts
Location
Des Moines, IA (Remote)
Skills
Best Practicesunmatched
Business Intelligenceunmatched
Business Intelligence Softwareunmatched
Cloud Computingunmatched
Coding Standardsunmatched
Communication Skillsunmatched
Data Analysisunmatched
Data Managementunmatched
Data Migrationunmatched
Data Modelingunmatched
Data Qualityunmatched
Data Warehousingunmatched
Database Extract Transform and Load (ETL)unmatched