Position Title: Lead Data Engineer (GCP) Location: Nashville, TN (Remote) Duration: Long Term Contract
Job description:
The Lead Data Engineer will be responsible for leading technical projects, mentoring a team of engineers, and driving the technical roadmap. This role requires a deep understanding of data engineering principles, proficiency in various programming languages and distributed systems, and hands-on experience with GCP technologies. The candidate will work closely with cross-functional teams to build and optimize data pipelines, manage data infrastructure, and support advanced analytics initiatives. Strong leadership and communication skills are essential to ensure successful project delivery and team development.
Required Skills:
Technical leadership experience (minimum 5 years as a lead)
Proficiency in SQL, Python, Java/Scala, and distributed systems (Spark, Beam)
GCP Expertise: Hands-on with BigQuery, Dataflow, Dataproc, Pub/Sub, Composer (Airflow), and Terraform
Experience with CloudSQL, Cloud Storage, GCP Suite, Cloud Run, and custom templates
Experience with Kafka and Data Plex
Leadership experience in leading projects, mentoring teams, and driving technical roadmaps
Familiarity with DevOps practices, CI/CD, Git, and infrastructure-as-code
Preferred Qualifications:
GCP Certifications (e.g., Professional Data Engineer)
Experience with real-time processing, Vertex AI, or multi-cloud environments
Understanding of DBT Labs & clinical/CMS billing data
Role and responsibilities:
Lead engineers, review code, and establish data engineering standards, CI/CD, and monitoring
Build and optimize ETL/ELT pipelines using Dataflow (Apache Beam), Dataproc (Spark), Pub/Sub, and Cloud Functions
Architect and manage BigQuery, Cloud Storage, and Data Fusion for efficient data ingestion, transformation, and storage
Optimize pipeline performance, query efficiency, and GCP cost management
Collaborate with data architects, scientists, and analysts to deliver self-service data platforms
Support advanced analytics/ML use cases
Implement data validation, lineage, and metadata management
Since 1996, RJT has provided successful SAP, Oracle, and IT consulting solutions and staffing services to clients around the world. The new Apolis brings you the same personalized service fortified with a greater array of IT solutions, global expertise, and cost-management strategies.
We are a global IT consultancy that seamlessly integrates experts and leading-edge solutions into your organization so you can focus on what really matters.
Skills
Apacheunmatched
Apache Sparkunmatched
Artificial Intelligence (AI)unmatched
Billingunmatched
Clinical Laboratoryunmatched
Cloud Computingunmatched
Cloud Storageunmatched
Code Reviewsunmatched
Communication Skillsunmatched
Content Management Systems (CMS)unmatched
Continuous Deployment/Deliveryunmatched
Continuous Integrationunmatched
Cost Controlunmatched
Cross-Functionalunmatched
Data Fusionunmatched
Data Managementunmatched
Data Qualityunmatched
Database Extract Transform and Load (ETL)unmatched
DevOpsunmatched
Distributed Computingunmatched
GCP (Good Clinical Practices)unmatched
Gitunmatched
Javaunmatched
Leadershipunmatched
Mentoringunmatched
Metadataunmatched
Performance Tuning/Optimizationunmatched
Programming Languagesunmatched
Python Programming/Scripting Languageunmatched
SQL (Structured Query Language)unmatched
Scala Programming Languageunmatched
Service Deliveryunmatched
Team Buildingunmatched
Technical Leadershipunmatched
Use Casesunmatched
🎯
Be found by employers
5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.
Level up your application
Professional resume templates
Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.