Lead Data Engineer with Terraform

EPAM Systems Inc

  • Atlanta, GA
  • 30+ days ago
    Want to know if you’re a fit?
    Upload your resume and let our AI show you.

    Skills

    • Automationunmatched
    • Best Practicesunmatched
    • Centers for Disease Control and Prevention (CDC)unmatched
    • Cloud Computingunmatched
    • Cloud Storageunmatched
    • Communication Skillsunmatched
    • Continuous Deployment/Deliveryunmatched
    • Continuous Integrationunmatched
    • Data Lakeunmatched
    • Data Managementunmatched
    • Data Qualityunmatched
    • DevOpsunmatched
    • English Languageunmatched
    • GCP (Good Clinical Practices)unmatched
    • GitHubunmatched
    • Lookerunmatched
    • Presentation/Verbal Skillsunmatched
    • Requirements Managementunmatched
    • Scalable System Developmentunmatched
    • Writing Skillsunmatched

    Description

    Back to Search

    Lead Data Engineer with Terraform

    Remote in Georgia, & 4 others

    Data Software Engineering

    apply

    FacebookLinkedInSend via email

    Looking for something else?

    Find a vacancy that works for you. Send us your CV to receive a personalized offer.

    Find me a job

    Location-specific conditions & benefits*

    Choose an option

    We are seeking an experienced Lead Data Engineer with strong Terraform expertise to design, build and maintain scalable data solutions on Google Cloud Platform. In this role, you will lead the development of robust data pipelines while driving best practices across infrastructure automation and DevOps processes.

    Responsibilities

    • Design and build scalable data pipelines using GCP services

    • Lead the development of data solutions leveraging BigQuery, Dataflow and Dataform/dbt

    • Orchestrate workflows with Cloud Composer/Airflow

    • Manage real-time data streaming through Pub/Sub and Cloud Storage

    • Implement infrastructure as code using Terraform

    • Establish and maintain CI/CD pipelines with GitHub Actions

    • Collaborate with stakeholders to translate business requirements into technical solutions

    • Ensure data quality, reliability and performance across all systems

    • Mentor team members and promote engineering best practices

    Requirements

    • 5+ years of hands-on experience with SQL and Python

    • Expertise in GCP services including BigQuery, Dataflow and Dataform/dbt

    • Proficiency in Cloud Composer/Airflow, Pub/Sub and Cloud Storage

    • Skills in DevOps practices including CI/CD, GitHub Actions and Terraform

    • Good verbal and written communication skills

    • Good business acumen

    • English proficiency at B2 level or higher

    Nice to have

    • Google Cloud Professional Data Engineer Certified

    • Familiarity with Data Lake technologies such as Iceberg

    • Knowledge of CDC using Datastream

    • Understanding of Dataplex, Knowledge Catalog and Analytics Hub

    • Competency in Looker

    Numbers & Facts

    LocationAtlanta, GA

    Similar Jobs

    See more jobs