Cloud Data Engineer - PySpark

Zp Group Llc
    • $110,000–$140,000 Per Year
    2 days ago

    Job Description

    Responsibilities: for the Data Cloud Engineer Include: Design and maintain scalable ETL/ELT data pipelines using Azure Synapse, Databricks, AWS Glue, and related cloud technologies. Develop large-scale data transformations using PySpark, Spark SQL, Python, and SQL . Build data ingestion frameworks for structured and unstructured data, including relational databases, CSV, JSON, and REST APIs. Implement full and incremental data loads, Change Data Capture (CDC) , and rerunnable pipeline architectures. Design and support cloud-based data lakes, data warehouses, and analytics-ready datasets . Implement data quality and governance controls including schema validation, RBAC, lineage, cataloging, and credential management. Monitor and troubleshoot data pipelines for performance, failures, latency, logging, and operational reliability. Implement CI/CD pipelines supporting automated deployments and environment promotion. Partner with cloud and cybersecurity teams to maintain compliance with RMF, STIG, FedRAMP, and DoD security requirements . Support cloud data migration, integration, and modernization initiatives across Azure and AWS environments. Qualifications: for the Data Cloud Engineer Include: 10+ years of experience designing and supporting production-grade cloud data pipelines . Strong experience with Azure Synapse, Databricks, Azure Data Factory, and/or AWS data services . Advanced experience with PySpark, Spark SQL, Python, and SQL . Experience with ETL/ELT, CDC, data lakes/warehouses, data quality, and governance . Experience implementing CI/CD and automated deployments for cloud data environments. Bachelor's degree in a related technical field. Active Secret clearance required. Compensation: for the Data Cloud Engineer Includes: Salary Range: $110,000 - $140,000 depending on experience. Comprehensive Benefits: Medical, Dental, Vision, 401(k), PTO, and Paid Holidays.

    Numbers & Facts

    Location
    Salary$110,000–$140,000 Per Year

    Skills

    • Amazon Web Services (AWS)unmatched
    • Application Programming Interface (API)unmatched
    • Cataloguingunmatched
    • Centers for Disease Control and Prevention (CDC)unmatched
    • Cloud Computingunmatched
    • Continuous Deployment/Deliveryunmatched
    • Continuous Integrationunmatched
    • Data Analysisunmatched
    • Data Collectionunmatched
    • Data Managementunmatched
    • Data Migrationunmatched
    • Data Qualityunmatched
    • Data Setsunmatched
    • Data Warehousingunmatched
    • Database Extract Transform and Load (ETL)unmatched
    • Identify Issuesunmatched
    • Internet Securityunmatched
    • JSONunmatched
    • Maintain Complianceunmatched
    • Microsoft Windows Azureunmatched
    • Production Supportunmatched
    • Python Programming/Scripting Languageunmatched
    • REST (Representational State Transfer)unmatched
    • Relational Databases (RDBMS)unmatched
    • SQL (Structured Query Language)unmatched
    • Software Engineeringunmatched
    • Structured Dataunmatched
    • United States Department of Defense (DoD)unmatched
    • Unstructured Dataunmatched

    Be found by employers

    5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.

    Level up your application

    Professional resume templates

    Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

    Free resume templates

    Free resume builder

    Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

    Free resume builder