Job Title: Big Data Engineer
Location:Alpharetta, GA (Local candidates only)
Duration:12 months (Contract)
Pay Rate:$79.71/hr W2 (No benefits)
Role Summary
We are seeking an experiencedBig Data Engineerto join the CPS Data Center of Excellence team. This role focuses on designing, enhancing, and governing data platform automation frameworks, with a strong emphasis on Spark-based ETL processing, performance optimization, and innovation.
Key Responsibilities
Design and develop ETL automation frameworks for big data platforms.
Enhance and support existing frameworks; act as technical POC for related teams.
Perform performance tuning for Spark and Snowflake ETL jobs.
Drive automation, process optimization, and utility development.
Conduct code development, reviews, testing, and participate in architecture/design discussions.
Support batch operations, troubleshoot issues, and assist application teams.
Evaluate new technologies and support cloud migration POCs.
Required Skills
7+ years of data engineering experience.
Strong hands-on expertise inPython,Apache Spark,SQL, andUNIX Shell scripting.
Solid understanding ofHDFS, Hive, Impala, and Spark internals.
Experience with GitHub, DevOps, and CI/CD tools.
Strong problem-solving, communication, and collaboration skills.
Ability to work independently with a strong sense of ownership.
Preferred Skills
Experience withSnowflakeand cloud platforms (AWS, Azure).
Exposure to ETL/data integration tools (e.g.,Informatica/IDMC).
Primary Skills:Python, Big Data, Apache Spark