Data Engineer

Job Title: Data Engineer
Request-ID:95956-1
Location: West Chester, PA
Duration: 6+ months
Pay Range: $45.00- 50.00 /Hour

We are seeking an experienced Data Engineer with strong expertise in Snowflake, PySpark, SQL, and ETL/ELT pipeline development. The ideal candidate will be responsible for designing, developing, optimizing, and maintaining scalable data solutions while ensuring data quality, performance, and reliability.

Required Skills & Experience:

• 6 8 years of experience in Data Engineering with strong hands-on experience in building data pipelines.
• Strong experience with Snowflake data warehouse development and optimization.
• Hands-on experience with PySpark for large-scale data processing and transformation.
• Strong proficiency in SQL and database concepts.
• Experience designing and implementing ETL/ELT pipelines using modern data engineering frameworks.
• Experience ingesting data from multiple sources including:
  • APIs
  • Flat files
  • Relational databases
• Strong understanding of data modeling concepts including:
  • Star schema
  • Snowflake schema
  • Fact and Dimension tables
• Experience optimizing:
  • Snowflake queries
  • Spark jobs
  • Data processing workflows
• Strong understanding of data quality, validation, and testing frameworks.
• Experience with version control tools such as Git.

Key Responsibilities:

• Design, develop, and maintain scalable ETL/ELT data pipelines using PySpark and SQL.
• Build data ingestion frameworks to process data from various enterprise sources.
• Develop and manage complex data models within Snowflake.
• Create and maintain Fact and Dimension tables to support analytics and reporting needs.
• Optimize Snowflake queries and Spark jobs for improved performance and cost efficiency.
• Implement automated data validation and quality checks to ensure data accuracy and consistency.
• Troubleshoot production data pipeline issues and provide timely resolutions.
• Manage code repositories and follow development best practices using Git.
• Collaborate with data analysts, architects, and business teams to deliver reliable data solutions.

Mandatory Skills:

• Snowflake
• PySpark
• SQL
• ETL/ELT Pipeline Development
• Data Modeling
• Data Quality & Validation
• Git

Preferred Skills:

• Experience with cloud data platforms
• Experience working with APIs and enterprise data sources
• Performance tuning of Spark and Snowflake workloads

• Strong communication and analytical skills.
• Ability to collaborate with operations, technical teams, and stakeholders.
• Problem-solving mindset with attention to detail.
• Ability to lead workshops and training sessions.