Senior Data Engineer

eTeam Inc.

Malvern, PA

Apply

JOB DETAILS

SALARY

$55–$60 Per Hour

SKILLS

AWS Lambda, Amazon Simple Storage Service (S3), Amazon Web Services (AWS), Analysis Skills, Apache Spark, Best Practices, Cloud Computing, Continuous Deployment/Delivery, Continuous Integration, Cost Control, Cryptography, Data Analysis, Data Lake, Data Management, Data Modeling, Data Partitioning, Data Processing, Data Quality, Data Science, Data Warehousing, Database Extract Transform and Load (ETL), Distributed Computing, Electronic Medical Records, Git, Information/Data Security (InfoSec), Java, Mentoring, Performance Tuning/Optimization, Python Programming/Scripting Language, SQL (Structured Query Language), Simple Queue Service (SQS), Training Data Sets

LOCATION

Malvern, PA

POSTED

21 days ago

REQUIREMENT_CITY - Malvern, PA
Role Name - Senior Data Engineer

Please prioritize candidates with Vanguard experience.

ROLE_DESCRIPTION -

Build and maintain event-driven data pipelines using AWS services such as Kinesis, MSK/Kafka, Lambda, Step Functions, SQS/SNS, and Glue/EMR.
Develop ETL/ELT workflows using Python and PySpark, ensuring performance, scalability, and cost efficiency.
Implement and optimize Spark-based data transformations, partitioning strategies, and data processing frameworks.
Design and manage data lake and warehouse structures using S3, Glue Catalog, Athena, and/or Redshift.
Build streaming solutions with checkpointing, stateful transformations, idempotency, and schema evolution.
Ensure high standards of data quality, observability, monitoring, and alerting (CloudWatch, Datadog, etc.).
Implement data security best practices including IAM, encryption (KMS), networking, and governance.
Create reusable frameworks, internal libraries, and CI/CD pipelines for automated deployments.
Collaborate with data scientists, analysts, and business teams to deliver well-modeled, reliable datasets.
Lead design reviews, mentor junior engineers, and contribute to engineering best practices.
Required Qualifications

Overall 8 yrs of experience
5 years of professional experience in Data Engineering
Must have an experience on Gule jobs and Lambda,
Experience of working on Java is an advantage
Strong expertise in Python and PySpark for large-scale data processing.
Advanced hands-on experience with AWS (S3, Glue, EMR, Lambda, Step Functions, Kinesis/MSK, DynamoDB, Athena, Redshift).
Deep experience building event-driven and streaming data pipelines.
Strong SQL experience for analytical and ETL workloads.
Hands-on experience with workflow orchestration tools such as Airflow or Step Functions.
Experience with CI/CD, Git, and Infrastructure-as-Code (Terraform or CloudFormation).
Strong understanding of distributed systems, Spark performance tuning, data modeling, and cloud cost optimization.
Knowledge of data security, encryption, networking, and compliance best practices in cloud environments

Skills: Digital : Spring Boot
Experience Required: 8-10

About the Company

eTeam Inc.

Looking for a great job? Join eTeam. We’re looking for talented staffing professionals to join our staff. We also provide contract assignments and full-time jobs at Fortune 2000 Companies. We’ve been named one of the best companies to work for by Staffing Industry Analysts and New Jersey Business.

COMPANY SIZE

100 to 499 employees

INDUSTRY

Other/Not Classified

FOUNDED

1998

WEBSITE

www.eteaminc.com

Resume Resources

Free Resume Templates Free Resume Builder