Job Description Role: Senior Data Engineer (Python / Apache Spark / AWS)Senior Data Engineer with strong hands-on experience in Python and Apache Spark to design, develop, and optimize scalable data pipelines and distributed data processing solutions. The ideal candidate will have expertise in ETL/ELT development, data modeling, cloud technologies, and software engineering best practices. This is a hands-on role requiring the ability to build production-grade data solutions in an Agile environment.
Required Skills
10%2B years of Data Engineering or Software Engineering experience.Strong hands-on Python experience (Required). Strong hands-on Apache Spark / PySpark experience (Required). Experience building scalable ETL/ELT pipelines . Strong knowledge of data modeling, SQL, distributed computing, and data warehousing . Experience with pipeline orchestration (Airflow, Databricks Workflows, or similar). Experience developing and consuming REST APIs . Strong understanding of software engineering principles , including object-oriented programming, design patterns, data structures, and algorithms. Experience with Git, CI/CD pipelines, automated testing, and Agile/Scrum . Excellent analytical, troubleshooting, and communication skills. AWS experience (S3, EC2, Glue, Lambda, EMR ). Databricks experience and/or Apache Spark certification. Experience with Docker, Kubernetes, Delta Lake, Snowflake . Experience with R or SAS is a plus.
Key Responsibilities
Design, develop, and optimize enterprise data pipelines using Python and Apache Spark . Build scalable ETL/ELT solutions for large datasets. Design and maintain data models supporting analytics and reporting. Optimize Spark jobs for performance, scalability, and reliability.Submit Develop APIs and data services supporting enterprise applications. Implement automated testing, CI/CD, and data quality controls. Collaborate with architects, software engineers, data scientists, and business stakeholders to deliver high-quality data solutions. Participate in code reviews, technical design discussions, and production support.
Show more Numbers & Facts Location Remote (Remote Job Type Contractor
Skills
AWS Lambdaunmatched
Agile Programming Methodologiesunmatched
Algorithmsunmatched
Amazon Elastic Compute Cloud (EC2)unmatched
Amazon Simple Storage Service (S3)unmatched
Amazon Web Services (AWS)unmatched
Analysis Skillsunmatched
Apache Sparkunmatched
Application Programming Interface (API)unmatched
Best Practicesunmatched
Cloud Computingunmatched
Code Reviewsunmatched
Communication Skillsunmatched
Continuous Deployment/Deliveryunmatched
Continuous Integrationunmatched
Data Analysisunmatched
Data Managementunmatched
Data Modelingunmatched
Data Processingunmatched
Data Qualityunmatched
Data Scienceunmatched
Data Setsunmatched
Data Structuresunmatched
Data Warehousingunmatched
Database Extract Transform and Load (ETL)unmatched
Design Patterns Programming Methodologiesunmatched
Distributed Computingunmatched
Dockerunmatched
Electronic Medical Recordsunmatched
Engineeringunmatched
Enterprise Applicationsunmatched
Gitunmatched
Identify Issuesunmatched
Object Oriented Design (OOD)unmatched
Object Oriented Programming (OOP)unmatched
Performance Tuning/Optimizationunmatched
Production Supportunmatched
Python Programming/Scripting Languageunmatched
R Programming Languageunmatched
REST (Representational State Transfer)unmatched
SQL (Structured Query Language)unmatched
Scalable System Developmentunmatched
Scrum Project Management and Software Developmentunmatched
Software Administrationunmatched
Software Architectureunmatched
Software Engineeringunmatched
Technical/Engineering Designunmatched
Test Automationunmatched
Show more Level up your application Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.
Free resume templates
Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.
Free resume builder