Sign upLog in

Senior Data Engineer

ADPMN INC

Remote(remote)

Apply
JOB DETAILS
JOB TYPE
Contractor
SKILLS
AWS Lambda, Agile Programming Methodologies, Algorithms, Amazon Elastic Compute Cloud (EC2), Amazon Simple Storage Service (S3), Amazon Web Services (AWS), Analysis Skills, Apache Spark, Application Programming Interface (API), Best Practices, Cloud Computing, Code Reviews, Communication Skills, Continuous Deployment/Delivery, Continuous Integration, Data Analysis, Data Management, Data Modeling, Data Processing, Data Quality, Data Science, Data Sets, Data Structures, Data Warehousing, Database Extract Transform and Load (ETL), Design Patterns Programming Methodologies, Distributed Computing, Docker, Electronic Medical Records, Engineering, Enterprise Applications, Git, Identify Issues, Object Oriented Design (OOD), Object Oriented Programming (OOP), Performance Tuning/Optimization, Production Support, Python Programming/Scripting Language, R Programming Language, REST (Representational State Transfer), SQL (Structured Query Language), Scalable System Development, Scrum Project Management and Software Development, Software Administration, Software Architecture, Software Engineering, Technical/Engineering Design, Test Automation
LOCATION
Remote
POSTED
8 days ago

Role: Senior Data Engineer (Python / Apache Spark / AWS)
100 % Remote
Duration: Long term 

We are seeking a Senior Data Engineer with strong hands-on experience in Python and Apache Spark to design, develop, and optimize scalable data pipelines and distributed data processing solutions. The ideal candidate will have expertise in ETL/ELT development, data modeling, cloud technologies, and software engineering best practices. This is a hands-on role requiring the ability to build production-grade data solutions in an Agile environment.

 

Required Skills

  • 10%2B years of Data Engineering or Software Engineering experience.
  • Strong hands-on Python experience (Required).
  • Strong hands-on Apache Spark / PySpark experience (Required).
  • Experience building scalable ETL/ELT pipelines.
  • Strong knowledge of data modeling, SQL, distributed computing, and data warehousing.
  • Experience with pipeline orchestration (Airflow, Databricks Workflows, or similar).
  • Experience developing and consuming REST APIs.
  • Strong understanding of software engineering principles, including object-oriented programming, design patterns, data structures, and algorithms.
  • Experience with Git, CI/CD pipelines, automated testing, and Agile/Scrum.
  • Excellent analytical, troubleshooting, and communication skills.
  • AWS experience (S3, EC2, Glue, Lambda, EMR).
  • Databricks experience and/or Apache Spark certification.
  • Experience with Docker, Kubernetes, Delta Lake, Snowflake.
  • Experience with R or SAS is a plus.

 

Key Responsibilities

  • Design, develop, and optimize enterprise data pipelines using Python and Apache Spark.
  • Build scalable ETL/ELT solutions for large datasets.
  • Design and maintain data models supporting analytics and reporting.
  • Optimize Spark jobs for performance, scalability, and reliability.Submit
  • Develop APIs and data services supporting enterprise applications.
  • Implement automated testing, CI/CD, and data quality controls.
  • Collaborate with architects, software engineers, data scientists, and business stakeholders to deliver high-quality data solutions.
  • Participate in code reviews, technical design discussions, and production support.


About the Company

A

ADPMN INC

Resume Resources

Free Resume TemplatesFree Resume Builder