Senior Software Engineer – Hadoop/AWS Big Data Migration Blue Bell, PA (100% Remote)

Job Title: Senior Software Engineer – Hadoop/AWS Big Data Migration Blue Bell, PA (100% Remote)
Location: Blue Bell, PA (100% Remote)
Job Type: Contract
Job Summary
We are seeking an experienced Senior Software Engineer with strong expertise in Cloudera Hadoop, AWS Big Data, and cloud migration to lead the modernization of enterprise data platforms. The ideal candidate will have extensive experience designing scalable big data solutions, migrating Hadoop workloads to AWS, and mentoring engineering teams. Healthcare domain experience is a strong plus.
Key Responsibilities

• Design, develop, and maintain high-quality, scalable software solutions for enterprise applications.
• Lead the migration of on-premises Cloudera Hadoop environments to AWS.
• Analyze existing Hadoop architecture, workflows, and data pipelines to create migration strategies.
• Design cloud-native architectures using Amazon EMR, AWS Glue, Airflow, Lambda, S3, and other AWS services.
• Develop and maintain Spark, Hive, Python, and shell-based data processing solutions.
• Conduct unit and integration testing while ensuring code quality and best practices.
• Troubleshoot production issues and optimize application performance.
• Collaborate with Product Owners, QA, DevOps, and Engineering teams throughout the SDLC.
• Create technical documentation, migration runbooks, and architectural designs.
• Mentor team members on software engineering and AWS best practices.
• Ensure security, governance, scalability, and compliance throughout the migration process.

Required Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• 10+ years of software engineering experience with enterprise applications and Big Data platforms.
• Strong experience with Cloudera Hadoop ecosystem:
  • HDFS
  • Hive
  • Spark
  • Oozie
  • Python
• Experience writing and maintaining Bash/Shell scripting for automation.
• Hands-on experience designing and implementing AWS Big Data solutions.
• Experience with:
  • Amazon EMR
  • AWS Glue
  • AWS Lambda
  • Apache Airflow
  • Amazon S3
• Proven experience migrating Hadoop workloads from on-premises environments to AWS.
• Strong understanding of cloud security, governance, scalability, and performance optimization.
• Experience with Infrastructure as Code using Terraform.
• Experience with CI/CD and platform engineering tools including:
  • Bitbucket
  • Gradle
  • Octopus Deploy
  • Artifactory
• Familiarity with XML and JSON data formats.
• Experience with monitoring and logging tools.
• Strong problem-solving, communication, and leadership skills.

Preferred Qualifications

• AWS Certified Solutions Architect.
• AWS Certified Big Data – Specialty (or equivalent AWS certification).
• Healthcare domain experience.
• Experience working with healthcare claims, providers, members, and related healthcare data models.

Required Skills

• Hadoop
• Cloudera
• HDFS
• Hive
• Spark
• Python
• Bash/Shell Scripting
• AWS
• Amazon EMR
• AWS Glue
• AWS Lambda
• Apache Airflow
• S3
• Terraform
• Bitbucket
• Gradle
• Octopus Deploy
• Artifactory
• XML
• JSON
• CI/CD
• Big Data
• Cloud Migration

Location
100% Remote (Client Location: Blue Bell, PA)