AWS Data Lead

Job title: AWS Data Lead

Location: Fort Mill, SC (Onsite)

Job Description

We are seeking an experienced AWS Data Lead to drive the design, development, and delivery of enterprise-scale data integration and analytics solutions on AWS. The ideal candidate will possess strong technical leadership skills, extensive hands-on experience with AWS data services, and a proven track record of building scalable, high-performance ETL/ELT pipelines and data platforms.

Key Responsibilities

• Lead the architecture, design, and implementation of end-to-end data pipelines and ETL/ELT workflows using AWS Glue and PySpark.
• Develop scalable and reliable data integration solutions leveraging AWS services including Glue, Lambda, EventBridge, S3, RDS (Aurora/PostgreSQL), MSK, and Kinesis.
• Design and implement event-driven architectures and real-time data processing solutions.
• Build and manage workflow orchestration using Apache Airflow.
• Design and optimize data warehouse and analytics solutions using Snowflake, Aurora, PostgreSQL, and SQL Server.
• Ensure data quality, governance, performance, and reliability across data platforms.
• Implement CI/CD pipelines and Infrastructure as Code (IaC) using Terraform and modern DevOps practices.
• Collaborate with business stakeholders, architects, developers, and data consumers to deliver scalable data solutions.
• Mentor engineering teams, conduct code reviews, and establish data engineering best practices.
• Drive technical discussions, solution design reviews, and project delivery.

Required Qualifications

• 10+ years of experience in Data Engineering, ETL Development, or Data Warehousing.
• 5+ years of hands-on experience with AWS Data Services.
• Strong expertise in AWS Glue, PySpark, Lambda, S3, EventBridge, MSK/Kinesis, and RDS (Aurora/PostgreSQL).
• Experience designing and developing enterprise ETL/ELT pipelines.
• Strong SQL development and data modeling skills.
• Hands-on experience with Apache Airflow for workflow orchestration.
• Experience working with Snowflake, PostgreSQL, Aurora, and MS SQL Server.
• Knowledge of CI/CD pipelines, Git, and DevOps best practices.
• Hands-on experience with Terraform or other Infrastructure-as-Code tools.
• Strong analytical, problem-solving, communication, and leadership skills.

Preferred Qualifications

• AWS Certifications such as:
  • AWS Certified Solutions Architect
  • AWS Certified Data Engineer
• Experience with real-time streaming architectures.
• Experience leading distributed data engineering teams.