Data Automation Engineer – AWS, Python & Generative AI

Location: Fully Remote (Occasional Travel to the Washington, D.C. Metro Area)

Job Type: Contract

Job Overview

We are seeking a Data Automation Engineer to build and maintain automated data pipelines and cloud-based data solutions, primarily using Amazon Web Services (AWS), with some integration with Microsoft Azure.

In this role, you will use Python, SQL, Apache Spark, and cloud technologies to collect, process, and analyze data from multiple sources. You will also explore Generative AI tools to improve data quality, automate tasks, identify unusual patterns, and make enterprise data easier to access.

The ideal candidate has strong hands-on data engineering experience, excellent problem-solving skills, and the ability to design, develop, test, and troubleshoot production-ready solutions independently.

Key Responsibilities

• Design, build, and maintain automated data pipelines using AWS and selected Azure services.

• Develop Python- and SQL-based solutions to collect, transform, and move data between databases and cloud platforms.

• Build batch and near-real-time data processing pipelines using Apache Spark and technologies such as Kafka or Flume.

• Work with databases and data services, including Amazon DynamoDB, SQL Server, Azure SQL, and Amazon S3.

• Use AWS services such as AWS Glue, Lambda, EMR, and Step Functions to automate data processing.

• Explore Generative AI tools such as Amazon Bedrock, Azure OpenAI, Hugging Face, and LangChain to improve data analysis, data quality, and automation.

• Integrate REST APIs and customer interaction data into analytics and reporting platforms.

• Use GitHub, Azure DevOps, Jenkins, Docker, or similar tools for source control, automated builds, and deployment.

• Troubleshoot data pipeline issues, improve performance, monitor production systems, and resolve technical incidents.

• Follow cloud security requirements, including access controls, encryption, and network security.

• Collaborate with cross-functional teams and participate in Agile development, sprint planning, and delivery.

Required Qualifications

• Bachelor’s degree in Computer Science or a related field.

• At least 5 years of experience in data engineering, data automation, or a related technical field.

• Strong hands-on experience developing, testing, and troubleshooting Python and SQL data pipelines in AWS environments.

• Experience with Microsoft Azure data services or integrating AWS with Azure.

• Strong practical experience with Apache Spark and working knowledge of Kafka, Flume, or another relevant ingestion technology.

• Experience with multiple AWS services, such as S3, Glue, Lambda, EMR, Step Functions, and AWS database services.

• Experience integrating a Generative AI model or service, such as Amazon Bedrock, Azure OpenAI, or an open-source LLM, into a Python application or workflow.

• Experience working with REST APIs and external data sources.

• Familiarity with Jira and source control or CI/CD tools such as GitHub, Azure DevOps, or Jenkins.

• Strong troubleshooting, performance optimization, and root-cause analysis skills.

• Experience supporting production systems, including monitoring, incident resolution, data reconciliation, and routine maintenance.

• Strong communication skills and the ability to explain technical solutions clearly.

• Must be able to obtain a Federal Government Public Trust clearance.

Benefits
PEAK's benefit offerings available for our associates include medical, dental, vision, Flexible Spending Account (FSA), Dependent Care Savings Account (DCA), and 401K plan. PEAK believes that taking care of our team is essential for success and we are proud to provide benefits that enhance both your well-being and your future. Additionally, our associates may be eligible for Paid Sick Leave as required by Federal, State, or local laws.  

Equal Opportunity Employer (EEO) 
PEAK Technical Staffing is committed to creating a diverse and inclusive environment and is proud to be an Equal Opportunity Employer. PEAK does not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or veteran status, or any other characteristic protected by applicable law. All employment decisions are made based on qualifications, merit, and business need. We encourage all individuals to apply. 

Americans Disabilities Act (ADA) 
The physical and mental requirements described in this job description are representative of those that must be met by an employee to successfully perform the essential functions of the position. Reasonable accommodations may be made to enable qualified individuals with disabilities to perform the essential functions. Must be able to perform the essential physical functions of the position, including sitting, standing, walking, stooping, kneeling, and lifting up to 25 pounds, with or without reasonable accommodation. 

Candidate Privacy
To read our Candidate Privacy Information Statement, which explains how we will use your information, please navigate to https://peaktechnical.com/privacy-policy/ and https://peaktechnical.com/ca-residents-privacy-rights/  

AI Recruiting Disclosure 
We use AI-assisted tools to help review applications and compare your experience to job requirements, but all hiring decisions are made by human recruiters. You may request a human-only process or opt out of automated communication at any time. Required notices and our latest bias audit are available on our website: www.peaktechnical.com/ai-disclosure.