Senior Data Engineer

Lancesoft

Reston, VA(remote)

Apply

JOB DETAILS

SALARY

$70

SKILLS

AWS Lambda, Agile Programming Methodologies, Amazon Simple Notification Service (SNS), Amazon Simple Storage Service (S3), Amazon Web Services (AWS), Analysis Skills, Apache, Artificial Intelligence (AI), Business Intelligence, Business Intelligence Software, Continuous Deployment/Delivery, Continuous Integration, Cross-Functional, Data Management, Data Migration, Data Modeling, Data Quality, Data Warehousing, Database Extract Transform and Load (ETL), DevOps, Documentation, Node.js, Python Programming/Scripting Language, Quality Assurance, Reconciliation, Risk Management, SQL (Structured Query Language), Scrum Project Management and Software Development, Simple Queue Service (SQS), Strategic Planning, Technical Writing, Technical/Engineering Design, Test Automation, Test Data, Test Plan/Schedule, Test Scripts, Test Strategy, Testing, Validation Testing

LOCATION

Reston, VA

POSTED

15 days ago

Title: Senior Data Engineer: Remote
Location: Remote

Pay range: $70/hr. - $75/hr. On w2

Note: Temp to hire

JOB DESCRIPTION:

Must Have:

AWS - CloudFormation
AWS - Dynamo
AWS - Lambda
AWS - S3
AWS - SNS/SQS
AWS Step Function
BI Tool
Gen AI
Node.Js Development
Python
RedShift/SQL

Key Responsibilities

Define the end-to-end testing scope based on solution architecture and project documentation
Design and implement a comprehensive testing strategy and plan aligned with organizational QA standards
Develop and maintain test scripts and frameworks for the Redshift serverless platform
Perform testing across key technologies, including:
- AWS Redshift
- AWS DMS (Data Migration Service)
- AWS Glue
- PySpark Deequ
- Event Bridge
- Data Lakes
- Python-based data pipelines
- Apache Airflow
- dbt (data build tool)
Build and implement automated testing solutions to ensure:
- End-to-end data validation
- Data ingestion accuracy
- Transformation logic integrity
- Data pipeline reliability
Conduct test coverage analysis and ensure adequate validation across all data engineering workflows
Prepare and manage test data
Review and provide feedback on:
- Solution architecture
- Data models
- Design and technical documentation
Collaborate with cross-functional teams (Data Engineering, BI, DevOps, Product) to:
- Identify testing impacts
- Mitigate risks
- Ensure high-quality deliverables

Required Qualifications

Proven experience in data engineering testing / data QA / ETL validation
Strong hands-on experience with AWS data services (Redshift, Glue, DMS)
Proficiency in Python for test automation and validation
Experience with Airflow and orchestration testing
Hands-on experience with dbt and data transformation validation
Familiarity with CDK for infrastructure validation
Experience in BI testing in Quicksuite will be highly beneficial
Experience with data quality tools such as PySpark Deequ or similar
Strong understanding of:
- Data warehousing concepts
- ETL/ELT pipelines
- Data validation techniques (schema, reconciliation, anomaly detection)

Preferred Qualifications

Experience designing enterprise-level test strategies for data platforms
Knowledge of CI/CD pipelines for data and test automation
Experience working in Agile / Scrum environments
Familiarity with data observability frameworks

About the Company

Lancesoft

We are a $125 Million, NMSDC-certified Minority & Woman owned Workforce Solutions Company headquartered in the DC metro area with presence across US with global presence - Canada, Mexico, India, UK, Malaysia, Indonasia, Hongkong, Singapore, UAE. We are specialized in providing Workforce Solutions, SOW project delivery, Engineering Solutions, Creative Services. We currently support 100+ Fortune companies globally and across multiple industry segments. We are currently supporting several massive programs across industry segment nationally/globally (Intel, Ally, AMD, QUALCOMM, Morgan Stanley, Kraft/ Mondelez, MNP, Amdocs, Dell, SanDisk, Medtronic, Becton Dickinson, GE, Lockheed Martin, UTC, L-3 Communications, Caterpillar, BMW, Mercedes Benz, National Grid, Dominion, Energy Future Holdings, PSEG, 3M, Fidelity, Aetna, Humana, Johnson & Johnson, Pfizer, Merck etc).

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender, identity, national origin, disability, or protected veteran status.

COMPANY SIZE

2,000 to 2,499 employees

INDUSTRY

Staffing/Employment Agencies

FOUNDED

2000

WEBSITE

http://www.lancesoft.com/

Resume Resources

Free Resume Templates Free Resume Builder