Senior Data Engineer

Mindlance

Reston, VA(remote)

Apply

JOB DETAILS

SKILLS

AWS Lambda, Administrative Skills, Agile Programming Methodologies, Amazon Simple Notification Service (SNS), Amazon Simple Storage Service (S3), Amazon Web Services (AWS), Analysis Skills, Apache, Artificial Intelligence (AI), Budget Management, Business Intelligence, Business Intelligence Software, Calendar Management, Consulting, Continuous Deployment/Delivery, Continuous Integration, Cross-Functional, Data Management, Data Migration, Data Modeling, Data Quality, Data Warehousing, Database Extract Transform and Load (ETL), DevOps, Documentation, Forecasting, Higher Education, Leadership, Metadata, Node.js, Operations, Problem Solving Skills, Python Programming/Scripting Language, Quality Assurance, Quality Engineering, Reconciliation, Risk Management, SQL (Structured Query Language), Scrum Project Management and Software Development, Simple Queue Service (SQS), Strategic Planning, Technical Writing, Technical/Engineering Design, Test Automation, Test Data, Test Plan/Schedule, Test Scripts, Test Strategy, Testing, Validation Testing

LOCATION

Reston, VA

POSTED

30+ days ago

Position Title: Senior Data Engineer
Location: Remote
Duration: Contract to hire

Profile : Data Quality Engineer (AWS Data Platform) Overview We are seeking a highly skilled Data Engineering - Quality Engineer to define and implement end-to-end testing strategies for a modern data platform built on AWS. This role will be responsible for ensuring data quality, reliability, and performance across the entire pipeline; from ingestion to transformation and reporting.

Must Have Skills:

AWS - CloudFormation
AWS - Dynamo
AWS - Lambda
AWS - S3
AWS - SNS/SQS
AWS Step Function
BI Tool
Gen AI
Node.js Development
Python
RedShift/SQL

About the Role: The Assistant Director, Strategic Higher Education-Enrolment Leadership (Temporary) provides high-level, confidential administrative and logistical support to ensure smooth daily operations and to facilitate flawless execution of member-focused engagements. This position plays a key role within the SHE unit, with responsibilities closely aligned to existing full-time assistant director roles. This position carries limited responsibility for budget planning, forecasting. Reporting to the Executive Director, this role manages complex calendars, meetings, communications, travel, and materials for internal and external engagements hosted by SHE. Serving as a trusted partner and key point of contact for SHE, the Assistant Director anticipates needs, solves problems proactively, and helps unit leaders stay focused on their most critical work while maintaining alignment across priorities in collaboration with Assistant Directors and the Senior Director for Strategic Higher Education.

Team: Team is Client delivery platform and Cumulus lots of data exchanges: AWS platform using Redshift as data warehouse Dynamo of meta-data. They are working on evolving code for digital SAT products and need dynamic Senior Data engineer who will also design, build and write test automation.

Responsibilities:

Define the end-to-end testing scope based on solution architecture and project documentation
Design and implement a comprehensive testing strategy and plan aligned with organizational QA standards
Develop and maintain test scripts and frameworks for the Redshift serverless platform
Perform testing across key technologies, including:
- AWS Redshift
- AWS DMS (Data Migration Service)
- AWS Glue
- PySpark Deequ
- Event Bridge
- Data Lakes
- Python-based data pipelines
- Apache Airflow
- dbt (data build tool)
Build and implement automated testing solutions to ensure:
- End-to-end data validation
- Data ingestion accuracy
- Transformation logic integrity
- Data pipeline reliability
Conduct test coverage analysis and ensure adequate validation across all data engineering workflows
Prepare and manage test data
Review and provide feedback on:
- Solution architecture
- Data models
- Design and technical documentation
Collaborate with cross-functional teams (Data Engineering, BI, DevOps, Product) to:
- Identify testing impacts
- Mitigate risks
- Ensure high-quality deliverables

Required Skills:

Proven experience in data engineering testing / data QA / ETL validation
Strong hands-on experience with AWS data services (Redshift, Glue, DMS)
Proficiency in Python for test automation and validation
Experience with Airflow and orchestration testing
Hands-on experience with dbt and data transformation validation
Familiarity with CDK for infrastructure validation
Experience in BI testing in Quicksuite will be highly beneficial
Experience with data quality tools such as PySpark Deequ or similar
Strong understanding of:
- Data warehousing concepts
- ETL/ELT pipelines
- Data validation techniques (schema, reconciliation, anomaly detection)

Preferred Qualifications:

Experience designing enterprise-level test strategies for data platforms
Knowledge of CI/CD pipelines for data and test automation
Experience working in Agile / Scrum environments
Familiarity with data observability frameworks.

EEO:
Mindlance is an Equal Opportunity Employer and does not discriminate in employment on the basis of Minority/Gender/Disability/Religion/LGBTQI/Age/Veterans.

About the Company

Mindlance

Resume Resources

Free Resume Templates Free Resume Builder