Data Engineer ( Databricks) Big Impact Tech (BIT)
Washington, DC18 days ago
- Full-time
Want to know if you’re a fit?
Upload your resume and let our AI show you.
Upload your resume and let our AI show you.
Skills
- Agile Programming Methodologiesunmatched
- Amazon Web Services (AWS)unmatched
- Analysis Skillsunmatched
- Apache Sparkunmatched
- Artificial Intelligence (AI)unmatched
- Artificial Intelligence (AI) Agentsunmatched
- Automationunmatched
- Best Practicesunmatched
- Big Dataunmatched
- Business Intelligenceunmatched
- Cloud Computingunmatched
- Code Reviewsunmatched
- Communication Skillsunmatched
- Computer Programmingunmatched
- Computer Scienceunmatched
- Cross-Functionalunmatched
- Customer Satisfactionunmatched
- Data Analysisunmatched
- Data Managementunmatched
- Data Processingunmatched
- Data Qualityunmatched
- Data Setsunmatched
- Detail Orientedunmatched
- Documentationunmatched
- Emerging Technologyunmatched
- GitHubunmatched
- Identify Issuesunmatched
- Incident Responseunmatched
- Interpersonal Skillsunmatched
- Leadershipunmatched
- Multiplatform/Cross-Platformunmatched
- Operational Improvementunmatched
- Problem Solving Skillsunmatched
- Process Improvementunmatched
- Production Systemsunmatched
- Productivity Managementunmatched
- Programming Toolsunmatched
- Python Programming/Scripting Languageunmatched
- Quality Assurance Methodologyunmatched
- Quality Engineeringunmatched
- Quality Managementunmatched
- Quality Monitoringunmatched
- Query Analysisunmatched
- Reconciliationunmatched
- Requirements Validation/Verificationunmatched
- Risk Managementunmatched
- Root Cause Analysisunmatched
- SQL (Structured Query Language)unmatched
- Scripting (Scripting Languages)unmatched
- Software Engineeringunmatched
- Source Code/Configuration Management (SCM)unmatched
- Standards Developmentunmatched
- Structured Analysisunmatched
- Tableauunmatched
- Team Playerunmatched
- Test Automationunmatched
- Test Dataunmatched
- Test Plan/Scheduleunmatched
- Test Toolsunmatched
- Time Managementunmatched
- Writing Skillsunmatched
Description
Title: Senior Data Engineer
Location: Remote
Pay Range: $70/hr. To $75/hr. On w2.
JOB DESCRIPTION:
Job Description:
Profile: Data Analyst will work closely with Architects and leads in the Interflow team, key business stakeholders including program staff to support the organizations effort in the areas of data Analysis and information management. Role should have strong experience in writing super complex SQL queries to extract data for reports. Candidate should have experience working with large set of data. These reports are very critical for the company, and we are looking for an expert who is capable of handling, consuming and extracting large sets of data for analysis and reports.
As a Senior Data Engineer, you ll help ensure that the data powering our products, reporting, and operational workflows is accurate, complete, timely, and trustworthy. You ll design and implement data quality checks, monitoring, and remediation processes across pipelines and platforms, working closely with engineers, analysts, product teams, and business stakeholders. Your work will help identify issues early, reduce operational risk, and improve confidence in the data used to support critical decisions and digital assessment experiences. This role blends hands-on technical investigation, automation, and cross-functional collaboration.
Note: We use Tableau and QuickSight for Data Analysis;Apache Spark for Big Data Processing;and they should have used at least one AI tool: Amazon Q;Google Cloud AI;Google Cloud Smart Analytics;Tableau AI
In this role you will:
Data Quality Engineering & Monitoring (45%)
- Design and implement automated data quality checks for completeness, accuracy, consistency, freshness, and schema integrity across critical datasets and pipelines.
- Build monitoring, alerting, and observability solutions to detect anomalies, pipeline failures, data drift, and unexpected changes before they impact downstream consumers.
- Develop and maintain reconciliation processes across source systems, transformed datasets, reports, and operational outputs.
- Partner with engineers and analysts to define quality rules, acceptance criteria, and data validation requirements for new and existing systems.
- Create reusable frameworks, scripts, and tooling for profiling, testing, and validating data in production and non-production environments.
- Investigate data issues by tracing data across systems, transformations, and business workflows to identify root causes and recommend fixes.
- Use SQL, Python, and cloud data tools to analyze large datasets, isolate anomalies, and validate business logic.
- Support incident response and issue resolution for data-related production problems, especially during high-priority operational periods.
- Work with cross-functional teams to remediate defects, improve upstream processes, and reduce recurrence of common data issues.
- Communicate findings clearly to both technical and non-technical stakeholders, including issue summaries, remediation recommendations, and quality trends.
- Document data definitions, validation logic, lineage, quality rules, and remediation procedures to improve transparency and operational readiness.
- Contribute to best practices for testing, version control, deployment, and ongoing maintenance of data quality solutions.
- Participate in Agile ceremonies, code reviews, and team planning, helping break work into manageable tasks and improve team productivity.
- Support the development of standards for data governance, ownership, and operational excellence across the team.
- Partner with stakeholders to improve trust in shared data assets and ensure quality considerations are built into delivery from the start.
About You
- BS degree in Engineering, Computer Science, or related field / equivalent experience
- 10+ years of general experience in quality testing
- Strong SQL skills and experience writing complex queries to analyze, validate, and troubleshoot data across multiple systems.
- Professional experience in data engineering, analytics engineering, data quality, software Engineering, or a related field with a strong focus on data investigation and validation.
- Exposure to AI-assisted development tools (e.G., GitHub Copilot, Claude) and hands-on experience applying to build and deploy AI agents that automate data pipelines, write code and testing workflows.
- Experience working with cloud data platforms and tools such as AWS, Redshift, Athena, Snowflake, Databricks, or similar technologies.
- Proficiency in Python or type script language used for automation, testing, and data analysis.
- Experience designing or maintaining data quality checks, monitoring, alerting, or observability processes for production datasets or pipelines.
- Strong understanding of data structures, data modeling, transformations, lineage, and common sources of data defects.
- Ability to investigate issues across systems, apply business logic, and translate ambiguous problems into structured analysis and action.
- Experience working with BI/reporting tools such as Tableau, QuickSight, or similar platforms is helpful.
- Strong communication, documentation, and collaboration skills, with the ability to work effectively across technical and non-technical teams.
- A learner s mindset, curiosity about emerging technologies and AI-enabled tools, and a drive to improve systems and processes continuously.
- Ability to support high-priority operational periods and respond effectively to production data issues when needed.
- Strong interpersonal and consultative skills.
- Highly self-motivated and directed, with keen attention to detail.
- Strong leadership skills and customer satisfaction orientation.
Numbers & Facts
| Location | Reston, VA (Remote) |
| Industry | Staffing/Employment Agencies |
| Salary | $70 |
| Company Size | 2,000 to 2,499 employees |
| Year Founded | 2000 |
| Website | http://www.lancesoft.com/ |
About Company
We are a $125 Million, NMSDC-certified Minority & Woman owned Workforce Solutions Company headquartered in the DC metro area with presence across US with global presence - Canada, Mexico, India, UK, Malaysia, Indonasia, Hongkong, Singapore, UAE. We are specialized in providing Workforce Solutions, SOW project delivery, Engineering Solutions, Creative Services. We currently support 100+ Fortune companies globally and across multiple industry segments. We are currently supporting several massive programs across industry segment nationally/globally (Intel, Ally, AMD, QUALCOMM, Morgan Stanley, Kraft/ Mondelez, MNP, Amdocs, Dell, SanDisk, Medtronic, Becton Dickinson, GE, Lockheed Martin, UTC, L-3 Communications, Caterpillar, BMW, Mercedes Benz, National Grid, Dominion, Energy Future Holdings, PSEG, 3M, Fidelity, Aetna, Humana, Johnson & Johnson, Pfizer, Merck etc).
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender, identity, national origin, disability, or protected veteran status.
Similar Jobs
- New!
Mechanical Commissioning Engineer / Project Manager (Data Centers) Jobot
Sterling, VA4 days agoRemote- $165,000–$180,000 Per Year
- New!
Senior Data Engineer Mozilla
Washington DC, DCToday - New!
Technical Consultant - Enterprise Data Engineer Esri
Vienna, VAToday- $84,240–$142,480 Per Year
- New!
Senior Data Engineer - Agentic AI Engineering Boomi
Washington DC, DCToday - New!
Lead Specialist, Federal Data Engineer KPMG
Washington, DC4 days ago