Sr. IT Big Data Developer

Diverse Agile Solutions

Washington, DC

JOB DETAILS
SALARY
$160,000–$175,000
SKILLS
Agile Programming Methodologies, Amazon Web Services (AWS), Analysis Skills, Apache, Big Data, Business Processes, Career Development, Centers for Disease Control and Prevention (CDC), Cloud Computing, Communication Skills, Computer Science, Continuous Deployment/Delivery, Continuous Integration, Customer Support/Service, Data Analysis, Data Collection, Data Lake, Data Management, Data Migration, Data Modeling, Data Processing, Data Quality, Data Science, Data Sets, Data Warehousing, DataArchitect Data Modeling Tool, Database Extract Transform and Load (ETL), Database Optimization, Distributed Computing, Documentation Standards, Enterprise Architecture, Financial Policies, Forecasting, GitHub, Government, Home Automation, Identify Issues, Information Technology & Information Systems, Information Technology Consulting, Internet Security, Java, JavaScript, Large-Scale Systems, Linux Operating System, Machine Learning, Microsoft SQL Server, Microsoft Windows Azure, MySQL, NoSQL, Performance Tuning/Optimization, Perl Programming Language, PostgreSQL, Presentation/Verbal Skills, Process Capability, Production Support, Programming Languages, Python Programming/Scripting Language, R Programming Language, Relational Databases (RDBMS), Root Cause Analysis, SQL (Structured Query Language), Scala Programming Language, Scalable System Development, Scientific Research, Software Administration, Software Design, Software Development, Software Engineering, Software Testing, Source Code/Configuration Management (SCM), Statistics, Structured Data, Team Player, Technical Delivery, Technical/Engineering Design, Test Plan/Schedule, United States Citizen, Unstructured Data, Writing Skills
LOCATION
Washington, DC
POSTED
3 days ago

TO-BH-3 Sr. IT Big Data Developer (Data Architect/Engineer)

Location: Washington, DC (100% On-site)
Client: Federal Reserve Board (Division of Research & Statistics)
Employment Type: Full-Time Contract
Period of Performance: July 27, 2026 – December 31, 2026 (Extension Possible)
Citizenship Requirement: U.S. Citizenship Required

About Diverse Agile Solutions

Diverse Agile Solutions (DAS) is a certified Minority Business Enterprise (MBE) providing innovative IT consulting, cloud, cybersecurity, software engineering, and data analytics solutions to federal, state, and commercial organizations. Our team partners with government agencies to modernize enterprise technology, improve mission outcomes, and deliver exceptional customer service.

At DAS, we invest in talented professionals who thrive on solving complex technical challenges while making a meaningful impact.

Position Overview

Diverse Agile Solutions is seeking a highly skilled Senior IT Big Data Developer (Data Architect/Engineer) to support the Federal Reserve Board's Data Architecture, Technology, and Analytics (DATA) organization within the Division of Research & Statistics.

The DATA team is responsible for transforming how economic research data is collected, managed, integrated, analyzed, and visualized across the organization.

This position is ideal for an experienced Data Architect and Data Engineer who enjoys designing scalable enterprise data platforms, building modern data pipelines, optimizing large-scale data processing systems, and supporting data-driven research initiatives.

The successful candidate will collaborate closely with economists, data scientists, researchers, and software engineers to design next-generation data architecture supporting critical economic policy research.

Key Responsibilities

  • Design and implement scalable enterprise data architectures supporting research and analytics initiatives.
  • Develop, optimize, and maintain enterprise data pipelines and automated ETL/ELT workflows.
  • Design conceptual, logical, and physical data models.
  • Build highly scalable data processing frameworks capable of supporting large datasets.
  • Develop data integration solutions for structured and unstructured data sources.
  • Optimize database performance across enterprise environments.
  • Design enterprise data lake and data warehouse solutions.
  • Implement Change Data Capture (CDC) methodologies.
  • Develop workflow orchestration using tools such as Apache Airflow, Prefect, Dagster, or AWS Step Functions.
  • Support migration of data platforms between on-premises and cloud environments.
  • Perform root cause analysis of data quality and business process issues.
  • Collaborate with economists and technical teams to deliver trusted, high-quality data assets.
  • Develop software solutions supporting enterprise data services.
  • Participate in application testing, deployment, and production support.
  • Build and maintain CI/CD pipelines supporting DataOps initiatives.
  • Document architecture, standards, and technical designs.
  • Recommend improvements to enterprise data strategy and governance.

Required Qualifications

  • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related technical discipline.
  • Minimum 7 years of professional experience in Data Engineering, Data Architecture, or Big Data Development.
  • Advanced experience developing complex SQL solutions.
  • Extensive experience with relational databases including:

    • PostgreSQL
    • Microsoft SQL Server
    • MySQL
  • Advanced programming experience with:

    • Python
    • R
  • Experience designing scalable enterprise data platforms.
  • Experience building automated ETL/ELT pipelines.
  • Experience developing scalable data processing solutions.
  • Experience with GitLab and/or GitHub source control.
  • Experience working in Linux environments.
  • Strong software engineering background including development, testing, and deployment.
  • Excellent written and verbal communication skills.
  • Strong analytical and troubleshooting abilities.

Preferred Qualifications

Experience with one or more of the following technologies is highly desirable:

Data Engineering

  • Apache Airflow
  • Prefect
  • Dagster
  • AWS Step Functions

Cloud Platforms

  • Amazon Web Services (AWS)
  • Microsoft Azure
  • Snowflake

Enterprise Data Technologies

  • Enterprise Data Lakes
  • Data Warehouses
  • CDC (Change Data Capture)
  • DataOps
  • CI/CD Pipelines

Big Data

  • Distributed Computing
  • Large Scale Data Processing
  • High-Volume Data Optimization

Additional Technologies

  • NoSQL Databases
  • Graph Databases
  • Machine Learning
  • Java
  • Scala
  • JavaScript
  • Perl

Domain Experience

  • Time Series Data
  • Forecasting Analytics
  • Economic Research
  • Financial Data
  • Research Organizations

Technical Skills

Programming Languages

  • Python
  • R
  • SQL
  • Java (Preferred)
  • Scala (Preferred)
  • JavaScript (Preferred)
  • Perl (Preferred)

Databases

  • PostgreSQL
  • Microsoft SQL Server
  • MySQL
  • NoSQL
  • Graph Databases

Cloud

  • AWS
  • Microsoft Azure
  • Snowflake

Data Engineering

  • ETL / ELT
  • Apache Airflow
  • Prefect
  • Dagster
  • AWS Step Functions
  • Data Lakes
  • Data Warehouses
  • Change Data Capture (CDC)
  • DataOps
  • CI/CD

Tools

  • GitLab
  • GitHub
  • Linux

Why Join Diverse Agile Solutions?

At DAS, you'll work alongside highly skilled professionals supporting one of the nation's most respected financial institutions. You'll contribute to enterprise-scale modernization initiatives that directly support economic research and national financial policy.

We offer:

  • Challenging, mission-critical projects
  • Collaborative technical teams
  • Opportunities to work with modern cloud and data technologies
  • Professional growth and career development
  • Competitive compensation

Work Location

On-site

Federal Reserve Board
Washington, DC

Equal Opportunity Employer

Diverse Agile Solutions is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration without regard to race, color, religion, sex, national origin, age, disability, veteran status, genetic information, sexual orientation, gender identity, or any other status protected by applicable law.

BreezyHR Knockout Questions

  1. Are you a U.S. Citizen?
  2. Are you able to work 100% on-site in Washington, DC?
  3. Do you have at least 7 years of experience in Data Engineering or Data Architecture?
  4. How many years of professional Python experience do you have?
  5. How many years of advanced SQL development experience do you have?
  6. Have you designed enterprise ETL/ELT data pipelines?
  7. Which cloud platforms have you used professionally? (AWS, Azure, Snowflake)
  8. Have you worked with Apache Airflow, Prefect, Dagster, or AWS Step Functions?
  9. Have you designed enterprise data warehouse or data lake solutions?
  10. Do you have experience supporting research, economic, or financial data environments?
  11. Have you worked with PostgreSQL, SQL Server, and MySQL?
  12. What is your earliest available start date?

About the Company

D

Diverse Agile Solutions