Sign upLog in
JobsJobs in District of ColumbiaJobs in Washington, DCIT JobsAutomation Jobs

Data Automation Engineer

Computer Merchant, Ltd., the

Washington, DC

Apply
JOB DETAILS
SALARY
$75–$79 Per Hour
SKILLS
ARM (Advanced RISC Machine), Access Control, Agile Programming Methodologies, Amazon Web Services (AWS), Analysis Skills, Apache Spark, Application Programming Interface (API), Artificial Intelligence (AI), Automation, Automation Engineering, Bash Scripting, Benchmarking, Business Intelligence Software, Change Control, Cloud Computing, Comparative Analysis, Computer Science, Continuous Improvement, Cryptography, Data Analysis, Data Lake, Data Management, Data Migration, Data Profiling, Data Quality, Database Extract Transform and Load (ETL), DevOps, Docker, Employee Assistance Plan, Federal Laws and Regulations, Firewalls, GitHub, High Availability, Identify Issues, Integration Testing, Knowledge Management, MDX (MultiDimensional eXpression Language), Memory Hardware, Metadata, Metrics, Microsoft Certifications, Microsoft Product Family, Microsoft SQL Server, Microsoft Transact-SQL (T-SQL), Microsoft Windows Azure, Needs Assessment, Network Routing, NoSQL, OLAP Cubes, Open Source, Performance Analysis, Performance Testing, Performance Tuning/Optimization, Power BI, Power Engineering, Problem Solving Skills, Production Support, Production Systems, Program Planning, Python Programming/Scripting Language, Query Analysis, Query Optimization, REST (Representational State Transfer), Regulations, Regulatory Compliance, Release Management/Engineering, Requirements Management, Resource Utilization, SQL (Structured Query Language), SQL Server Analysis Services (SSAS), SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), Scripting (Scripting Languages), Security Compliance, Security Information and Event Management (SIEM), Software Development, Software Engineering, Source Code/Configuration Management (SCM), State Laws and Regulations, Stored Procedures, Team Player, Test Data, Windows PowerShell
LOCATION
Washington, DC
POSTED
Today
JOB TITLE: DATA AUTOMATION ENGINEER
JOB LOCATION: WASHINGTON DC (REMOTE)
WAGE RANGE*: 75.00-79.00 PER HOUR
JOB NUMBER: SAIJP00038797

REQUIRED EXPERIENCE:
  • BS degree in Computer Science or related field and 2+ years of experience in relevant field
  • 2+ years of experience with more than one of the follow scripting languages: SQL, T-SQL, MDX/DAX, Python, and PySpark.
  • Experience designing and building ETL/data engineering solutions, schedule and monitor utilizing various cloud services such as Azure Data Lake Services, Azure Synapse Analytics, Azure Data Factory, Integration Runtime.
  • Experience working with Microsoft database and business intelligence tools, including SQL Server, including stored procedures, SSIS, SSRS, SSAS (cubes), and Power BI.
  • Experience with data automation using Azure/AWS CLI tools with Bash or PowerShell scripting.
  • Familiarity with Azure DevOps Repos or GitHub and pipeline versioning/release management.
  • Demonstrated experience in supporting production, testing, integration, and development environments.

JOB DESCRIPTION

Data Automation Engineer to work with a team of subject matter experts and developers to design and implement innovative data automation solutions for Azure cloud-based data lake, SQL, and NoSQL platform. As a data automation engineer, you will translate business requirements to data engineering and AI based solutions to support an enterprise scale Microsoft Azure based data analytics and reporting platform. Our ideal candidate is mission focused and delivery oriented and applies critical thinking to create innovative functions and solve technical issues.
  • Utilize Microsoft Azure services including Azure Data Factory, Synapse Pipelines, Apache Spark Notebooks, Python, SQL, stored procedures to develop high performing data pipelines.
  • Continuously improve and optimize the automation toolset for reliability, scalability, and adaptability.
  • Research and implement cutting-edge AI/ML and GenAI tools to rapidly develop intelligent applications, scripts, and ETL pipelines that automate data processes, and proactively eliminate workflow bottlenecks.
  • Work closely with implementation specialists, engineering teams, and customer to understand data driven needs and build solutions that address real operational challenges.
  • Work closely with client personnel and team members to understand data requirements and develop appropriate data solutions.
  • Identify, create, prepare data required for advanced analytics, visualization, reporting, and AI/ML.
  • Implement data migration, data integrity, data quality, metadata management, and data security functions to optimize data pipelines.
  • Monitor and troubleshoot data related issues to maintain high availability and performance.
  • Assist in ETL performance testing for data pipelines by executing test runs and validating data load performance against expected benchmarks.
  • Support baseline performance analysis by comparing new pipeline performance with legacy system metrics (e.g., load time, throughput, latency).
  • Help monitor pipeline execution metrics such as run time, data volume processed, and resource utilization to identify bottlenecks.
  • Participate in performance test execution for Azure-based pipelines (ADF, Synapse, Databricks) in non-production environments.
  • Assist in identifying performance issues and contribute to tuning efforts (e.g., query optimization, partitioning, indexing basics).
  • Validate data consistency and completeness after performance test runs to ensure no data loss during high-volume processing.
  • Collaborate with DevOps and infrastructure teams to understand how compute, memory, and scaling impact pipeline performance.
  • Follow defined performance testing processes, checklists, and guidelines established by senior team members.
  • Document test results, issues, and observations clearly for team review and tracking.
  • Actively support Agile DevOps process, including Program Increment planning.
  • Actively engage in continuous learning to increase relevant skills.
  • Maintain strict versioning and configuration control to ensure integrity of data.

Not required, but additional education, certifications, and/or experience are a plus:
  • Experience and/or certifications in Generative AI development, Generative AI for Data Analytics, and solution delivery.
  • Microsoft certification in Azure fundamentals, data engineer, Power BI, AI or AWS certified data engineer.
  • Integration knowledge using enterprise/open source ETL toolsets, REST API, Docker.
  • Experience or exposure to performance fine tuning (indexing, execution plans, views), data profiling and query analytics.
  • Knowledge of security compliance standards with data encryption, cloud virtual networks, routing, firewalls, log analytics, monitors
  • Basic knowledge of ARM or Bicep templates for automation, familiarity with RBAC access controls.
  • Data lineage and impact analysis using tools like Purview, Synapse pipeline tracing, et


Equal opportunity employer as to all protected groups, including protected veterans and individuals with disabilities

* While an hourly range is posted for this position, an eventual hourly rate is determined by a comprehensive salary analysis which considers multiple factors including but not limited to: job-related knowledge, skills and qualifications, education and experience as compared to others in the organization doing substantially similar work, if applicable, and market and business considerations. Benefits offered include medical, dental and vision benefits; dependent care flexible spending account; 401(k) plan; voluntary life/short term disability/whole life/term life/accident and critical illness coverage; employee assistance program; sick leave in accordance with regulation. Benefits may be subject to generally applicable eligibility, waiting period, contribution, and other requirements and conditions. Benefits offered are in accordance with applicable federal, state, and local laws and subject to change at TCM's discretion.

#Dice

About the Company

C

Computer Merchant, Ltd., the

About TCM

If you would like to…

  • Develop your skills
  • Improve your earnings potential
  • Gain greater control over your career


The Computer Merchant, Ltd. (TCM) has provided Information Technology Solutions and enterprise staffing services to Fortune 1000, mid to small sized corporations, as well as Federal, state, and local governments for over 30 years.

At The Computer Merchant (TCM), we are committed to your professional and financial success. We'll evaluate your background, experience and qualifications, and then recommend contract jobs that are the best match for your goals.


Fast Facts & Recognition:

  • 41 year track record of success deploying over 63,000 consultants and core employees in critical positions for Fortune 1000 companies
  • Access to over 11 million unique consultants nationwide
  • Centralized and dedicated client delivery team
  • Supplier Diversity Certification as a Veteran Business Enterprise

COMPANY SIZE
1,500 to 1,999 employees
INDUSTRY
Staffing/Employment Agencies
FOUNDED
1980
WEBSITE
http://itstaffing.com/

Resume Resources

Free Resume TemplatesFree Resume Builder