Data Engineer II

SMX USA

Arlington, VA

JOB DETAILS
SKILLS
Apache Hadoop, Apache Hive, Apache Spark, Best Practices, Big Data, Code Reviews, Communication Skills, Computer Science, Cross-Functional, Data Analysis, Data Management, Data Modeling, Data Processing, Data Quality, Data Sets, Database Design, Database Extract Transform and Load (ETL), Ecosystems, Engineering, Finance, Financial Services, HDFS (Hadoop Distributed File System), Identify Issues, Maintain Compliance, Mathematics, Performance Management, Presentation/Verbal Skills, Python Programming/Scripting Language, Quality Assurance Methodology, Query Optimization, Regulatory Requirements, SQL (Structured Query Language), Scalable System Development, Source Code/Configuration Management (SCM), Team Player, Test Data, Validation Testing, Writing Skills
LOCATION
Arlington, VA
POSTED
4 days ago

Job Title: Data Engineer II

Location: Arlington, VA (Local Candidates Preferred)

Employment Type: Contract (C2C)

 

IndustryPayments / Financial Services

 

Important Notes

  •  Local candidates strongly preferred.
  •  No third-party vendors.
  • The submitting company  must directly sponsor/hold the candidate's visa.
  • Please submit candidates with competitive C2C rates based on their skills and experience.

 

Required Experience

We are seeking a highly skilled  Data Engineer II with  8+ years of hands-on data engineering experience building and maintaining large-scale ETL pipelines and enterprise data solutions. The ideal candidate will have a strong background in the  payments or financial services industry, along with excellent communication and stakeholder management skills.

 

Required Qualifications

  • Bachelor's degree in Engineering, Mathematics, Finance, Business, Computer Science, or a related quantitative field (or equivalent practical experience).
  • 8+ years of experience as a Data Engineer or in a similar role.
  • Strong expertise in designing, developing, and optimizing enterprise ETL pipelines.
  • Advanced SQL skills with the ability to write and optimize complex queries.
  • Hands-on experience with:
  • Apache Spark (PySpark, Spark SQL, Spark Streaming)
  • Hadoop ecosystem (HDFS/Ozone, Hive, YARN)
  • Python
  • Strong understanding of data modeling and database design.
  • Experience troubleshooting and resolving data quality and pipeline issues.
  • Knowledge of data validation and testing methodologies.
  • Excellent verbal and written communication skills with the ability to collaborate effectively across technical and business teams.

 

Preferred Experience

  • Experience designing, implementing, and maintaining enterprise-scale ETL processes.
  • Ability to develop scalable, high-performance data processing solutions.
  • Experience building and optimizing big data pipelines using Apache Spark and Hadoop.
  • Collaborate with cross-functional teams to deliver high-quality data solutions.
  • Experience supporting global data platforms and enterprise data delivery initiatives.
  • Ability to build strong relationships with stakeholders and contribute to both local and global projects.

 

Responsibilities

  • Design, develop, and maintain scalable ETL pipelines and data processing frameworks.
  • Build and optimize large-scale data pipelines using Apache Spark, Hadoop, SQL, and Python.
  • Improve data processing performance and efficiency for large datasets.
  • Automate routine data engineering tasks and streamline workflows.
  • Apply best practices including version control, code reviews, testing, and data validation.
  • Partner with Data Engineers, Analysts, and business stakeholders to deliver reliable, high-quality data solutions.
  • Monitor, troubleshoot, and resolve data pipeline and data quality issues.
  • Ensure compliance with internal policies, security standards, and regulatory requirements.

 

Must-Have Skills

  • Data Engineering
  • ETL Development
  • Apache Spark (PySpark, Spark SQL, Spark Streaming)
  • Hadoop (HDFS/Ozone, Hive, YARN)
  • Python
  • SQL
  • Data Modeling
  • Big Data Technologies
  • Payments or Financial Services Domain
  • Strong Communication & Stakeholder Management

About the Company

S

SMX USA