Our client, a Financial company, is looking for a Senior Sr. Data Engineer for their McLean. VA location.
Responsibilities:- Designing and implementing high-performance data pipelines that handle large volumes of data
- Ensuring data integrity through advanced quality checks and lineage tracking
Requirements:- Core Languages: Expert-level proficiency in Python and PySpark.
- AWS Ecosystem: Deep hands-on experience with AWS Glue and Amazon EMR.
- Big Data Architecture: Proven track record of building scalable pipelines for large-scale data (Terabyte-scale preferred).
- Data Integrity: Demonstrated experience implementing frameworks for Data Lineage and Data Quality.
- Database Knowledge: Strong experience working with S3-based lakes and relational databases (RDS/PostgreSQL/MySQL).
- Industry: Experience within the Financial Services industry is a huge plus.
- Real-time Processing: Experience with Kinesis or Kafka integration for low-latency data delivery.
- DevOps: Familiarity with CI/CD for data pipelines and Infrastructure as Code.
Why Should You Apply?Why Should You Apply?