Role: Sr Data Engineer Scala, Python, Databricks & AWS Location: Boston, MA (Hybrid) Experience: 12+ Years
Job Summary
We are looking for an experienced Data Engineer with strong hands-on skills in Scala, Python, Databricks, and AWS to join our financial services client, State Street.
The ideal candidate will have experience building and maintaining data pipelines, processing large datasets, and developing scalable data engineering solutions using cloud technologies. The candidate should be comfortable working with financial data and collaborating with technical and business teams.
Key Responsibilities
Design, develop, and maintain data pipelines using Scala and Python.
Build and optimize data processing workflows using Databricks and Apache Spark.
Develop data engineering solutions on AWS cloud services.
Process, transform, and integrate large volumes of structured and unstructured data.
Write efficient, reusable, and high-quality code.
Troubleshoot data pipeline issues and improve performance and reliability.
Work with databases, data lakes, and other data storage systems.
Collaborate with developers, architects, and business teams to deliver data solutions.
Follow data quality, security, and coding standards.
Required Skills
Strong hands-on experience with Scala and Python.
Experience with Databricks and Apache Spark.
Experience building and supporting data pipelines.
Hands-on experience with AWS cloud services.
Strong understanding of data processing, transformation, and ETL/ELT concepts.
Experience working with large datasets and distributed data processing.
Strong problem-solving and debugging skills.
Preferred Qualifications
Experience in banking, financial services, or capital markets.
Experience working with cloud-based data platforms and data lakes.
Knowledge of SQL and relational databases.
Experience with data quality, performance tuning, and production support.
Mandatory Requirements
Must be willing to work onsite in Boston, MA, 3 days per week.
Must be willing to relocate to Boston if currently based elsewhere.
Must be available for W2 employment only.
Note: Candidates must be comfortable with the hybrid work arrangement and relocation requirement before proceeding with the interview process.
Numbers & Facts
Location
Boston, MA
Skills
Amazon Web Services (AWS)unmatched
Apache Sparkunmatched
Cloud Computingunmatched
Coding Standardsunmatched
Data Managementunmatched
Data Processingunmatched
Data Qualityunmatched
Data Setsunmatched
Data Storageunmatched
Database Extract Transform and Load (ETL)unmatched
Financial Servicesunmatched
Identify Issuesunmatched
Information/Data Security (InfoSec)unmatched
Performance Managementunmatched
Performance Tuning/Optimizationunmatched
Production Supportunmatched
Python Programming/Scripting Languageunmatched
Relational Databases (RDBMS)unmatched
Reliability Engineeringunmatched
SQL Databasesunmatched
Scala Programming Languageunmatched
Scalable System Developmentunmatched
Software Engineeringunmatched
Structured Dataunmatched
Unstructured Dataunmatched
🎯
Be found by employers
5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.
Level up your application
Professional resume templates
Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.