Senior Data Engineer
Mizuho Americas Services LLC
Jersey City, NJ
Apply
JOB DETAILS
JOB TYPE
Full-time
SKILLS
Agile Programming Methodologies, Application Programming Interface (API), Atlassian JIRA, Best Practices, Capital Markets, Cloud Computing, Continuous Deployment/Delivery, Continuous Integration, Data Management, Data Modeling, Data Processing, DevOps, Documentation, Engineering, Finance, Incident Management, Investment Services, Microsoft Windows Azure, OLAP (OnLine Analytical Processing), Onboarding, Python Programming/Scripting Language, SQL (Structured Query Language), SQL Server Integration Services (SSIS), Scalable System Development, Schedule Development, Scrum Project Management and Software Development, Securities Investments, ServiceNow, Source Code/Configuration Management (SCM), Test Driven Development (TDD), Transaction Processing/Management, Unified Modeling Language (UML)
LOCATION
Jersey City, NJ
POSTED
30+ days ago
Major Responsibilities:
- Building and maintaining data pipelines to ingest data from source systems into Databricks
- Designing, Building and maintaining generic frameworks to ingest data through the medallion layers
- Working with the core data platform team to integrate the framework with reference architecture
- Assisting the data mesh teams with best practices and onboarding to the new framework
Requirements:
- 10+ years of data engineering experience in building OLTP and OLAP databases, both on-prem and in the cloud
- 5+ years of experience with large scale data processing using SQL, Python, Pandas and Pyspark
- 5+ years of experience building robust and scalable data pipelines in Databricks Lakehouse platform on any key cloud platform provider, preferably Azure cloud
- Experience with implementing Medallion architecture for data processing
- Experience with implementing Streaming data ingestion using Kafka
- Test driven development experience
- Proven experience in solution design and applying best design practices
- Data modelling and ER/UML diagram skills
- Experience with orchestration/enterprise scheduler platforms like Airflow, Tidal etc..
- Experience with implementing API based data integration pipelines
- Experience with source control and DevOps for CI/CD
- Experience working in Agile/scrum methodologies
- Experience with Jira, confluence for project work and documentation
- Experience with Service now for incident management
- Finance domain knowledge in Investment Banking (Securities, Capital markets) and Security reference data knowledge
- Nice to have ADF and SSIS experience
- College degree required.
The expected base salary ranges from $105,000 - $190,000. Salary offers are based on a wide range of factors including relevant skills, training, experience, education, and, where applicable, certifications and licenses obtained. Market and organizational factors are also considered. In addition to salary and a generous employee benefits package, including Medical, Dental and 401K plans, successful candidates are also eligible to receive a discretionary bonus.
#LI-Hybrid
About the Company
M