Request ID: 110317-1
Title: Senior Data Engineer
Location: New York, NY-Need to work from office 3 days a week - Will have Face 2 Face Round of Interview.
Duration: 6 Months
Pay Range: $40 - $45/Hour on W2/C2C (All inclusive)
We are looking for a highly skilled Senior Data Engineer with strong hands-on experience in SQL Server, Snowflake, Python, and SSIS to design, develop, and support enterprise data integration and analytics solutions. The candidate will work closely with business stakeholders, data analysts, data scientists, and technical teams to build scalable and reliable data pipelines, ensure data quality, support testing activities, and optimize enterprise data warehouse processes.
Key Responsibilities
Business & Stakeholder Engagement
" Collaborate with business stakeholders, data analysts, data scientists, and application teams to understand business requirements and data needs.
" Participate in requirement gathering sessions and translate business requirements into technical data solutions.
" Assist in data analysis, source system assessment, and data mapping activities.
Data Engineering & Development
" Design, develop, and maintain ETL/ELT pipelines for ingesting data from multiple source systems into Snowflake-based Enterprise Data Warehouse.
" Develop scalable data integration solutions using SQL Server, SSIS, Python, and Snowflake.
" Create and optimize SQL queries, stored procedures, views, and data transformation logic.
" Build ingestion frameworks for batch and incremental data loads.
" Implement metadata-driven and reusable data pipeline components.
" Support migration of SQL Server databases, stored procedures, and SSIS packages to Snowflake and Python-based frameworks.
" Define and implement data quality rules, validations, and reconciliation processes.
" Perform root cause analysis for data quality issues and implement corrective actions.
" Ensure data integrity, consistency, and compliance across data platforms.
" Maintain data lineage, audit, and operational logging processes.
" Design and develop Snowflake databases, schemas, tables, views, stages, streams, tasks, and data pipelines.
" Implement data loading processes using Snowflake native capabilities.
" Optimize Snowflake warehouse utilization, query performance, and overall operational efficiency.
" Support role-based access control, security, and governance requirements.
" Experience with Azure/AWS Cloud services.
" Experience with CI/CD, Git, and DevOps practices.
Testing & User Acceptance Support
" Work closely with business users during System Integration Testing (SIT) and User Acceptance Testing (UAT).
" Support defect triage, issue resolution, and validation activities.
" Prepare test cases, reconciliation reports, and deployment validation documentation.
Production Support & Optimization
" Monitor ETL/ELT pipelines and batch processes.
" Troubleshoot production incidents and resolve data integration issues.
" Optimize pipeline performance, query execution, and data processing efficiency.
" Implement monitoring, alerting, and operational support procedures.
Participate in on-call support activities when required
Skills: Digital: Python~ Client SQL Server 2019
Experience Required: 6-8