Apache, BTEQ, Continuous Deployment/Delivery, Continuous Integration, Customer Relations, Data Management, Data Quality, Database Extract Transform and Load (ETL), Delivery Management, Engineering, Git, Identify Issues, Leadership, Microsoft SQL Server, Multiplatform/Cross-Platform, NCR Teradata, Offshoring, Python Programming/Scripting Language, Reconciliation, SQL (Structured Query Language), SQL Server Integration Services (SSIS), Scripting (Scripting Languages), Snowflake Schema, Stored Procedures, Team Lead/Manager, Technical Delivery, Technical Leadership
Location: Philadelphia, PA (Hybrid 3 Days Onsite)
Type: Full-Time
Client Domain: Telecom
Experience: 8+ Years
Job Summary We are seeking a Senior Data Engineer / Technical Lead with strong expertise in Snowflake, Teradata migration, Databricks, PySpark, and Airflow to support a large-scale telecom data modernization initiative. The role involves leading migration, validation, reconciliation, and production cutover activities across enterprise data platforms.
Must-Have Skills - 8+ years of Data Engineering experience
- 3+ years of strong hands-on experience with Snowflake
- Proven experience in Teradata to Snowflake migration
- Strong expertise in:
- Teradata SQL / BTEQ
- Snowflake SQL
- PySpark
- Python
- Databricks
- Apache Airflow
- Experience with ETL / data pipeline modernization
- Strong experience with SQL Server / Teradata / Netezza source systems
- Hands-on experience with Git and CI/CD workflows
- Ability to lead technical teams and manage migration delivery
Key Responsibilities - Lead migration and repointing of downstream scripts and pipelines to Snowflake
- Convert Teradata SQL, BTEQ scripts, macros, and stored procedures into Snowflake SQL
- Update and validate Airflow DAGs and workflows
- Coordinate validation, reconciliation, and production cutover activities
- Troubleshoot pipeline failures, performance issues, and data mismatches
- Lead onshore/offshore engineering teams and review technical deliverables
- Maintain migration documentation, issue logs, and deployment checklists
- Act as the technical point of contact for client and delivery teams
Nice to Have - Telecom domain experience (CDR, subscriber data, revenue assurance, etc.)
- Snowflake certifications (SnowPro Core / Advanced)
- Experience with IICS, SSIS, Snowpark, or Dynamic Tables
- Exposure to data observability/validation tools