Senior Data Engineer DataStage to Azure Databricks Migration

Role: Senior Data Engineer – DataStage to Azure Databricks Migration

Remote

Rate: $65/hr on C2C

Job ID: SF_OP_207156-3

Job Description:

· Strong hands-on experience in IBM DataStage, Teradata, SQL and Azure Databricks.

· Analyze existing DataStage jobs and their Teradata dependencies.

· Knowledge of Teradata utilities/components such as BTEQ and TPT.

· Experience configuring or working with JDBC/ODBC database connectivity from ETL platforms.

· Identify and remediate Teradata-specific SQL for compatibility with Databricks/Spark SQL

· Perform data reconciliation and validation, including row-count and checksum validation.

· Troubleshoot migration issues related to SQL, connectivity, schemas, metadata and data types.

· Support unit testing, SIT, UAT, cutover and post-production stabilization.

· Good understanding of ADLS Gen2, Delta tables, Unity Catalog and Azure connectivity/security.

· Experience in large-scale Teradata-to-Azure/Databricks migration is preferred.