Data Engineer
Redmond, WA-Onsite
Job Description
We are looking for a Data Engineer with strong experience in Azure, Databricks, Python, SQL, and ETL/ELT pipelines to design, develop, and maintain scalable cloud-based data solutions. The ideal candidate should have hands-on experience with Azure Data Lake, Spark/PySpark, and DevOps practices to support enterprise analytics and data integration initiatives.
Required Skills
Hands-on experience with Databricks / Spark
Experience with Azure Cloud, ADLS, or Data Lake
Strong knowledge of Python / PySpark and SQL
Experience in ETL / ELT pipeline development
Knowledge of data pipelines and cloud-based data processing
Familiarity with DevOps / CI-CD / Git
Experience with data integration and transformation workflows
Good understanding of performance tuning and troubleshooting
Roles & Responsibilities
Design and develop data pipelines using Azure and Databricks.
Build and maintain ETL/ELT workflows for structured and unstructured data.
Develop Python/PySpark and SQL-based transformations for analytics and reporting.
Integrate data from multiple systems into cloud data platforms.
Optimize Spark/Databricks workloads for scalability and performance.
Support data ingestion, validation, and monitoring processes.
Work with Azure Data Lake and cloud storage for scalable data processing.
Follow DevOps and CI/CD practices using Git and deployment tools.
Troubleshoot pipeline failures and production issues.
Collaborate with business and technical teams to deliver data-driven solutions.