Data Engineer

Responsibilities:
* Analyze large and complex datasets to identify trends, patterns, and anomalies.
* Use statistical techniques and data mining tools to extract meaningful insights.
* Prepare data visualizations (dashboards, reports) to communicate findings effectively.
* Data Engineering:
* Collaborate with data engineers to design and implement data pipelines using Azure Data Factory (ADF).
* Utilize Databricks to process and transform large datasets efficiently.
* Develop and maintain data quality checks and validation processes.
* SQL Proficiency:
* Write complex SQL queries to extract, transform, and analyze data from relational databases.
* Optimize SQL queries for performance and scalability.
* Cloud Technology Expertise:
* Leverage Azure cloud services (Azure Data Lake Storage, Azure Synapse Analytics) to store and process data.
* Utilize Azure Databricks for data engineering and analysis tasks.
* Data Governance:
* Adhere to data governance policies and standards.
* Ensure data security and privacy.
* Collaboration:
* Work closely with business stakeholders to understand their data needs.
* Collaborate with data scientists and engineers to build data products.

Qualifications:
* 10+ years of experience in data analysis and data engineering.
* Strong proficiency in SQL and data querying languages.
* Experience with data visualization tools (e.g., Power BI, Tableau).
* Hands-on experience with Azure cloud technologies, including Databricks and ADF.
* Knowledge of statistical techniques and data mining algorithms.
* Excellent problem-solving and analytical skills.
* Strong communication and presentation skills.