Job Description: Data Engineer
Local to Toronto or London ON in Hybrid Mode.
Job Summary
We are seeking an experienced Data Engineer with 9 to 13 years of experience to join our team. The ideal candidate will have expertise in Databricks SQL, Databricks Workflows, and PySpark. Experience in the Life and Annuities Insurance domain is a plus. This hybrid role requires a proactive individual who can drive innovation and efficiency in our data solutions, contributing to the companys growth and societal impact.
Responsibilities
- Design and implement scalable data architectures using Databricks SQL and PySpark to enhance data processing capabilities.
Collaborate with cross-functional teams to develop and optimize Databricks Workflows for seamless data integration.
Analyze complex data sets to identify trends and insights that drive business decisions and improve operational efficiency.
Ensure data quality and integrity by implementing robust data governance practices and monitoring systems.
Provide technical guidance and mentorship to junior team members, fostering a culture of continuous learning and improvement.
Develop and maintain comprehensive documentation for data architecture and workflows to support ongoing development and maintenance.
Work closely with stakeholders to understand business requirements and translate them into technical solutions that align with company objectives.
Lead efforts to innovate and improve data processing techniques, ensuring the company remains at the forefront of industry advancements.
Conduct regular performance assessments of data systems to identify areas for optimization and implement necessary enhancements.
Collaborate with IT and business teams to ensure data solutions are aligned with organizational goals and regulatory requirements.
Drive the adoption of best practices in data engineering and architecture to ensure high-quality deliverables.
Engage in continuous professional development to stay updated with the latest trends and technologies in data architecture.
Contribute to the companys mission by leveraging data to create impactful solutions that benefit society.
Qualifications
Possess strong technical skills in Databricks SQL and PySpark, with a proven track record of successful implementations.
Demonstrate expertise in designing and optimizing Databricks Workflows for efficient data processing.
Exhibit a deep understanding of data architecture principles and best practices.
Have experience in the Life and Annuities Insurance domain, which is considered an advantage.
Show proficiency in data governance and quality assurance practices.
Display excellent problem-solving skills and the ability to work collaboratively with diverse teams.
Maintain a commitment to continuous learning and professional growth in the field of data architecture.