Senior Data Engineer

Global Financial Firm located in MISSISSAUGA, ON has an immediate contract opportunity for an experienced Senior Data Engineer

"This role is currently on a Hybrid Schedule.
You will need to have reliable internet, computer and android or iphone for remote access into the client systems during remote work.
We will be expected in the office weekly 3 days depending on the team requirement.

****Video/ f2f interviews are required prior to all offers.

Job Posting Title: Applications Development Tech Lead Analyst (Data Engineer)

Job Description:
The Applications Development Tech Lead Analyst is responsible for accomplishing results through the management of a team or department in an effort to establish and implement new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to drive applications systems analysis, development and maintenance activities. This role requires hands-on development and participation in entire software/application development lifecycle.

Responsibilities:

• Manage one or more Applications Development teams in an effort to accomplish established goals
• Utilize in-depth knowledge and skills across multiple Applications Development areas to provide technical oversight across systems and applications
• Review/analyze/develop proposed technical solutions for projects
• Contribute to formulation of strategies for applications development and other functional areas
• Develop comprehensive knowledge of how areas of business integrate to accomplish business goals
• Provide evaluative judgment based on analysis of factual data in complicated and unique situations
• Impact the Applications Development area through monitoring delivery of end results, participate in budget management, and handling day-to-day staff management issues, including resource management and allocation of work within the team/project
• Ensure essential procedures are followed and contribute to defining standards negotiating with external parties when necessary
• Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Clientgroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency, as well as effectively supervise the activity of others and create accountability with those who fail to maintain these standards.

Core Skills:
The Data Engineering lead will be working very closely with and managing the work of a team of data engineers working on our Big DataPlatform. The lead will need the below core skills

• Strong solid understanding of the Big Data architecture and the ability to trouble shoot performance and/or development issues on Hadoop (Cloudera preferably)
• Hands-on experience working with Hive, Impala, Kafka, HBase, Spark for data curation/conformance related work.
• Strong proficiency in Spark for development work related to curation/conformance. Strong Scala development (with previous Java background) preferred.
• Experience with Spark/Kafka or equivalent streaming/batch processing and event-based messaging.
• Strong data analysis skills and the ability to slice and dice the data as needed for business reporting.
• Relational SQL (Oracle, SQL Server), NoSQL (MongoDB) and Cache (Couchbase) database integration and data distribution principles experience
• Leadership & Mentorship: Ability to guide and mentor junior developers, fostering a collaborative team environment and promoting professional growth.
• Communication Skills: Strong communication skills, both written and verbal, with the ability to explain complex technical concepts to both technical and non-technical audiences.
• DevOps Practices: Experience working in a Continuous Integration and Continuous Delivery environment and familiarity with tools like Jenkins, TeamCity, SonarQube, OpenShift, ECS, or Kubernetes.
• Software Engineering Principles: Proficient in industry-standard best practices such as Design Patterns, Coding Standards, Coding modularity, and Prototyping.
• Data Visualization: Experience with data visualization tools and techniques for presenting data insights effectively.
• Agile Methodologies: Familiarity with agile development methodologies and experience working in agile and scaled agile teams.

Additional Requirements (Nice to have):

• Cloudera/Hortonworks/AWS EMR, S3 experience a plus
• Experience with Cloud Integration on AWS, Snowflake or GCP tech stack components.
• Experience with API development and use of JSON/XML/Hypermedia data formats.
• Analysis and development across Lines of business product/function including Payments, Digital Channels, Liquidities, Trade, Sales, Pricing, Client Experience having Cross train, functional and/or technical knowledge

Qualifications:

• 8-12 years of relevant experience in the Big Data Application Development
• Experience as Applications Development Manager
• Experience as senior level in an Applications Development role
• Stakeholder and people management experience
• Demonstrated leadership skills
• Proven project management skills
• Basic knowledge of industry practices and standards

Education:

• Bachelors degree/University degree or equivalent experience
• Masters degree preferred

Other Relevant Skills
Apache Hadoop, Apache Hive, Apache Impala, Apache Kafka, Apache Spark, Big Data, Java, MongoDB, NoSQL, Oracle Database, Python (Programming Language), Relational Database Management System (RDBMS).
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

Minimum Technical Skills REQUIRED-
Experience with Spark/Kafka or equivalent streaming/batch processing and event-based messaging.

Additional Technical Skills PREFERRED-
Apache Hadoop, Apache Hive, Apache Impala, Apache Kafka, Apache Spark, Big Data, Java, MongoDB, NoSQL, Oracle Database, Python (Programming Language), Relational Database Management System (RDBMS).