Data Engineer II

This position is responsible for aiding operational areas of the organization leveraging both internal and external data assets to achieve business insights, gain deeper understanding of member needs, and enhance tactical and strategic decision making. The Data Engineer position will support the architecture and systems that support data movement within the organization in both Linux and Windows environments, including managing the software that runs in those environments.

1. Responsibilities

• Independently Install, patch, upgrade, and administer software systems that support data pipelines. This includes ETL platforms (Airflow, SSIS) , data quality platforms Great Expectations), distributed data processing systems (Hopsworks, Polar), and streaming platforms ( Kafka , RabbitMQ.)
• Develop data pipelines to support operational implementation of Data Science and analytical models.
• Ensure all security, documentation, governance, and compliance standards are met.
• Manage small reporting layer on top of analytical models to ensure accountability and insight into models’ performance and impact.
• Perform DevOps and orchestration around supporting data marts and analytical processes.

2. Related Duties

• Engineer each solution with appropriate kinds of technology, with optimized performance.
• Execute analytics solution engineering strategy, requirements, and adapt processes as needed.
• Monitor and secure usage of data while tracking platform product performance.
• Advise and collaborate in internal partnerships to deliver accurate, available, and accessible API services.
• Identifies potential concerns based on projections of current trends.
• Contribute to Credit Union culture by keeping a positive attitude and growing relationships

EDUCATION:

• Bachelor of Science degree in information technology, computer science, statistics, or related business degree with equivalent experience of up to 3 years.
• Master of Science in information technology, computer science, statistics, or related degree.

EXPERIENCE:

• 2 to 4 years of experience in designing, developing and implementing Data solutions.
• Must have advanced SQL abilities, experience with both Oracle and Microsoft desired.
• Must have advanced programming experience with Python.
• Must have experience with Linux.
• Experience with a variety of ETL tools is desired, Airflow, SSIS, Informatica, dbt, etc.
• Experience with Anaconda; Kafka; RabbitMQ; Jupyter Notebook; Tableau desired.
• Experience developing business analytical solutions in large or midsize companies.
• Must be able to manage multiple tasks simultaneously and react to problems quickly.
• Understanding of the financial services industry desired.
• Experience with dashboard design and delivery desired.
• Must be able to translate concepts and directions into practical solutions.
• Must have development experience with various data management technology; NoSQL; relational database; message broker; multi-dimensional database; and design architecture.
• Understand data collection, streaming, preparation, analysis, visualization, modeling, algorithm integration, evaluation, optimization within an implementation context.