Sr. Data Engineer

Iconma

ST Paul, MN

JOB DETAILS
SALARY
$76.44–$80.54 Per Hour
SKILLS
AWS Lambda, Agriculture, Amazon Web Services (AWS), Analysis Skills, Apache, Best Practices, Big Data, Business Intelligence, Business Processes, Cloud Computing, Computer Science, Continuous Deployment/Delivery, Continuous Integration, Customer/Client Research, Data Analysis, Data Formats, Data Management, Data Modeling, Data Processing, Data Quality, Data Warehousing, Database Extract Transform and Load (ETL), Detail Oriented, Documentation, Documentation Standards, Git, Health Plan, Information/Data Security (InfoSec), Leadership, Loans, Mentoring, Multitasking, Problem Solving Skills, Process Flow, Process Management, Purchasing/Procurement, Python Programming/Scripting Language, Requirements Management, SQL (Structured Query Language), Scripting (Scripting Languages), Snowflake Schema, Source Code/Configuration Management (SCM), Splunk, Standards Development, Stored Procedures, Structured Data, Team Lead/Manager, Time Management, Unstructured Data, Use Cases
LOCATION
ST Paul, MN
POSTED
1 day ago
Our client, an Agriculture and Energy Services company, is looking for a Sr. Data Engineer for their St Paul, Minneapolis or Grove Heights location.
 
Responsibilities:
  • Support a variety of projects that will range in scale and complexity within the Enterprise Big Data Ingestion Team. 
  • Play a critical role in designing, developing, and supporting our data ingestion pipelines, ensuring seamless integration of data from client various sources to support robust analytics and business intelligence.
  • Cloud Data Platforms: Utilize cloud data warehouses using Snowflake and AWS, ensuring optimal performance, security, and scalability of data pipelines.
  • Python Development: Develop, optimize, and maintain data processing scripts and applications using Python to support various big data ingestion tasks.
  • Adhere to, improve, and contribute perspective to programming and development deadlines for the team.
  • ELT Process Management: Assist with architecting and implementing of Extract-Load-Transform (ELT) processes, including AWS Lambda functions, to ensure efficient and accurate data loading between systems.
  • Data Transformation: Utilize Snowflake’s functionality of tasks, streams, stored procedures, dynamic tables, and dbt (data build tool) to model raw data into a consumable format for data engineers, analysts, and scientists.
  • Business Integration: Understand business processes, data flows, and strategies for Client business units and work collaboratively on their data needs.
  • Documentation and Standards: Produce, maintain, and encourage high-quality documentation to ensure transparency and understanding of data ingestion pipelines and solutions.
  • Monitoring and Observability: Understand, monitor, and enhance data ingestion flows to enable reporting and insights development, including tracking data and job statuses.
  • Team Leadership: Mentor and guide other team members, fostering a culture of continuous learning and development.
  • Advise on best practices around data ingestion pipelines and procurement of data based on use-cases (structured, semi-structured, and unstructured data).
 
Requirements:
  • Top 3 Technical Skills:
    • Python
    • SQL
    • Writing Lambdas
  • Top 3 Functional Skills:
    • Understanding how loans work
    • Gathering requirements
    • Can work with little direction
  • Bachelor or Graduate degree in Business Management, Information Management, Computer Science, or other STEM degree program.
  • 5+ years in relevant data engineering positions.
  • Strong understanding of modern, cloud-based data architecture concepts and best practices, including Lakehouse architectures.
  • Hands-on experience using version control systems such as Git and CI/CD workflows and practices.
  • Comfortable with ambiguity; able to take ownership, thrive with less oversight and process.
  • Experience in ELT/ETL tools, including AWS Glue, AWS Lambda, and Apache Airflow.
  • Experience leading other team members and developing technical standards.
  • Attention to detail and commitment to data and code quality.
  • Strong analytical and problem-solving skills and an ability to multi-task.
  • Experience with data observability and monitoring tools, such as Dynatrace, Datadog, Splunk, Monte Carlo, and AWS CloudWatch.
 
Why Should You Apply?

About the Company

I

Iconma

ICONMA is a global information consulting management firm providing Professional Staffing Services and Project-Based Solutions for organizations in a broad range of industries.

  • Corporate Headquarters in Troy, Michigan; 20+ locations worldwide.
  • Certified Woman-Owned Business Enterprise (WBE); certified by Women’s Business Enterprise National Council, National Women Business Owners Corporation (NWBOC); and California Public Utilities Commission (CPUC).
  • Founded in 2000
  • 2000+ Employees

The company was founded on the principle that success is derived from delivering high quality service and resources in the most responsive, flexible, and innovative way. ICONMA invests in people and resources with a single goal: To provide our customers with the highest quality service in the most responsive manner. Through its network of offices, ICONMA provides the resources to help clients maintain their competitive advantage.

COMPANY SIZE
2,000 to 2,499 employees
INDUSTRY
Management Consulting Services
EMPLOYEE BENEFITS
401K, Employee Referral Program, Life Insurance
FOUNDED
2000
WEBSITE
https://www.iconma.com/