Being good neighbors – helping people, investing in our communities, and making the world a better place – is who we are at State Farm. It is at the core of how we operate and the reason for our success. Come join a #1 team and do some good!
The State Farm Innovation Group is looking for an experienced Data Engineer to join the AIMD team, focused on Advanced AI, Modeling and Data. This position calls for flexibility and learning agility, as we work in a fast paced environment and will be doing many types of data work as the team and department evolve.
HYBRID: Qualified candidates (in or near hub locations listed below) should plan to spend time working from home and some time working in the office as part of our hybrid work environment.
HUB LOCATIONS: Dunwoody, GA; Richardson, TX; Tempe, AZ; or Bloomington, IL
SPONSORSHIP: Applicants are required to be eligible to lawfully work in the U.S. immediately; employer will not sponsor applicants for U.S. work authorization (e.g., H-1B visa) for this opportunity.
Incumbency: This position will have a 12-month incumbency period, beginning on the effective date of the position, which must be met before the employee can post for any other lateral State Farm position. Employees may be considered for leadership or Technology Engineer openings at any time, and a promotional position within the same job structure (i.e. Professional/Technical or Para-professional/Support) after 6 months from the effective date of the position. In these cases, the remaining incumbency would be waived. The incumbency period does not affect the at-will relationship between State Farm and the employee and does not create an employment contract, nor contractual rights.
Our team will be handling data needs for the Innovation Group, a department dedicated to being a 'bridgehead' to advanced solutions for the State Farm Enterprise. State Farm is in the process of bringing in the Databricks product into our environment, and this team will be responsible for providing services to other teams in the department from Databricks.
Your Responsibilities May Include:
• Utilizes industry-adopted languages and frameworks in coding, testing, security, DevOps, DataOps and data engineering practices
• Develops and maintains reusable, scalable, and compliant data solutions across multiple platforms and compute environments
• Responsible for the identification, acquisition, cleansing, profiling, and ETL (extracting, transformation, and loading) of data used in analytic discovery and production solution deployment across multiple platforms
• Establishes business domain knowledge for existing State Farm data sources and investigates, recommends, and initiates acquisition of data resources, both internal and external
• Identifies and consults on emerging technologies and critical core systems, including techniques, tools, data sources, and platforms in the data engineering field
• Familiar with handling datasets containing mixes of structured and unstructured data
• Exhibits DataOps mindset where team is accountable for ensuring data aligns to enterprise needs and leveraging automation to deliver quality data solutions
• Collects and analyzes information to identify customer's technical needs, suggest solutions and develop implementation and integration plans (e.g., technical proposals)
• Responsible for the analysis, design, deployment, support, and security of technology to ensure the organization is efficiently managing its technology and data-related assets in accordance with market best-practices and external regulations
• Applies a wide application of complex principles, theories, and concepts in computer science for data engineering solutions
We Are Seeking Candidates With:
• Minimum of 2-4 years of professional experience as a Data Engineer.
• Proficiency in programming languages such as Python, Spark SQL (or PySpark), R, Java, Bash, etc.
• Hands-on experience with AWS services including ETL tools (Glue, EMR Serverless), Lambda, Step Functions, EventBridge, S3, DynamoDB, Kinesis Firehose, Redshift, Iceberg, and SageMaker.
• Experience with distributed data processing frameworks such as Apache Spark, Databricks.
• Experience with infrastructure as code tools such as OpenTofu (formerly Terraform) for managing cloud resources and deployments.
• Familiarity with CI/CD pipelines including automated testing, security scans, and tools like Airflow.
Additional
• An 'Innovation Mindset', and the ability to quickly learn new data technologies as needs change
• Experience with relational databases such as DB2, Postgres, Redshift, etc.
• Experience with version control systems such as GitHub or GitLab.
• Data access skills using SQL, and Athena.
• Experience in designing, building, and maintaining data pipelines for automated data processing.
• Knowledge of data modeling techniques such as star schema and snowflake schema, with an understanding of data architecture.
Because work-life balance is a priority at State Farm, compensation is based on our standard 38:45-hour work week!
At State Farm, we offer more than just a paycheck. Check out our suite of benefits designed to give you the flexibility you need to take care of you and your family!
Visit our State Farm Careers page for more information on our benefits, locations, and the hiring process of joining the State Farm team!
Customers and communities rely on us to help them face life's uncertainties. They come to us for guidance with insurance needs, financial planning, and strengthening the community.