Data Engineer

Integrity. Care. Trust. Compassion. Expertise. Do these words resonate with you? These values of Builders culture create success in all we do. We strive to provide deeply supportive partnerships to our customers, agents, and each other. Builders is proud to be named among the Great Places to Work. Our award-winning culture has earned top marks in Company Direction, Employee Appreciation, Work-Life Balance, Leadership, and Compensation and Benefits. Our strong culture keeps us Built Strong in a forever-changing world, and our AM Best A Rating is evidence of our financial strength. Position Summary The Data Engineer is responsible for designing, developing, and maintaining data pipelines that power the companys Azure Databricks lakehouse for its property and casualty insurance business. Using technologies such as Delta Lake, Unity Catalog, Lakeflow pipelines, and Databricks SQL, the Data Engineer delivers reliable, high-quality, well-tested, and well-documented data to support key business functions, including underwriting, claims, actuarial, and finance. A key responsibility is developing and supporting data pipelines for the phased migration of data from Guidewire and legacy policy, claims, and billing systems into the Azure Databricks lakehouse. The Data Engineer ensures solutions align with the Unity Catalog governance framework and adhere to the engineering standards and best practices established by the Data Engineering Lead. The role also emphasizes knowledge sharing, technical ownership, and long-term sustainability by progressively assuming responsibility for contractor-developed pipelines, strengthening internal expertise, and building lasting in-house platform capabilities. Responsibilities Build pipelines for the phased data migration from Guidewire (PolicyCenter, ClaimCenter, BillingCenter) and legacy systems into the lakehouse on Azure Databricks, including historical loads, incremental/CDC (Change Data Capture) loads and reconciliation.Develop bronze and silver layer transformations in PySpark and Spark SQL on Delta Lake, following the medallion architecture.Support modeling of property and casualty insurance data: policies, insured risks and exposures, coverages, endorsements, premiums, claims, reserves, payments and recoveries.Integrate third-party data sources such as geospatial and weather data.Schedule and run production pipelines with Databricks Workflows (Lakeflow Jobs) or Azure Data Factory, including job dependencies, parameters, retries and alerting; investigate and resolve pipeline failures.Apply Unity Catalog controls defined by the Data Engineering Lead and Data Governance lead, including permissions, PII (Personally Identifiable Information) masking, tags and lineage.Implement data quality checks, error handling and monitoring.Tune pipeline performance and cost, including partitioning, liquid clustering and right-sized job compute.Use Git version control (GitHub or Bitbucket) and CI/CD (Continuous Integration/Continuous Deployment) with Databricks Asset Bundles to version, review and deploy code across development, test and production.Write documentation and runbooks, take part in code reviews, and take ownership of contractor-built pipelines over time.Perform other duties as assigned. Qualifications Associate degree or an equivalent combination of education and experienceCertification in Databricks engineeringThree or more years in data engineering, including one or more years hands-on with Databricks (PySpark, Spark SQL, Delta Lake)Experience with property and casualty insurance data, ideally Guidewire data; experience migrating data from legacy source systemsKnowledge of Python/PySpark and SQL (Structured Query Language)Knowledge of Unity Catalog: permissions, row/column-level security and lineageExperience with incremental loading patterns such as CDC, MERGE, SCD (Slowly Changing Dimension) and Auto LoaderKnowledge of data modeling, including dimensional modelingExperience scheduling and monitoring pipelines with Databricks Workflows and/or Azure Data FactoryExperience with Git-based version control (GitHub or Bitbucket), including branching, pull request reviews and Databricks Git foldersExperience with Azure data services such as ADLS (Azure Data Lake Storage) Gen2, Azure Data Factory and Key VaultKnowledge of CI/CD basics (Databricks Asset Bundles, Azure DevOps, GitHub Actions or Bitbucket Pipelines)Experience with streaming (Structured Streaming, Event Hubs)Experience with API (Application Programming Interface) and integration tools such as MuleSoft is an added advantage Lets talk benefits! Competitive SalaryBonus StructureProfit SharingMedical, Dental, Vision InsuranceEmployer Paid Short Term DisabilityEmployer Paid Long Term DisabilityEmployer Paid Life InsuranceVoluntary Life Insurance401K with Company MatchPTO About Builders Builders is a mid-sized mutual with remarkable strengths. Rated A by AM Best, Builders has forged rock-solid financial strength and a reputation for reliability and fairness in fulfilling our promises to customers. Kind, collaborative, and customer-centric, our experienced and passionate teams foster a rewarding atmosphere of excellence, trust, and mutual respect, meriting the Culture Excellence honors from Top Workplaces. Flexible and highly personal, our experts leverage deeply supportive partnerships with knowledgeable independent agencies to drive better services and protection for policyholders. Our financial excellence, amazing people, and powerful partnerships build outstanding outcomes and peace of mind for our agents and their clients. This is what we mean by Insurance Built Strong. Builders Insurance Group is an Equal Opportunity Employer.We welcome applicants from all walks of life and don't discriminate based on any protected status. Join us in creating a diverse and inclusive workplace!