Senior Data Engineer
Seattle, Washington / Miami, FL
Engineering /
Regular Full Time /
On-site
apply for this job
We are looking for a Senior Data Engineer to join our growing data platform team. You will own the design, build, and reliability of our cloud-native data lakehouse - from raw ingestion through to analytics-ready Gold tables. You will work closely with data analysts, analytics engineers, and product stakeholders to deliver trusted data at speed, while championing data quality and observability as first-class concerns.
This role sits at the intersection of data engineering and platform engineering - you will be expected to think in architectures, not just pipelines.
What You Will Do
Data Platform & Pipeline Engineering
Design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF) and Apache Airflow, processing structured and semi-structured data across the Medallion architecture (Bronze Silver Gold).
Implement incremental load patterns, change data capture (CDC), and event-driven ingestion to ensure data freshness across the platform.
Build and optimise Snowflake data warehouse objects - tables, views, dynamic tables, streams, tasks, and stored procedures - for performance and cost efficiency.
Develop modular, tested dbt models aligned to each Medallion layer, enforcing consistent naming conventions, documentation, and lineage across all transformations.
Data Quality & Observability
Embed automated data validation at every Medallion layer using Elementary (dbt's observability layer), ensuring anomaly detection, freshness checks, and schema drift alerts are in place before data reaches consumers.
Define and enforce data contracts between producers and consumers - row count checks, null rate thresholds, referential integrity, and value domain validation.
Build and maintain data quality dashboards to give engineering and business stakeholders real-time confidence in platform health.
Azure Cloud Infrastructure
Manage and optimise Azure Data Lake Storage Gen2 (ADLS) - folder structures, lifecycle policies, access tiers, and partition strategies.
Build and maintain Azure Functions and Azure Logic Apps for lightweight event-driven processing, orchestration triggers, and operational automation.
Manage secrets, credentials, and environment-specific configuration securely using Azure Key Vault - no hardcoded credentials in pipelines or code.
Contribute to infrastructure-as-code practices for provisioning Azure data services (Terraform or Bicep preferred).
Collaboration & Delivery
Translate ambiguous business requirements into well-defined data models and pipeline designs, working with analysts and stakeholders to validate assumptions before build.
Participate in code reviews, enforce standards, and mentor junior engineers on data engineering best practices.
Support CI/CD adoption for pipeline and dbt model deployment across Dev / Test / Prod environments.
What We Are Looking For
Must-Have
Snowflake: Snowflake
Advanced SQL - window functions, CTEs, recursive queries, query profiling
Snowflake-native features: streams, tasks, snowpipe, dynamic tables, row-level security
Virtual warehouse tuning and credit cost optimisation
dbt + Elementary: dbt + Elementary
Writing, testing, and documenting production dbt models
Elementary integration for data observability and anomaly detection
dbt incremental strategies, snapshots, and semantic layer
Azure Cloud: Azure Cloud
Azure Data Factory - pipeline authoring, triggers, parameterisation, linked services
ADLS Gen2 - zone/folder design, lifecycle management, Parquet/Delta partitioning
Azure Key Vault - secret management, managed identities
Azure Functions / Logic Apps - event-driven triggers and lightweight automation
Airflow: Airflow
DAG authoring, task dependencies, XCom, sensors, and connection management
Airflow deployment and monitoring in cloud-hosted environments
Python: Python
Data pipeline scripting, PySpark basics, REST API integration
Unit testing pipeline logic and transformation functions
Data Quality & Medallion Architecture: Medallion Architecture:
Hands-on experience implementing Bronze / Silver / Gold Medallion architecture
Data validation checks at each layer - not just at the final Gold layer
Schema evolution handling and SCD Type 2 dimension management
4+ years of professional data engineering experience with at least 2 years on Azure cloud data platforms.
Nice-to-Have
Exposure to Snowflake Cortex, dbt Semantic Layer, or Boomi Data Hub for AI-assisted data enrichment within pipeline layers.
Experience integrating LLM-based quality checks or AI-assisted anomaly detection into data workflows.
Familiarity with Microsoft Fabric and OneLake as a complementary or future-state platform.
Knowledge of data mesh or data product thinking and how it maps to Medallion layer ownership.
Experience with Terraform or Bicep for Azure infrastructure provisioning.
What We Are Looking For
Must-Have
Snowflake: Snowflake
Advanced SQL - window functions, CTEs, recursive queries, query profiling
Snowflake-native features: streams, tasks, snowpipe, dynamic tables, row-level security
Virtual warehouse tuning and credit cost optimisation
dbt + Elementary: dbt + Elementary
Writing, testing, and documenting production dbt models
Elementary integration for data observability and anomaly detection
dbt incremental strategies, snapshots, and semantic layer
Azure Cloud: Azure Cloud
Azure Data Factory - pipeline authoring, triggers, parameterisation, linked services
ADLS Gen2 - zone/folder design, lifecycle management, Parquet/Delta partitioning
Azure Key Vault - secret management, managed identities
Azure Functions / Logic Apps - event-driven triggers and lightweight automation
Airflow: Airflow
DAG authoring, task dependencies, XCom, sensors, and connection management
Airflow deployment and monitoring in cloud-hosted environments
Python: Python
Data pipeline scripting, PySpark basics, REST API integration
Unit testing pipeline logic and transformation functions
Data Quality & Medallion Architecture: Medallion Architecture:
Hands-on experience implementing Bronze / Silver / Gold Medallion architecture
Data validation checks at each layer - not just at the final Gold layer
Schema evolution handling and SCD Type 2 dimension management
4+ years of professional data engineering experience with at least 2 years on Azure cloud data platforms.
Nice-to-Have
Exposure to Snowflake Cortex, dbt Semantic Layer, or Boomi Data Hub for AI-assisted data enrichment within pipeline layers.
Experience integrating LLM-based quality checks or AI-assisted anomaly detection into data workflows.
Familiarity with Microsoft Fabric and OneLake as a complementary or future-state platform.
Knowledge of data mesh or data product thinking and how it maps to Medallion layer ownership.
Experience with Terraform or Bicep for Azure infrastructure provisioning.
Why Work for WatchGuard?
WatchGuard is a global leader in network security and intelligence, advanced endpoint protection, multi-factor authentication, and secure Wi-Fi. Our award-winning products and services are trusted worldwide by more than 18,000 security resellers and service providers to protect more than 250,000 customers. Our technology keeps our customers ahead of increasingly sophisticated hackers and has fueled record revenues at WatchGuard.
WatchGuard is headquartered in Seattle, Washington, with team members working remotely and in offices worldwide.
Our company culture places an intense focus on our customers and employees. From the newest employee to our CEO, you'll find that each person at WatchGuard embodies our Core Values: Accountability, Community, Belonging, Action, Innovation, and Customer-Centric. Learn more about our company culture at www.watchguard.com/wgrd-careers.
WatchGuard provides equal employment opportunities for all qualified employees, regardless of their race, color, national origin, religion, ancestry, creed, pregnancy, age, sex, sexual orientation (including gender expression or identity), marital status, mental or physical disability, honorably discharged veteran or military status or any other category protected by federal, state or local laws. Our equal employment opportunity (or EEO) policy focuses solely on the talent, hard work, contributions, and actual results achieved by each WatchGuard employee and on the potential of employment candidates to make such contributions. We consider focusing on an employee's protected characteristics rather than on talent, hard work, and actual work results to violate our EEO policy. As an Equal Opportunity Employer, we are committed to a diverse workforce. WatchGuard participates in E-verify.
WatchGuard is committed to providing reasonable accommodation for qualified individuals with disabilities in our job application procedures. Please let us know if you need assistance or accommodation due to a disability.
Compensation
The base salary range is $140,000-$150,000 per year for full-time employment, exclusive of benefits. Your base salary will be determined by your individual skills, education, and experience. Hiring at the maximum of the range is not typical in order to allow for future salary growth.
U.S. Benefits
Other Perks
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
apply for this job