Data Engineer Snowflake & Apache Doris

Applab Systems Inc
  • sunnyvale, CA
  • Instant Apply
30+ days ago

Job Description


Title : Data Engineer — Snowflake & Apache Doris – W2 Contract
Location: Sunnyvale, CA – Onsite

About the Role

We are seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines and analytics infrastructure. The ideal candidate has hands-on expertise with Snowflake for cloud data warehousing and Apache Doris for real-time OLAP analytics, and is comfortable working across the full data lifecycle — from ingestion to transformation to serving high-performance queries for analytics and BI teams.

Responsibilities

- Design, build, and maintain robust, scalable ETL/ELT pipelines to ingest structured and semi-structured data from multiple sources into Snowflake and Apache Doris.
- Architect and optimize data models, schemas, and partitioning strategies in Snowflake and Doris to support high-throughput, low-latency analytical workloads.
- Tune query performance, indexing, materialized views, and storage layout in Doris for real-time OLAP use cases.
- Manage Snowflake warehouse sizing, cost optimization, resource monitors, and query performance tuning.
- Build and maintain data orchestration workflows (e.g., Airflow, dbt, or similar) to automate pipeline scheduling, dependency management, and monitoring.
- Implement data quality checks, validation frameworks, and observability/alerting for pipeline reliability.
- Collaborate with data analysts, data scientists, and BI teams to understand reporting requirements and translate them into performant data models.
- Support migration and integration projects between transactional systems, data lakes, Snowflake, and Doris.
- Ensure data governance, security, and access control best practices (RBAC, data masking, encryption) across platforms.
- Document data architecture, pipeline logic, and operational runbooks.

Required Qualifications

- 7+ years of experience as a Data Engineer or in a similar role.
- Hands-on production experience with Snowflake — including SQL scripting, warehouse management, Snowpipe, Streams/Tasks, and performance tuning.
- Hands-on experience with Apache Doris — including cluster architecture (FE/BE nodes), table models (Aggregate, Unique, Duplicate), materialized views, and real-time data loading (Stream Load, Routine Load, Broker Load).
- Strong SQL skills and experience with data modeling (star/snowflake schemas, dimensional modeling).
- Proficiency in Python commonly used in data engineering.
- Experience with workflow orchestration tools (Apache Airflow, dbt, Dagster, or similar).
- Familiarity with streaming/messaging systems (Kafka, Pulsar, or similar) for real-time data ingestion.
- Solid understanding of data warehousing concepts, OLAP vs. OLTP design, and distributed systems fundamentals.
- Experience with version control (Git) and CI/CD practices for data pipelines.

Preferred Qualifications

- Experience migrating workloads from traditional data warehouses to Snowflake and/or Doris.
- Familiarity with cloud platforms (AWS, GCP, or Azure) and infrastructure-as-code tools (Terraform, CloudFormation).
- Experience with containerization/orchestration (Docker, Kubernetes) for deploying Doris clusters.
- Knowledge of BI/visualization tools (Tableau, Looker, Superset, Power BI).
- Background in cost optimization and capacity planning for large-scale analytical systems.
- Contributions to open-source data engineering projects (e.g., Apache Doris community).



Have a Great Day!
Warm Regards,
Sania Wadhwa
Technical Recruiter
Contact Details: 609-755-5388
Email:

sania@applabsystems.com


4365 Route 1 South,Suite 105
Princeton, NJ 08540
www.applabsystems.com

Numbers & Facts

Locationsunnyvale, CA

Skills

  • Access Controlunmatched
  • Amazon Web Services (AWS)unmatched
  • Analysis Skillsunmatched
  • Apacheunmatched
  • Apache Kafkaunmatched
  • Best Practicesunmatched
  • Brokerageunmatched
  • Business Intelligenceunmatched
  • Capacity Managementunmatched
  • Cloud Computingunmatched
  • Continuous Deployment/Deliveryunmatched
  • Continuous Integrationunmatched
  • Cost Controlunmatched
  • Cryptographyunmatched
  • Data Analysisunmatched
  • Data Managementunmatched
  • Data Modelingunmatched
  • Data Qualityunmatched
  • Data Scienceunmatched
  • Data Warehousingunmatched
  • Database Extract Transform and Load (ETL)unmatched
  • Dimensional Modelingunmatched
  • Distributed Computingunmatched
  • Dockerunmatched
  • Engineeringunmatched
  • GCP (Good Clinical Practices)unmatched
  • Gitunmatched
  • High Throughputunmatched
  • Information/Data Security (InfoSec)unmatched
  • Large-Scale Systemsunmatched
  • Lookerunmatched
  • Messaging Technologyunmatched
  • Microsoft Windows Azureunmatched
  • Multiplatform/Cross-Platformunmatched
  • OLAP (OnLine Analytical Processing)unmatched
  • Open Sourceunmatched
  • Performance Analysisunmatched
  • Performance Tuning/Optimizationunmatched
  • Power BIunmatched
  • Python Programming/Scripting Languageunmatched
  • Query Analysisunmatched
  • SQL (Structured Query Language)unmatched
  • Scalable System Developmentunmatched
  • Scripting (Scripting Languages)unmatched
  • Snowflake Schemaunmatched
  • Software Engineeringunmatched
  • Source Code/Configuration Management (SCM)unmatched
  • Star Schemaunmatched
  • Structured Dataunmatched
  • Tableauunmatched
  • Technical Recruitingunmatched
  • Transaction Processing/Managementunmatched
  • Use Casesunmatched
  • Validation Testingunmatched
  • Warehousingunmatched

Be found by employers

5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.

Level up your application

Professional resume templates

Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

Free resume templates

Free resume builder

Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

Free resume builder