Designing and building the data Ingestion Pipeline
Designing, building and maintain large, complex data processing pipelines using Databricks and Azure Data Factory in Azure to meet enterprise Data requirements
Providing operational and functional support on creating, storing, managing, and maintaining enterprise data, including the ability to incorporate policies and procedures for centrally managing and sharing data through the data life cycle
Identifying, designing, and implement internal process improvements: automating manual processes, optimizing data delivery, and re-designing for flexibility and scalability
Building the infrastructure required for extraction, transformation, and loading of data from a wide variety of cloud and on-premises data sources.
Working with stakeholders including to assist with data-related technical issues and support their data infrastructure needs.
Working closely with data architecture, data governance and data analytics teams to ensure pipelines adhere to enterprise standards, usability, and performance.
Experience in building Meta data driven framework using Databricks
Experience in Snow-Pipe and Snow-SQL
Write complex SQL queries, stored procedures, and user-defined functions in Snowflake to support data processing and analytics requirements.
Optimize SQL code and query performance by understanding query execution plans, indexing strategies, and query optimization techniques.
Implement query performance tuning and indexing strategies to improve overall system performance.
Data Quality and Governance:
Implement data quality checks and validation processes to ensure the accuracy, consistency, and integrity of data in Snowflake.
Collaborate with data governance teams to enforce data quality standards and compliance with data regulations.
Implement and maintain data security measures in Snowflake to ensure data privacy and compliance.
Document data models, ETL processes, data transformation rules, and best practices for future reference and knowledge sharing.
Participate in code reviews, quality assurance, and documentation reviews.
Numbers & Facts
Location
Oregon (Remote)
Want to know if you’re a fit? Upload your resume and let our AI show you.
Skills
Best Practicesunmatched
Cloud Computingunmatched
Code Reviewsunmatched
Data Analysisunmatched
Data Managementunmatched
Data Modelingunmatched
Data Processingunmatched
Data Qualityunmatched
Database Extract Transform and Load (ETL)unmatched
Documentation Modelsunmatched
Documentation Reviewunmatched
Information/Data Security (InfoSec)unmatched
Insurance Documentationunmatched
Metadataunmatched
Microsoft Windows Azureunmatched
Operational Supportunmatched
Performance Managementunmatched
Performance Tuning/Optimizationunmatched
Process Improvementunmatched
Quality Assuranceunmatched
Quality Metricsunmatched
Query Optimizationunmatched
Regulatory Complianceunmatched
Requirements Managementunmatched
SQL (Structured Query Language)unmatched
Sales Pipelineunmatched
Snowflake Schemaunmatched
Stored Proceduresunmatched
Technical Supportunmatched
Usability Engineeringunmatched
Validation Testingunmatched
🎯
Be found by employers
5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.
Level up your application
Professional resume templates
Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.