Data Management, Data Modeling, Data Processing, Data Quality, Database Extract Transform and Load (ETL), Documentation, Identify Issues, JSON, Linux Operating System, Python Programming/Scripting Language, Query Optimization, Requirements Management, SQL (Structured Query Language), Scalable System Development, Scripting (Scripting Languages), Snowflake Schema, Star Schema, Structured Data, Unix Operating Systems, Unix Shell Programming, Unstructured Data, Validation Testing
Job Description
Junior Data Engineer
Must Have Technical/Functional Skills
Snowflake, DBT
Roles & Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines to process structured and unstructured data
- Design, develop, and maintain data pipelines using Snowflake and dbt
- Build efficient and scalable data models (star/snowflake schemas) using dbt
- Develop and optimize SQL queries for high-performance data transformation
- Implement ELT workflows leveraging Snowflake architecture
- Collaborate with analysts and business stakeholders to translate requirements into data solutions
- Schedule and monitor jobs using tools like Control-M
- Perform data validation, testing, and ensure high data quality
- Troubleshoot pipeline failures and performance bottlenecks
- Work with semi-structured data (JSON, Parquet) in Snowflake
- Maintain documentation for data pipelines and models
- Working knowledge of Python for data processing and scripting
- Experience with UNIX/Linux commands and shell scripting
- Familiarity with Control-M or any job scheduling/orchestration tools
- Basic understanding of data pipeline orchestration and monitoring