Responsibilities: -- Primary function: Build and maintain reliable, scalable data pipelines
- Common data clouds (AWS, Azure, Snowflake)
- Data processing (Spark, distributed systems, etc)
- APIs/ingestions (REST, streaming, etc)
- Performance optimization
- Schema understanding and evolution
Experience: - · 12+ Years
Location: - · Remote
Educational Qualifications: -- Engineering Degree – BE/ME/BTech/MTech/BSc/MSc.
- Technical certification in multiple technologies is desirable.
Technical Skills: -
Python
SQL
Airflow or other orchestration tools
·
Business skills- Business domain knowledge
- Understanding SLAs
- Collaboration with analytics, product and business teams
- Cost awareness and optimization
Specific technologies to be used: -- Experience in working on CI/CD Pipelines using GitLab.
- Snowflake.
- Azure Data Factory.
- SQL Server.