Expert Data Engineer

Summary:

• Location: Oakland, CA or San Ramon, CA
• Work Mode: Hybrid Role
• Duration: 11 Months

Responsibilities:

• Design, develop, and maintain Streamlit applications hosted on Snowflake.
• Develop Python-based solutions for data ingestion, transformation, validation, and reporting.
• Create scalable data pipelines and workflows to support business processes and analytics.
• Build interactive dashboards, forms, workflows, and self-service applications for business users.
• Develop and maintain integrations between Snowflake and enterprise systems including SharePoint, SAP, APIs, and other internal platforms.
• Collaborate with business stakeholders to gather requirements and translate them into technical solutions.
• Support data modeling, data quality, and governance activities.
• Troubleshoot production issues and implement performance improvements.
• Participate in Agile development activities, including sprint planning, backlog grooming, testing, and deployment.
• Create technical documentation, deployment guides, and support materials.

Requirements:

• Minimum 3 years of experience in Python development.
• Experience building applications using Streamlit.
• Experience developing solutions on Snowflake.
• Experience with SQL and database design concepts.
• Experience developing ETL/ELT processes and data pipelines.
• Knowledge of data engineering best practices, data quality controls, and data integration patterns.
• Experience working with REST APIs and external data sources.
• Experience using Git, version control, and CI/CD practices.
• Strong analytical, problem-solving, and communication skills.

Preferred Skills:

• Experience with Snowpark for Python.
• Experience with Airflow, orchestration tools, or automated deployment pipelines.
• Experience working with cloud platforms (AWS, Azure, or GCP).
• Experience integrating with SAP, SharePoint, or enterprise asset management applications.
• Experience working with Asset Management, Utility Operations, Engineering, or Energy industry business processes.
• Familiarity with Power BI, Plotly, Pandas, and data visualization technologies.
• Understanding of data governance, master data management, and application security concepts.