Agile Programming Methodologies, Amazon Simple Storage Service (S3), Amazon Web Services (AWS), Best Practices, Data Analysis, Data Management, Data Modeling, Data Structures, Data Warehousing, Documentation Standards, Leadership, Python Programming/Scripting Language, Software Development, Software Engineering, Team Lead/Manager, Team Player, Thought Leadership, Time Management, User Groups
Project description
Luxoft is looking for a Senior Data Engineer for development of new application to be used by investors and investment committees to review their portfolio data, tailored to specific user groups.
Responsibilities
- Work with complex data structures and provide innovative ways to a solution for complex data delivery requirements
- Evaluate new and alternative data sources and new integration techniques
- Contribute to data models and designs for the data warehouse
- Establish standards for documentation and ensure your team adheres to those standards
- Influence and develop a thorough understanding of standards and best practices used by your team
SKILLS
Must have
- Seasoned data engineer who has hands-on experience in AWS to conduct end-to-end data analysis and data pipeline build-out using Python, Glue, S3, Airflow, DBT, Redshift, RDS, etc.
- PySpark experience
- Very solution-driven, and highly collaborative at providing thought leadership and soliciting diverse opinions
- Accountable for results. Experienced in leading team of data engineers to work collectively to deliver solutions on time
- Experience on operating in agile (scaled Agile) setting.
Nice to have
- Databricks experience massively preferred but not mandatory