Must Have: AWS Data service experience (S3, GLUE, Lambda, Redshift, KMS etc.), Strong SQL knowledge and Aws CDK knowledge.
8+ years of experience in Data Engineer with AWS services like Simple Storage Service(S3), Lambda, Glue ETL, Redshift, SQL, Python, Git.
1. Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred).
2. Must be able to work with large volumes of data coming from various sources. Perform data cleansing, data validation etc
3. Hands on ETL developer who is good at python, SQL. AWS services like glue, glue crawlers, lambda, red shift, athena, s3, EC2, IAM, Monitoring and Logging mechanisms- AWS cloudwatch, setting up alerts.
4. Deployment knowledge on cloud. Integrate CI/CD pipeline to build artifacts and deploy changed to higher Environments.
5. Scheduling frame works Airflow, AWS Step functions
6. Excellent Communication skills, should be able to work collaboratively with other teams
Requirements
Education:
- Bachelor's Degree (preferred)
Locations: Toronto ON, Atlanta GA and Remote.