Our Client, a Waste Disposal company, is looking for a Sr. Data Engineer with AI for their Remote location.
Responsibilities:
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Cloud Integration ETL Tools, Cloud Data Warehouse, SQL, and AWS technologies understanding of REST API GraphQL.
Design and develop ELT, ETL, Event drivern data integration architecture solutions
Work with the Data Analysts, Data Architects, BI Architects, Data Scientists, and Data Product Owners to establish an understanding of source data and determine data transformation and integration requirements
Troubleshoot and tune complex SQL
Utilize On-Prem and Cloud-based ETL platforms, Cloud Datawarehouse, AWS, GitHub, various scripting languages, SQL, querying tools, data quality tools, and metadata management tools.
Develop data validation processes to ensure data quality
Demonstrated ability to work individually and as a part of the team in a collaborative manner
Requirements:
Bachelor's degree (or foreign equivalent) in Computer Science, Computer Engineering, or a related field.
8+ years of experience with Data Engineering, ETL, data warehouse/data mart development, data lake development
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Experience working with Cloud Datawarehouse like Snowflake, Google BigQuery, Amazon Redshift
Experience with AWS cloud services: EC2, S3, Lambda, SQS, SNS, etc.
Experience with Cloud Integration Tools like Matillion, Dell Boomi, Informatica Cloud, Talend, AWS Glue
Experience with GitHub and its integration with the ETL tools for version control
Experience with Informatica PowerCenter, various scripting languages, SQL, querying tools
Familiarity with modern data management tools and platforms including Spark, Hadoop/Hive, NoSQL, APIs, Streaming, and other analytic data platforms
Experience with object-oriented/object function scripting languages: Python, Java, Scala, etc., a plus.
Experience with Agile/Scrum is valuable.
Other Knowledge, Skills, or Abilities Required :
Must Speak English.
Ability to work with business as well as IT stakeholders.
Strong written and oral communication skills with the ability to work with users, peers, and management.
Strong interpersonal skills.
Ability to work independently and as part of a team to successfully execute projects.
Highly motivated, self-starter with problem-solving skills.
Ability to multitask and meet aggressive deadlines efficiently and effectively.
Extraordinary attention to detail and accuracy.
Why Should You Apply?
Health Benefits
Referral Program
Excellent growth and advancement opportunities
Numbers & Facts
Location
TX
Skills
AWS Lambdaunmatched
Agile Programming Methodologiesunmatched
Amazon Elastic Compute Cloud (EC2)unmatched
Amazon Simple Storage Service (S3)unmatched
Amazon Web Services (AWS)unmatched
Analysis Skillsunmatched
Apache Hadoopunmatched
Apache Hiveunmatched
Apache Sparkunmatched
Application Programming Interface (API)unmatched
Artificial Intelligence (AI)unmatched
Business Intelligenceunmatched
Cloud Computingunmatched
Communication Skillsunmatched
Computer Engineeringunmatched
Computer Scienceunmatched
Data Analysisunmatched
Data Lakeunmatched
Data Managementunmatched
Data Martunmatched
Data Processingunmatched
Data Qualityunmatched
Data Scienceunmatched
Data Warehousingunmatched
Database Extract Transform and Load (ETL)unmatched
Dell Computersunmatched
Detail Orientedunmatched
English Languageunmatched
GitHubunmatched
GraphQLunmatched
Health Planunmatched
Identify Issuesunmatched
Informaticaunmatched
Interpersonal Skillsunmatched
Javaunmatched
Metadataunmatched
Multitaskingunmatched
NoSQLunmatched
Object Oriented (OO)unmatched
Presentation/Verbal Skillsunmatched
Problem Solving Skillsunmatched
Python Programming/Scripting Languageunmatched
REST (Representational State Transfer)unmatched
Relational Databases (RDBMS)unmatched
SQL (Structured Query Language)unmatched
Scala Programming Languageunmatched
Scripting (Scripting Languages)unmatched
Scrum Project Management and Software Developmentunmatched