Want to know if you’re a fit? Upload your resume and let our AI show you.
Skills
Amazon Web Services (AWS)unmatched
Apacheunmatched
Application Programming Interface (API)unmatched
Code Reviewsunmatched
Computer Scienceunmatched
Data Managementunmatched
Data Modelingunmatched
Data Processingunmatched
Data Scienceunmatched
Database Extract Transform and Load (ETL)unmatched
Interpersonal Skillsunmatched
Linux Administrationunmatched
Microsoft SQL Serverunmatched
Microsoft Windows Azureunmatched
Microsoft Windows Serverunmatched
Microsoft Windows System Administrationunmatched
Oracle Databaseunmatched
Production Controlunmatched
Project/Program Managementunmatched
Prototypingunmatched
Python Programming/Scripting Languageunmatched
Quality Managementunmatched
REST (Representational State Transfer)unmatched
SQL (Structured Query Language)unmatched
Software Developmentunmatched
Team Buildingunmatched
Team Lead/Managerunmatched
Testingunmatched
Unix Shell Programmingunmatched
Description
Job Title: Senior Data Engineer
(This is not a Data Science role)
This is FTE role. Candidates who currently live within commutable distance from Waltham, MA or Long Island, NY will only be considered.
The company is aggressively transforming into a 21st century data-driven organization for its customers. We are building a team that will be responsible for Data Engineering and MLOps. The team will develop data pipelines, take data science prototype models to production, monitor operations and standup the necessary infrastructure in Azure to perform these functions.
Key Accountabilities
Work with data scientists to specify data requirements for data science projects.
Work with data owners to understand the data schema, the nature of data flow within the enterprise, and develop data dictionaries.
Develop a deep understanding of the ingested data from a business perspective.
Design robust, scalable, and maintainable data ingestion ETL/ELT pipelines.
Choose appropriate data models and ensure that ingested data is high quality.
Write high quality code that has high test coverage.
Participate in code reviews to help improve code quality.
Supervisory/Interpersonal- Experience Required
Experience in project management and stakeholder-based delivery.
Qualifications
Bachelor’s degree in a computer science or another quantitative field.
5+ years of experience in a Data Engineer role
Minimum of 5 years’ experience in advanced data processing and software development is desired.
Experience in deploying pipelines using Apache Airflow.
Proficient/expert level hands-on knowledge of shell scripting, Python, SQL, Azure, or AWS.
Experience in extracting data using REST APIs and from databases (Oracle, MSSQL)
Experience with Dockers and Kubernetes are pluses
Ideally, experience in administering Windows and/or Linux servers.