data engineer

Intellisoft Technologies, Inc.

Austin, TX(remote)

JOB DETAILS
SKILLS
Agile Programming Methodologies, Amazon Web Services (AWS), Apache, Bash Scripting, Best Practices, Cloud Computing, Communication Skills, Continuous Deployment/Delivery, Continuous Integration, Data Analysis, Data Management, Data Modeling, Data Processing, Data Science, Data Sets, Database Extract Transform and Load (ETL), Git, Information/Data Security (InfoSec), MySQL, Needs Assessment, Oracle PL-SQL, Performance Analysis, Performance Tuning/Optimization, Problem Solving Skills, Process Flow, Process Improvement, Python Programming/Scripting Language, Relational Databases (RDBMS), SQL (Structured Query Language), Schedule Development, Snowflake Schema, Source Code/Configuration Management (SCM), Time Management, Transformation Tools, Unix Shell Programming
LOCATION
Austin, TX
POSTED
30+ days ago
Role: Data Engineer with snowflake, vertica, ETL, MySQL, Airflow
Location: Remote
Duration: 6 months


Responsibilities:
  • Design and implement robust ETL/ELT pipelines to ingest, transform, and load data from various sources.
  • Work with relational and columnar databases including MySQL, PL/SQL, and Vertica to manage large datasets.
  • Develop and schedule data workflows using Shell/Bash scripting and Python.
  • Build and maintain data pipelines on Snowflake using ELT best practices.
  • Collaborate with data analysts, data scientists, and other stakeholders to understand data needs.
  • Optimize existing processes for scalability and performance.
  • Use tools like Airflow, Fivetran, and DBT for orchestration, transformation, and data movement.
  • Monitor data pipeline performance and resolve issues in a timely manner.
  • Document processes, data flows, and technical architecture.

Required Skills & Qualifications:
  • Good experience in ETL/ELT development.
  • Strong experience with MySQL and PL/SQL.
  • Hands-on experience with Vertica and Snowflake.
  • Proficient in Shell/Bash scripting and Python.
  • Solid understanding of data modeling and SQL performance tuning.
  • Familiarity with DBT (Data Build Tool) for transformation workflows.
  • Basic knowledge of Fivetran and Apache Airflow.
  • Experience working in an Agile environment.
  • Excellent problem-solving and communication skills.
  • Experience with Git version control.
  • Exposure to CI/CD pipelines for data engineering.
  • Knowledge of AWS cloud platforms.
  • Familiarity with data governance and security best practices

About the Company

I

Intellisoft Technologies, Inc.