Data Engineer – Pipeline Migration

Trispoke managed services
  • Fort Walton Beach, FL
  • $50.88 Per Hour
  • Instant Apply
13 days ago

Job Description

US Citizenship is required for this position

Data Engineer Pipeline Migration (Req.# 7695) Fort Walton Beach, FL

Pay Rate: $50.88/Hr on W2

Shift: 1st Shift , 08:00AM-04:00PM.

Position Description

We seek a pragmatic specialist to migrate existing analytical pipelines from Alteryx and R into Dataiku.

The focus is on executing validated, documented translations-not building platform extensions or innovating on tooling. Success = production-ready SQL/Dataiku pipelines handed off to internal teams with clear lineage and zero regression in business logic.

Key Responsibilities:

1. Pipeline Translation: Convert R (dplyr/data.table) and Alteryx workflows into modular, optimized SQL (CTEs, window functions, set-based logic) and/or Dataiku visual/SQL recipes-prioritizing correctness over elegance.

2. Cloud Warehouse Execution: Deploy/test translated logic on one primary cloud platform (Redshift or Snowflake or Athena)-no need for multi-cloud expertise.

3. Validation & Handoff: Run unit-style validation against source pipelines; document assumptions, lineage, and deployment steps for internal teams.

4. Knowledge Transfer: Conduct 2 3 focused sessions (max 1 hr each) walking data science/analytics team members through migrated pipelines and validation reports.

5. Documentation: Maintain a living wiki/OneNote page with transformation logic, test results, and known limitations-not formal data governance artifacts.

Skills Required:

1. Core SQL: Fluency in writing/optimizing queries (JOINs, CTEs, window functions) for cloud warehouses and traditional databases (Redshift/SQL Server).

2. Translation Ability: Proven track record converting R/Alteryx logic to SQL or equivalent experiences (KNIME, Informatica, etc).

3. Validation Mindset: Comfort building simple row-count/checksum tests to verify migration fidelity.

4. Clear Communication: Ability to explain technical steps to non-engineers and document assumptions plainly.

5. Self-Starter: Comfort working with minimal daily supervision; flags blockers early.

Skills Preferred:

1. Familiarity with Dataiku DSS interface (visual recipes, project structure)-learnable in < 1 week.

2. Exposure to DBT concepts (understands why modular SQL matters for handoff).

3. Experience with Git for version control (basic branching/PRs).

Experience Required:

2 4 years in data engineering with direct pipeline migration/replatforming experience (e.g., moved Alteryx to Dataiku; converted R to SQL/Python; packaged SQL to DBT, other equivalent experience).

Education Required:

Bachelor's degree in CS, IS, Data Engineering, or equivalent practical experience (e.g., 3+ years hands-on SQL/data pipeline work).

Education Preferred

Bachelor's degree in CS, IS, Data Engineering

.

.

.

.

.

#DataEngineer #DataEngineering #SQL #ETL #ELT #DataMigration #PipelineMigration #Replatforming #Alteryx #RProgramming #Snowflake #Redshift #AmazonAthena #Informatica #SSIS #DataValidation #DataQuality #Dataiku #dbt #Git #CloudDataEngineering #DataPipelines #SQLServer #AWS #CloudMigration #ETLDeveloper #AnalyticsEngineer #DataWarehouse

Numbers & Facts

LocationFort Walton Beach, FL

Skills

  • Analysis Skillsunmatched
  • Cloud Computingunmatched
  • Communication Skillsunmatched
  • Data Analysisunmatched
  • Data Managementunmatched
  • Data Scienceunmatched
  • Data Warehousingunmatched
  • Establish Prioritiesunmatched
  • Knowledge Transferunmatched
  • Logic Testingunmatched
  • Machine Toolunmatched
  • Microsoft SQL Serverunmatched
  • Python Programming/Scripting Languageunmatched
  • Query Optimizationunmatched
  • R Programming Languageunmatched
  • SQL (Structured Query Language)unmatched
  • Testingunmatched
  • Warehousingunmatched

Be found by employers

5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.

Level up your application

Professional resume templates

Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

Free resume templates

Free resume builder

Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

Free resume builder