Senior Data Engineer

APN Consulting Inc

Monmouth Junction, NJ(remote)

JOB DETAILS
SKILLS
Artificial Intelligence (AI), Business Solutions, Cloud Computing, Consulting, Continuous Deployment/Delivery, Continuous Integration, Data Management, Data Sets, Debugging Skills, ERP (Enterprise Resource Planning), Enterprise Architecture, GitHub, Identify Issues, Manufacturing, Microsoft Product Family, Microsoft Windows Azure, Performance Tuning/Optimization, Problem Solving Skills, Process Improvement, Python Programming/Scripting Language, SQL (Structured Query Language), Scalable System Development, Scripting (Scripting Languages), ServiceNow, Software Engineering, Software Reuse, Technical Recruiting, Technical Writing, Unit Test
LOCATION
Monmouth Junction, NJ
POSTED
6 days ago
APN Consulting, Inc. is a progressive IT staffing and services company offering innovative business solutions to improve client business outcomes. We focus on high impact technology solutions in ServiceNow, Fullstack, Cloud & Data, and AI / ML. Due to our globally expanding service offerings we are seeking top-talent to join our teams and grow with us.

Title: Data Engineer
Location: Remote
Duration: 6 Months

Role Summary

Design, build, and operationalize scalable data pipelines and data products using a Python-based, code-first engineering approach , aligned to enterprise architecture, governance, and AI-readiness goals.
Key Responsibilities
  • Develop pipelines and transformations using Python (PySpark / notebooks / scripts)
  • Work within VS Code + GitHub development workflows
  • Build ingestion, transformation, and curated data layers aligned to medallion architecture
  • Integrate data from ERP, MES, OT, historian, and operational systems
  • Convert notebooks into production-grade, reusable components
  • Implement unit testing, logging, monitoring, and observability frameworks
  • Follow branching strategies, pull request processes, and CI/CD pipelines
  • Package reusable logic into shared modules and libraries
  • Enable creation of certified, semantic-ready data products
  • Optimize performance, troubleshoot failures, and ensure production reliability
  • Maintain technical documentation and operational runbooks
Required Skills
  • Strong proficiency in Python and PySpark-based data engineering
  • Experience with VS Code, GitHub, and code-based pipeline development
  • Strong experience with Azure Data Factory, Synapse, Microsoft Fabric, SQL
  • Understanding of:
    • Notebook vs. production pipeline design
    • Code modularization and reuse
  • Strong debugging, optimization, and problem-solving capabilities
Preferred Background
  • Manufacturing data experience
  • Exposure to AI-ready datasets, feature engineering, and data observability



We are committed to fostering a diverse, inclusive, and equitable workplace where individuals from all backgrounds feel valued and empowered to contribute their unique perspectives. We strongly encourage applications from candidates of all genders, races, ethnicities, abilities, and experiences to join our team and help us build a culture of belonging.

About the Company

A

APN Consulting Inc