We are seeking an experienced AI/LLM Software Engineer to design, develop, and deploy enterprise-grade AI applications, assistants, agents, and intelligent workflows. The ideal candidate will have strong hands-on Python and software engineering experience combined with practical expertise in LLMs, RAG, agentic AI, orchestration frameworks, tool integration, and AI observability. This is a highly collaborative, stakeholder-facing role requiring the ability to translate business requirements into secure, scalable, and production-ready AI solutions. Key Responsibilities
Design and develop enterprise AI/LLM applications, assistants, agents, and intelligent workflows.
Build scalable and production-ready solutions using Python and modern software engineering practices.
Develop agentic AI workflows using frameworks such as LangGraph or similar orchestration technologies.
Implement tool integrations using MCP/FastMCP or comparable protocols and frameworks.
Build and integrate REST APIs, enterprise systems, databases, and SQL-based solutions.
Develop RAG (Retrieval-Augmented Generation) solutions using structured and unstructured data sources.
Implement AI evaluation, monitoring, tracing, and observability using tools such as LangSmith, Weights & Biases (W&B), OpenTelemetry, or similar platforms.
Establish mechanisms to evaluate LLM accuracy, reliability, latency, cost, and overall application performance.
Incorporate Human-in-the-Loop (HITL) processes into AI workflows where appropriate.
Apply principles of AI governance, responsible AI, privacy, security, and compliance throughout the development lifecycle.
Collaborate directly with business stakeholders, product teams, architects, and engineering teams to identify opportunities and deliver AI solutions.
Act as a forward-deployed engineer, working closely with stakeholders to understand problems, prototype solutions, gather feedback, and rapidly iterate.
Troubleshoot, optimize, and continuously improve AI applications in production environments.
Contribute to technical documentation, architecture decisions, development standards, and best practices.
Required Qualifications
5–8 years of professional software engineering experience.
Strong hands-on experience with Python and software development.
Demonstrated experience building AI/LLM-powered applications in enterprise or production environments.
Experience developing AI assistants, agents, agentic workflows, or LLM applications.
Hands-on experience with MCP/FastMCP or similar tool-integration technologies.
Experience with LangGraph or comparable AI/agent orchestration frameworks.
Strong understanding of APIs, SQL, databases, and enterprise system integration.
Experience implementing RAG solutions using structured and/or unstructured data.
Experience with LLM evaluation, monitoring, tracing, or observability tools such as LangSmith, W&B, OpenTelemetry, or similar.
Understanding of authentication, authorization, secure data access, and enterprise security practices.
Strong understanding of AI governance, responsible AI, privacy, security, and Human-in-the-Loop concepts.
Excellent communication and stakeholder-management skills.
Ability to work directly with customers/business stakeholders in a forward-deployed engineering capacity.
Preferred Qualifications
Experience working with major LLM platforms and APIs such as OpenAI, Azure OpenAI, Anthropic, or similar.
Experience with vector databases, embeddings, semantic search, and retrieval pipelines.
Experience deploying AI applications in cloud environments such as Azure, AWS, or GCP.
Familiarity with CI/CD, Git, containers, and modern DevOps practices.
Experience building enterprise-grade AI solutions with strong emphasis on security, scalability, reliability, and governance.
Experience working in consulting, professional services, or customer-facing engineering environments.
Key Technologies Python | LLMs | Generative AI | AI Agents | AI Assistants | MCP / FastMCP | LangGraph | RAG | APIs | SQL | Databases | LangSmith | W&B | OpenTelemetry | Authentication | Authorization | AI Governance | Responsible AI | HITL | Enterprise Integration
Powered by JazzHR
Numbers & Facts
Location
Rutherford, NJ
Website
https://www.inabia.com/
Skills
Access Authorizationunmatched
Application Programming Interface (API)unmatched
Artificial Intelligence (AI)unmatched
Artificial Intelligence (AI) Agentsunmatched
Authenticationunmatched
Best Practicesunmatched
Business Skillsunmatched
Communication Skillsunmatched
Consultingunmatched
Continuous Deployment/Deliveryunmatched
Continuous Improvementunmatched
Continuous Integrationunmatched
Customer Relationsunmatched
DevOpsunmatched
Engineeringunmatched
Enterprise Protectionunmatched
Gitunmatched
Identify Issuesunmatched
Information/Data Security (InfoSec)unmatched
MCP - Microsoft Certified Professionalunmatched
Microsoft Windows Azureunmatched
Privacy Controlsunmatched
Product Lifecycleunmatched
Production Systemsunmatched
Professional Servicesunmatched
Prototypingunmatched
Python Programming/Scripting Languageunmatched
REST (Representational State Transfer)unmatched
Requirements Managementunmatched
SQL (Structured Query Language)unmatched
SQL Databasesunmatched
Scalable System Developmentunmatched
Semantic Searchunmatched
Software Agentsunmatched
Software Designunmatched
Software Developmentunmatched
Software Engineeringunmatched
Structured Dataunmatched
System Integration (SI)unmatched
Team Playerunmatched
Technical Writingunmatched
Unstructured Dataunmatched
🎯
Be found by employers
5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.
Level up your application
Professional resume templates
Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.