Job Title: AI Prompt Engineer Experience: 2 Years Location: Whippany , NJ ( 3 days onsite)
Salary – 120K (But don't stop on the salary part)
Role Overview
We are seeking an innovative and detail-oriented AI Prompt Engineer to design, optimize, and evaluate prompts for Generative AI and Large Language Model (LLM) applications. The ideal candidate will work closely with business stakeholders, data scientists, AI engineers, and product teams to develop high-quality prompts that improve AI accuracy, reliability, and user experience across enterprise use cases.
Key Responsibilities
Design, develop, test, and refine prompts for LLMs such as GPT /Claude .
Create prompt engineering best practices for enterprise applications.
Evaluate model outputs and continuously optimize prompts for accuracy, relevance, safety, and performance.
Develop prompt libraries, prompt chains, and AI agent workflows.
Work with RAG (Retrieval Augmented Generation), vector databases, and knowledge management systems to improve contextual responses.
Monitor AI application performance and implement prompt improvements based on user feedback.
Document prompt engineering methodologies, testing results, and governance standards.
Required Skills
Strong understanding of Generative AI, LLMs, and Prompt Engineering concepts.
Hands-on experience with OpenAI/ Anthropic Claude or similar AI platforms.
Knowledge of prompt patterns such as:
Zero-shot
Few-shot
Chain-of-Thought (CoT)
Tree-of-Thought (ToT)
ReAct
Role-based prompting
Experience with Python and AI development frameworks.
Familiarity with any of the frameworks like LangChain, LangGraph, LlamaIndex, Semantic Kernel, or equivalent frameworks.
Understanding of RAG architectures and vector databases such as Pinecone etc
Strong analytical and problem-solving skills.
Excellent communication and documentation abilities.