Applied AI Engineer

Lancesoft

New York, NY

JOB DETAILS
SALARY
$77.30
SKILLS
Artificial Intelligence (AI), Auditing, Content Delivery/Distribution, Cross-Functional, Data Management, Data Quality, Embedded Systems, Engineering, Enterprise Protection, Failure Analysis, Fixed Income Investments, Identify Issues, Java, Loans, Metadata, Metrics, Normalized Discounted Cumulative Gain (NDCG), Open Source, Production Systems, Programming Tools, Python Programming/Scripting Language, Quality Metrics, React.js, Regression Testing, Search Engine Optimization (SEO), Shallow Parsing, System Operations, Traceability, User Interface/Experience (UI/UX)
LOCATION
New York, NY
POSTED
25 days ago
Applied AI Engineer
Hybrid 3 days
In- person Interview

 Description:
We are seeking senior hands-on full stack engineers who have designed, built, and operated GenAI systems in production, and understand failure modes, evaluation, and governance as first class AI-powered systems. What Youll Do Design and evolve reusable GenAI workflows used across Lending business lines.
Develop an enterprise grade AI-based document ingestion and data extraction capability, including traceability, confidence scoring, and human-in-the-loop review. Build AI-powered assistants embedded in Lending systems using agentic workflows. Deliver automated content and deck generation workflows for reporting and approvals. Provide expert advice on GenAI architecture including model selection, orchestration patterns, and evaluation strategy. Establish LLMOps practices: extraction accuracy, assistant reliability, prompts management, and audit monitoring. Design and implement controls for entitlements, PII handling within open-source models in a regulated environment. In the role you are expected to act as a hands-on technical expert, and it has a clear path to becoming a platform owner responsible for shared GenAI standards across Lending.
 
Role Overview
We are seeking a highly skilled Senior GenAI Engineer to design, build, and operate enterprise-grade Generative AI platforms. This role requires hands-on expertise in GenAI orchestration frameworks, LLMOps practices, and advanced retrieval systems, with a focus on delivering reliable, scalable, and production-ready AI solutions.

Key Responsibilities
  • Design and implement GenAI orchestration frameworks for enterprise-scale applications.
  • Build and maintain production-grade LLM platforms with robust reliability and observability.
  • Develop advanced retrieval pipelines and optimize vector search strategies.
  • Establish LLMOps practices including evaluation, regression testing, and prompt management.
  • Collaborate with cross-functional teams to integrate GenAI solutions into business workflows.
  • Troubleshoot and mitigate production issues related to GenAI systems.

What You’ll Bring
  • 2+ years of dedicated experience applying GenAI solutions in enterprise environments.
  • Proven ability to design and operate GenAI orchestration frameworks in production (e.G., LangChain systems).
  • 5+ years of engineering experience with AI/ML platforms and workflows (Python or Java).
  • Hands-on experience building and operating production-grade GenAI/LLM platforms, applying patterns such as RAG, tool/function calling, agentic workflows, and validated structured outputs.
  • Strong LLMOps expertise: evaluation harnesses, prompt/version management, regression testing, observability, and reliability measurement.
  • Experience building AI-first data ingestion pipelines with measurable quality, accuracy, and reliability.
  • Advanced retrieval expertise: vector search (multi-vector, late interaction approaches like ColBERT, chunking), multi-stage retrieval pipelines, metadata filtering, reranking.
  • Solid understanding of evaluation metrics (recall vs precision, latency vs quality, MRR, NDCG) and their impact on RAG system design.
  • Experience operating GenAI systems through real production failures (model regressions, retrieval degradation, prompt drift, data quality issues) and designing mitigation strategies.
Nice to Have
  • Domain experience in Fixed Income or Institutional Lending.
  • Experience working in regulated environments with strong audit and control requirements.
  • Familiarity with enterprise security, data governance, and entitlement models.
  • Experience designing reusable internal platforms or shared developer tooling.
  • Frontend development experience (Angular or React)

About the Company

L

Lancesoft

We are a $125 Million, NMSDC-certified Minority & Woman owned Workforce Solutions Company headquartered in the DC metro area with presence across US with global presence - Canada, Mexico, India, UK, Malaysia, Indonasia, Hongkong, Singapore, UAE. We are specialized in providing Workforce Solutions, SOW project delivery, Engineering Solutions, Creative Services. We currently support 100+ Fortune companies globally and across multiple industry segments. We are currently supporting several massive programs across industry segment nationally/globally (Intel, Ally, AMD, QUALCOMM, Morgan Stanley, Kraft/ Mondelez, MNP, Amdocs, Dell, SanDisk, Medtronic, Becton Dickinson, GE, Lockheed Martin, UTC, L-3 Communications, Caterpillar, BMW, Mercedes Benz, National Grid, Dominion, Energy Future Holdings, PSEG, 3M, Fidelity, Aetna, Humana, Johnson & Johnson, Pfizer, Merck etc). 

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender, identity, national origin, disability, or protected veteran status.

COMPANY SIZE
2,000 to 2,499 employees
INDUSTRY
Staffing/Employment Agencies
FOUNDED
2000
WEBSITE
http://www.lancesoft.com/