Sign upLog in
Fashion Jobs in Jersey City, NJ

AI Foundational Model Engineer

Kasmo Inc

Jersey City, NJ

Apply
JOB DETAILS
SKILLS
Amazon Web Services (AWS), Application Programming Interface (API), Artificial Intelligence (AI), Authentication, Bank Management, Banking Services, Blueprints, Business Case, Cloud Architecture, Cloud Computing, Computer Security, Continuous Deployment/Delivery, Continuous Improvement, Continuous Integration, Data Modeling, Decision Support, DevOps, Financial Compliance, Financial Operations, Information/Data Security (InfoSec), Know Your Customer (KYC), Management Strategy, Production Support, Production Systems, Release Management/Engineering, Risk, Sales Pipeline, Software Engineering, Telemetry, Underwriting, Use Cases, User Interface/Experience (UI/UX)
LOCATION
Jersey City, NJ
POSTED
Today


Description:
This role requires working onsite 4 days per week, and a F2F interview at the client s Jersey City location is mandatory.
Only USCs/GCs are eligible
AI Foundation Model Engineer
LLM / Agentic AI / Full-Stack AI Engineering
Level
Senior Individual Contributor
Target / alternate titles
LLM Engineer; GenAI Engineer; Machine Learning Engineer - LLM; AI Platform Engineer; NLP Engineer; Applied ML Engineer; RAG Engineer
Core keywords
LLM, GenAI, RAG, embeddings, vector database, LangChain, LlamaIndex, Hugging Face, PyTorch, AWS Bedrock, SageMaker, OpenSearch, Kubernetes, Docker, Terraform, CI/CD, MLOps, LLMOps, model serving
Recruiter red flags
Only notebook or prototype experience; no AWS/cloud deployment ownership; weak API engineering; no Terraform/IaC or pipeline exposure; cannot explain evaluation, security, or rollback controls.
Role purpose
Design, build, deploy, and optimize enterprise-grade AI systems powered by foundation models, LLMs, retrieval-augmented generation, and agentic workflows. The role converts AI concepts into secure, scalable, observable, and supportable production systems on the enterprise AI-ready platform (AIRP), which is currently AWS-hosted while following a cloud-agnostic architecture blueprint.
Client-specific emphasis
Hands-on AWS AI and cloud engineering is a major asset because AIRP currently runs on AWS.
Candidates should be comfortable working with Terraform/IaC and CI/CD teams to move AI services and infrastructure through controlled deployment pipelines.
Experience should map to business AI use cases such as KYC, credit underwriting, pitch book generation, Banker 360, Customer 360, deal library intelligence, financial crime quality, and sanctions screening.
Primary ownership
Production LLM applications, RAG pipelines, AI services, and model-serving integrations for AIRP.
End-to-end LLMOps/MLOps lifecycle from experimentation to deployment, monitoring, evaluation, rollback, and continuous improvement.
Reusable AI service components, APIs, prompts, retrieval logic, and observability patterns that can be federated across multiple business use cases.
Key responsibilities
Design and implement LLM-powered applications such as knowledge assistants, document intelligence solutions, workflow agents, summarization tools, and decision-support systems.
Build RAG pipelines using embeddings, chunking strategies, vector databases, semantic retrieval, reranking, response grounding, and citation patterns.
Integrate AI capabilities with AWS-hosted platform components, including model APIs, model gateways, data services, container platforms, and enterprise authentication patterns.
Collaborate with cloud engineering teams on Terraform modules, IaC templates, environment promotion, CI/CD pipelines, release controls, and rollback procedures.
Adapt and optimize models using LoRA, PEFT, instruction tuning, distillation, transfer learning, quantization, and domain adaptation techniques where appropriate.
Optimize inference workloads for latency, throughput, token efficiency, cost, reliability, and user experience.
Implement model and application observability, including prompt logs, retrieval quality, hallucination indicators, drift signals, feedback loops, cost telemetry, and service health.
Embed security, privacy, Responsible AI, and model risk controls into AI application design and delivery.
Create production documentation, runbooks, release notes, test evidence, and audit-ready implementation records.
Must-have candidate profile
7+ years in AI/ML engineering, platform engineering, software engineering, or applied machine learning.
Hands-on experience with LLMs, transformers, embeddings, RAG, semantic search, and GenAI application patterns.
Strong Python engineering skills with PyTorch, TensorFlow, Hugging Face, LangChain, LlamaIndex, Semantic Kernel, or equivalent frameworks.
Experience deploying production AI services using APIs, containers, Kubernetes, CI/CD, cloud-native services, and monitoring platforms.
Practical exposure to AWS AI/cloud services or comparable cloud-native AI deployment experience, with ability to ramp quickly on AWS-hosted AIRP patterns.
Working knowledge of Terraform/IaC, DevOps pipelines, release management, model evaluation, inference optimization, and secure data handling.
Preferred experience
Banking, risk, compliance, financial crime, operations, or enterprise technology background.
Experience with AWS Bedrock, SageMaker, OpenSearch, Kendra, Lambda, EKS/ECS, Azure OpenAI, Vertex AI, Databricks, vLLM, Triton, MLflow, Kubeflow, or model gateways.
Exposure to cloud-agnostic application patterns, reusable IaC modules, model risk, AI governance, audit controls, AI cost governance, and private or open-source LLM deployments.
Initial screening questions
Describe a production LLM or RAG system you built. What was your role and what changed after launch?
Which AWS AI or cloud services have you used for production AI delivery, and what design trade-offs did you make?
How have you worked with Terraform, IaC modules, or CI/CD pipelines to deploy AI services?
How did you evaluate groundedness, hallucination rate*** retrieval quality, latency, and cost?
How did you secure sensitive data and prevent leakage in the AI pipeline?
What observability and rollback mechanisms did you implement?

About the Company

K

Kasmo Inc

Resume Resources

Free Resume TemplatesFree Resume Builder

Similar Job Searches

Luxury Brands Jobs in Jersey City, NJPersonal Stylist Jobs in Jersey City, NJTailor Jobs in Jersey City, NJModel Jobs in Hoboken, NJModel Jobs in Trinity, NYModel Jobs in Newark, NJModel Jobs in New York City, NYRemote Retail JobsEntry Level Retail Jobs