On-Prem LLM Inference & GPU Systems Architect

NTT DATA North America

Charlotte, NC

JOB DETAILS
SKILLS
Artificial Intelligence (AI), Ecosystems, GPU (Graphics Processing Unit), System Architecture, Systems Engineering
LOCATION
Charlotte, NC
POSTED
Today

NTT DATA North America is seeking an On-Premise LLM Inference & GPU Systems Engineer in Charlotte, North Carolina. The role focuses on building and maintaining large-scale on-prem LLM infrastructure using NVIDIA H200 GPU clusters.Responsibilities include optimizing runtime efficiencies, managing inference serving, and overseeing the complete Hugging Face model lifecycle within the OpenShift AI ecosystem. Ideal candidates should have extensive experience with NVIDIA clusters and modern inference frameworks.#J-18808-Ljbffr

About the Company

N

NTT DATA North America