Generative AI Systems Architect

EPAM Systems Inc

Atlanta, GA

JOB DETAILS
SKILLS
Amazon Web Services (AWS), Application Integration, Application Programming Interface (API), Artificial Intelligence (AI), Best Practices, Blueprints, Capacity and Performance Management, Cloud Architecture, Cloud Computing, Computer Science, Continuous Deployment/Delivery, Continuous Integration, Cross-Functional, DevOps, Docker, English Language, Enterprise Architecture, GCP (Good Clinical Practices), GitHub, Identity Data Management, Jenkins, MCP - Microsoft Certified Professional, Mentoring, Microsoft Windows Azure, Modeling Languages, Regulatory Compliance, Release Management/Engineering, Risk, Security Compliance, Strategic Planning, System Architecture
LOCATION
Atlanta, GA
POSTED
30+ days ago

Back to Search

Generative AI Systems Architect

Hybrid in Georgia, & 4 others

Systems Architecture

apply Facebook LinkedIn Send via email

Looking for something else? Find a vacancy that works for you. Send us your CV to receive a personalized offer.

Find a job

Location-specific conditions & benefits

Choose an option

We are seeking a skilled Generative AI Platforms Architect to lead and define the architecture for our enterprise GenAI platform.

The role involves creating reference architectures, guardrails, and roadmaps to deliver scalable and secure AI solutions-including LLMs, agentic applications, and tool integrations-across multiple clouds. By collaborating with engineering, security, data governance, and product teams, the Architect will translate business goals into platform designs and actionable delivery plans, while mentoring engineers and advocating for best practices in LLMOps/ModelOps.

Responsibilities

Design enterprise generative AI reference architectures, blueprints, and reusable patterns

Define multi-cloud platform foundations addressing networking, identity, and secrets management

Lead efforts in LLMOps/ModelOps, focusing on model evaluation, safety, observability, and rollout strategies

Create frameworks and governance for agentic systems, including tool governance and the Model Context Protocol (MCP)

Ensure systems comply with security, risk, and compliance standards, with Responsible AI principles and PII controls applied

Establish strategies for cost efficiency, reliability, and performance using capacity planning and FinOps techniques

Improve developer experience through CI/CD pipelines, golden paths, templates, and Infrastructure as Code (IaC) techniques

Collaborate with cross-functional teams to align system requirements with strategic objectives

Requirements

Bachelor's degree in Computer Science, Engineering, or related field, or equivalent experience

1+ years in architecture roles involving cloud, data, or production Generative AI/LLM systems

Knowledge of cloud platforms (Azure, AWS, GCP) and IaC tools (Terraform, Bicep, CDK, CloudFormation)

Competency in containerization and orchestration technologies (Docker, Kubernetes), as well as API gateways/service meshes

Proficiency in CI/CD and release management for ML/LLM workloads (Jenkins, GitHub Actions, GitLab CI, Azure DevOps)

Understanding of Large Language Model (LLM) platforms like Azure AI Foundry, Azure OpenAI, AWS Bedrock, or Google Vertex AI

Familiarity with security-by-design principles and compliance frameworks tailored to GenAI systems

Advanced proficiency in English (B2+/C1)

About the Company

E

EPAM Systems Inc