Job Description
Job Title: AI Gateway Engineer - Platform & Identity Access Management (IAM)
Location: Milpitas, CA (Onsite)
Position Summary
We are seeking an experienced AI Gateway Engineer to design, implement, secure, and operate enterprise AI Gateway platforms that enable governed access to Large Language Models (LLMs), AI agents, foundation models, and AI services across hybrid and cloud environments.
The ideal candidate will have strong expertise in AI Platforms, API Gateways, IAM, OAuth/OIDC, Enterprise Security, AI Governance, Kubernetes, and Cloud Architecture, ensuring secure, scalable, and compliant AI consumption across the organization. The role will focus on AI traffic management, model access control, agent security, policy enforcement, observability, and responsible AI controls.
Key Responsibilities
AI Gateway Platform Engineering
Identity & Access Management (IAM)
AI Security & Governance
Cloud & Platform Engineering
Observability & Monitoring
DevSecOps & Automation
Required Qualifications
Education
Experience
Technical Skills
AI Technologies
Preferred Certifications
AI & Cloud
Key Competencies
Target Profile
This role is ideal for professionals currently working as:
Location: Milpitas, CA (Onsite)
Position Summary
We are seeking an experienced AI Gateway Engineer to design, implement, secure, and operate enterprise AI Gateway platforms that enable governed access to Large Language Models (LLMs), AI agents, foundation models, and AI services across hybrid and cloud environments.
The ideal candidate will have strong expertise in AI Platforms, API Gateways, IAM, OAuth/OIDC, Enterprise Security, AI Governance, Kubernetes, and Cloud Architecture, ensuring secure, scalable, and compliant AI consumption across the organization. The role will focus on AI traffic management, model access control, agent security, policy enforcement, observability, and responsible AI controls.
AI Gateway Platform Engineering
- Design and implement enterprise AI Gateway platforms for GenAI, Agentic AI, and LLM workloads.
- Build and manage centralized ingress and egress gateways for AI applications, agents, MCP servers, and external AI services.
- Develop AI traffic routing, model orchestration, load balancing, failover, and request governance capabilities.
- Implement model abstraction layers supporting multiple AI providers including OpenAI, Azure OpenAI, Anthropic, Google Gemini, AWS Bedrock, and private models.
- Design multi-tenant AI platform architectures for enterprise consumption.
- Establish AI service onboarding standards and platform governance processes.
- Design AI-specific authentication and authorization frameworks.
- Implement OAuth2, OpenID Connect (OIDC), SAML, JWT, API keys, and service-account-based access controls.
- Configure RBAC and ABAC policies for AI applications and agents.
- Integrate AI platforms with:
- Microsoft Entra ID (Azure AD)
- Okta
- Ping Identity
- CyberArk
- AWS IAM
- Google Cloud IAM
- Design least-privilege access models for agents, tools, and AI services.
- Implement agent identity and machine-to-machine authentication mechanisms.
- Manage secret handling, token lifecycle, certificate rotation, and privileged access controls.
- Implement enterprise AI Guardrails and Responsible AI controls.
- Configure protections for:
- Prompt Injection
- Jailbreak Attacks
- Malicious URL Detection
- Data Leakage Prevention
- Sensitive Data Masking
- PII Detection
- Content Moderation
- Design AI security policies using Policy-as-Code and Governance-as-Code methodologies.
- Establish model access governance, agent authorization, and inference authorization mechanisms.
- Support compliance frameworks including:
- NIST AI RMF
- NIST CSF
- ISO 27001
- SOC2
- GDPR
- HIPAA
- Conduct AI threat modeling and risk assessments.
- Build and manage AI platform infrastructure on:
- Azure
- AWS
- Google Cloud Platform
- Deploy and manage Kubernetes-based AI environments.
- Develop Infrastructure as Code using:
- Terraform
- CloudFormation
- Helm
- Automate AI platform provisioning and governance controls.
- Implement CI/CD pipelines for AI platform deployment and policy validation.
- Support highly available and scalable AI runtime environments.
- Implement AI platform observability frameworks.
- Monitor:
- Model utilization
- Latency
- Cost
- Token Consumption
- Security Violations
- Agent Activities
- Build dashboards using:
- Grafana
- Prometheus
- Splunk
- Datadog
- Azure Monitor
- CloudWatch
- Develop audit and compliance reporting mechanisms.
- Establish AI operational metrics and SLOs.
- Integrate security controls into AI delivery pipelines.
- Implement:
- SAST
- DAST
- SCA
- Container Security
- IaC Security Validation
- Automate AI policy enforcement and compliance checks.
- Support software supply chain security and AI BOM/SBOM validation.
- Build reusable platform automation frameworks and reference architectures.
Education
- Bachelor's or Master's degree in:
- Computer Science
- Information Technology
- Engineering
- Cybersecurity
- Related discipline
- 7+ years in Platform Engineering, Cloud Engineering, Security Engineering, or IAM.
- 3+ years in AI/GenAI platform implementation.
- Experience deploying enterprise AI solutions in production environments.
- Strong exposure to secure software development and cloud-native architectures.
AI Technologies
- Large Language Models (LLMs)
- RAG Architectures
- AI Agents
- MCP Frameworks
- Prompt Engineering
- Vector Databases
- AI Gateway Platforms
- AI Guardrails
- Model Governance
- OAuth2
- OIDC
- SAML
- JWT
- RBAC
- ABAC
- Zero Trust Architecture
- PAM Solutions
- Secrets Management
- Azure
- AWS
- GCP
- Microsoft Entra ID
- AWS IAM
- Google Cloud IAM
- Okta
- PingFederate
- CyberArk
- Kubernetes
- Docker
- Terraform
- Helm
- GitHub Actions
- Azure DevOps
- Jenkins
- Python
- Go
- Java
- PowerShell
- Shell Scripting
AI & Cloud
- Microsoft Certified: Azure AI Engineer Associate
- Google Professional Cloud AI Engineer
- AWS Machine Learning Specialty
- Microsoft AI Engineer
- CISSP
- CCSP
- Certified Identity & Access Manager (CIAM)
- CyberArk Defender/Sentry
- Certified Kubernetes Administrator (CKA)
- Terraform Associate
- AWS Solutions Architect Professional
- Azure Solutions Architect Expert
- Enterprise Architecture
- AI Governance
- Platform Engineering
- Security Design
- Identity Architecture
- Stakeholder Management
- Problem Solving
- Automation Mindset
- Risk Assessment
- Technical Leadership
This role is ideal for professionals currently working as:
- AI Platform Engineer
- GenAI Platform Engineer
- Cloud Platform Engineer
- IAM Engineer
- Identity Architect
- API Gateway Engineer
- Security Platform Engineer
- AI Security Engineer
- DevSecOps Engineer
- Kubernetes Platform Engineer
Numbers & Facts
| Location | Milpitas, CA |
| Industry | Computer Software |
| Company Size | 20 to 49 employees |
| Year Founded | 2014 |
| Website | http://www.tekfortune.com/ |
About Company
Tekfortune is a software solutions company providing project development and staff augmentation services to companies in various industries including Healthcare, Banking, Finance, Telecommunication and Aviation.
Tekfortune Inc delivers solutions to a wide variety of organizations of various sizes and industries. Our clients include mid-market to Fortune 1000 companies spanning across industries such as: Insurance, Financial, Pharmaceutical, Manufacturing, Retail and many others.
In Tekfortune Inc, we are offering selection of services and solutions at very reasonable rates. With years of experience in the placement and recruitment Industry and over time we have acquired the knowledge essential to comprehend the exact need and dependence on customers. Therefore we provide the customers the best and also the brightest candidates for vacancies. Moreover, by understanding the working interest of customers who is able to place them within the companies where they are able to get maximum opportunity for professional growth.
Tekfortune Inc has a strong emphasis on quality. Its goal would be to achieve client satisfaction by looking into making deliveries satisfaction of customer's business needs. Our ability to quickly identify and effectively employ proven fundamental principles, techniques and resources yields highly desirable results for our clients.
We understand that each industry and organization share a level of uniqueness that requires a tailored approach in order to deliver specific solutions. Such factors as client culture, industry regulations, organizational maturity, financial health and many more items may impact our approach to delivering client solutions.
Having served a wide variety of clients has provided Tekfortune the ability to build subject matter expertise across numerous industries. Our industry expertise combined with our specialized knowledge of Business Process Improvement, Requirements Management and Program & Project Management provides a powerful combination and a tremendous value to our clients.
We are run by a group of industry experts who have decades of experience in delivering custom solutions to our clients.
Tekfortune Inc delivers solutions to a wide variety of organizations of various sizes and industries. Our clients include mid-market to Fortune 1000 companies spanning across industries such as: Insurance, Financial, Pharmaceutical, Manufacturing, Retail and many others.
In Tekfortune Inc, we are offering selection of services and solutions at very reasonable rates. With years of experience in the placement and recruitment Industry and over time we have acquired the knowledge essential to comprehend the exact need and dependence on customers. Therefore we provide the customers the best and also the brightest candidates for vacancies. Moreover, by understanding the working interest of customers who is able to place them within the companies where they are able to get maximum opportunity for professional growth.
Tekfortune Inc has a strong emphasis on quality. Its goal would be to achieve client satisfaction by looking into making deliveries satisfaction of customer's business needs. Our ability to quickly identify and effectively employ proven fundamental principles, techniques and resources yields highly desirable results for our clients.
We understand that each industry and organization share a level of uniqueness that requires a tailored approach in order to deliver specific solutions. Such factors as client culture, industry regulations, organizational maturity, financial health and many more items may impact our approach to delivering client solutions.
Having served a wide variety of clients has provided Tekfortune the ability to build subject matter expertise across numerous industries. Our industry expertise combined with our specialized knowledge of Business Process Improvement, Requirements Management and Program & Project Management provides a powerful combination and a tremendous value to our clients.
We are run by a group of industry experts who have decades of experience in delivering custom solutions to our clients.
Skills
Level up your application
Professional resume templates
Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.
Free resume templatesResume Builder
Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.
Resume Builder