Technology Lead | Cloud Platform | Amazon Webservices DevOps

Ipolarity LLC

Saint Louis, MO

JOB DETAILS
SKILLS
Amazon Web Services (AWS), Apache Kafka, Artificial Intelligence (AI), Artificial Intelligence (AI) Agents, Brokerage, Capacity Management, Cloud Computing, Data Management, Data Processing, Database Architecture, DevOps, Distributed Computing, Docker, Documentation Standards, GCP (Good Clinical Practices), Identify Issues, Java, Kernel Programming, Microservices, Microsoft Windows Azure, Performance Tuning/Optimization, Productivity Model, Python Programming/Scripting Language, REST (Representational State Transfer), Risk, Software Patches, Technical Leadership, Time Tracking, Web Services
LOCATION
Saint Louis, MO
POSTED
5 days ago

Job Title: Kafka Expert with Agentic AI Skills
Work Location: Saint LouisMO63131
Vendor Rate: 66.50
Contract duration: 12
Target Start Date: 08 Jul 2026
Does this position require Visa independent candidates only? YES
**face to face is mandatory for Interview**
**Onsite work set-up**

Job Details:

Detailed Job Description

Must Have Skills::
Apache Kafka Expertise
Strong hands-on experience with Apache Kafka (Kafka Streams, Kafka Connect, Brokers)
Designing, implementing, and managing Kafka-based streaming architectures
Performance tuning, scalability, and reliability of Kafka clusters
Agentic AI / Generative AI
Hands-on experience with Agentic AI frameworks and LLM orchestration tools (e.g., LangChain, AutoGen, CrewAI, Semantic Kernel)
Experience building autonomous AI workflows, agents, and AI-driven decision systems
Architecture & Integration
Strong knowledge of event-driven architecture
Experience with microservices architecture and real-time data processing
Real-Time Data Engineering
Developing, optimizing, and maintaining real-time streaming/data pipelines
Troubleshooting and monitoring high-volume data streams


Nice to Have Skills:

Cloud platform experience (Azure, AWS, or GCP)

Experience with real-time analytics platforms and monitoring tools

Grafana
Prometheus
ELK Stack
Datadog
Splunk

Experience with containerization and orchestration

Docker
Kubernetes

Exposure to MLOps or AI deployment pipelines

Experience integrating Kafka with cloud-native data services

Knowledge of vector databases and RAG architectures

Experience working in large-scale enterprise environments



Job Description

Job Title: Kafka Expert with Agentic AI Skills

Role Summary:

Seeking a Kafka expert with experience in Agentic AI to design, build, and optimize real-time data pipelines and intelligent autonomous systems.

Key Responsibilities:

Design and manage Kafka-based streaming architectures
Develop and optimize real-time data processing pipelines
Build and integrate Agentic AI solutions (LLMs, autonomous workflows)
Ensure scalability, reliability, and performance of data systems
Collaborate with AI, data, and engineering teams

Required Skills:

Strong experience with Apache Kafka (Streams, Connect, brokers)
Proficiency in Python/Java and distributed systems
Hands-on experience with Agentic AI / LLM frameworks (e.g., LangChain, AutoGen)
Knowledge of event-driven architecture and microservices

Good to Have:

Cloud platforms (Azure/AWS/GCP)
Experience with real-time analytics and monitoring tools


Minimum years of experience
5-8 years

Certifications Needed :No

Top 3 responsibilities you would expect the Subcon to shoulder and execute
Hardware refresh plan capacity model, sizing, architecture diagrams,
consumer group strategies for performance and cost.Own upgrades, patches, and migrations.Implement and manage Kafka components Kafka Connect, Schema Registry, MirrorMakerConfluent Replicator, REST Proxy familiarity with Kafka Streams and ksqlDB is a plus.Performanc
risk registerImplement and validated onprem clusters on refreshed hardware with performance benchmarksOperational documentation standards, runbooks, monitoringalerts

Interview Process (Is face to face required?)
Yes

Any additional information you would like to share about the project specs/ nature of work

Project Code: CHC WO for CFOBI

About the Company

I

Ipolarity LLC