SDE III Gen AI

What You Will Be Doing

• Design and implement production-ready generative AI applications that serve millions of users, from initial architecture through deployment and monitoring
• Build advanced RAG (Retrieval-Augmented Generation) pipelines that combine vector databases, hybrid search, and intelligent caching to deliver sub-second response times
• Develop multimodal AI systems that seamlessly integrate text, vision, and audio capabilities using state-of-the-art models
• Architect scalable microservices that handle thousands of concurrent AI requests while optimizing for cost, latency, and reliability
• Lead code reviews and technical design sessions, establishing best practices and architectural patterns that elevate the entire team's capabilities
• Optimize large language models through fine-tuning techniques to achieve domain-specific performance improvements
• Implement comprehensive MLOps practices including automated testing, model versioning, A/B testing frameworks, and real-time monitoring dashboards
• Collaborate with product managers and stakeholders to translate complex business requirements into innovative AI solutions
• Deploy AI models across multiple cloud platforms (GCP) using containerization and orchestration technologies
• Create and maintain technical documentation, runbooks, and architectural decision records that enable knowledge sharing across teams
• Mentor junior engineers through pair programming, technical talks, and hands-on guidance to accelerate their growth
• Research and prototype emerging AI technologies to identify opportunities for competitive advantage

Gen AI Responsibilities

• Fine-tune and optimize state-of-the-art language models for specific business use cases, achieving significant improvements in accuracy and relevance
• Design multi-agent AI systems using frameworks to orchestrate complex workflows and decision-making processes
• Implement advanced prompt engineering strategies including Tree of Thoughts, ReAct patterns, and automatic prompt optimization to maximize model performance
• Build production-grade embedding systems that handle billions of vectors, implementing efficient indexing strategies and hybrid search capabilities
• Develop computer vision pipelines using models for tasks ranging from object detection to visual question answering
• Create secure AI applications with robust safeguards against prompt injection, jailbreaking, and data leakage while maintaining compliance with AI governance standards
• Optimize token usage and implement intelligent caching strategies to reduce costs by 50-70% while maintaining quality
• Design and implement evaluation frameworks that go beyond traditional metrics, incorporating human feedback loops and domain-specific quality measures
• Build real-time AI inference systems capable of processing streaming data with sub-100ms latency requirements
• Integrate multiple foundation models into unified applications, implementing fallback mechanisms and load balancing for high availability
• Develop custom tools and functions that extend LLM capabilities, enabling models to interact with databases, APIs, and external systems
• Implement advanced RAG techniques including contextual embeddings, cross-encoder reranking, and Graph RAG for complex reasoning tasks
• Create multimodal search systems that enable users to query across text, images, and documents using natural language
• Build AI-powered data processing pipelines that automatically extract, transform, and enrich unstructured data at scale
• Deploy edge AI solutions using frameworks like ONNX and TensorRT, optimizing models for resource-constrained environments

What We're Looking For

• 5+ years of hands-on experience building and deploying ML/AI systems, with at least 2+ years focused on generative AI and LLMs
• Expert-level Python programming skills with deep knowledge of async programming, multiprocessing, and performance optimization
• Strong experience with modern AI frameworks including PyTorch, Transformers, LangChain, and vector databases
• Proven track record of deploying AI applications to production environments serving real users at scale
• Deep understanding of transformer architectures, attention mechanisms, and the latest advances in generative AI
• Experience with cloud platforms (GCP) and containerization technologies (Docker, Kubernetes)
• Excellent communication skills with the ability to explain complex AI concepts to both technical and non-technical audiences
• Proven experience improving large-scale product search and discovery - including dense retrieval with bi-encoders, cross-encoder reranking, query understanding, and hybrid BM25 + vector search across catalogs of tens of millions of SKUs
• Hands-on experience building and deploying production multi-agent systems using orchestration frameworks such as LangGraph and Google ADK - designing stateful, tool-augmented agents for complex, real-world workflows
• Bachelor's degree in Computer Science, Mathematics, or related field (Master's preferred but not required with relevant experience)

Nice to Have

• Published research papers or significant contributions to open-source AI projects
• Experience with multimodal AI systems combining vision, language, and audio
• Domain expertise in specific verticals (healthcare, finance, legal, e-commerce)
• Knowledge of AI safety, alignment, and constitutional AI principles
• Experience building AI infrastructure and platforms used by other engineers
• Familiarity with emerging technologies like neural architecture search, mixture of experts, or neuromorphic computing