About the Team
The Seed Infrastructures team oversees the distributed training, reinforcement learning framework, high-performance inference, and heterogeneous hardware compilation technologies for AI foundation models.
Responsibilities
- Conduct research and engineering development on large-scale infrastructure to enable efficient pretraining of foundation models, multimodal LLMs, and video generation models
- Design and optimize distributed training strategies for model training, including parallelism schemes, computation and communication optimization, and throughput scaling on large GPU clusters
- Analyze performance bottlenecks in exascale training systems and propose principled, data-driven optimization methods
- Bridge cutting-edge research and large-scale production deployment by translating research ideas into scalable, real-world infrastructure solutionsMinimum Qualifications
- Bachelor's degree or above in Computer Science, Software Engineering or a related field, with 2+ years of experience in large-scale model training, distributed training systems, or GPU kernel optimization
- Solid understanding of large-scale training of LLMs and multimodal models
- Proven experience with parallelism strategies (e.g., data, pipeline, expert parallelism) on large GPU clusters, or GPU kernel performance optimization
- Strong grasp of algorithm-system co-design and cross-layer optimization for training efficiency, scalability, and reliability
- Strong programming skills and hands-on experience implementing production-grade ML systems or infrastructure
Preferred Qualifications
- Hands-on experience pretraining LLMs, multimodal, or video generation models at scale, or with mainstream distributed training frameworks (e.g., Megatron-LM, DeepSpeed, PyTorch FSDP, NCCL), or with custom kernel development using CUDA or Triton
- Publications at top-tier machine learning or systems conferences (e.g., NeurIPS, ICML, MLSys, OSDI, SOSP), or notable open-source contributions to widely used training frameworks