San Francisco, CA30+ days ago
High-performance networking and storage are essential for interconnecting these systems and supporting AI training and inference at scale.\n \nLambda's Infrastructure Engineering team integrates advanced storage, networking, and compute hardware to build high-performance clusters.\n \nOur expertise lies at the intersection of:\n\n High-Performance Distributed Storage Solutions: We deploy and maintain the storage systems that provide customer training and inference datasets at the speeds demanded by modern clustered GPUs.\n \n\n Software Defined Networking: We deploy software defined network overlays that provide multi-tenant security and intelligent routing without compromising performance, using the latest in high-performance networking hardware.\n \n\n Compute Virtualization: We enable virtualization that allows AI researchers and engineers to focus on AI workloads, not AI infrastructure.\n \n\n Cluster Integrity: We own the cluster integrity lifecycle: validating deployments, diagnosing performance and health across hardware and fabrics, and providing proactive remediation.\n \n\n \nAbout the Role:\n \nYou will focus on strategy, architecture, and organizational influence\n\n Strategic Selection: Lead the RFP process and drive evidence-based storage solution selection and vendor evaluations.\n \n\n Workload Optimization: Develop an in-depth understanding of AI/ML workload profiles to influence future storage architecture and performance tuning.\n \n\n Operational Strategy: Identify and lead high-impact operational improvements and cross-functional deployment plans.\n \n\n Customer Discovery: Partner with leadership during deal formation to gather technical requirements and inform solution design.\n \n\n Organizational Leadership: Delegate complex engineering tasks and maintain consistent, proactive communication with the engineering leadership team.\n \n\n \nYou Have:\n\n 8+ years of experience designing, building, and operating large-scale multi-petabyte storage production environments\n \n\n A strong understanding of diverse storage solutions and their ecosystems:\n Familiarity with one or more storage solutions of the following vendors: Vast, Weka, DDN, NetApp, PureStorage, Dell, IBM, HPE\n \n\n File, Block, and Object storage types\n \n\n Storage Network Access Protocols such as NFS, SMB, and POSIX-compliant protocols.\n \n\n NVMEoverFabricStorage Transport Protocols: NVME/TCP, NVME/IB, or NVME/RoCE\n \n\n Storage performance via RDMA, GPUDirect Storage, parallel file systems\n \n\n Encryption, storage security, and multi-tenancy strategies\n \n\n Storage data-reduction, compression, and encryption\n \n\n Backup and data protection\n \n\n \n\n 5+ years of experience in Infrastructure as Code (e.g. Terraform, Ansible).\n \n\n \nNice to Have\n\n Experience with Kubernetes, including CSI and COSI drivers and CNI's\n \n\n Deep understanding of storage performance\n \n\n Strong understanding of public cloud features (e.g., SDN, block storage, distributed file systems, identity management)\n \n\n Experience deploying, operating, and maintaining Software Defined Storage\n \n\n Have implemented either open-source or commercial monitoring solutions of storage and storage-adjacent solutions\n \n\n \nSalary Range Information\n \nThe annual salary range for this position has been set based on market data and other factors.