Senior Software Engineer

Location: New York
Company Stage of Funding: AI Infrastructure Startup
Office Type: Onsite (5 Days Per Week)
Salary: $300,000–$400,000 + Equity

Company Description

We're representing an AI infrastructure company building a new workspace that enables knowledge workers to conduct massive-scale research using large language models. Their platform orchestrates hundreds of thousands of AI agents simultaneously, processing millions of tokens per minute and compressing research workflows that previously took days into seconds.

The engineering challenges are deeply technical and highly distributed—from managing race conditions across 100,000+ concurrent agents to transmitting outputs across services in real time and optimizing massive write throughput without sacrificing memory efficiency. This is an opportunity for an experienced engineer to serve as a primary technical owner on some of the hardest distributed systems problems emerging from large-scale agentic AI.

What You Will Do

• Design, build, deploy, and operate distributed systems supporting hundreds of thousands of concurrent AI agents.
• Own medium-to-large engineering initiatives as a primary individual contributor from architecture through production.
• Build infrastructure capable of processing millions of tokens per minute across highly parallel workloads.
• Design systems that safely handle massive numbers of agents concurrently reading from and writing to shared data models.
• Build real-time infrastructure for transmitting agent outputs across backend services to end users.
• Optimize backend systems for write throughput, latency, reliability, and memory efficiency.
• Design and operate production-grade distributed services capable of scaling alongside rapidly increasing AI workloads.
• Debug complex production issues spanning concurrency, distributed state, infrastructure, and application services.
• Serve as a technical resource for other engineers through architecture discussions, debugging, and design reviews.
• Help establish engineering patterns and technical foundations for large-scale agent orchestration.

Ideal Background

• 7+ years of professional software engineering experience.
• Proven track record as the primary individual contributor on multiple medium-to-large technical projects.
• Deep experience designing, deploying, and operating distributed services in production.
• Strong understanding of concurrency, distributed systems, data modeling, and production infrastructure.
• Experience solving scalability challenges involving high-throughput or highly concurrent workloads.
• Strong debugging skills with the ability to diagnose complex issues across distributed systems.
• Demonstrated ability to independently own technically complex projects from initial design through production.
• Strong communication skills with the ability to explain complex technical concepts clearly.
• Track record of becoming a trusted technical resource for other engineers.

Preferred

• Professional experience with Go.
• Experience building high-throughput systems using Redis.
• Familiarity with Pub/Sub architectures and event-driven distributed systems.
• Experience designing RPC-based service architectures.
• Strong experience with PostgreSQL and production data systems.
• Familiarity with S3 or similar object storage infrastructure.
• Experience with Temporal or other durable workflow orchestration systems.
• Background building real-time systems or infrastructure supporting extremely high concurrency.
• Experience with AI infrastructure, agent orchestration, or large-scale LLM applications.
• Strong technical leadership as an individual contributor, regardless of formal title.

Compensation and Benefits

• Base salary: $300,000–$400,000.
• Competitive equity package.
• Five days per week onsite in NYC.
• Opportunity to solve novel distributed systems challenges created by orchestrating hundreds of thousands of AI agents simultaneously.
• Significant technical ownership with an emphasis on engineering ability and demonstrated impact rather than title or corporate seniority.
• Highly collaborative, in-person engineering culture focused on solving complex technical problems quickly.