Developer Advocate, MAX Inference & Serving

Modular AI
    • $150,200–$225,400 Per Year
    30+ days ago

    Job Description

    About the role:

    Modular is building a next-generation AI infrastructure platform that unifies the many application frameworks and hardware backends, simplifying deployment for AI production teams and accelerating innovation for AI researchers and hardware developers.

    We are looking for a Developer Advocate to evangelize the MAX Platforms inference and serving capabilities with our user base and developer community. This involves creating technical content such as user guides and blog posts as well as giving talks at conferences, leading workshops, all with the goal of enabling our community of builders deploying models in production.

    Join our world-leading product team and be part of redefining how AI infrastructure is built and deployed.

    LOCATION: Candidates based in the US or Canada are welcome to apply. To support growth and collaboration, those in earlier career stages work in a hybrid capacity at our Los Altos, CA. More senior staff can work out of our office in Los Altos, CA or remotely from home. Onboarding for new hires is conducted in-person in our Los Altos, CA office.

    Additionally, this role requires travel to conferences and developer events, which may be as often as once per month, as well as travel for team and company events (typically 2-4 times per year).

    What you will do:

    • Provide support and respond to questions from customers evaluating MAX for inference and serving, including some of the worlds largest corporations.
    • Establish, run and publish benchmarks comparing MAX to serving frameworks like vLLM, Triton Inference Server, and TensorRT-LLM.
    • Foster an inclusive and welcoming environment for ML engineers and practitioners deploying models with MAX.
    • Collaborate with engineering and product teams to create tutorials, video guides, and examples demonstrating how the MAX Platform handles inference and serving workloads efficiently on both CPUs and GPUs.
    • Write blog posts and other educational content that inform prospective and current customers about MAXs inference and serving performance and functionality.
    • Engage with the community across GitHub, Discord, Twitter/X, and LinkedIn by facilitating discussions, answering questions, and providing support.
    • Act as a voice for the developer community internally, feeding inference and serving feedback back to engineering and product teams, shaping the future of the MAX Platform.
    • Represent Modular at conferences, summits, and industry events through presentations, panel discussions, and networking with industry professionals.
    • Contribute to Modulars broader developer relations, product, and marketing strategies.

    What success looks like after 6 months

    • Youve published a steady cadence of inference and serving content that developers reference when deploying models with MAX.
    • Your benchmarks and comparisons against tools like vLLM, Triton Inference Server, and TensorRT-LLM get cited in community discussions.
    • Code examples and cookbooks youve built get linked in forum and Discord answers by other community members.
    • Youve identified and closed content gaps that were blocking adoption of MAX for production inference.

    What you bring to the table:

    • Demonstrable experience creating technical content for developer audiences. Send us a portfolio: blog posts, tutorials, videos, docs, or courses.
    • You understand the ML inference stack, including model serving architectures, GPU acceleration, and how MAX compares to vLLM, Triton Inference Server, and TensorRT-LLM.
    • Strong Python skills; systems programming experience (C++, Rust, or similar) is an advantage.
    • You learn new tools fast and produce accurate content quickly. A feature ships Tuesday, your tutorial goes out Thursday.
    • You can record, edit, and publish a technical video without a production team. Clear audio, good pacing, technically correct, not necessarily polished.
    • You write well. You explain complex ideas without losing precision, and you cut the filler.
    • You plan your own content calendar because youre in the community and know where developers get stuck.
    • A growth and leadership mindset, with a collaborative attitude that seeks to learn more from our customers, team members, and the broader market.

    Helpful, but not required

    • Experience programming GPUs using CUDA or ROCm.
    • Familiarity with the Mojo programming language and MAX AI framework.
    • Familiarity with open source software development practices and communities.
    • Experience producing high-quality videos covering technical topics.

    What Modular brings to the table:

    • Amazing Team. We are a progressive and agile team with some of the industry's best engineering and product leaders.
    • World-class Benefits. In order to attract the best, we need to offer the best. Premier insurance plans, up to 5% 401k matching, flexible paid time off, and more are available to you! Please note that specific benefit packages may vary based on your location.
    • Competitive Compensation. We offer very strong compensation packages, including stock options. We want people to be focused on their best work and believe in tailoring compensation plans to meet the needs of our workforce.
    • Team Building Events. We organize regular team onsites and local meetups in Los Altos, CA as well as different cities. Traveling 2-4 times a year is expected for all roles.

    Working at Modular will enable you to grow quickly as you work alongside incredibly motivated and talented people who have high standards, possess a growth mindset, and a purpose to truly change the world.

    The estimated base salary range for this role to be performed in the US is $150,200.00 - $225,400.00 USD.

    The estimated base salary range for this role to be performed in Canada is $111,500.00 - $167,300.00 CAD.

    The salary for the successful applicant will depend on a variety of permissible, non-discriminatory job-related factors, which include but are not limited to education, training, work experience, business needs, or market demands. This range may be modified in the future. The total compensation for a candidate will also include annual target bonus, equity, and benefits, with equity making up a significant portion of your total compensation.

    For candidates who fall outside of the listed requirements, we nevertheless encourage you to apply as we may have openings that are lower/higher level than the ones advertised.

    Numbers & Facts

    Location
    Salary$150,200–$225,400 Per Year

    Skills

    • Application Frameworkunmatched
    • Artificial Intelligence (AI)unmatched
    • Artificial Intelligence (AI) Programming Languagesunmatched
    • Audience Developmentunmatched
    • Benchmarkingunmatched
    • Blogunmatched
    • C++ Programming Languageunmatched
    • CAD/CAM (Computer-Aided Design/Computer-Aided Manufacturing)unmatched
    • CPU (Central Processing Unit)unmatched
    • CUDA (Compute Unified Device Architecture)unmatched
    • Cadenceunmatched
    • Compensation and Benefitsunmatched
    • Conferencesunmatched
    • Content Developmentunmatched
    • Develop and Maintain Customersunmatched
    • GPU (Graphics Processing Unit)unmatched
    • GitHubunmatched
    • Hardware Developmentunmatched
    • Leadershipunmatched
    • Link Buildingunmatched
    • LinkedInunmatched
    • Marketing Strategyunmatched
    • Onboardingunmatched
    • Open Sourceunmatched
    • Product Marketingunmatched
    • Product Strategyunmatched
    • Python Programming/Scripting Languageunmatched
    • Rust Programming Languageunmatched
    • Sales Prospectingunmatched
    • Software Developmentunmatched
    • Systems/Internals Programmingunmatched
    • Team Buildingunmatched
    • Team Lead/Managerunmatched
    • Team Playerunmatched
    • Technical Writingunmatched
    • Twitterunmatched
    • User Documentationunmatched
    • Video Productionunmatched

    Be found by employers

    5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.

    Level up your application

    Professional resume templates

    Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

    Free resume templates

    Free resume builder

    Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

    Free resume builder