Staff Machine Learning Engineer - Computer Vision & Multi-Modal AI

Unity Software Inc

San Francisco, CA

JOB DETAILS
SKILLS
ARM (Advanced RISC Machine), Apple, Architectural Services, Artificial Intelligence (AI), Artificial Intelligence (AI) Games, Attorney, Automotive Industry, Automotive Manufacturing, Benchmarking, Best Practices, Budgeting, Cisco Unity, Cloud Computing, Code Reviews, Computer Vision, Cross-Functional, Data Analysis, Data Management, Data Modeling, Deep Learning, English Language, Federal Trade Commission, GPU (Graphics Processing Unit), Government, Graphics, Healthcare, Leadership, Leading Edge Technology, Legal, Machine Learning, Machine Tool, Memory Hardware, Mentoring, Metadata, Modeling Languages, Open Source, OpenGL Programming Libraries, Performance Metrics, Product Planning, Production Systems, Prototyping, Publications, Python Programming/Scripting Language, Recruiting/Staffing Agency, Scientific Research, System-on-a-Chip (SoC), Systems Scalability, Technical Leadership
LOCATION
San Francisco, CA
POSTED
8 days ago

b''Staff Machine Learning Engineer - Computer Vision & Multi-Modal AI, San Francisco, CA, USA - Unity Careers

Requisition ID: JOBREQ-2616040

Staff Machine Learning Engineer - Computer Vision & Multi-Modal AI

San Francisco, CA, USA, Full-time

  • Unity Careers
  • Positions
  • Description

ALERT: Unity has received reports of scams where individuals purporting to be Unity HR representatives conduct bogus employment interviews via email or text, and then request payment as a condition for receiving an offer of employment. Please be aware that Unity does not conduct interviews by email or text, and will never request payment as a condition for applying for a position or receiving an offer of employment. These scam operators may also ask for your personal information (name, address, birthdate, social security number, etc.) which you should not provide to them. If you have been a target of such a scam, you should report it by contacting the U.S. Federal Trade Commission (see this FTC posting for further details) the office of your state Attorney General, or the government agency responsible for investigating matters such as this where you reside this FTC posting for further details) the office of your state Attorney General, or the government agency responsible for investigating matters such as this where you reside.nn

See more

  • ]:whitespace-nowrap">

See FTC

Dismiss

  • The opportunity
  • What you'll be doing
  • What we're looking for
  • You might also have
  • Additional information
  • Benefits
  • Life at Unity
  • Apply

The opportunity

We are building the next generation of AI-driven game experiences xe2x80x94 generative world models, neural rendering, and multi-modal understanding that turn images, text, and 3D primitives into interactive worlds. As our Staff Machine Learning Engineer, you will be a core technical leader bringing state-of-the-art computer vision and multi-modal models xe2x80x94 transformers, diffusion networks, vision-language models (VLMs), and JEPA-style architectures xe2x80x94 from research into robust, production-grade systems.n

This is a deeply hands-on, high-impact role. You will help define the modeling andxc2xa0deployment strategy, drive architectural decisions across the ML stack, and mentor a teamxc2xa0of senior and mid-level engineers. Your work will directly shape the quality, capability, andxc2xa0performance of AI features experienced by billions of players xe2x80x94 across cloud, server, andxc2xa0on-device targets.

n

What you''ll be doing

n

Technical Leadership

n

n

  • Help set the technical vision and roadmap for computer vision and multi-modal AI models, spanning transformers, diffusion models, vision-language models, and JEPA-style generative architectures. n
  • Drive design and implementation of models for image and video understanding, generation, segmentation, detection, and dense prediction, as well as multi-modal reasoning over images, text, and 3D inputs. n
  • Make sound decisions on model architecture, training strategy, data pipelines, and evaluation xe2x80x94 balancing quality, capability, latency, and cost across deployment targets. n
  • Own the path from research prototype to production: training, fine-tuning, distillation, export, and serving, with deployment spanning cloud GPUs through to efficient on-device inference where the product requires it. n

n

Architecture & Research Translation

n

n

  • Collaborate directly with research scientists to translate novel CV and multi-modal model architectures into deployable, well-engineered implementations. n
  • Design scalable systems for multi-modal inference that process diverse inputs images, n
  • video, text, primitives, and metadata xe2x80x94 and produce rich outputs from semantic n
  • predictions to pixel-level generation. n
  • Track and rapidly adopt breakthroughs across the field: vision-language pretraining and n
  • alignment, efficient diffusion (e.g., consistency models, flow matching), efficient attention n
  • e.g., FlashAttention, linear-attention variants), and tokenization/representation learning n
  • for vision. n
  • Where latency or device constraints demand it, apply compression, quantization, pruning, and knowledge distillation, and work with appropriate runtimes (e.g., TensorRT, ONNX Runtime, CoreML, TFLite) to meet performance budgets. n
  • Team & Cross-Functional Leadership n
  • Lead and mentor a team of ML engineers; define engineering best practices, code review standards, and rigorous benchmarking and evaluation methodology. n
  • Partner with research, platform engineers, product managers, and runtime teams to align ML capabilities with product roadmaps and target-platform constraints. n
  • Champion a culture of measurement: define KPIs for model quality, accuracy, latency, memory, and cost, and ensure the team tracks them rigorously. n

n

What we''re looking for

n

n

  • 6+ years in ML engineering, with significant depth in computer vision and/or multi-modal modeling. n
  • Proven production experience with transformer-based and diffusion-based vision models (e.g., ViT, CLIP/SigLIP-style encoders, Stable Diffusion, DETR/SAM-style architectures) n
  • Strong command of the full model lifecycle: data curation, training and fine-tuning, evaluation, and serving at scale. n
  • Familiarity with efficient attention, diffusion samplers, multi-modal fusion, and vision-language alignment techniques. n
  • Strong Python and modern deep-learning tooling (PyTorch); solid software n
  • engineering fundamentals. n
  • Track record of technical leadership: setting direction, influencing cross-functional partners, and growing engineers. n

n

You might also have

n

n

  • Experience with world-model, video-generation, or neural rendering pipelines (NeRF, n
  • 3DGS, or similar). n
  • Experience deploying models to constrained or on-device targets, including quantization n
  • INT8/INT4/FP16), pruning, distillation, and runtimes such as CoreML, TFLite, ONNX n
  • Familiarity with mobile SoC accelerators (Apple Neural Engine, Qualcomm Hexagon/Adreno,ARM Mali) or compiler stacks such as MLIR, TVM, or XLA. n
  • Contributions to open-source ML frameworks or peer-reviewed CV/ML research publications. n
  • Background in real-time graphics or game engine pipelines (Metal, Vulkan, OpenGL ES). n

n

Additional information

n

n

  • Relocation support is not available for this position n
  • Work visa/immigration sponsorship is not available for this position n

n

Benefits

At Unity, we want our team members to thrive. We offer a wide range of benefits designed to support well-being and work-life balance.n

Please note: Benefits eligibility, specific offerings, and coverage vary based on the country and employment status.

n

While specific benefits vary, here are some of the ways we strive to take care of our eligible team members globally: Comprehensive health, life, and disability insurance | Commute subsidy | Employee stock ownership | Competitive retirement/pension plans | Generous vacation and personal days | Support for new parents through leave and family-care programs | Office food snacks | Mental Health and Wellbeing programs and support | Employee Resource Groups | Global Employee Assistance Program | Training and development programs | Volunteering and donation matching program

n

Life at Unity

Unity [NYSE: U] is the worldxe2x80x99s leading game engine, powering play for more than 3 billion consumers each month. The top mobile games in the world, the most played PC indie titles, the most innovative console games, and virtually all of the top XR and Web Games are developed, deployed, and grown in Unity. Unity also enables teams across industries like automotive, manufacturing, and healthcare to design, simulate, and collaborate in 3D xe2x80x94 closing the gap between ideas and reality. For more information, please visit www.unity.com.n

Unity is a proud equal opportunity employer. We are committed to fostering an inclusive, innovative environment and celebrate our employees across age, race, color, ancestry, national origin, religion, disability, sex, gender identity or expression, sexual orientation, or any other protected status in accordance with applicable law. Our differences are strengths that enable us to support the growing and evolving needs of our customers, partners, and collaborators. If you have a disability that means there are preparations or accommodations we can make to help ensure you have a comfortable and positive interview experience, please fill out this form to let us know.

n

Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

n

This position requires the incumbent to have a sufficient knowledge of English to have professional verbal and written exchanges in this language since the performance of the duties related to this position requires frequent and regular communication with colleagues and partners located worldwide and whose common language is English.

n

Headhunters and recruitment agencies may not submit resumes/CVs through this Web site or directly to managers. Unity does not accept unsolicited headhunter and agency resumes. Unity will not pay fees to any third-party agency or company that does not have a signed agreement with Unity.

n

Your privacy is important to us. Please take a moment to review our Prospect Privacy Policy and Applicant Privacy Policy. Should you have any concerns about your privacy, please contact us at DPO@unity.com.

n

#SEN #LI-MC1

Apply

Location: San Francisco, CA, USADepartment: AI & Machine LearningType: Full-timeRequisition ID: JOBREQ-2616040

''

About the Company

U

Unity Software Inc