Visual Intelligence and Machine Learning Research Scientist

Apple Inc

San Jose, CA

JOB DETAILS
SKILLS
Accounts Receivable, Algorithms, Apple, Artificial Intelligence (AI), Biology, Biomedical Engineering, Cognitive Science, Communication Skills, Computational Engineering, Computer Science, Computer Skills, Computer Systems, Computer Vision, Continuous Improvement, Data Modeling, Data Sets, Deep Learning, Environmental Sciences, JAX (Java API for XML), Linear Algebra, Localization, Mac Operating System, Machine Learning, Mathematics, Neuroscience, Object Modeling, Performance Metrics, Process Improvement, Product Design, Product Shipments, Prototyping, Python Programming/Scripting Language, Scene Understanding, Scientific Research, Signal Processing, Software Design, Systems Engineering, Team Player, User Experience Design (UXD), User Interface/Experience (UI/UX), iOS
LOCATION
San Jose, CA
POSTED
13 days ago

Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, every service we deliver, is the result of us making each others ideas stronger. Here, youll do more than join something - youll add something.

Our team sits at the intersection of computational neuroscience, visual intelligence, and AI, translating cutting-edge research directly into experiences that users see and feel every day. We prototype algorithms from first principles all the way through to shipping features, working hand-in-hand with app teams and designers so that the science we build has immediate, tangible impact on how people interact with Apple products. If you want your research to matter beyond a paper, this is where that happens. We are looking for a Visual Intelligence and Machine Learning Scientist who bridges computational neuroscience and modern AI. You will build models that reason about human visual attention, behavioral states, comfort, and perceptual salience from video and multimodal sensor streams. You will have a track record of original research contributions, a drive to deploy algorithms on real-world data, and the versatility to take an idea from exploratory research to polished user experience.Apply large and on-device vision foundation models, multimodal transformers, and generative AI to build visual intelligence systems that predict saliency, understand scene context, and estimate perceptual state from video and sensor streams. Design and own end-to-end AI pipelines: from data curation and model training to fine-tuning and adapting pretrained vision-language and multimodal foundation models for on-device, real-time inference. Build multimodal AI systems that fuse visual signals with IMU, depth, and temporal context, improving robustness and perceptual fidelity across diverse real-world conditions. Use generative AI and computational modeling to develop learned representations and priors that extend model generalization beyond labeled data, across devices, environments, and user populations. Partner with app teams, UX designers, and systems engineers to translate algorithmic outputs directly into user-facing features on iOS, macOS, and spatial computing platforms. Define and track perceptual and behavioral KPIs at the object, scene, and user level to rigorously validate algorithm quality and drive continuous improvement. Stay at the frontier of visual intelligence, multimodal AI, and computational neuroscience, rapidly prototyping novel ideas and carrying the most promising from research to shipped product.MS with 3+ years of research experience, in Computer Science, Biomedical Engineering, Computational Neuroscience, Applied Mathematics, or a related field, with a focus on computer vision or machine learning. Demonstrated research contributions to visual intelligence or perceptual modeling, including peer-reviewed publications or equivalent industry impact. Deep expertise in visual perception: saliency modeling, object detection and localization, optical flow, depth estimation, and multimodal learning including sensor fusion with IMU and temporal signals. Strong hands-on experience training and deploying deep learning models using modern frameworks (PyTorch, TensorFlow, JAX) and Python scientific libraries (NumPy, OpenCV, scikit-learn). Strong mathematical foundations in linear algebra, probability, optimization, and signal processing, with experience in large-scale dataset curation and evaluation methodology. Excellent communication and collaboration skills; ability to thrive in a fast-paced environment alongside scientists, engineers, designers, and domain experts from the behavioral and cognitive sciences.PhD in Computer Science, Biomedical Engineering, Computational Neuroscience, Applied Mathematics, or a related field, with a focus on computer vision or machine learning. Experience with vision foundation models, vision transformers (ViT), and adapter-based fine-tuning for perceptual or behavioral downstream tasks. Familiarity with generative AI and neural rendering approaches (diffusion models, implicit neural representations) as components of computational perception pipelines. Background in computational modeling of perceptual or behavioral phenomena: modeling user state, comfort, visual salience, or behavioral response from video or sensor data. Experience developing or deploying models for spatial computing platforms (AR/VR headsets, iOS, macOS). Track record of shipping algorithms in resource-constrained, real-time on-device inference environments. Ability to be versatile across a multi-faceted role, moving fluidly between deep research, engineering rigor, and direct collaboration with product and design teams to bring science to life in user-facing features.

About the Company

A

Apple Inc

We bring amazing people together to make amazing things happen.

We’re a diverse collection of thinkers and doers, continually reimagining what’s possible to help us all do what we love in new ways. The people who work here have reinvented entire industries with the Mac, iPhone, iPad, and Apple Watch, as well as with services, including iTunes, the App Store, Apple Music, and Apple Pay. And the same passion for innovation that goes into our products also applies to our practices — strengthening our commitment to leave the world better than we found it.

About Apple

There’s a place here for every kind of brilliant. Everyone here is an innovator, or an innovator-to-be, no matter what your team or your role. So bring your passion, courage, and original thinking and get ready to share it, because every new product, service, or feature we invent is the result of people working together to make each others’ ideas stronger. Innovation at this level depends on people who represent the variety of the human experience and inspire us with their own fresh perspectives. Together, we’ll do amazing work that can make a difference in people’s lives. Including your own. Learn more about working at Apple.

COMPANY SIZE
10,000 employees or more
INDUSTRY
Computer/IT Services
FOUNDED
1976
WEBSITE
https://www.apple.com/jobs