AIML - Machine Learning Manager, Red Teaming - Responsible AI and Safety

Apple Inc

CA

JOB DETAILS
SKILLS
Analysis Skills, Apple, Artificial Intelligence (AI), Artificial Intelligence (AI) Programming Languages, Computer Science, Conferences, Cross-Functional, Data Management, Data Sets, Engineering, Leadership, Machine Learning, Needs Assessment, Organizational Skills, Performance Analysis, Product Development, Product Testing, Publications, Python Programming/Scripting Language, Quality Metrics, Safety/Work Safety, Statistics, Team Lead/Manager, Technical Leadership, Training Data Sets, User Interface/Experience (UI/UX)
LOCATION
CA
POSTED
6 days ago

Apples Responsible AI and Safety team focuses on innovative technologies, methodologies, and research to enable fantastic user experiences and to push the frontier of machine learning. Our team is looking to hire a leader with a strong track record in Applied Research, who is passionate about ML and foundation models with a focus on responsibility, fairness, and safety. In this role, you will lead the research and application of ML methods for technologies that power breakthrough user experiences while upholding Apples values, privacy, and quality standards. This role focuses on leading a team working on developing, carrying-out, interpreting, and communicating pre- and post-ship evaluations of the safety of Apple Intelligence features. This team is also responsible for producing safety evaluations that uphold Apple's Responsible AI values requires thoughtful data sampling, creation, and curation for evaluation datasets; high quality, detailed annotations and careful auto-grading to assess feature performance; and mindful analysis to understand what the evaluation means for the user experience.Proven technical leadership with 5+ years of team management or leadership experience Demonstrated expertise in ML production deployment lifecycle, datasets, identifying data needs, and working on creative solutions, scaling and expanding data coverage through human and synthetic generation methods. Provide technical direction and expertise to team-wide initiatives in safety auto-grading. Use and implement data pipelines, and collaborate cross-functionally to execute end-to-end safety evaluations. Work with highly-sensitive content with exposure to offensive and controversial content.MS, or PhD in Computer Science, Machine Learning, Statistics, or related fields; or an equivalent qualification acquired through other avenues. Experience working with generative models for evaluation and/or product development, and up-to-date knowledge of common challenges and failures. Strong engineering skills and experience in writing production-quality code in Python. Deep experience in foundation model-based AI programming (i.e.: using DSPy for optimizing foundation model prompts, for example) and a drive to innovate in this space. Experience working with noisy, crowd-based data labels and human evaluations.Publication record in relevant conferences (e.g., NeurIPS, ICML, ICLR, EMNLP, etc.) Experience working on Responsible AI and AI Safety Strong organizational and operational skills working with large, multi-functional, and diverse teams. Curiosity about fairness and bias in generative AI systems, and a strong desire to help make the technology more equitable.

About the Company

A

Apple Inc

We bring amazing people together to make amazing things happen.

We’re a diverse collection of thinkers and doers, continually reimagining what’s possible to help us all do what we love in new ways. The people who work here have reinvented entire industries with the Mac, iPhone, iPad, and Apple Watch, as well as with services, including iTunes, the App Store, Apple Music, and Apple Pay. And the same passion for innovation that goes into our products also applies to our practices — strengthening our commitment to leave the world better than we found it.

About Apple

There’s a place here for every kind of brilliant. Everyone here is an innovator, or an innovator-to-be, no matter what your team or your role. So bring your passion, courage, and original thinking and get ready to share it, because every new product, service, or feature we invent is the result of people working together to make each others’ ideas stronger. Innovation at this level depends on people who represent the variety of the human experience and inspire us with their own fresh perspectives. Together, we’ll do amazing work that can make a difference in people’s lives. Including your own. Learn more about working at Apple.

COMPANY SIZE
10,000 employees or more
INDUSTRY
Computer/IT Services
FOUNDED
1976
WEBSITE
https://www.apple.com/jobs