Novel AI Lead Methodologist

Novel AI Lead Methodologist - Google Careers

Careers

Careers

Skip navigation links

homehome

Home

Home

work_outlinework_outline

Jobs

Jobs

noogler_hatnoogler_hat

Students

Students

googlegoogle

How we work

How we work

handymanhandyman

How we hire

How we hire

person_outlineperson_outline

Your career

Your career

help_outline

Help link

feedback

Send feedback

more_vert

• Help
• Send Feedback

Sign in

Careers

Careers

homeHome

work_outlineJobs

expand_more

noogler_hatStudents

expand_more

googleHow we work

expand_more

handymanHow we hire

expand_more

person_outlineYour career

expand_more

job details

arrow_back

Back to jobs search

Jobs search results

3,522 jobs matched

• Regulatory and Litigation Counsel, APAC Defense

Seoul, South Korea

• Forward Deployed Engineer IV, GenAI, Google Cloud

Austin, TX, USA; Chicago, IL, USA; +6 more; +5 more

• AI Outcome Customer Engineer, Google Cloud

Seoul, South Korea

• Administrative Business Partner, Gemini App, DeepMind

Mountain View, CA, USA

• People Partner, Data Cloud, Storage

Sunnyvale, CA, USA; Kirkland, WA, USA; +2 more; +1 more

• Senior Software Engineer, Search, Mobile (Android)

London, UK

• Manufacturing Structural Test Development Engineer

Sunnyvale, CA, USA

• Account Manager, Travel

Chicago, IL, USA

• Senior Software Engineer, Ads Bidding ML

New York, NY, USA

• Senior Applied AI/ML Engineer

Bengaluru, Karnataka, India

• Senior UX Designer, Social Responsibility, Search

New York, NY, USA

• Software Engineer III, Android Large Screen

San Jose, CA, USA

• Facilities Manager, Data Center Operations

Frankfurt am Main, Germany

• Staff Software Engineer, Cloud Migration

Bengaluru, Karnataka, India

• Field Sales Representative, Financial Services, Google Cloud

Washington D.C., DC, USA; Atlanta, GA, USA; +4 more; +3 more

• Network Implementation Engineer

Kronstorf, Austria

• Senior Software Engineer, AI/ML, Google Cloud

Sunnyvale, CA, USA; Mountain View, CA, USA

• Product Support Manager, gUP Platforms and Devices Social and Community

Atlanta, GA, USA; Boulder, CO, USA

• Director, Strategic Sourcing

Sunnyvale, CA, USA

• Staff Software Engineer, AI/ML, YouTube Ads

Mountain View, CA, USA

Showing 1 to 20 of 3522 rows

1‑20 of 3522

navigate_next

Follow Life at Google on

*

More about us

About usopen_in_newContact usopen_in_newPressopen_in_new

Related Information

Investor relationsopen_in_newBlogopen_in_new

Equal Opportunity

Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google"s EEO Policy, Know your rights: workplace discrimination is illegal, Belonging at Google, and How we hire.

More about us

expand_more

Related information

expand_more

Equal opportunity

expand_more

Privacyopen_in_newApplicant & Candidate Privacyopen_in_newTermsopen_in_newManage cookies

helpHelpopen_in_new

arrow_back

Back to jobs search

Novel AI Lead Methodologist

share

• linkCopy link
• emailEmail a friend

corporate_fareGoogleplaceWashington D.C., DC, USA; Atlanta, GA, USA; +4 more; +3 more

bar_chartAdvanced

Advanced

Experience owning outcomes and decision making, solving ambiguous problems and influencing stakeholders; deep expertise in domain.

Apply

share

• linkCopy link
• emailEmail a friend

info_outline

XIn accordance with Washington state law, we are highlighting our comprehensive benefits package, which is available to all eligible US based employees. Benefits for this role include:

• Health, dental, vision, life, disability insurance
• Retirement Benefits: 401(k) with company match
• Paid Time Off: 20 days of vacation per year, accruing at a rate of 6.15 hours per pay period for the first five years of employment
• Sick Time: 40 hours/year (increased to 69 hours/year for Seattle) including 5 discretionary sick days per instance
• Maternity Leave (Short-Term Disability + Baby Bonding): 28-30 weeks
• Baby Bonding Leave: 18 weeks
• Holidays: 13 paid days per year

Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Washington D.C., DC, USA; Atlanta, GA, USA; Austin, TX, USA; Kirkland, WA, USA; Seattle, WA, USA.

Minimum qualifications:

• Bachelor"s degree or equivalent practical experience.

• 10 years of experience in AI testing or research, data analytics, data science, or a related field.

Preferred qualifications:

• Master"s degree or PhD in relevant field.
• 5 years of experience in data analysis for AI Testing with experience in SQL or Python.
• Experience building or partnering with engineering teams to build prototypes for AI testing.
• Experience in designing and conducting experiments or quantitative research, preferably in a technology or AI context.
• Experience in AI systems, machine learning, and their potential risks.
• Strong technical competency with a data-driven investigative approach to solve complex tests, including demonstrable proficiency in data manipulation, analysis, and automation using languages like Python and SQL.

About the job

Novel Testing is a team within Trust and Safety specializing in complex testing, defining protocols and methodologies for assessing risk where best practices do not currently exist. We pioneer and scale testing programs, streamlining the launch of trustworthy, novel AI products.

Work spans from designing first-of-their-kind evaluations for Google's most ambitious product bets-including autonomous agents, personalization, and the latest hardware-to developing new methodologies for assessing novel foundational model capabilities as they emerge.

Advancing in AI evaluation is central to this mission. To scale these methods, we partner closely with engineering teams to build the infrastructure and tools required for automated evaluation.

In this role, you will lead the development of novel testing methodologies for emergent AI, requiring the methodology to design evaluation frameworks where established standards do not yet exist. You will address complex testing questions with creative experimentation, designing sophisticated prompt strategies and quantitative analyses to identify systemic risks and edge cases in GenAI products.

Bridging the gap between theory and execution, you will move quickly to build and prototype testing solutions that incorporate methodological best practices. You will then partner directly with data science and engineering teams to inform the development of novel testing approaches and automated infrastructure, ensuring your insights scale effectively across Google's ecosystem. This position demands a researcher's mindset-capable of deep qualitative and quantitative inquiry-paired with the technical agility to translate those findings into scalable, engineering prototypes.

Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

US: $171000 - $248000 (USD) + 20% bonus target + equity + benefits

Learn more about benefits at Google.

Responsibilities

• Drive the methodological frontier of model evaluation. Partner with DeepMind and Data Science, developing novel, data-driven methodologies for structured and unstructured testing of emerging AI products. Move beyond standard benchmarks, designing sophisticated experimental frameworks, uncovering latent model behaviors and capabilities.
• Define testing and safety standards, working with cross-functional colleagues to ensure they are met. Perform analyses and drive insights to develop model-level and product-level safety mitigations.
• Lead and influence cross-functional teams to implement safety initiatives. Advise executive leadership on complex safety issues.
• Represent Google"s AI safety efforts in external forums and collaborations, contributing to industry-wide best practices. Mentor analysts, fostering a culture of excellence, acting as a subject matter expert on adversarial techniques.
• Work with sensitive content or situations and may be exposed to graphic, controversial or upsetting topics or content.

Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google"s Applicant and Candidate Privacy Policy.

Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google"s EEO Policy, Know your rights: workplace discrimination is illegal, Belonging at Google, and How we hire.

If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form.

Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.

To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes.

Equity is granted exclusively and discretionarily by Alphabet Inc. on the basis of an agreement concluded between you and Alphabet Inc. Alphabet Inc. is your sole contractual partner with respect to equity grants. GSU grants are not guaranteed, are discretionary, are subject to approval by the Alphabet Inc. board of directors or its delegate, the terms of the relevant Alphabet Inc. stock plan, and your grant agreement. They have no impact on statutory payments. Current or past grants do not confer an acquired right.

Follow Life at Google on

*

More about us

About usopen_in_newContact usopen_in_newPressopen_in_new

Related Information

Investor relationsopen_in_newBlogopen_in_new

Equal Opportunity

Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google"s EEO Policy, Know your rights: workplace discrimination is illegal, Belonging at Google, and How we hire.

More about us

expand_more

Related information

expand_more

Equal opportunity

expand_more

Privacyopen_in_newApplicant & Candidate Privacyopen_in_newTermsopen_in_newManage cookies

helpHelpopen_in_new

Follow Life at Google on

*

More about us

About usopen_in_newContact usopen_in_newPressopen_in_new

Related Information

Investor relationsopen_in_newBlogopen_in_new

Equal Opportunity

Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google"s EEO Policy, Know your rights: workplace discrimination is illegal, Belonging at Google, and How we hire.

More about us

expand_more

Related information

expand_more

Equal opportunity

expand_more

Privacyopen_in_newApplicant & Candidate Privacyopen_in_newTermsopen_in_newManage cookies

helpHelpopen_in_new

Google apps

Main menu