Staff Software Engineer, Model as a Service, Cloud AI - Google Careers
Careers
Careers
Skip navigation links
homehome
Home
Home
work_outlinework_outline
Jobs
Jobs
noogler_hatnoogler_hat
Students
Students
googlegoogle
How we work
How we work
handymanhandyman
How we hire
How we hire
person_outlineperson_outline
Your career
Your career
help_outline
Help link
feedback
Send feedback
more_vert
Sign in
Careers
Careers
homeHome
work_outlineJobs
expand_more
noogler_hatStudents
expand_more
googleHow we work
expand_more
handymanHow we hire
expand_more
person_outlineYour career
expand_more
job details
arrow_back
Back to jobs search
Jobs search results
3,411 jobs matched
Saint George, SC, USA
Hyderabad, Telangana, India
Kirkland, WA, USA
New York, NY, USA; Kirkland, WA, USA; +3 more; +2 more
Sunnyvale, CA, USA; Atlanta, GA, USA; +5 more; +4 more
Mountain View, CA, USA; Cambridge, MA, USA
Sunnyvale, CA, USA
Mexico City, CDMX, Mexico
Dublin, Ireland
Kirkland, WA, USA; Mountain View, CA, USA
San Bruno, CA, USA
New York, NY, USA; Los Angeles, CA, USA; +2 more; +1 more
Dublin, Ireland
Sunnyvale, CA, USA
Santiago, Chile; Buenos Aires, Argentina; +3 more; +2 more
New York, NY, USA
Mountain View, CA, USA
Mountain View, CA, USA
San Jose, CA, USA; Waterloo, ON, Canada; +2 more; +1 more
Eemshaven, Netherlands
Showing 1 to 20 of 3411 rows
1‑20 of 3411
navigate_next
Go to next page
Follow Life at Google on
*
More about us
About usopen_in_newContact usopen_in_newPressopen_in_new
Related Information
Investor relationsopen_in_newBlogopen_in_new
Equal Opportunity
Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google"s EEO Policy, Know your rights: workplace discrimination is illegal, Belonging at Google, and How we hire.
More about us
expand_more
Related information
expand_more
Equal opportunity
expand_more
Privacyopen_in_newApplicant & Candidate Privacyopen_in_newTermsopen_in_newManage cookies
helpHelpopen_in_new
arrow_back
Back to jobs search
Staff Software Engineer, Model as a Service, Cloud AI
share
Share Staff Software Engineer, Model as a Service, Cloud AI
corporate_fareGoogleplaceSunnyvale, CA, USA
bar_chartAdvanced
Advanced
Experience owning outcomes and decision making, solving ambiguous problems and influencing stakeholders; deep expertise in domain.
Apply
share
Share Staff Software Engineer, Model as a Service, Cloud AI
Minimum qualifications:
Bachelor's degree or equivalent practical experience.
8 years of experience in software development.
5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
5 years of experience with ML design and ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
Experience integrating generative AI tools or LLM interfaces into workflows.
Experience with Kubernetes, C++, Go programming.
Preferred qualifications:
Master's degree or PhD in Engineering, Computer Science, or a related technical field.
8 years of experience with data structures and algorithms.
5 years of experience with software development in Go, Python or Java programming languages.
3 years of experience in a technical leadership role leading project teams and setting technical direction.
3 years of experience with distributed system design of infrastructure software.
Experience testing, maintaining, or launching software products, and with software design and architecture.
About the job
Google"s software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We"re looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google's needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.
The AI industry is rapidly adopting GenAI models due to their versatility and powerful capabilities in creating text, code, images, videos and more via increasingly more complex input context length. However, even the most technically competent businesses and GenAI developers will face challenges in development, scaling and managing the cost and infrastructure required to host such large models. Our Model as a Service (MaaS) aims to provide a much needed new level of abstraction to remove the complexity of development and provide large GenAI models as a scalable, cloud-based service with an enhanced suite of tools to facilitate the use, integration, and model management.
Google Cloud accelerates every organization's ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google's cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.
Individual pay is determined by factors including job-related skills, experience, and relevant education or training.
US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits
Learn more about benefits at Google.
Responsibilities
Build infrastructure for model creators to be able to generate business with their models.
Build a platform for partners to manage their services on Vertex.
Work with sister teams to bring optimized models and serving techniques (e.g. prefix caching, cache-aware routing, etc.).
Build infrastructure for efficiently onboarding open and closed source models to Google Cloud.
Scale and maintain existing Model-as-a-service deployments.
Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google"s Applicant and Candidate Privacy Policy.
Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google"s EEO Policy, Know your rights: workplace discrimination is illegal, Belonging at Google, and How we hire.
If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form.
Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.
To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes.
Equity is granted exclusively and discretionarily by Alphabet Inc. on the basis of an agreement concluded between you and Alphabet Inc. Alphabet Inc. is your sole contractual partner with respect to equity grants. GSU grants are not guaranteed, are discretionary, are subject to approval by the Alphabet Inc. board of directors or its delegate, the terms of the relevant Alphabet Inc. stock plan, and your grant agreement. They have no impact on statutory payments. Current or past grants do not confer an acquired right.
Follow Life at Google on
*
More about us
About usopen_in_newContact usopen_in_newPressopen_in_new
Related Information
Investor relationsopen_in_newBlogopen_in_new
Equal Opportunity
Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google"s EEO Policy, Know your rights: workplace discrimination is illegal, Belonging at Google, and How we hire.
More about us
expand_more
Related information
expand_more
Equal opportunity
expand_more
Privacyopen_in_newApplicant & Candidate Privacyopen_in_newTermsopen_in_newManage cookies
helpHelpopen_in_new
Follow Life at Google on
*
More about us
About usopen_in_newContact usopen_in_newPressopen_in_new
Related Information
Investor relationsopen_in_newBlogopen_in_new
Equal Opportunity
Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google"s EEO Policy, Know your rights: workplace discrimination is illegal, Belonging at Google, and How we hire.
More about us
expand_more
Related information
expand_more
Equal opportunity
expand_more
Privacyopen_in_newApplicant & Candidate Privacyopen_in_newTermsopen_in_newManage cookies
helpHelpopen_in_new
Google apps
Main menu
| Location | Sunnyvale, CA |
Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.
Free resume templatesImprove your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.
Free resume builder