Staff Software Engineer, Vertex GenAI, Infrastructure and Features

About the job

Google Cloud's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google Cloud's needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. You will anticipate our customer needs and be empowered to act like an owner, take action and innovate. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

Vertex GenAI - Infrastructure and Features team develops and scales the foundational inference serving infrastructure for Google's leading AI models, including Gemini, Imagen, and Embedding models. In this role, you will focus on building high-performance, distributed systems that enable efficient and scalable deployment of these models, reaching billions of users globally. Key initiatives include optimizing inference latency, maximizing throughput, and ensuring high availability for large-scale GenAI applications. You will work on critical areas such as performance optimization, distributed caching, and advanced resource management, driving solutions for high-scale AI problems.

Responsibilities

• Provide technical leadership on high-impact projects.
• Influence and coach a distributed team of engineers.
• Facilitate alignment and clarity across teams on goals, outcomes, and timelines.
• Manage project priorities, deadlines, and deliverables.
• Design, develop, and maintain the infrastructure behind Vertex AI’s GenAI APIs, ensuring scalability, reliability, and performance.

Minimum qualifications:

• Bachelor's degree or equivalent practical experience.
• 8 years of experience in software development.
• 7 years of experience building and developing large-scale infrastructure or distributed systems.
• 5 years of experience with design and architecture; and testing/launching software products.

Preferred qualifications:

• Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
• 8 years of experience with data structures/algorithms.
• 3 years of experience in a technical leadership role leading project teams and setting technical direction.
• 3 years of experience working in matrixed organization involving cross-functional, or cross-business projects.

Benefits: 

• Health and Wellbeing (Medical, dental, and vision insurance for employees and dependents)
• Financial wellbeing (Competitive compensation, regular bonus and equity refresh opportunities)
• Flexibility and time off (Paid time off, including vacation, bereavement, jury duty, sick leave, parental leave, disability, and holidays)
• Family support and care (Fertility and growing family support, parental leave and baby bonding leave)
• Community and personal development (Educational reimbursement)
• Googley extras (Inspiring spaces to work, recharge, and collaborate with fellow Googlers)

Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. See also Google's EEO Policy and EEO is the Law. If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form.