Google
Posted 4w ago

Software Engineering Manager, Google Cloud TPU

Google
Tel Aviv, Tel Aviv District, Israel
OnsiteFull Time
Responsibilities
  • mentoring engineers
  • shaping strategy
  • driving delivery
Requirements
  • 8+ years software development experience
  • 3+ years engineering management
  • 2+ years LLM training/inference experience
  • Bachelor's or equivalent
  • BSc/MS/PhD preferred
  • Experience with TPU/GPU and PyTorch/JAX/TensorFlow
Technical tools mentioned
Google CloudTPUGPUPyTorchJAXTensorFlow

Job description

Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 8 years of experience in software development, focusing on building distributed cloud services.
  • 3 years of experience in an engineering management role, guiding software engineering teams, including hiring or team development.
  • 2 years of experience in LLM training or inference, including performance optimizations, distributed execution, GPU or TPU acceleration, or PyTorch, JAX, or TensorFlow programming.

Preferred qualifications:

  • Master's degree or PhD in Computer Science or related technical field.
  • 3 years of experience working in a complex, matrixed organization.

About the job

Like Google's own ambitions, the work of a Software Engineer goes beyond just Search. Software Engineering Managers have not only the technical expertise to take on and provide technical leadership to major projects, but also manage a team of Engineers. You not only optimize your own code but make sure Engineers are able to optimize theirs. As a Software Engineering Manager you manage your project goals, contribute to product strategy and help develop your team. Teams work all across the company, in areas such as information retrieval, artificial intelligence, natural language processing, distributed computing, large-scale system design, networking, security, data compression, user interface design; the list goes on and is growing every day. Operating with scale and speed, our exceptional software engineers are just getting started -- and as a manager, you guide the way.

With technical and leadership expertise, you manage engineers across multiple teams and locations, a large product budget and oversee the deployment of large-scale projects across multiple sites internationally.

This role is a unique leadership opportunity to manage an engineering team dedicated to critical Google Cloud TPU software services, which empower Google’s global AI customers. As a Software Engineering Manager, you will lead the architecture and execution of large-scale ML infrastructure, requiring a deep understanding of Large Language Model (LLM) operations from chip level to fleet level. You will be responsible for solving complex ML infrastructure issues, driving technical strategy, fostering a high-performance team culture, and working directly with customers to ensure successful landings.

Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.

Responsibilities

  • Build, mentor, and inspire a software engineering team. Cultivate a culture of high performance, innovation, psychological safety, and deliberate career development where every engineer grows.
  • Shape the technical strategy and multi-year product roadmap, seamlessly aligning team objectives with the broader Google Cloud goal and our pioneering AI-first initiative.
  • Drive engineering velocity across the entire project lifecycle, ensuring the predictable, high-quality delivery of scalable features.
  • Drive deep technical decision-making for our infrastructure components, fostering a culture of code reviews, scalable architecture design, AI-first and data-driven development, while mentoring engineers.
  • Advocate an unyielding customer-first mindset, establishing standards for service reliability, performance, and operational excellence, transforming complex customer requirements into technical realities, and maintaining a healthy production.
Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. See also Google's EEO Policy and EEO is the Law. If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form.

About Google

Provides online search, advertising, cloud computing, and consumer electronics.

Year founded
1998
Employees
190000
Organization type
Public
Headquarters
US

Similar jobs

Software Engineering Manager roles near Tel Aviv, Tel Aviv District
1w
Save
Mark Applied
Hide
Software Engineering Manager, Networking Tools Team
Yokneam or Tel Aviv
OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs GPU-accelerated computing and artificial intelligence hardware.
8+ YOE3+ MgmtRequires 8+ years software development experience, 3+ years software engineering management, C++, Python, Linux, Git, debugging, design, leadership, and communication skills.
C++, Python, Linux, Git
1w
Save
Mark Applied
Hide
Software Engineering Manager, Networking Tools Team
Yokne'am Illit or Tel Aviv-Yafo
OnsiteFull Time
NVIDIA
NVIDIANASDAQ: NVDA: Designs graphics processing units and artificial intelligence hardware.
8+ YOE3+ MgmtBachelor's or master's degree or equivalent experience; 8+ years software development and 3+ years engineering management experience; proficiency in C++, Python, Linux, Git, object-oriented design, debugging, and modern development practices.
C++, Python, Linux, Git
2w
Save
Mark Applied
Hide
Software Engineering Manager
Durham or Austin or New York City or Los Angeles or San Francisco or London or Berlin or Singapore or Tel Aviv or Europe or United States or Israel
HybridFull Time
Digital Turbine
Digital TurbineNASDAQ: APPS: Platform for mobile application distribution and advertising monetization.
8+ YOE2+ MgmtRequires 8+ years of software development, 2+ years of direct engineering people management, full-stack and distributed systems expertise, API design, cloud infrastructure, Agile, CI/CD, and operational metrics experience.
TypeScript, React, Java, Kotlin, Go, Python, C++, AWS, GCP, CI/CD, Agile, SLA, SLO
2w
Save
Mark Applied
Hide
Manager, SW Engineering- Identity SSO- (Idira)
Petah Tikva, Central District, Israel
OnsiteFull Time
Palo Alto Networks
Palo Alto NetworksNASDAQ: PANW: Provides enterprise-grade network, cloud, and endpoint security software.
5+ YOE5+ Mgmt5+ years R&D/engineering management, 5+ years hands-on development (C#, Node.js, React JS), cloud and CI/CD experience, strong communication and architecture skills, familiarity with Identity SSO and security protocols.
C#, Node.js, React JS, AWS, Azure, Google Cloud, AWS CDK, Terraform, SAML, OAuth2, OIDC, SCIM, CI/CD, GitHub, Jenkins, Artifactory, Docker, Kubernetes, OpenShift, OpenAI, Anthropic
1mo
Save
Mark Applied
Hide
Manager, Software Engineering - Figma Weave (Tel Aviv, Israel)
Tel Aviv-Yafo, Tel Aviv District, Israel
HybridFull Time
Figma
FigmaNew York Stock Exchange: FIG: Collaborative interface design and prototyping software for teams.
4+ Mgmt4+ years hiring and leading engineering teams, hands-on technical background, strategic product and engineering roadmap thinking, strong cross-functional collaboration and leadership skills.
2mo
Save
Mark Applied
Hide
Manager, Software Engineering
Ramat Gan, Tel Aviv District, Israel
OnsiteFull Time
Mastercard
MastercardNYSE: MA: Global payment processing and financial technology service provider.
7+ YOE2+ MgmtBachelor's in CS/Engineering, 7+ years engineering experience with distributed systems and large-scale data platforms, 2+ years leading engineering teams, hands-on with Kafka/Spark/Flink/Airflow/DBT/Snowflake, strong Java/Scala/Python and cloud (AWS/GCP/Azure) skills.
Kafka, Spark, Flink, Airflow, DBT, Snowflake, Cassandra/ScyllaDB, Java, Scala, Python, AWS, GCP, Azure, Kubernetes, CI/CD
1w
Save
Mark Applied
Hide
Senior Software Engineer Lead
Tel Aviv or Israel
RemoteFull Time
Akamai
AkamaiNASDAQ: AKAM: Provides content delivery, cybersecurity, and cloud computing services globally.
5+ YOE2+ MgmtRequires 2+ years leading software engineering teams and 5+ years as a senior software engineer in SaaS, plus cloud-native, microservices, distributed systems, AWS, Kubernetes, CI/CD, mentorship, and strategic leadership experience.
AWS, Kubernetes, CI/CD
8mo
Save
Mark Applied
Hide
Manager, Software Development Engineering
Tel Aviv, Tel Aviv, Israel
HybridFull Time
Workday
WorkdayNASDAQ: WDAY: Provides cloud-based software for financial and human capital management.
3+ YOE3+ Mgmt3+ years managing software teams; 5+ years hands-on development; Python/Node.js; GraphQL/REST; RabbitMQ; React/Angular/Vue; English fluency; BS in CS/Engineering.
Python, Node.js, RabbitMQ, GraphQL, REST, React, Angular, Vue, Kubernetes, ArgoCD, Argo Workflows, Airflow, Prefect, MS Teams, Slack, RPA