In this role, you will drive the performance and optimization of both training and serving, delivering massive impact for customers. We are seeking a talented Kernel Engineer to join the highly interdisciplinary CoreML team. You will have exposure to the newest Tensor Processing Unit (TPU), Graphics Processing Unit (GPU) hardware, the latest ML models, and the advanced toolchains that bridge them. Your work will directly enable AI research and production deployments across Google Cloud, and the broader open-source ecosystem. You will address complex technical issues that directly impact the efficiency and scalability of AI across the industry.

Responsibilities

• Design and optimize high-performance kernels (using languages like Pallas, Mosaic, and Triton) targeting Tensor Processing Unit (TPU) and Graphics Processing Unit (GPU) architectures for critical Machine Learning (ML) operations, redefining what’s possible from massive training runs to high-speed inference
• Architect infrastructure such as benchmarking suites, autotuning frameworks, performance analysis tools, regression testing, and documentation, transforming how the developer community interacts with increasingly critical custom kernels in key Open-Source Software (OSS) libraries
• Track the latest advancements in hardware architectures, compiler technologies, and AI models to identify new opportunities for performance optimization through custom kernels
• Engage with ML researchers, framework developers (Just After eXecution (JAX), PyTorch), and compiler engineers (Accelerated Linear Algebra (XLA)) to enhance adoption, identify new requirements, and address bottlenecks by providing appropriate solutions

Requirements

• Overall, 12+ years of industry experience
• 5+ years of experience with software development in C++ or Python
• 3+ years of experience testing, maintaining, or launching software products, and at least 1 year of experience with software design and architecture
• Experience with performance optimization at the kernel level
• Experience optimizing TPU/GPU code using low-level kernel languages like Pallas, Compute Unified Device Architecture (CUDA), or Triton
• Knowledge of ML frameworks (JAX/PyTorch) and common operations like attention and Mixture of Experts (MoEs), including model optimization and low-precision formats
• Understanding of modern accelerators (e.g., data movement, pipelining, heterogeneous compute, and scale-out)
• Understanding of compiler principles (optimization, code generation) and toolchains such as MLIR and OpenXLA
• Demonstrated record of building developer infrastructure, including Open-Source Software (OSS) libraries, flexible high-performance APIs, and easy-to-consume documentation to empower the community
• Excellent investigative and problem-solving capabilities, with strong communication skills across cross-functional teams

We offer/Benefits

• Opportunity to work in a fast-paced, agile, software engineering culture
• Comfortable modern office in Prague 7, with support of hybrid or fully remote mode
• Benefit program (5 weeks of vacation, paid sick days, paid days off for special occasions, meal vouchers, flexi pass, Prague city public transport annual coupon, multisport cards, optional contribution to pension fund, health insurance for family member)
• EPAM Employee Stock Purchase Plan (ESPP) (subject to certain eligibility requirements)
• English language courses
• Czech language courses upon request
• Referral bonuses for recommended candidates
• Mobile Phone Tariff’s program for managerial-level candidates
• Great learning and development opportunities, including in-house professional training, career advisory and coaching, sponsored professional certifications, well-being programs, LinkedIn Learning Solutions and much more

• Opportunity to work in a fast-paced, agile, software engineering culture
• Benefit program (5 weeks of vacation, 5 paid sick days, meal vouchers, cafeteria and recreation bonuses, reimbursement of glasses, contribution to pension fund)
• Referral bonuses for recommended candidates
• English language courses
• Great learning and development opportunities, including in-house professional training, career advisory and coaching, sponsored professional certifications, well-being programs, LinkedIn Learning Solutions and much more

The remote work option is available to candidates residing and working within the Czech Republic.

The remote work option is available to candidates residing and working within Slovakia.

Certain benefits and perks may be subject to eligibility requirements and may be available only after you have passed your probationary period.

Certain benefits and perks may be subject to eligibility requirements and may be available only after you have passed your probationary period.