We are Foundation Model Inference Team, within AI, Search & Knowledge Platform Technologies organization. Our team is responsible to build Inference stack to power Apple Intelligence. It builds frameworks, services and tools that power the largest Apple foundation models on servers. Our Infrastructure powers a wide gamut of services at Apple including Apple Search, Apple Music, AppleTV, AppStore, iMessages, Photos & Camera, Spotlight, Safari, Siri and upcoming ever exciting Apple products serving millions of queries every day with incredible low latencies, drawing every ounce of compute from our hardware. As part of this group, you will get a chance to bring Intelligence to billions of users across the world. You will have an opportunity to make difference in life of people by empowering them with AI. You will have a chance to work on optimizing billions of parameter language and vision and speech models using state of the art technologies and make it run at scale of Apple.
Posted 3d ago
Sr. Machine Learning Engineer, Foundation Models Inference - Cloud OS & Inference
Apple
Seattle, Washington, United States
OnsiteFull Time
Responsibilities
- building frameworks
- optimizing models
- scaling inference
Requirements
- Build and optimize inference frameworks
- Services, and tools for large-scale foundation models
- Supporting low-latency AI services across Apple products
Job description
About Apple
Designs and sells consumer electronics, software, and online services.
Year founded
1976
Employees
166000
Industries
Activities
Organization type
Public
Headquarters
US
Similar jobs
Machine Learning Engineer roles near Seattle, Washington
7h
Save
Mark Applied
Hide
Machine Learning Engineer Graduate (E-Commerce Governance) - 2027 Start
Seattle or Los Angeles or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
$122k-$243k/yr OnsiteFull Time
Bachelor's degree in software development, computer science, computer engineering, or related field; strong coding, Linux, Python, Go, or C++, algorithms, and machine learning knowledge.
Linux, Python, Go, C++
3d
Save
Mark Applied
Hide
Lead Machine Learning Engineering, (Hybrid)
Seattle or San Jose
$198k-$250k/yr HybridFull Time
8+ YOESTEM degree and 8+ years relevant experience, or equivalent advanced-degree pathways; 3+ years scaling ML datasets; 5+ years programming and ML framework experience.
Python, C++, Go, PyTorch, TensorFlow, Spark, Ray, Beam, Large Language Models (LLMs)
3d
Save
Mark Applied
Hide
Staff Machine Learning Engineer, Generative AI Modeling and Inference
Los Angeles or Seattle or Palo Alto or New York City or Bellevue
$195k-$343k/yr OnsiteFull Time
8+ YOEBachelor's degree or equivalent experience and 8+ years of post-bachelor's ML experience, or advanced degree with equivalent experience. Requires computer vision or generative modeling and ML framework experience.
TensorFlow, PyTorch, JAX, MLX, scikit-learn, GPU, CPU, NPU, RSUs
3d
Save
Mark Applied
Hide
Staff Machine Learning Engineer, Generative AI Modeling and Inference
Los Angeles or Seattle or Palo Alto or New York City or Bellevue
$229k-$343k/yr OnsiteFull Time
8+ YOEBachelor's degree or equivalent experience and 8+ years of post-bachelor's machine learning experience, with expertise in generative modeling, computer vision, deep learning, and ML frameworks.
TensorFlow, PyTorch, JAX, MLX, scikit-learn
3d
Save
Mark Applied
Hide
Senior Machine Learning Engineer
Seattle, Washington, United States
$151k-$241k/yr HybridFull Time
6+ YOEBachelor's degree in a technical field, 6+ years of software engineering experience, AI model deployment, cloud architecture, Python, C++, ML frameworks, Linux, and strong system design and problem-solving skills.
Python, C++, TensorFlow, PyTorch, Linux
5d
Save
Mark Applied
Hide
Machine Learning Engineer, GenAI Technology
New York City or Stamford or Seattle
$185k-$300k/yr OnsiteFull Time
3+ YOEBachelor’s or master’s degree in computer science, engineering, or related field; 3–7 years of AI/ML engineering experience; expertise in TensorFlow, PyTorch, Scikit-learn, and Python, Java, or C++.
TensorFlow, PyTorch, Scikit-learn, Python, Java, C++
5d
Save
Mark Applied
Hide
Senior/Staff Machine Learning Engineer, Data Infrastructure
Mountain View or Bellevue
$200k-$261k/yr OnsiteFull Time
Strong Python and distributed-systems experience with Flink, Spark, or Ray; expertise in training data, ML feature pipelines, orchestration, scalability, reliability, performance, and cost optimization.
Flink, Spark, Ray, Flyte, Airflow, Python
6d
Save
Mark Applied
Hide
Agent Evaluation & Evolution Machine Learning Engineer Graduate (AML-Ark-US) - 2027 Start
Seattle, Washington, United States
OnsiteFull Time
Bachelor's or master's degree in a relevant field, machine learning and deep learning foundations, hands-on LLM system experience, strong Python skills, ML or agent evaluation framework experience, and demonstrated research or engineering ability.
Python, Large Language Model (LLM), Model-as-a-Service (MaaS)