1w
Save
Mark Applied
Hide
Inference Infrastructure Engineer, Serving
Palo Alto, California, United States
$275k-$475k/yr OnsiteFull Time
3+ YOE3+ years building low-latency, high-throughput inference serving systems; knowledge of quantization, batching, speculative decoding, KV cache; experience with vLLM/TensorRT-LLM/Triton/SGLang; multi-GPU model parallelism; C++/CUDA/Python; autoscaling and GPU cost optimization.
vLLM, TensorRT-LLM, Triton, SGLang, C++, CUDA, Python
4d
Save
Mark Applied
Hide
Senior Performance Co-Design Engineer, LLM Serving
Sunnyvale, California, United States
$174k-$252k/yr OnsiteFull Time
5+ YOEBachelor's in CS/EE/CE or equivalent,5+ years in performance modeling/engineering or architecture,proficiency with C++ or Python,experience with ML serving and hardware/software co-design preferred.
C++, Python, TPU, Vertex AI
1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer, Ad Serving
New York or San Jose
$195k-$408k/yr HybridFull Time
10+ YOE10+ years applying machine learning and optimization to production systems; deep statistics/ML expertise; production ML lifecycle experience (feature engineering, model serving, monitoring); strong software skills in Python, SQL, Java/Scala; excellent communication.
Python, SQL, Java/Scala
3w
Save
Mark Applied
Hide
Senior Machine Learning Engineer, Model Serving Infrastructure (Multiple Positions)
San Jose, California, United States
$265k-$388k/yr OnsiteFull Time
2+ YOEMaster's (plus 2 years) or Bachelor's (plus 5 years) in a quantitative field; 2+ years coding in Python or C++; Linux development experience; ML, system design, and production deployment experience.
Python, C++, Linux
2w
Save
Mark Applied
Hide
Staff Software Engineer, Foundation Model API
San Francisco or Mountain View
$190k-$265k/yr OnsiteFull Time
8+ YOE8+ years backend/infrastructure experience, distributed systems, scalable APIs, cloud-native infra, real-time serving/ML infra/GPU orchestration, strong Scala/Go/Python skills, product ownership and customer engagement.
OpenAI, Anthropic, Gemini, Qwen, GPT-OSS, Llama, SageMaker, Vertex AI, Azure ML, FMAPI, Apache Spark™, Delta Lake, MLflow, Scala, Go, Python
6d
Save
Mark Applied
Hide
Distributed Systems Engineer 5 - Core Ad Serving Platform
New York City or Seattle or Los Angeles or Los Gatos
$388k-$619k/yr OnsiteFull Time
7+ YOE7+ years experience with at least 4+ years in Ads domain, expertise building and operating large-scale distributed systems, ad-server components, API and data model design, SLO-driven development, and incident response.
1mo
Save
Mark Applied
Hide
Infrastructure Engineer
Redwood City, California, United States
HybridFull Time
8+ YOE8+ years in infrastructure/DevOps/SRE; strong cloud expertise; experience with CI/CD, PostgreSQL, Redis, APM, model serving, vector databases, GPU optimization, and LLM deployment.
PostgreSQL, Redis, APM, CI/CD, vector databases, model serving frameworks, LLM
1mo
Save
Mark Applied
Hide
AI Field Engineer - AI Natives
San Mateo, California, United States
FieldFull Time
5+ YOE5+ years in customer-facing technical engineering roles, strong Python and Kubernetes skills, experience with LLM inference, model serving and fine-tuning, cloud GPU deployment across major clouds, and exceptional communication.
Python, Kubernetes, vLLM, SGLang, TensorRT-LLM, AWS, Microsoft Azure, GCP, Azure AI Foundry, AWS Bedrock, SageMaker, GCP Vertex
1mo
Save
Mark Applied
Hide
Senior Machine Learning Engineer
Palo Alto, California, United States
$189k-$283k/yr OnsiteFull Time
2+ YOEBachelor's in a technical field required, 2+ years production ML experience, proficiency in Python and PyTorch, experience training/fine-tuning/distilling language models, serving low-latency models, and building closed-loop data and evaluation pipelines.
Python, PyTorch, vLLM, SGLang, TensorRT-LLM, LoRA, DPO, RLAIF, RLHF, GRPO, FP8, INT8, KV-cache, MCP, LiteLLM, Google ADK, Azure AI Foundry, Vertex AI
1w
Save
Mark Applied
Hide
Machine Learning Engineer (Staff)
San Francisco or Menlo Park
$220k-$270k/yr HybridFull Time
8+ YOE8+ years building production ML systems and infrastructure; experience with training/serving pipelines, feature pipelines, monitoring, deployment, cloud, containers, CI/CD, and model governance.
CI/CD, APIs, containers, feature stores, MLOps, LLM
3w
Save
Mark Applied
Hide
Analytics Engineer, Revenue
San Mateo or Provo or United States
$181k-$245k/yr RemoteFull Time
5+ YOE5+ years in data engineering/analytics with strong SQL, data modeling, dbt and BI experience; builds dimensional models, KPIs, and self-serve analytics; cross-functional collaboration with Revenue and Finance.
SQL, dbt, Looker, Tableau, Sigma, BigQuery, Snowflake, Python, CRM, Monte Carlo, Great Expectations
2mo
Save
Mark Applied
Hide
Machine Learning Engineer 5 - Decisioning & Optimization
New York or Los Angeles or Los Gatos or Seattle
$466k-$750k/yr OnsiteFull Time
7+ YOE7+ years software engineering; 3+ years ML infrastructure, model serving, or ML platform experience in ads/real-time decisioning; real-time model serving with sub-20ms latency; proficiency in Java, Python, or Scala; experience with ML serving frameworks and real-time feature pipelines; strong model monitoring and production readiness.
Java, Python, Scala, ML serving frameworks, feature stores, model registries
1mo
Save
Mark Applied
Hide
Head of Developer Relations
San Mateo, California, United States
$160k-$240k/yr HybridFull Time
6+ YOE6+ years combined software engineering, DevRel, and technical content experience; strong technical fluency in inference/model serving; prior experience growing developer communities and producing technical content and benchmarks.
Discord, Hacker News
1mo
Save
Mark Applied
Hide
Software Development Engineer II (Planning and Forecasting)
Palo Alto, California, United States
$162k-$182k/yr OnsiteFull Time
2+ YOE2-4 years production software engineering experience; strong fundamentals in data structures and algorithms; experience with data pipelines, APIs, and model-serving; AI-native engineering practice; Bachelor's in CS/Engineering or equivalent experience.
Google Meet, Zoom
1mo
Save
Mark Applied
Hide
Sr Machine Learning Services Engineer
San Jose, California, United States
$152k-$265k/yr OnsiteFull Time
5+ YOE5+ years building and operating ML systems with GPU workloads, designing large-scale cloud services, optimizing model inference, and collaborating with research and engineering teams; proficiency with Python, PyTorch/TensorFlow, model serving tools, containerization, orchestration, and AWS.
Python, PyTorch, TensorFlow, NVIDIA Triton, TorchServe, ONNX, AIT, AOT, CUDA, Docker, Kubernetes, AWS
3w
Save
Mark Applied
Hide
Senior Machine Learning Engineer
Palo Alto, California, United States
$149k-$306k/yr HybridFull Time
7+ YOEMaster's in Software Engineering, 7+ years development experience, 3+ years with SAP BTP & SAP AI Core, strong Java/Python/NodeJs skills, Docker/Kubernetes, ML model serving, PyTorch or TensorFlow, SQL/Postgres, CI/CD and cloud experience.
SAP BTP, SAP AI Core, SAP GenAI Hub, Java, Python, NodeJs, Docker, Kubernetes, PyTorch, TensorFlow, Git, SQL, Postgres, AWS, GCP, Azure, ReactJS, SAP UI5, CI/CD
1mo
Save
Mark Applied
Hide
(USA) Distinguished, Software Engineer
Bentonville or Sunnyvale
$130k-$260k/yr OnsiteFull Time
10+ YOE10+ years building and operating large-scale distributed systems; deep AI/ML systems and model-serving experience; cloud-native platform and observability expertise; strong communication and technical leadership.
JSON Schema, OpenAPI, Pydantic, protobuf, WCAG 2.2, CI/CD
1mo
Save
Mark Applied
Hide
DevOps, MLOps & Security Engineering Lead
San Jose, California, United States
$140k-$170k/yr HybridFull Time
Engineering leader with hands-on DevSecOps experience across AWS and GCP, CI/CD and IaC expertise, AI infrastructure (GPU/compute provisioning, model serving), cloud security, and scripting in Python/Bash/Go/Java.
AWS, GCP, SageMaker, Vertex AI, EKS, GKE, Python, Bash, Go, Java
2w
Save
Mark Applied
Hide
Senior Software Engineer: Assistant
San Mateo, California, United States
$197k-$243k/yr HybridFull Time
5+ YOE5+ years building large-scale software; experience with AI infrastructure, model serving, orchestration, agentic systems; proficiency in C++, C#, Java, SQL/NoSQL; strong system design and leadership skills.
C++, C#, Java, SQL, NoSQL, LLM
1mo
Save
Mark Applied
Hide
Sr. Staff Software Engineer, Systems Infrastructure
Sunnyvale or Mountain View
$198k-$326k/yr HybridFull Time
LinkedInNASDAQ: MSFT: Professional social network for career development and job recruitment.
8+ YOEBA/BS or equivalent; 8+ years engineering experience building large-scale ML/model serving and GPU systems; experience with CUDA, PyTorch/TensorFlow, C++/Go/Python/Java; strong systems and performance optimization skills.
SGLang, vLLM, Triton, TensorRT, Ray, XLA, TVM, PyTorch, TensorFlow, CUDA, C++, Go, Python, Java
Explore Jobs