PromotedHiringCafe
ML Engineer - Inference & Model Deployment
Cupertino, CA, US
$250k-$310k/yr On-SiteFull Time
Turn powerful AI and ML models into fast, reliable production systems. Own inference latency, throughput, model-serving architecture, multi-GPU systems, and production deployment for millions of users.
Python, PyTorch, vLLM, SGLang, TensorRT, LLMs
PromotedHiringCafe
Founding Machine Learning / AI Search Engineer
Cupertino, CA, US
$160k-$310k/yr On-SiteFull Time
Build the ML and AI search behind HiringCafe — ranking, recommenders, retrieval, and LLM agents that surface jobs people would never find on their own.
Python, PyTorch, Elasticsearch, LLMs
PromotedHiringCafe
Founding Backend / Infra Engineer
Cupertino, CA, US
$160k-$300k/yr On-SiteFull Time
Own the crawlers, pipelines, and infrastructure powering a real-time job search engine. Strong Node.js and Python fundamentals; bonus points for security and reverse-engineering chops.
Node.js, Python, Elasticsearch, Redis
1w
Save
Mark Applied
Hide
AI Infrastructure Engineer
San Jose, California, United States
$45k-$121k/yr OnsiteFull Time
3+ YOEDesign and build hybrid AI infrastructure integrating compute, GPU nodes, software-defined storage, Kubernetes, IaC, and observability; 3+ years experience in AI infrastructure or related roles.
NC2, Objects (S3-compatible), Kubernetes, Calm, Terraform, Prometheus, Grafana, ELK, OpenTelemetry, AOS, AHV, Cloud Manager (NCM)
2mo
Save
Mark Applied
Hide
AI Infrastructure Engineer
San Francisco, California, United States
$190k-$270k/yr OnsiteFull Time
5+ YOE5+ years in AI infrastructure or related roles; BS in CS or equivalent; knowledge of Ansible, Terraform, Kubernetes; programming/scripting; monitoring/observability; cloud services; collaborative work
Ansible, Terraform, Kubernetes
1mo
Save
Mark Applied
Hide
AI Infrastructure Engineer - Emerging Technologies
Ashburn or Dallas or Columbus
RemoteFull Time
5+ YOEBachelor's in engineering or related field, 5+ years in data center/AI/HPC/power or cooling engineering, strong understanding of AI compute and infrastructure, ability to translate technical analysis into infrastructure strategy, authorized to work in the U.S. (no sponsorship).
NVIDIA GPU architectures, ARM, Battery Energy Storage Systems (BESS), UPS
1w
Save
Mark Applied
Hide
Staff AI Infrastructure Engineer
Austin or Reston
HybridFull Time
8+ YOE8+ years building distributed systems and cloud-native AI infrastructure; strong Python and systems programming skills; Kubernetes, GPU inference, and platform engineering experience; leadership and architecture experience.
Python, Go, Rust, C++, vLLM, SGLang, TensorRT-LLM, Triton Inference Server, Ray Serve, Kubernetes, Helm, Argo CD, Docker, Prometheus, Grafana, OpenTelemetry, Infrastructure-as-Code, GitOps, CI/CD, AWS, Azure, Oracle Cloud Infrastructure, Google Cloud Platform
1mo
Save
Mark Applied
Hide
AI Infrastructure Engineer
San Jose, California, United States
$179k-$306k/yr HybridFull Time
5+ YOE5+ years in DevOps/platform/infrastructure engineering; deep Kubernetes experience; experience building developer-facing platforms, Helm and GitOps workflows, storage/networking for GPU workloads; Terraform, monitoring, and ML framework exposure preferred.
Kubernetes, Helm, ArgoCD, Flux, GitOps, Terraform, CSI drivers, CNI, Prometheus, Grafana, Loki, Slurm, PyTorch, vLLM, SGLang
3d
Save
Mark Applied
Hide
AI Infrastructure Engineer
Fremont, California, United States
OnsiteFull Time
Experience with on-prem/datacenter operations, Infrastructure-as-Code, networking (VLANs/routing/firewalls), container orchestration, scripting, Git; comfortable with hands-on hardware tasks.
Terraform, Terragrunt, Ansible, Vault, Boundary, Keycloak, Prometheus, Grafana, Alertmanager, Docker, Kubernetes, Git, Jira, Confluence
3w
Save
Mark Applied
Hide
AI Infrastructure Engineer
Seattle, Washington, United States
$152k-$332k/yr OnsiteFull Time
5+ YOEBachelor's in CS/Engineering/AI, 5+ years software engineering experience in infrastructure and distributed systems, GPU/CUDA expertise, container and cloud experience, Python/C++ programming, PyTorch and Transformers experience.
Docker, Kubernetes, CUDA, Python, C++, PyTorch, Transformers, BrightHire
3mo
Save
Mark Applied
Hide
AI Infrastructure Engineer
United States
$170k-$210k/yr RemoteFull Time
5+ YOE5+ years software engineering with a focus on AI infrastructure, ML model serving, distributed systems, and GPU-based deployments; Python experience; Kubernetes/Docker; travel up to 10%.
Python, C++, CUDA, Go, Rust, TensorRT, Triton, TorchServe, Kubernetes, Docker, vLLM, SGLang, Datadog, Prometheus, Grafana, Terraform, Helm
3mo
Save
Mark Applied
Hide
Senior AI Infrastructure Engineer
Wilmington, Massachusetts, United States
$144k-$198k/yr OnsiteFull Time
Deep expertise in designing and operating AI infrastructure across on-prem, hybrid, and cloud; proven ability to work embedded with technical teams; strong Kubernetes and distributed compute experience; Infrastructure-as-Code proficiency; cloud multi-region experience.
Kubernetes, Ray, Spark, Terraform, CDK, Terraform, Container orchestration, Infrastructure-as-Code
3w
Save
Mark Applied
Hide
AI Infrastructure Engineer
Chicago or Hartford or Nashville or Costa Mesa or San Jose or Atlanta or Boston or Cleveland or Columbus or Dallas or Denver or Fort Lauderdale or Grand Rapids or Indianapolis or Los Angeles or Miami or New York or Oakbrook Terrace or Sacramento or San Francisco or South Bend or Tampa or Houston or Austin or Charlotte
$95k-$213k/yr OnsiteFull Time
Design, operate, and scale production Kubernetes (AKS) platforms; build Terraform and Crossplane infra-as-code; implement GitOps with FluxCD; create Azure DevOps pipelines; define observability (Azure Monitor, Prometheus, Grafana); bachelor’s degree required.
Terraform, Crossplane, FluxCD, GitOps, ADO, Azure DevOps, AKS, Kubernetes, Microsoft Azure, Azure Monitor, Log Analytics, Prometheus, Grafana, OpenFaaS, ARM templates, Octopus Deploy, Key Vault, ACR
1w
Save
Mark Applied
Hide
Senior AI Infrastructure Engineer, LLM/AI Platforms
Virginia or United States
$140k-$215k/yr RemoteFull Time
6+ YOE6+ years infrastructure/data engineering experience with 2+ years on LLM platforms; bachelor’s in CS or related; hands-on LLM infra, GPU cluster provisioning, distributed training, container orchestration, IaC, EMR/cloud experience, strong Python skills, technical leadership.
MLflow, Sagemaker, Vertex AI, CUDA, NVIDIA, GPU, TPU, vLLM, Triton Inference Server, Pytorch, Ray, Megatron, JAX, Python, Docker, Kubernetes, Slurm, Airflow, Terraform, Ansible, AWS, GCP, OCI, LangChain, LlamaIndex, Spark, Dask, Flink
3d
Save
Mark Applied
Hide
AI Infrastructure Engineer
Huntsville, Alabama, United States
OnsiteFull Time
10+ YOEBachelor's in CS/Engineering/Data Science/Math,10+ years enterprise IT experience, experience with AI/ML applications, familiarity with LLM patterns, strong communication, and active security clearance.
LangChain, LangGraph, Semantic Kernel, AutoGen, CrewAI, Haystack, LlamaIndex, Python, JavaScript, TypeScript
1mo
Save
Mark Applied
Hide
AI Infrastructure & Security Engineer
Alexandria, Virginia, United States
$110k-$140k/yr RemoteFull Time
3+ YOE3+ years software engineering and Azure experience, CI/CD and DevOps with Azure DevOps/GitHub, containerization, Python scripting, production AI coding agent experience, security-focused instincts, and ability to communicate across teams.
Claude, Claude Code, CLAUDE.md, Cowork, Azure, Azure Container Apps, Azure DevOps, Azure Repos, GitHub, CI/CD, npm, NuGet, Office 365, eCommerce, CRM, Python, Windows Server, Linux, DNS, TCP/IP, firewalls, VPNs, MCP
3w
Save
Mark Applied
Hide
AI Infrastructure Engineer
United States
OnsiteFull Time
5+ YOE5+ years infrastructure/cloud/DevOps experience with AWS and Azure, Terraform, Docker, CI/CD, monitoring, Linux, scripting, and cloud security/IAM.
Azure, AWS, Terraform, Docker, GitHub Actions, Prometheus, Grafana, ELK, Jenkins, Azure DevOps, Linux, Vault, AWS Secrets Manager, Azure Key Vault, Python, Bash, PowerShell, Kubernetes, App Services, Load Balancers
1mo
Save
Mark Applied
Hide
Cloud Infrastructure and AI Efficiency Engineer
San Francisco, California, United States
OnsiteFull Time
Engineering role focused on cloud infrastructure and AI efficiency; specific experience and certifications not provided in the description.
3w
Save
Mark Applied
Hide
Senior AI Infrastructure Engineer
United States
RemoteFull Time
No specific qualifications, responsibilities, or technical requirements are listed in the posting.
1mo
Save
Mark Applied
Hide
Gen AI Infrastructure Engineer
Woodbridge or New York City or Atlanta or Boston or Chicago or Dallas or Delaware or Denver or Garden City or Cayman Islands or Greenwich or Houston or Los Angeles or Miami or Naples or Nevada or Palm Beach or San Diego or San Francisco or Seattle or Stuart or Washington
$160k-$200k/yr HybridFull Time
7+ YOE7+ years in DevOps/platform/cloud infrastructure engineering; strong AWS (IAM, CloudFormation, Lambda, API Gateway, VPC, CloudWatch, SSM, Secrets Manager, ECR); AWS CDK/CloudFormation/Terraform; CI/CD (Bitbucket/GitHub Actions, OIDC); container and datastore operations; security fundamentals.
AWS Bedrock, AgentCore, Lambda, API Gateway, AWS CDK, CloudFormation, Terraform, Bitbucket Pipelines, GitHub Actions, OIDC, IAM, VPC, CloudWatch, SSM, Secrets Manager, ECR, Neo4j, Neptune, Redis, Milvus, VectorDB
3w
Save
Mark Applied
Hide
AI Infrastructure Manager
Bengaluru or San Francisco or Boston or New York City or Austin or Tokyo or London
HybridFull Time
Experience leading engineering teams building GenAI or AI infrastructure and distributed systems; strong cloud, accelerator, and performance optimization knowledge; proficiency in Python or Go; architecture and reliability experience.
Python, Go
1mo
Save
Mark Applied
Hide
Senior AI Infrastructure Engineer - DGX Cloud
Santa Clara or California
$152k-$288k/yr HybridFull Time
5+ YOEBS or equivalent, 5+ years experience, background in infrastructure automation and distributed systems, proficiency with Python/Go/C/C++/Java, Kubernetes/OpenStack, Terraform, Linux, and experience with large-scale cloud platforms.
DGX Cloud, Kubernetes, OpenStack, Python, Go, C/C++, Java, Terraform, Slurm, Linux
1mo
Save
Mark Applied
Hide
Senior AI Infrastructure Engineer - DGX Cloud
Santa Clara or California or United States
$152k-$288k/yr OnsiteFull Time
5+ YOEBS in CS or related (or equivalent experience), 5+ years experience, expertise in infrastructure automation and distributed systems, proficiency in Python/Go/C/C++/Java, Kubernetes, OpenStack, Terraform, Linux, and capacity/performance management.
Kubernetes, OpenStack, Python, Go, C/C++, Java, Terraform, Slurm, Infrastructure as a Code (IAAC), Linux
Explore Jobs