153 ml infrastructure engineer jobs at 96 companies in Clark, NJ
23h
Save
Mark Applied
Hide
Senior ML Infra Engineer
New York City or San Francisco
$200k-$275k/yr HybridFull Time
5+ YOERequires 5+ years in software, machine learning, or infrastructure engineering; Python proficiency; production ML infrastructure, cloud, distributed systems, containers, independent system design, and a Computer Science degree or equivalent.
Python
3mo
Save
Mark Applied
Hide
Senior ML Infrastructure Engineer
New York City, New York, United States
OnsiteFull Time
3+ YOEBachelor's degree or higher in CS/EE or related field; 3+ years backend infra; expert Python; 2+ years cloud (AWS); design APIs/SDKs; ML workflows.
Python, AWS, IAM, Networking, Cost Management, APIs, SDKs
3mo
Save
Mark Applied
Hide
Senior ML Infrastructure Engineer
New York City, New York, United States
$180k-$230k/yr OnsiteFull Time
5+ YOEExperience building scalable data pipelines; proficiency in Spark, Databricks, SQL, PySpark, Python; strong communication; ownership of end-to-end data systems; healthcare/insurance domain preferred.
Spark, Databricks, SQL, PySpark, Python, Git
3w
Save
Mark Applied
Hide
ML Engineer, Foundation Model Infrastructure
Mountain View or San Francisco or Kirkland or New York City
$175k-$215k/yr HybridFull Time
Master's degree or equivalent practical experience; Python and C++ proficiency; modern deep learning framework familiarity; experience with large-scale data pipelines or ML infrastructure.
Python, C++, Flume, JAX, PyTorch, TensorFlow, Spark, Borg, Kubeflow
1mo
Save
Mark Applied
Hide
Staff ML Engineer - Ads ML Infrastructure
New York City, New York, United States
OnsiteFull Time
Design, develop, and build scalable machine learning platform capabilities for advertising; collaborate with engineers and data scientists in an Agile environment; focus on performance and privacy.
3w
Save
Mark Applied
Hide
Senior Infrastructure Engineer, Research
Singapore or London or New York City or Singapore
HybridFull Time
5+ YOERequires 5+ years building and operating ML infrastructure at scale, distributed training expertise, Linux and networking fundamentals, Kubernetes and SLURM, Python, ML frameworks, and cloud GPU infrastructure experience.
NVIDIA DGX B200, NCCL, FSDP, DDP, Linux, NVLink, InfiniBand, Kubernetes, SLURM, Python, PyTorch, CoreWeave, Weights & Biases, MLflow, Prometheus, Grafana
1mo
Save
Mark Applied
Hide
Senior ML Ops Engineer
New York, New York, United States
$210k-$300k/yr OnsiteFull Time
5+ YOE5+ years building production ML/ML platform systems, strong Python and cloud infrastructure skills, experience with IaC and CI/CD, productionizing models and agentic workloads, and ownership of reliability/observability.
Python, Ruby, Ruby on Rails, AWS, Terraform, Kubernetes, GitHub Actions, Snowflake, Aurora/RDS, Redis, Kafka, vLLM, ONNX, TensorRT, MLflow, BentoML, Ray, Airflow, Bedrock, SageMaker, Vertex AI
5h
Save
Mark Applied
Hide
AI Infrastructure Engineer
New York City, New York, United States
$215k-$350k/yr HybridFull Time
Linux infrastructure administration, KVM or containerization, DevOps toolchains, Python or Bash automation, GPU-based compute or AI/ML infrastructure; bachelor's degree preferred.
Linux, KVM, Docker, Kubernetes, Python, Bash, FortiGate, FortiManager, FortiAnalyzer
2w
Save
Mark Applied
Hide
Senior ML Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York City or Canada or Seattle or Santa Barbara or San Diego or Toronto
$152k-$228k/yr RemoteFull Time
5+ YOE5+ years of ML engineering experience; advanced Python, PyTorch, and deep learning; production NLP model deployment; SLM/LLM fine-tuning; inference infrastructure; production APIs; MLOps and model monitoring.
Python, PyTorch, HuggingFace Transformers, spaCy, Triton Inference Server, Baseten, Kubernetes, LoRA, QLoRA, PEFT, vLLM, TGI, SageMaker, Vertex AI, Braintrust, MLflow, RLHF
2w
Save
Mark Applied
Hide
Senior Infrastructure Engineer
Petah Tikva or Austin or New York City or Los Angeles or San Francisco or London or Berlin or Singapore or Tel Aviv
HybridFull Time
8+ YOE8+ years in infrastructure, platform, or back-end engineering; distributed systems, AWS or GCP, programming, Kubernetes, data or ML infrastructure, infrastructure-as-code, CI/CD, GitOps, observability, and production operations experience.
AWS, GCP, Azure, Go, Java, Python, Scala, Kubernetes, Spark, Apache Kafka, Databricks, ArgoCD, GitOps, CI/CD, MLOps, FinOps
2w
Save
Mark Applied
Hide
Senior AI/ML Engineer
New York City, New York, United States
RemoteFull Time
Build inference infrastructure, own model evaluation pipelines, optimize latency, and integrate orchestration engines with frontier large language models.
3mo
Save
Mark Applied
Hide
Infrastructure Engineer
New York or San Francisco or United States
$165k-$200k/yr HybridFull Time
Kubernetes production experience; IaC (Terraform/Helm); cloud (AWS/GCP); Python/Node.js; CI/CD (GitHub Actions/Spacelift); security and ML/AI infrastructure familiarity.
Kubernetes, Terraform, Helm, Python, Node.js, GitHub Actions, Spacelift, AWS, GCP, PyTorch, TensorFlow, Bash
1mo
Save
Mark Applied
Hide
Machine Learning Infrastructure Engineer
San Francisco or New York or Los Angeles or Seattle
$200k-$345k/yr HybridFull Time
4+ YOE4+ years building ML systems,3+ years software engineering,1+ year Python,experience with databases,monitoring,cloud services and production ML deployments.
Python, PostgreSQL, DynamoDB, Elasticsearch, Redis, DataDog, Grafana, AWS Sagemaker, Lambda, Kinesis, S3, EC2, EKS, ECS, Apache Kafka, Flink
3mo
Save
Mark Applied
Hide
SWE - Backend Infrastructure Engineer
San Francisco or Bellevue or New York
$175k-$280k/yr OnsiteFull Time
3+ YOEStrong systems thinker with reliability engineering experience; 3+ years in infrastructure, platform, or ML systems; Kubernetes production experience; strong communication.
Kubernetes, Terraform, CloudFormation, Pulumi, TorchServe, Seldon, KServe, Ray Serve, PyTorch, APIs, Database design
2mo
Save
Mark Applied
Hide
Founding ML Engineer
New York City or San Francisco
OnsiteFull Time
3+ YOERequires 3–7 years of experience, Python, deep learning with TensorFlow/Keras or PyTorch, signal processing, time-series analysis, deployment infrastructure, cloud, databases, and applied research experience.
TensorFlow, Keras, PyTorch, Python, C++, Rust, R, C, Docker, Kubernetes, GCP, Azure, SQL, MongoDB, Bigtable, Claude Code, CodeX
2w
Save
Mark Applied
Hide
Software Engineer, ML Platform
Denver or San Francisco or New York City or San Jose or Scottsdale
$160k-$240k/yr HybridFull Time
4+ YOERequires 4+ years of software engineering experience in Python, Ruby, or Java; ML infrastructure and platform-service experience; cloud-platform experience; and familiarity with AI frameworks and AI-assisted development tools.
Python, Ruby, Java, AWS, CI/CD
2w
Save
Mark Applied
Hide
Machine Learning Infrastructure Engineer, Technology
New York City, New York, United States
$185k-$300k/yr OnsiteFull Time
3+ YOEBachelor’s or master’s degree in a technical field; 3–7 years building scalable compute or ML infrastructure; expertise in distributed systems, Kubernetes, cloud platforms, MLOps, Python, and systems programming.
Kubernetes, AWS, Google Cloud Platform, Azure, MLflow, Ray, Airflow, Kubeflow, Terraform, Python, Go, C++, Rust
1mo
Save
Mark Applied
Hide
Software Engineer, ML Products
New York City, New York, United States
$175k-$275k/yr OnsiteFull Time
5+ YOE5+ years experience building ML/agentic systems, expertise in context engineering (RAG, token optimization), evaluation systems, and production-quality agent infrastructure.
1mo
Save
Mark Applied
Hide
AI-Enabled Infrastructure and Systems Engineer
New York, New York, United States
$162k-$200k/yr HybridFull Time
5+ YOE5+ years infrastructure engineering experience; cloud (AWS/Azure/GCP) and IaC (Terraform/CloudFormation/ARM/Bicep/Ansible) proficiency; scripting (Python/Java/Golang); experience supporting AI/ML workloads and platform engineering.
Terraform, Ansible, CloudFormation, ARM/Bicep, Python, Java, Golang, AWS, Microsoft Azure ML, Microsoft Azure Foundry, AWS Bedrock, Google Vertex
3mo
Save
Mark Applied
Hide
Software Engineer, AI/ML (Infrastructure & Platform)
New York City or Tempe or San Francisco
$200k-$235k/yr HybridFull Time
Build AI infrastructure and platform software; strong software engineering, distributed systems, production AI experience.
Python, TypeScript, C#, APIs, Distributed Systems, LLM/AI Systems, Tool/Skill Abstractions, LangChain, Data Pipelines
Explore Jobs