87 ai ml infrastructure engineer jobs at 56 companies in Plainview, NY
3d
Save
Mark Applied
Hide
Senior AI/ML Engineer
New York City, New York, United States
RemoteFull Time
Build inference infrastructure, own model evaluation pipelines, optimize latency, and integrate orchestration engines with frontier large language models.
1mo
Save
Mark Applied
Hide
AI-Enabled Infrastructure and Systems Engineer
New York, New York, United States
$162k-$200k/yr HybridFull Time
5+ YOE5+ years infrastructure engineering experience; cloud (AWS/Azure/GCP) and IaC (Terraform/CloudFormation/ARM/Bicep/Ansible) proficiency; scripting (Python/Java/Golang); experience supporting AI/ML workloads and platform engineering.
Terraform, Ansible, CloudFormation, ARM/Bicep, Python, Java, Golang, AWS, Microsoft Azure ML, Microsoft Azure Foundry, AWS Bedrock, Google Vertex
3w
Save
Mark Applied
Hide
Sr Lead Software Engineer - AWS - Lead AI/ML Platform Engineer
Jersey City, New Jersey, United States
$171k-$260k/yr OnsiteFull Time
5+ YOE5+ years software engineering experience, deep AWS and cloud infrastructure knowledge, production platform and architecture experience, strong client communication, and experience with responsible AI and AI-assisted development.
AWS, Kubernetes, EKS, AWS Sagemaker, Golang, Terraform, LLMs
3mo
Save
Mark Applied
Hide
Software Engineer, AI/ML (Infrastructure & Platform)
New York City or Tempe or San Francisco
$200k-$235k/yr HybridFull Time
Build AI infrastructure and platform software; strong software engineering, distributed systems, production AI experience.
Python, TypeScript, C#, APIs, Distributed Systems, LLM/AI Systems, Tool/Skill Abstractions, LangChain, Data Pipelines
6d
Save
Mark Applied
Hide
Recommendation Architecture AI/ML Infrastructure Engineer Intern (Data-Arch-TikTok Live) - 2027 Summer
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
OnsiteInternship
Pursuing a bachelor's or master's degree in AI, software development, computer science, computer engineering, or related field; strong C++ or Python skills; data structures, algorithms, systems, PyTorch or TensorFlow, and LLM knowledge.
C++, Python, PyTorch, TensorFlow, CUDA, Triton, FSDP, ZeRO, FlashAttention
2mo
Save
Mark Applied
Hide
General Application — Data & AI/ML Engineering
New York or United States
HybridFull Time
4+ YOE4+ years in data or ML engineering, strong Python and SQL, experience with Spark/dbt/Airflow, cloud data infrastructure (AWS/GCP/Azure), ML lifecycle and systems design; Bachelor's/Master's in CS/Engineering preferred.
Python, SQL, Spark, dbt, Airflow, AWS, GCP, Azure, Docker, Kubernetes
2w
Save
Mark Applied
Hide
Distinguished AI Engineer
Jersey City, New Jersey, United States
$140k-$210k/yr OnsiteFull Time
10+ YOE10+ years building AI/ML or platform engineering systems; deep LLM, RAG, model-serving, and AI infrastructure experience; strong AWS and Terraform/IaC skills; ability to define enterprise architecture and influence senior stakeholders.
Terraform, AWS
3mo
Save
Mark Applied
Hide
Infrastructure Engineer
New York or San Francisco or United States
$165k-$200k/yr HybridFull Time
Kubernetes production experience; IaC (Terraform/Helm); cloud (AWS/GCP); Python/Node.js; CI/CD (GitHub Actions/Spacelift); security and ML/AI infrastructure familiarity.
Kubernetes, Terraform, Helm, Python, Node.js, GitHub Actions, Spacelift, AWS, GCP, PyTorch, TensorFlow, Bash
2w
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor's degree plus 6 years or master's degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java. Leadership and cloud AI experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
4w
Save
Mark Applied
Hide
Sr AI Engineer I
New York or Sunrise or Phoenix
$123k-$215k/yr OnsiteFull Time
5+ YOE5+ years software engineering experience with production LLM or applied ML systems; strong backend, APIs, data pipelines, and cloud infrastructure skills; experience shipping AI/agentic systems and owning production reliability.
Python, Go, TypeScript, AWS, GCP, Kubernetes, REST, gRPC, Kafka, LLMs
3w
Save
Mark Applied
Hide
AI Platform Engineer
Boston or Springfield or New York City
$164k-$215k/yr HybridFull Time
5+ YOE5+ years platform/infrastructure/SRE experience, cloud-native Kubernetes expertise, CKA/CKAD or AWS certifications, IaC/GitOps experience, AI/ML infrastructure and platform ownership from design to production.
Kubernetes, Terraform, Pulumi, ArgoCD, vLLM, Triton, Ray Serve, AWS, GCP, Azure, Degreed
3d
Save
Mark Applied
Hide
Software Engineer, ML Platform
Denver or San Francisco or New York City or San Jose or Scottsdale
$160k-$240k/yr HybridFull Time
4+ YOERequires 4+ years of software engineering experience in Python, Ruby, or Java; ML infrastructure and platform-service experience; cloud-platform experience; and familiarity with AI frameworks and AI-assisted development tools.
Python, Ruby, Java, AWS, CI/CD
3mo
Save
Mark Applied
Hide
AI Engineer (Copy)
New York, New York, United States
$170k-$230k/yr OnsiteFull Time
5+ YOE5–10+ years software engineering; hands-on with LLM-based agents or RAG in production; Python; AI/ML frameworks; cloud infra (GCP preferred); strong system design and communication.
Python, GCP, AI/ML frameworks, APIs, Cloud infrastructure
2w
Save
Mark Applied
Hide
Associate Manager, Production AI/ML Engineering, Advanced Informatics
Tarrytown or Armonk or Warren
$110k-$179k/yr OnsiteFull Time
7+ YOEBachelor's (Master's preferred) and 7+ years building and operating enterprise ML/platform infrastructure on AWS; Kubernetes, Python, SQL, API, Postgres, MLOps tooling, and informatics experience preferred.
Kubernetes, AWS, SageMaker, ECS, EC2, S3, Lambda, SNOMED CT, ICD-10, ICD-11, LOINC, RxNorm, OMOP CDM, RESTful APIs, Postgres, Python, SQL, Git, MLflow, W&B, Docker, Airflow, Prefect
2w
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor’s degree plus 6 years or master’s degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java; cloud AI deployment experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, NeMo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Microsoft Azure, C++, C#, Golang
1d
Save
Mark Applied
Hide
Software Engineer, AI/ML, Workspace
Sunnyvale or New York City
$147k-$210k/yr OnsiteFull Time
2+ YOEBachelor's degree or equivalent practical experience; 2 years software development experience, or 1 year with an advanced degree; 1 year in ML infrastructure or a specialized ML area.
ML infrastructure
3mo
Save
Mark Applied
Hide
Senior AI Engineer
New York or United States
RemoteFull Time
4+ YOE4+ years software/data engineering, 3+ years building AI/ML-driven products; Python and SQL; experience with AI frameworks and data pipelines; cloud infrastructure; production LLM/RAG; strong communication; startup experience preferred.
Python, SQL, HuggingFace, LangChain, Airflow, Dagster, AWS, GCP, Azure, LLM deployment, RAG
2d
Save
Mark Applied
Hide
Staff AI Platform Engineer
San Francisco or Los Angeles or Denver or Austin or Chicago or New York or Seattle or Toronto or Santa Barbara or San Diego
$180k-$273k/yr RemoteFull Time
7+ YOERequires 7+ years in AI/ML platform engineering, strong Python and/or TypeScript, distributed systems, APIs, evaluation, observability, and AI infrastructure experience; bachelor's degree or equivalent practical experience.
Python, TypeScript, JavaScript, React, Kubernetes, Docker, Terraform, LangChain, LangGraph, LlamaIndex, LiveKit, REST, gRPC, MCP, A2A
3mo
Save
Mark Applied
Hide
Senior Distinguished Engineer, AI Compute (Remote Eligible)
San Francisco or Cambridge or Richmond or McLean or New York or San Jose or San Francisco
$286k-$392k/yr RemoteFull Time
10+ YOE10+ years AI/ML engineering; Python/Go/Scala/Java; distributed compute; CPU/GPU infrastructure; ML/AI workloads.
Python, Go, Scala, Java, Spark, Dask, Ray, Flink, Kubernetes, AWS Lambda
3w
Save
Mark Applied
Hide
Staff II Software Engineer AI/ML Ops
Pleasanton or New York City or Los Angeles
$245k-$307k/yr HybridFull Time
Extensive experience building and operating ML/AI production systems, designing scalable data pipelines, distributed training, model deployment, CI/CD, observability, and cloud infrastructure.
PySpark, FiveTran, Plaid, PyTorch, TensorFlow, scikit-learn, Airflow, Kubeflow, Vertex AI, MLflow, W&B, LangChain, LangGraph, ADK, Prometheus, Grafana, Newrelic, Docker, Kubernetes, Python, Java, Scala, GCP, AWS, Azure, Bash, Apache Airflow