97 ai infrastructure engineer jobs at 66 companies in Holden, MA
2w
Save
Mark Applied
Hide
AI Infrastructure Engineer
Boston or San Francisco or Scottsdale or Seattle
$134k-$247k/yr OnsiteFull Time
4+ YOERequires 4+ years in platform, DevOps, infrastructure, internal tools, automation, or software engineering; cloud infrastructure, CI/CD, infrastructure-as-code, production support, and AI application knowledge.
Vercel, Azure, AWS, GitHub Actions, Terraform, Bicep, Pulumi, CloudFormation, Python, TypeScript, JavaScript, Node.js, GCP, SSO, OAuth, OIDC, Entra ID, Azure AD, RBAC, Slack, Jira, Confluence, Quip, Microsoft 365, Salesforce, Snowflake, ServiceNow, React
2mo
Save
Mark Applied
Hide
Gen AI Infrastructure Engineer
Woodbridge or New York City or Atlanta or Boston or Chicago or Dallas or Delaware or Denver or Garden City or Cayman Islands or Greenwich or Houston or Los Angeles or Miami or Naples or Nevada or Palm Beach or San Diego or San Francisco or Seattle or Stuart or Washington
$160k-$200k/yr HybridFull Time
7+ YOE7+ years in DevOps/platform/cloud infrastructure engineering; strong AWS (IAM, CloudFormation, Lambda, API Gateway, VPC, CloudWatch, SSM, Secrets Manager, ECR); AWS CDK/CloudFormation/Terraform; CI/CD (Bitbucket/GitHub Actions, OIDC); container and datastore operations; security fundamentals.
AWS Bedrock, AgentCore, Lambda, API Gateway, AWS CDK, CloudFormation, Terraform, Bitbucket Pipelines, GitHub Actions, OIDC, IAM, VPC, CloudWatch, SSM, Secrets Manager, ECR, Neo4j, Neptune, Redis, Milvus, VectorDB
2w
Save
Mark Applied
Hide
AI & HPC Infrastructure Engineer
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irvine or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$80k-$266k/yr HybridFull Time
5+ YOERequires 5+ years designing AI infrastructure, accelerated computing, clusters, orchestration, and automation; bachelor's degree or equivalent experience. Strong Kubernetes, Python, Terraform, and cloud expertise required.
Slurm, Run:ai, Kubernetes, NVIDIA Base Command Manager (BCM), NVIDIA NGC, NCCL, NVLink, CUDA, TensorRT-LLM, vLLM, SGLang, Triton Inference Server, NVIDIA Dynamo, llm-d, MLPerf, NCCL tests, fio, iperf, InfiniBand, Ethernet, SONiC, NVMe, NVMe-oF, VAST, Weka, DDN, AWS, Azure, GCP, VMware, Nutanix, Python, Terraform, Ansible, REST, OpenAPI, JSON, YAML, TensorFlow, PyTorch, JAX, Jupyter notebooks, Google Colab, MCP
3mo
Save
Mark Applied
Hide
Senior AI Infrastructure Platform Engineer, Assistant Vice President
Quincy or Austin
$90k-$158k/yr OnsiteFull Time
5+ YOELead GenAI/Agentic AI projects; strong full-stack development and architecture; collaboration with business and IT; experience with cloud and AI/ML tools.
Python, FastAPI, Unix, Docker, PostgreSQL, Lang Chain, Kubernetes, Databricks, API Management, AWS, Azure, OpenAI
1w
Save
Mark Applied
Hide
Staff AI Infrastructure Engineer -
Costa Mesa or Seattle or Washington or Boston
$220k-$292k/yr OnsiteFull Time
7+ YOERequires 7+ years building production-scale ML systems, proficiency in Python, Go, or C++, distributed systems expertise, Docker/Kubernetes, distributed training, data pipelines, technical leadership, and Top Secret clearance eligibility.
MLOps, Python, Go, C++, Docker, Kubernetes, PyTorch Distributed, Ray, Slurm, Megatron-LM, AWS Trainium, Google TPUs, RLHF/DPO, CI/CD
1mo
Save
Mark Applied
Hide
AI HPC Infrastructure Engineer
Boston, Massachusetts, United States
$150k-$170k/yr HybridFull Time
5+ YOEBachelor's degree and 5+ years Linux/HPC systems administration experience; expertise with NVIDIA GPU stack, SLURM, GPFS, Kubernetes, Python/R, LLM tuning, Posit Workbench; must be authorized to work in the US.
Posit Workbench (RStudio Server Pro), MPI, OpenMP, PyTorch Distributed, Horovod, DeepSpeed, SLURM, Kubernetes, CUDA, cuDNN, NCCL, MLflow, Kubeflow, Docker, Singularity/Apptainer, GPFS (IBM Spectrum Scale), Bright Cluster Manager, Ansible, RDP, SSH, PyTorch, TensorFlow, Weights & Biases, NVIDIA GPU Operator, LiteLLM, Kong AI Gateway, Portkey
3mo
Save
Mark Applied
Hide
Senior AI Infrastructure Platform Engineer, Assistant Vice President
Quincy or Austin
$90k-$158k/yr HybridFull Time
5+ YOELead/architect AI automation platforms; hands-on development with AI/ML, cloud, and DevOps; senior engineer capable of driving projects and collaborating with cross-functional teams.
Python, FastAPI, Unix, Docker, Postgres, Lang Chain, Lang Graph, Kubernetes, Databricks, API Management, AWS, Azure, OpenAI, Azure Foundry, Sagemaker, Lambda, EKS
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor's degree plus 6 years or master's degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java. Leadership and cloud AI experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
2mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York or San Francisco or McLean or Cambridge or San Jose or Plano
$209k-$286k/yr OnsiteFull Time
4+ YOEBachelor's in CS/AI/EE/CE +6 years or Master's +4 years; 6+ years programming with Python/Go/Scala/Java; experience deploying scalable AI on cloud; LLM, inference, similarity search, VectorDBs, guardrails, model evaluation, and optimization experience; leadership and research literacy.
Python, Go, Scala, Java, C++, C#, Golang, AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, AWS, Google Cloud, Azure
3w
Save
Mark Applied
Hide
Cloud Infrastructure Engineer
Boston, Massachusetts, United States
$125k-$165k/yr OnsiteFull Time
4+ YOERequires 4+ years of IT infrastructure experience, cloud, virtualization, networking, automation, Python or PowerShell, REST APIs, AI agents, and strong analytical and communication skills.
Python, PowerShell, REST APIs, Model Context Protocol (MCP), Microsoft Azure, AI agents, virtualization, networking
1mo
Save
Mark Applied
Hide
AI Platform Engineer
Boston or Springfield or New York City
$164k-$215k/yr HybridFull Time
5+ YOE5+ years platform/infrastructure/SRE experience, cloud-native Kubernetes expertise, CKA/CKAD or AWS certifications, IaC/GitOps experience, AI/ML infrastructure and platform ownership from design to production.
Kubernetes, Terraform, Pulumi, ArgoCD, vLLM, Triton, Ray Serve, AWS, GCP, Azure, Degreed
3mo
Save
Mark Applied
Hide
Senior AI Platform Engineer
Boston, Massachusetts, United States
$200k-$325k/yr OnsiteFull Time
10+ YOE10+ years in infrastructure or platform engineering; strong AWS Bedrock and Azure OpenAI; MCP registries/gateways; production-grade LLM workloads; AI security controls; developer tooling experience.
AWS Bedrock, Azure OpenAI, MCP, Kubernetes, Datadog, Splunk, Grafana, M365, Office
2mo
Save
Mark Applied
Hide
Principal Engineer, Data Infrastructure
Boston, Massachusetts, United States
$244k-$366k/yr OnsiteFull Time
10+ YOE10+ years building and operating distributed data systems; expertise in ingestion/CDC, stream processing, batch orchestration, lakehouse patterns, governance, SLOs, and applying AI/ML to data platforms.
Kafka, PubSub, Flink, Spark, Beam, Airflow, Dagster, Iceberg, Delta, Hudi, Snowflake, BigQuery, object storage
2mo
Save
Mark Applied
Hide
Lead AI Engineer
Boston, Massachusetts, United States
$150k-$190k/yr HybridFull Time
7+ YOE7+ years in software/ML engineering with expertise in LLMs, RAG, AI Agents, production ML systems, Python/SQL, cloud infrastructure, and leadership on cross-functional initiatives.
Python, SQL, OpenAI, Anthropic, Gemini, Mistral, LangGraph, LangChain, LlamaIndex, MCP, Vector Databases, AWS, GCP, Docker, Kubernetes
1mo
Save
Mark Applied
Hide
Senior ASIC Front End Infrastructure Engineer
Santa Clara or Durham or Austin or Westford
$184k-$357k/yr OnsiteFull Time
8+ YOEMaster's degree or equivalent in engineering or computer science, 8+ years of relevant experience, programming proficiency, AI automation, distributed build systems, CI pipelines, and ASIC or CPU verification knowledge.
Python, Perl, Make, Jenkins, ML, DL, AI, Continuous Integration
1mo
Save
Mark Applied
Hide
AI Systems Engineer
King of Prussia or Boston
$100k-$125k/yr HybridFull Time
Hands-on production AWS infrastructure experience, Terraform, CI/CD, observability, containerized workloads, Python, OpenSearch/vector search, and strong security/IAM expertise.
Terraform, AWS Bedrock AgentCore, Lambda, API Gateway, ECS, Fargate, App Runner, IAM, VPC, S3, CloudWatch, X-Ray, GitHub Actions, AWS CodePipeline, OpenTelemetry, OpenSearch, Docker, Python
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor’s degree plus 6 years or master’s degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java; cloud AI deployment experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, NeMo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Microsoft Azure, C++, C#, Golang
3w
Save
Mark Applied
Hide
Senior Developer Relations Engineer, GKE and AI Infrastructure
Sunnyvale or Cambridge or Kirkland or New York City or Raleigh or Durham or Seattle
$163k-$236k/yr OnsiteFull Time
5+ YOEBachelor's in CS or equivalent,5+ years technical experience,2+ years running AI/ML workloads on GPUs/TPUs with Kubernetes/GKE,2+ years producing developer content,proficiency in Python and strong programming skills.
Kubernetes, GKE, GPU, TPU, Python, C++, Java, Vertex AI, Google Cloud
3mo
Save
Mark Applied
Hide
Senior ASIC Front End Infrastructure Engineer
Santa Clara or Westford or Austin or Durham
$184k-$357k/yr OnsiteFull Time
8+ YOE8+ years experience; Masters in Electrical Engineering, Computer Engineering, Computer Science or related; Python/Perl; AI tooling; Make; CI (Jenkins); strong problem solving; ASIC/CPU verification knowledge.
Python, Perl, Make, Jenkins
1mo
Save
Mark Applied
Hide
Senior / Staff Software Engineer, AI Engineering
Boston, Massachusetts, United States
$220k-$280k/yr OnsiteFull Time
5+ YOE5+ years full-stack engineering experience; built and shipped internal tooling; hands-on experience with LLMs, AI APIs, and agentic workflows; strong cross-functional communication; experience owning production infrastructure.
LLMs, AI APIs
Explore Jobs