79 ai infrastructure engineer jobs at 58 companies in Harvard, MA
3d
Save
Mark Applied
Hide
AI Infrastructure Engineer
Boston or San Francisco or Scottsdale or Seattle
$134k-$247k/yr OnsiteFull Time
4+ YOERequires 4+ years in platform, DevOps, infrastructure, internal tools, automation, or software engineering; cloud infrastructure, CI/CD, infrastructure-as-code, production support, and AI application knowledge.
Vercel, Azure, AWS, GitHub Actions, Terraform, Bicep, Pulumi, CloudFormation, Python, TypeScript, JavaScript, Node.js, GCP, SSO, OAuth, OIDC, Entra ID, Azure AD, RBAC, Slack, Jira, Confluence, Quip, Microsoft 365, Salesforce, Snowflake, ServiceNow, React
2mo
Save
Mark Applied
Hide
Gen AI Infrastructure Engineer
Woodbridge or New York City or Atlanta or Boston or Chicago or Dallas or Delaware or Denver or Garden City or Cayman Islands or Greenwich or Houston or Los Angeles or Miami or Naples or Nevada or Palm Beach or San Diego or San Francisco or Seattle or Stuart or Washington
$160k-$200k/yr HybridFull Time
7+ YOE7+ years in DevOps/platform/cloud infrastructure engineering; strong AWS (IAM, CloudFormation, Lambda, API Gateway, VPC, CloudWatch, SSM, Secrets Manager, ECR); AWS CDK/CloudFormation/Terraform; CI/CD (Bitbucket/GitHub Actions, OIDC); container and datastore operations; security fundamentals.
AWS Bedrock, AgentCore, Lambda, API Gateway, AWS CDK, CloudFormation, Terraform, Bitbucket Pipelines, GitHub Actions, OIDC, IAM, VPC, CloudWatch, SSM, Secrets Manager, ECR, Neo4j, Neptune, Redis, Milvus, VectorDB
3d
Save
Mark Applied
Hide
AI & HPC Infrastructure Engineer
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Des Moines or Detroit or Hartford or Houston or Irvine or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Redmond or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$80k-$266k/yr HybridFull Time
5+ YOERequires 5+ years designing AI infrastructure, accelerated computing, clusters, orchestration, and automation; bachelor's degree or equivalent experience. Strong Kubernetes, Python, Terraform, and cloud expertise required.
Slurm, Run:ai, Kubernetes, NVIDIA Base Command Manager (BCM), NVIDIA NGC, NCCL, NVLink, CUDA, TensorRT-LLM, vLLM, SGLang, Triton Inference Server, NVIDIA Dynamo, llm-d, MLPerf, NCCL tests, fio, iperf, InfiniBand, Ethernet, SONiC, NVMe, NVMe-oF, VAST, Weka, DDN, AWS, Azure, GCP, VMware, Nutanix, Python, Terraform, Ansible, REST, OpenAPI, JSON, YAML, TensorFlow, PyTorch, JAX, Jupyter notebooks, Google Colab, MCP
3mo
Save
Mark Applied
Hide
Senior AI Infrastructure Platform Engineer, Assistant Vice President
Quincy or Austin
$90k-$158k/yr OnsiteFull Time
5+ YOELead GenAI/Agentic AI projects; strong full-stack development and architecture; collaboration with business and IT; experience with cloud and AI/ML tools.
Python, FastAPI, Unix, Docker, PostgreSQL, Lang Chain, Kubernetes, Databricks, API Management, AWS, Azure, OpenAI
2w
Save
Mark Applied
Hide
AI HPC Infrastructure Engineer
Boston, Massachusetts, United States
$150k-$170k/yr HybridFull Time
5+ YOEBachelor's degree and 5+ years Linux/HPC systems administration experience; expertise with NVIDIA GPU stack, SLURM, GPFS, Kubernetes, Python/R, LLM tuning, Posit Workbench; must be authorized to work in the US.
Posit Workbench (RStudio Server Pro), MPI, OpenMP, PyTorch Distributed, Horovod, DeepSpeed, SLURM, Kubernetes, CUDA, cuDNN, NCCL, MLflow, Kubeflow, Docker, Singularity/Apptainer, GPFS (IBM Spectrum Scale), Bright Cluster Manager, Ansible, RDP, SSH, PyTorch, TensorFlow, Weights & Biases, NVIDIA GPU Operator, LiteLLM, Kong AI Gateway, Portkey
3mo
Save
Mark Applied
Hide
Senior AI Infrastructure Platform Engineer, Assistant Vice President
Quincy or Austin
$90k-$158k/yr HybridFull Time
5+ YOELead/architect AI automation platforms; hands-on development with AI/ML, cloud, and DevOps; senior engineer capable of driving projects and collaborating with cross-functional teams.
Python, FastAPI, Unix, Docker, Postgres, Lang Chain, Lang Graph, Kubernetes, Databricks, API Management, AWS, Azure, OpenAI, Azure Foundry, Sagemaker, Lambda, EKS
2w
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor's degree plus 6 years or master's degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java. Leadership and cloud AI experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Azure, C++, C#, Golang
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York or San Francisco or McLean or Cambridge or San Jose or Plano
$209k-$286k/yr OnsiteFull Time
4+ YOEBachelor's in CS/AI/EE/CE +6 years or Master's +4 years; 6+ years programming with Python/Go/Scala/Java; experience deploying scalable AI on cloud; LLM, inference, similarity search, VectorDBs, guardrails, model evaluation, and optimization experience; leadership and research literacy.
Python, Go, Scala, Java, C++, C#, Golang, AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, AWS, Google Cloud, Azure
1w
Save
Mark Applied
Hide
Cloud Infrastructure Engineer
Boston, Massachusetts, United States
$125k-$165k/yr OnsiteFull Time
4+ YOERequires 4+ years of IT infrastructure experience, cloud, virtualization, networking, automation, Python or PowerShell, REST APIs, AI agents, and strong analytical and communication skills.
Python, PowerShell, REST APIs, Model Context Protocol (MCP), Microsoft Azure, AI agents, virtualization, networking
3w
Save
Mark Applied
Hide
AI Platform Engineer
Boston or Springfield or New York City
$164k-$215k/yr HybridFull Time
5+ YOE5+ years platform/infrastructure/SRE experience, cloud-native Kubernetes expertise, CKA/CKAD or AWS certifications, IaC/GitOps experience, AI/ML infrastructure and platform ownership from design to production.
Kubernetes, Terraform, Pulumi, ArgoCD, vLLM, Triton, Ray Serve, AWS, GCP, Azure, Degreed
1mo
Save
Mark Applied
Hide
Principal Engineer, Data Infrastructure
Boston, Massachusetts, United States
$244k-$366k/yr OnsiteFull Time
10+ YOE10+ years building and operating distributed data systems; expertise in ingestion/CDC, stream processing, batch orchestration, lakehouse patterns, governance, SLOs, and applying AI/ML to data platforms.
Kafka, PubSub, Flink, Spark, Beam, Airflow, Dagster, Iceberg, Delta, Hudi, Snowflake, BigQuery, object storage
3mo
Save
Mark Applied
Hide
Senior AI Platform Engineer
Boston, Massachusetts, United States
$200k-$325k/yr OnsiteFull Time
10+ YOE10+ years in infrastructure or platform engineering; strong AWS Bedrock and Azure OpenAI; MCP registries/gateways; production-grade LLM workloads; AI security controls; developer tooling experience.
AWS Bedrock, Azure OpenAI, MCP, Kubernetes, Datadog, Splunk, Grafana, M365, Office
2mo
Save
Mark Applied
Hide
Lead AI Engineer
Boston, Massachusetts, United States
$150k-$190k/yr HybridFull Time
7+ YOE7+ years in software/ML engineering with expertise in LLMs, RAG, AI Agents, production ML systems, Python/SQL, cloud infrastructure, and leadership on cross-functional initiatives.
Python, SQL, OpenAI, Anthropic, Gemini, Mistral, LangGraph, LangChain, LlamaIndex, MCP, Vector Databases, AWS, GCP, Docker, Kubernetes
1mo
Save
Mark Applied
Hide
AI Systems Engineer
King of Prussia or Boston
$100k-$125k/yr HybridFull Time
Hands-on production AWS infrastructure experience, Terraform, CI/CD, observability, containerized workloads, Python, OpenSearch/vector search, and strong security/IAM expertise.
Terraform, AWS Bedrock AgentCore, Lambda, API Gateway, ECS, Fargate, App Runner, IAM, VPC, S3, CloudWatch, X-Ray, GitHub Actions, AWS CodePipeline, OpenTelemetry, OpenSearch, Docker, Python
2w
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York City or San Francisco or San Jose or Cambridge or McLean or Plano
$209k-$286k/yr OnsiteFull Time
6+ YOEBachelor’s degree plus 6 years or master’s degree plus 4 years developing AI/ML technologies; 6 years programming with Python, Go, Scala, or Java; cloud AI deployment experience preferred.
AWS Ultraclusters, Hugging Face, VectorDBs, NeMo Guardrails, PyTorch, Python, Go, Scala, Java, Google Cloud, Microsoft Azure, C++, C#, Golang
2mo
Save
Mark Applied
Hide
Senior ASIC Front End Infrastructure Engineer
Santa Clara or Westford or Austin or Durham
$184k-$357k/yr OnsiteFull Time
8+ YOE8+ years experience; Masters in Electrical Engineering, Computer Engineering, Computer Science or related; Python/Perl; AI tooling; Make; CI (Jenkins); strong problem solving; ASIC/CPU verification knowledge.
Python, Perl, Make, Jenkins
1w
Save
Mark Applied
Hide
Senior Developer Relations Engineer, GKE and AI Infrastructure
Sunnyvale or Cambridge or Kirkland or New York City or Raleigh or Durham or Seattle
$163k-$236k/yr OnsiteFull Time
5+ YOEBachelor's in CS or equivalent,5+ years technical experience,2+ years running AI/ML workloads on GPUs/TPUs with Kubernetes/GKE,2+ years producing developer content,proficiency in Python and strong programming skills.
Kubernetes, GKE, GPU, TPU, Python, C++, Java, Vertex AI, Google Cloud
2w
Save
Mark Applied
Hide
Director of Infrastructure Engineering
United States or Canada or San Francisco or New York City or Seattle or Boston or Chicago or Denver or Austin or Portland
$195k-$358k/yr RemoteFull Time
10+ YOE5+ Mgmt10+ years software engineering,5+ years engineering management,deep infrastructure and platform expertise,experience with AWS,Kubernetes,Postgres,Terraform,AI-native development,and hiring and mentoring engineers.
AWS, Postgres, Kubernetes, Redshift, Terraform, Cloudwatch, TypeScript, React, Node.js, GraphQL, PostgreSQL
1mo
Save
Mark Applied
Hide
Senior / Staff Software Engineer, AI Engineering
Boston, Massachusetts, United States
$220k-$280k/yr OnsiteFull Time
5+ YOE5+ years full-stack engineering experience; built and shipped internal tooling; hands-on experience with LLMs, AI APIs, and agentic workflows; strong cross-functional communication; experience owning production infrastructure.
LLMs, AI APIs
2mo
Save
Mark Applied
Hide
Principal AI Product Engineer
Boston, Massachusetts, United States
$152k-$283k/yr HybridFull Time
Design and ship internal-facing AI products and infrastructure; strong design+engineering skills; React/Next.js/TypeScript frontend experience; systems thinking about data; comfortable with agentic tools and AWS.
Claude Code, Codex, Cursor, React, Next.js, TypeScript, Tailwind, shadcn/ui, AWS, Cognito, Bedrock, CDK
Explore Jobs