72 ai infrastructure engineer jobs at 53 companies in Hingham, MA
2mo
Save
Mark Applied
Hide
Gen AI Infrastructure Engineer
Woodbridge or New York City or Atlanta or Boston or Chicago or Dallas or Delaware or Denver or Garden City or Cayman Islands or Greenwich or Houston or Los Angeles or Miami or Naples or Nevada or Palm Beach or San Diego or San Francisco or Seattle or Stuart or Washington
$160k-$200k/yr HybridFull Time
7+ YOE7+ years in DevOps/platform/cloud infrastructure engineering; strong AWS (IAM, CloudFormation, Lambda, API Gateway, VPC, CloudWatch, SSM, Secrets Manager, ECR); AWS CDK/CloudFormation/Terraform; CI/CD (Bitbucket/GitHub Actions, OIDC); container and datastore operations; security fundamentals.
AWS Bedrock, AgentCore, Lambda, API Gateway, AWS CDK, CloudFormation, Terraform, Bitbucket Pipelines, GitHub Actions, OIDC, IAM, VPC, CloudWatch, SSM, Secrets Manager, ECR, Neo4j, Neptune, Redis, Milvus, VectorDB
1mo
Save
Mark Applied
Hide
AI Infrastructure Manager
Bengaluru or San Francisco or Boston or New York City or Austin or Tokyo or London
HybridFull Time
Experience leading engineering teams building GenAI or AI infrastructure and distributed systems; strong cloud, accelerator, and performance optimization knowledge; proficiency in Python or Go; architecture and reliability experience.
Python, Go
3mo
Save
Mark Applied
Hide
Senior AI Infrastructure Platform Engineer, Assistant Vice President
Quincy or Austin
$90k-$158k/yr OnsiteFull Time
5+ YOELead GenAI/Agentic AI projects; strong full-stack development and architecture; collaboration with business and IT; experience with cloud and AI/ML tools.
Python, FastAPI, Unix, Docker, PostgreSQL, Lang Chain, Kubernetes, Databricks, API Management, AWS, Azure, OpenAI
2w
Save
Mark Applied
Hide
AI HPC Infrastructure Engineer
Boston, Massachusetts, United States
$150k-$170k/yr HybridFull Time
5+ YOEBachelor's degree and 5+ years Linux/HPC systems administration experience; expertise with NVIDIA GPU stack, SLURM, GPFS, Kubernetes, Python/R, LLM tuning, Posit Workbench; must be authorized to work in the US.
Posit Workbench (RStudio Server Pro), MPI, OpenMP, PyTorch Distributed, Horovod, DeepSpeed, SLURM, Kubernetes, CUDA, cuDNN, NCCL, MLflow, Kubeflow, Docker, Singularity/Apptainer, GPFS (IBM Spectrum Scale), Bright Cluster Manager, Ansible, RDP, SSH, PyTorch, TensorFlow, Weights & Biases, NVIDIA GPU Operator, LiteLLM, Kong AI Gateway, Portkey
3mo
Save
Mark Applied
Hide
Senior AI Infrastructure Platform Engineer, Assistant Vice President
Quincy or Austin
$90k-$158k/yr HybridFull Time
5+ YOELead/architect AI automation platforms; hands-on development with AI/ML, cloud, and DevOps; senior engineer capable of driving projects and collaborating with cross-functional teams.
Python, FastAPI, Unix, Docker, Postgres, Lang Chain, Lang Graph, Kubernetes, Databricks, API Management, AWS, Azure, OpenAI, Azure Foundry, Sagemaker, Lambda, EKS
1mo
Save
Mark Applied
Hide
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
New York or San Francisco or McLean or Cambridge or San Jose or Plano
$209k-$286k/yr OnsiteFull Time
4+ YOEBachelor's in CS/AI/EE/CE +6 years or Master's +4 years; 6+ years programming with Python/Go/Scala/Java; experience deploying scalable AI on cloud; LLM, inference, similarity search, VectorDBs, guardrails, model evaluation, and optimization experience; leadership and research literacy.
Python, Go, Scala, Java, C++, C#, Golang, AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, AWS, Google Cloud, Azure
5d
Save
Mark Applied
Hide
Cloud Infrastructure Engineer
Boston, Massachusetts, United States
$125k-$165k/yr OnsiteFull Time
4+ YOERequires 4+ years of IT infrastructure experience, cloud, virtualization, networking, automation, Python or PowerShell, REST APIs, AI agents, and strong analytical and communication skills.
Python, PowerShell, REST APIs, Model Context Protocol (MCP), Microsoft Azure, AI agents, virtualization, networking
2w
Save
Mark Applied
Hide
AI Platform Engineer
Boston or Springfield or New York City
$164k-$215k/yr HybridFull Time
5+ YOE5+ years platform/infrastructure/SRE experience, cloud-native Kubernetes expertise, CKA/CKAD or AWS certifications, IaC/GitOps experience, AI/ML infrastructure and platform ownership from design to production.
Kubernetes, Terraform, Pulumi, ArgoCD, vLLM, Triton, Ray Serve, AWS, GCP, Azure, Degreed
3mo
Save
Mark Applied
Hide
Senior AI Platform Engineer
Boston, Massachusetts, United States
$200k-$325k/yr OnsiteFull Time
10+ YOE10+ years in infrastructure or platform engineering; strong AWS Bedrock and Azure OpenAI; MCP registries/gateways; production-grade LLM workloads; AI security controls; developer tooling experience.
AWS Bedrock, Azure OpenAI, MCP, Kubernetes, Datadog, Splunk, Grafana, M365, Office
1mo
Save
Mark Applied
Hide
Principal Engineer, Data Infrastructure
Boston, Massachusetts, United States
$244k-$366k/yr OnsiteFull Time
10+ YOE10+ years building and operating distributed data systems; expertise in ingestion/CDC, stream processing, batch orchestration, lakehouse patterns, governance, SLOs, and applying AI/ML to data platforms.
Kafka, PubSub, Flink, Spark, Beam, Airflow, Dagster, Iceberg, Delta, Hudi, Snowflake, BigQuery, object storage
1mo
Save
Mark Applied
Hide
Lead AI Engineer
Boston, Massachusetts, United States
$150k-$190k/yr HybridFull Time
7+ YOE7+ years in software/ML engineering with expertise in LLMs, RAG, AI Agents, production ML systems, Python/SQL, cloud infrastructure, and leadership on cross-functional initiatives.
Python, SQL, OpenAI, Anthropic, Gemini, Mistral, LangGraph, LangChain, LlamaIndex, MCP, Vector Databases, AWS, GCP, Docker, Kubernetes
1mo
Save
Mark Applied
Hide
AI Systems Engineer
King of Prussia or Boston
$100k-$125k/yr HybridFull Time
Hands-on production AWS infrastructure experience, Terraform, CI/CD, observability, containerized workloads, Python, OpenSearch/vector search, and strong security/IAM expertise.
Terraform, AWS Bedrock AgentCore, Lambda, API Gateway, ECS, Fargate, App Runner, IAM, VPC, S3, CloudWatch, X-Ray, GitHub Actions, AWS CodePipeline, OpenTelemetry, OpenSearch, Docker, Python
1w
Save
Mark Applied
Hide
Senior Developer Relations Engineer, GKE and AI Infrastructure
Sunnyvale or Cambridge or Kirkland or New York City or Raleigh or Durham or Seattle
$163k-$236k/yr OnsiteFull Time
5+ YOEBachelor's in CS or equivalent,5+ years technical experience,2+ years running AI/ML workloads on GPUs/TPUs with Kubernetes/GKE,2+ years producing developer content,proficiency in Python and strong programming skills.
Kubernetes, GKE, GPU, TPU, Python, C++, Java, Vertex AI, Google Cloud
2mo
Save
Mark Applied
Hide
Senior ASIC Front End Infrastructure Engineer
Santa Clara or Westford or Austin or Durham
$184k-$357k/yr OnsiteFull Time
8+ YOE8+ years experience; Masters in Electrical Engineering, Computer Engineering, Computer Science or related; Python/Perl; AI tooling; Make; CI (Jenkins); strong problem solving; ASIC/CPU verification knowledge.
Python, Perl, Make, Jenkins
1w
Save
Mark Applied
Hide
Director of Infrastructure Engineering
United States or Canada or San Francisco or New York City or Seattle or Boston or Chicago or Denver or Austin or Portland
$195k-$358k/yr RemoteFull Time
10+ YOE5+ Mgmt10+ years software engineering,5+ years engineering management,deep infrastructure and platform expertise,experience with AWS,Kubernetes,Postgres,Terraform,AI-native development,and hiring and mentoring engineers.
AWS, Postgres, Kubernetes, Redshift, Terraform, Cloudwatch, TypeScript, React, Node.js, GraphQL, PostgreSQL
1mo
Save
Mark Applied
Hide
Senior / Staff Software Engineer, AI Engineering
Boston, Massachusetts, United States
$220k-$280k/yr OnsiteFull Time
5+ YOE5+ years full-stack engineering experience; built and shipped internal tooling; hands-on experience with LLMs, AI APIs, and agentic workflows; strong cross-functional communication; experience owning production infrastructure.
LLMs, AI APIs
1mo
Save
Mark Applied
Hide
Principal AI Product Engineer
Boston, Massachusetts, United States
$152k-$283k/yr HybridFull Time
Design and ship internal-facing AI products and infrastructure; strong design+engineering skills; React/Next.js/TypeScript frontend experience; systems thinking about data; comfortable with agentic tools and AWS.
Claude Code, Codex, Cursor, React, Next.js, TypeScript, Tailwind, shadcn/ui, AWS, Cognito, Bedrock, CDK
1mo
Save
Mark Applied
Hide
Senior IT Engineer (AI)
Atlanta or Austin or Boston or Chicago or Denver or San Francisco or New York or London or Lisbon or United States or United Kingdom
RemoteFull Time
Experience building integrations and automations, API and cloud proficiency (GCP), AI implementation experience, strong technical communication, and operational infrastructure skills (Terraform, DNS, certificate management).
Salesforce, Snowflake, ADP, Gemini Enterprise, GCP, Terraform, Model Context Protocol (MCP)
2mo
Save
Mark Applied
Hide
Senior ASIC Front End Infrastructure Engineer
Santa Clara or Durham or Austin or Westford
$184k-$357k/yr OnsiteFull Time
8+ YOEMaster's degree (or equivalent) in EE/CE/CS, 8+ years relevant experience, Python/Perl programming, CI/build system experience (Make, Jenkins), AI tooling experience, verification domain knowledge, strong debugging and problem-solving skills.
Python, Perl, Make, Jenkins, containers
2w
Save
Mark Applied
Hide
Global AI/ML Engineer Senior Manager
Boston or Atlanta
$173k-$211k/yr OnsiteFull Time
10+ YOEBachelor in CS/Engineering or related; 10+ years software/IT experience; Proven AI-driven application and SaaS implementation; frontend/backend development; cloud and infrastructure-as-code; DevOps and CI/CD experience.
React, Python, Java, Typescript, AWS, Kubernetes, Terraform, pgvector, chromadb, Helm, Neo4J, GraphQL, Jenkins, RDS, Batch, Lambda, Fargate, Step Functions, SQS, SNS, FastAPI, NextJS, Websockets, RabbitMQ, Kafka
Explore Jobs