34 llm engineer jobs at 21 companies in Durham, NH
1mo
Save
Mark Applied
Hide
Senior Principal Software Engineer/Architect
Lowell or Atlanta or Alpharetta or Sunrise or United States
$207k-$298k/yr HybridFull Time
12+ YOE~12+ years engineering experience designing SaaS multi-tenant systems, AI/ML (LLM) productionization, M&A technical diligence and cloud/SRE expertise; strong communication and architectural leadership.
Kubernetes, AWS, GCP, Azure, CI/CD, MLOps, LLM, ETL/ELT, feature store, API
3w
Save
Mark Applied
Hide
Software Engineer
Lexington, Massachusetts, United States
$125k-$175k/yr OnsiteFull Time
5+ YOEU.S. citizen with active DoD Secret clearance, 5+ years professional programming experience (or MS equivalent), strong software design and full-stack development experience, familiarity with databases and devops tools.
Java, Kotlin, JavaScript, TypeScript, Spring, Hibernate, Angular, Node, Python, Postgres, MySQL, MSSQL, MongoDB, Docker, Kubernetes, JIRA, Confluence, Bamboo, Git, BitBucket, Fisheye, Crucible, Cassandra, Kafka, Minio, Elasticsearch, HBase, Hadoop, Lucene, TensorFlow, REST API, LLM
1w
Save
Mark Applied
Hide
Staff AI Engineer (L4)
Portland or Boston or Chicago or Dallas or San Jose or Seattle
$185k-$217k/yr RemoteFull Time
8+ YOE8+ years building production ML/AI systems; BS in CS or related (MS/PhD preferred); strong Python/Java/Go/C# skills; LLM, RAG, MLOps, Kubernetes, and cloud experience; excellent communication.
GitHub Actions, Terraform, Java, C#, GoLang, Python, PyTorch, TensorFlow, Scikit-learn, LangChain, LlamaIndex, vLLM, Kubernetes, AWS, SQL, NoSQL
1mo
Save
Mark Applied
Hide
Associate Director, AI Software Security Engineer
McKinney or Tewksbury or Tucson
$157k-$299k/yr OnsiteFull Time
12+ YOEU.S. citizen with ability to obtain/maintain TS/SCI clearance, STEM degree, ~12+ years experience deploying AI/LLMs, secure MLOps/DevSecOps, cloud (AWS/Azure/GCP), Python, ML frameworks, and leadership experience.
Amazon Web Services (AWS), Azure, Google Cloud Platform (GCP), Python, Large Language Models (LLMs)
2mo
Save
Mark Applied
Hide
Sr Software Quality Engineer (Exp w/ AI Techniques)
Bedford, Massachusetts, United States
$90k-$113k/yr OnsiteFull Time
5+ YOEBS/MS in CS or engineering, 5+ years software engineering with automation/quality/performance focus, experience with AI/ML/LLM-assisted testing, Python/Java/C#/JavaScript/TypeScript, CI/CD, Azure, containers, Kubernetes, and performance/observability tools.
Python, Java, C#, JavaScript, TypeScript, Azure, Azure DevOps, GitHub Actions, Jenkins, Docker, Kubernetes, JMeter, Gatling, K6, ML, LLM, APM, Infrastructure as Code, SAFe
2w
Save
Mark Applied
Hide
Staff Software Engineer
St. Louis or Burlington
$111k-$166k/yr HybridFull Time
3+ YOEBachelor's in CS/Engineering/Data Science, 3+ years in ML/data/search systems, strong Python, backend and data engineering experience, SQL, cloud (GCP/AWS), and production ML/LLM system design.
Python, REST API, Pandas, NumPy, MLFlow, TensorFlow, PyTorch, Scikit-learn, AWS Services, GCP, Kubernetes, Bedrock, Kafka, LangGraph, LangChain, AirFlow, Qdrant, Docker, Git, CI/CD, SQL
1mo
Save
Mark Applied
Hide
Lead Software Engineer, Meteorological Technologies
Andover or Atlanta
$150k-$190k/yr HybridFull Time
7+ YOE7+ years building cloud-based (e.g., AWS) production systems; domain experience in meteorology or forecasting; hands-on software delivery in 24x7 operational environments; AI/LLM integration, prompt engineering, and multi-project execution; proficiency in Python, JavaScript/TypeScript, or Go.
AWS, V0, GitHub CoPilot, Cursor, LLM, RAG, Python, JavaScript/TypeScript, Go, React, Next.js, Vercel, CI/CD, APIs
2w
Save
Mark Applied
Hide
Senior Security Automation Engineer
Wilmington, Massachusetts, United States
$120k-$165k/yr HybridFull Time
5+ YOEBachelor's degree in a technical field,5+ years professional software engineering experience,experience with AI/LLM systems and full-stack development,Python and API integration skills,security-aware design and strong communication.
Docker, CI/CD, LLM APIs, RAG pipelines, Python, TypeScript, Go, Rust, PostgreSQL, SQLite, BigQuery, REST APIs, webhooks, message queues, SIEM, SOAR, ITSM, IAM, GRC
3w
Save
Mark Applied
Hide
Senior Software Engineer - GPU Local AI Platforms
Santa Clara or Austin or Westford or Durham or Seattle
$224k-$431k/yr OnsiteFull Time
12+ YOE12+ years software engineering experience with GPU computing or ML systems, strong Python or C++ skills, GPU kernel optimization (CUDA/Triton), container engineering, and LLM inference knowledge.
Python, C++, CUDA, Triton, Docker, OCI, NVIDIA Container Toolkit, NCCL, RCCL
2mo
Save
Mark Applied
Hide
Senior Software Engineer
Wakefield or Boston
$102k-$190k/yr HybridFull Time
5+ YOE5-8 years of software engineering experience; strong data engineering expertise; Databricks, Python, PySpark, Spark; AWS (S3/Glue/Athena/Lambda); Kafka/RabbitMQ; SQL Server/MongoDB; CI/CD; Azure/GCP; Generative AI exposure; experience in large-scale data platforms.
Databricks, Python, PySpark, Apache Spark, AWS, S3, Glue, Athena, Lambda, Kafka, RabbitMQ, SQL Server, MongoDB, Jenkins, GitHub, GitLab, Bitbucket, CI/CD, DevOps, Delta Lake, Azure, GCP, LLM, Generative AI
1mo
Save
Mark Applied
Hide
Senior Software Engineer Applied AI
Concord or United States
RemoteFull Time
7+ YOE7+ years building production backend systems, strong Python skills, distributed/cloud experience (AWS), hands-on LLM/generative AI and end-to-end ML lifecycle experience, disciplined in regulated environments, US work authorization required.
Python, AWS, LLM, LinkedIn, AI coding assistants
1mo
Save
Mark Applied
Hide
AI Developer, AVP
Burlington, Massachusetts, United States
$90k-$158k/yr OnsiteFull Time
2+ YOEHands-on engineer with 2+ years building production AI systems: LLMs, RAG, agent frameworks, Python (plus Java/C#/TypeScript), cloud platforms (Azure preferred), Kafka/Event Hub, Redis/Hazelcast, and CI/CD practices.
LLMs, RAG, MCP, Python, Java, C#, TypeScript, Kafka, Event Hub, Redis, Hazelcast, Snowflake, Microsoft Azure, AWS, GCP, API Management, APIs, CI/CD, Agile, Scrum
1mo
Save
Mark Applied
Hide
Principal Build & Release Engineer
Evendale or Lynn or Grand Rapids
$152k-$202k/yr OnsiteFull Time
10+ YOEBachelor's in CS/STEM, 10+ years engineering experience, production AI/ML systems and end-to-end service delivery, strong software and DevSecOps/MLOps skills, US person and ability to obtain security clearance required.
Python, C++, Rust, Go, Java, AWS, Azure, GCP, Docker, Kubernetes, CI/CD, MLflow, Kubeflow, LLM, CFD, FEA, PLM
1mo
Save
Mark Applied
Hide
Senior Software Machine Learning Engineer (Teradyne, North Reading, MA) (North Reading, MA, US)
North Reading, Massachusetts, United States
$134k-$224k/yr OnsiteFull Time
5+ YOE5+ years ML experience, LLM fine-tuning, reinforcement learning and reward-model design, production ML/MLOps, Python, distributed systems, computer vision for manufacturing, edge deployment (ONNX/quantization), strong communication.
Python, ONNX, LangChain, AutoGen, STDF, TEMS, LLM, PPO, MLOps
1mo
Save
Mark Applied
Hide
Machine Learning Engineer
Burlington, Massachusetts, United States
$165k-$200k/yr HybridFull Time
3+ YOEBS/MS/PhD in CS or related field, 3-5 years building and deploying ML systems, strong C++ and Python skills, experience with AI agents/LLM apps, and excellent collaboration and problem-solving skills.
C++, Python, LangChain, LangGraph, LlamaIndex, AutoGen, Semantic Kernel, TensorRT, ONNX, OpenVINO, TVM, MLOps, CI/CD, GPU, NPU, FPGA
1mo
Save
Mark Applied
Hide
Lead Release/Software Engineering
Burlington, Massachusetts, United States
$173k-$260k/yr HybridFull Time
8+ YOE8+ years in software engineering with deep release engineering/CI/CD/build systems experience; strong Java and build-tool skills; experience with CI/CD platforms, cloud, containers, observability, AI/LLM dev tooling; related technical degree required.
Java, Gradle, Maven, Bazel, Jenkins, GitLab CI, GitHub Actions, LLM, Docker, Kubernetes, AWS, GCP, Splunk, Grafana, ELK
2mo
Save
Mark Applied
Hide
Product Security Engineer
Andover, Massachusetts, United States
$100k-$125k/yr OnsiteFull Time
3+ YOEOperate a SOC for Azure environments: monitor, detect, investigate, and respond to threats; perform forensic investigations; develop detections and automation; experience with Azure GovCloud/GCC High, SIEM, Python/PowerShell, and relevant Azure security certifications.
Azure, Azure GovCloud, GCC High, SIEM, Python, PowerShell, Managed Detection and Response (MDR), AI/ML, LLM, Aras SaaS
1w
Save
Mark Applied
Hide
Principal Data Engineer - CX Analytics
Portland or Chattanooga or Atlanta or Columbia or Baton Rouge or Ireland or Poland or United Kingdom
$109k-$224k/yr OnsiteFull Time
8+ YOEBachelor’s degree in a quantitative field and 8 years of professional experience preferred. Requires expertise in Python, Java or Scala, SQL, data pipelines, architecture, DevOps, cloud platforms, analytics, and technical leadership.
DB2, SQL Server, Web API, Teradata, Java, Scala, Python, SQL, DevOps, CI/CD, Cloud, Microsoft Excel, LLM
3mo
Save
Mark Applied
Hide
Engineering Manager, Application Security
Austin or San Francisco or Concord
$210k-$240k/yr HybridFull Time
5+ YOE2+ Mgmt5+ years security or full-stack engineering; 2+ years managing security or platform team; hands-on AppSec; automation with AI/LLMs; fintech/real estate familiarity preferred.
JavaScript, NodeJS, Typescript, MongoDB, Kubernetes, AWS, SAST, DAST, SCA, AI tooling
2mo
Save
Mark Applied
Hide
AI Architect
Woburn, Massachusetts, United States
$130k-$155k/yr OnsiteFull Time
8+ YOE8+ years in software/cloud infrastructure/enterprise architecture; LLM/MLOps experience; enterprise platform design; AI governance and security.
Azure OpenAI, AWS Bedrock, Google Vertex AI, OpenAI, Anthropic, LangChain, LlamaIndex, Semantic Kernel, CrewAI, AutoGen, IBM Watson X, AWS AgentCore, Pinecone, Weaviate, Milvus, pgvector, Elasticsearch, OpenSearch, Azure AI Search, Workato, MuleSoft, Boomi, UiPath, n8n, Zapier, Make
Explore Jobs