154 llmops engineer jobs at 99 companies in United States

3w
Save
Mark Applied
Hide
LLMOps Engineer
McLean, Virginia, United States
OnsiteFull Time
Steampunk
Steampunk: Design-led federal technology consulting and innovation services firm.
2+ YOEAbility to hold a public trust; degree in CS/data engineering/ML or related; 2+ years in software/DevOps/MLOps or 3–5+ years depending on degree; Python, Docker, Kubernetes, cloud (AWS/Azure/GCP), LLM tooling experience.
Python, Hugging Face Transformers, LangChain, LlamaIndex, Docker, Kubernetes, AWS, Azure, GCP, CI/CD, vector databases
2mo
Save
Mark Applied
Hide
Senior Engineer - LLMOps & MLOps
United States
RemoteFull Time
Sedgwick
Sedgwick: Provides global insurance claims management and risk services.
6+ YOE6+ years engineering experience; 3+ years in MLOps/LLMOps; proficient in AWS and Azure; strong Python/SQL/PySpark; containerization with Docker/Kubernetes; IaC with Terraform/CloudFormation; CI/CD/CT pipelines across cloud platforms.
Python, SQL, PySpark, Docker, Kubernetes, Airflow, Kubeflow, Step Functions, LangSmith, Arize Phoenix, WhyLabs, Terraform, CloudFormation, Bedrock, Azure OpenAI, SageMaker, Pinecone, OpenSearch, Azure AI Search, Databricks, Snowflake
3w
Save
Mark Applied
Hide
LLMOps Engineer
McLean, Virginia, United States
$115k-$145k/yr OnsiteFull Time
Steampunk
Steampunk: Federal digital transformation and consulting services provider.
2+ YOEAbility to hold Public Trust. Degree in CS/Data/ML (BS or MS) plus multi-year experience; Python, LLM tool familiarity (Hugging Face Transformers, LangChain, LlamaIndex), Docker/Kubernetes, cloud (AWS/Azure/GCP), CI/CD, and MLOps/DevSecOps experience.
Python, Hugging Face Transformers, LangChain, LlamaIndex, Docker, Kubernetes, AWS, Azure, GCP, CI/CD
3mo
Save
Mark Applied
Hide
LLMOps Engineer
Brooklyn, New York, United States
$130k-$150k/yr OnsiteFull Time
BSE Global
BSE Global: Operates professional sports franchises and premium entertainment venues.
3+ YOE3–6 years in DevOps/MLOps or infrastructure roles; strong AWS; production AI/ML experience; familiarity with Amazon Bedrock or similar LLM platforms; CI/CD pipelines; observability and monitoring.
AWS, Amazon Bedrock, CI/CD, Observability
1mo
Save
Mark Applied
Hide
Senior - MLOps/LLMOps Engineer, Development (51577)
United States
$155k-$195k/yr RemoteFull Time
Citrin Cooperman
Citrin Cooperman: Provides accounting, tax, and business advisory services for companies.
4+ YOEBS in CS/IT/Engineering; 4+ years in DevOps/MLOps/SRE; strong CI/CD and cloud infra; hands-on with LLMOps tools and frontend/backend integration.
Azure DevOps, GitHub Actions, GitLab CI, MLflow, LangSmith, LangGraph, LangChain, PromptFlow, Arize, OpenAI, Anthropic, Google Vertex AI, Docker, Kubernetes, Python, Azure, AWS, Terraform, CI/CD
1mo
Save
Mark Applied
Hide
Senior - MLOps/LLMOps Engineer, Development (51577)
United States
$155k-$195k/yr RemoteFull Time
Citrin Cooperman
Citrin Cooperman: Provides accounting, tax, and business advisory services to clients.
4+ YOEBachelor's in CS/IT/Engineering; ML/AI certifications; 4+ years DevOps/MLOps/SRE; CI/CD and cloud experience; Python; LLM/observability tools.
Azure DevOps, GitHub Actions, GitLab CI, MLflow, LangSmith, PromptFlow, Arize, Docker, Kubernetes, LangGraph, OpenAI, Anthropic, Google Vertex AI
2mo
Save
Mark Applied
Hide
Agentic Architecture and LLMOps Engineering - Senior Principal, VP III - State Street Investment Management
Boston or Quincy
$120k-$218k/yr OnsiteFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
15+ YOEMaster’s degree in Computer Science or related engineering; 15+ years in financial services; experience with multi-agent workflows, agentic AI, LLMOps, cloud platforms; strong communication; leadership.
Python, SQL, Rust, Google Gemini Enterprise, Vertex AI, AWS Bedrock, GCP, Azure, Anthropic Code, GitHub Copilot, Codex
1mo
Save
Mark Applied
Hide
AI Engineer
Arlington, Virginia, United States
$117k-$243k/yr OnsiteFull Time
Accenture Federal Services
Accenture Federal ServicesNYSE: ACN: Provides technology and consulting services to U.S. federal agencies.
Experience in AI/ML production engineering, LLMOps or MLOps, deployment of RAG architectures; Kubernetes-based deployments; Python development; GPU inference optimization; familiarity with LangGraph, Semantic Kernel, vLLM, Ollama, Ray; NVIDIA GPU ecosystems.
LLMOps, MLOps, Kubernetes, Python, LangGraph, Semantic Kernel, vLLM, Ollama, Ray, OpenAI API, GPU NVIDIA, Vector databases
2w
Save
Mark Applied
Hide
Principal Engineer - Agentic AI Platform Engineering & Performance
Charlotte, North Carolina, United States
OnsiteFull Time
Bank of America
Bank of AmericaNYSE: BAC: Provides global banking, investing, and financial risk management services.
15+ YOE15+ years engineering experience leading enterprise platforms and developer tooling; deep expertise in agent orchestration, LLMOps, AI performance engineering, CI/CD, SDLC governance, and stakeholder influence. Bachelor’s required.
LLMOps, CI/CD, SDLC, RAG
1mo
Save
Mark Applied
Hide
AI Engineer - Forward Deployed Engineer Associate Manager · Databricks · Reinvention Centers
Dallas or St. Petersburg or Tampa or Atlanta or Columbus or Houston
$63k-$262k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
5+ YOEExperience productionizing GenAI on Databricks and Lakehouse (Delta Lake, DLT, Unity Catalog), building RAG and multi-agent systems, strong Python/Java skills, MLOps/LLMOps and CI/CD experience, and 4–5+ years engineering experience.
Databricks, Mosaic AI, Hugging Face, LangChain, DSPy, Vector Search, Model Serving, MLflow, Unity Catalog, Delta Lake, DLT, Apache Spark, OpenAI, Claude, Vertex AI, Python, Java, Terraform, Helm, CI/CD, MLOps, LLMOps, AWS, Azure, GCP
2w
Save
Mark Applied
Hide
Distinguished AI Engineer - Onsite in Jersey City, NJ
Jersey City, New Jersey, United States
$140k-$210k/yr OnsiteFull Time
NTT DATA
NTT DATA: Global provider of IT and business consulting services.
10+ YOE10+ years in AI/ML systems or platform engineering; deep experience with LLMs, RAG, embeddings, model serving, LLMOps/MLOps, GPU/inference optimization, governance, and stakeholder engagement.
LLMs, LLMOps, MLOps, RAG, embeddings, AI gateways, model-serving, model hubs, agent frameworks, orchestration layers, GPU, evaluation frameworks, observability
1mo
Save
Mark Applied
Hide
AI Engineer
Washington, District of Columbia, United States
$142k-$236k/yr OnsiteFull Time
ManTech
ManTech: Provides technology solutions for defense and intelligence agencies.
7+ YOE7+ years AI/ML production engineering experience, strong Python, TensorFlow/PyTorch, MLOps/LLMOps, Kubernetes with GPU optimization, Azure ecosystem experience, and ability to obtain TS/SCI with polygraph.
Python, TensorFlow, PyTorch, Kubernetes, MLOps, LLMOps, OpenAI-compatible APIs, LangGraph, Semantic Kernel, Ray, NVIDIA GPU, Azure OpenAI, Azure Synapse, Databricks, Azure Security Center
1mo
Save
Mark Applied
Hide
Principal Engineer, AI
Pennsylvania, United States
RemoteFull Time
Anaplan
Anaplan: Provider of cloud-native enterprise business planning and modeling software.
Extensive hands-on experience building and deploying ML and Generative AI systems, expertise with LLMs, prompt engineering, MLOps/LLMOps, Python, CI/CD, and production model monitoring and evaluation.
Python, LLM APIs, MLOps, LLMOps, CI/CD, Pinecone, Weaviate, Qdrant, vLLM, TensorRT, Ray, LangSmith, W&B, MLflow
2d
Save
Mark Applied
Hide
AI Engineer Lead
Irvine, California, United States
$179k-$287k/yr OnsiteFull Time
Capital Group
Capital Group: Providing active investment management and research-driven financial strategies
10+ YOE10+ years software engineering experience, strong Python, hands-on LLM/LLMOps and RAG production experience, system design, eval-driven development, security/privacy controls, and bachelor’s degree or equivalent.
Python, MLOps, LLMOps, FinOps, IAM, SOC 2
2d
Save
Mark Applied
Hide
Staff AI Engineer
Raleigh, North Carolina, United States
$161k-$250k/yr OnsiteFull Time
Western Governors University
Western Governors University: Offers accredited online competency-based bachelor's and master's degrees.
7+ YOE7+ years software/ML experience,5+ years building LLM/AI systems,Python proficiency,experience with LLMOps/MLOps,platform engineering,LLM fine-tuning and evaluation;Bachelor's required,Master's preferred.
Python, AWS, Databricks, PEFT, LLM APIs, RAG pipelines, MLOps, LLMOps
3w
Save
Mark Applied
Hide
Senior AI Engineer
Boston or Toronto
$107k-$200k/yr HybridFull Time
Manulife
ManulifeTSX: MFC: Provides insurance, wealth management, and investment services globally.
5+ YOE5+ years in AI/ML/ML engineering or related role; strong Python and SQL; experience deploying models to production, MLOps/LLMOps, cloud (preferably Microsoft Azure), Databricks, MLflow, and monitoring production models.
Python, Microsoft Azure, Microsoft Azure ML, Microsoft Azure OpenAI, Microsoft Azure AI Search, Databricks, MLflow, Docker, Kubernetes, Microsoft AKS, GitHub Actions, Microsoft Azure DevOps, SQL, Spark, Delta Lake, Elastic, Pinecone, FAISS, vector databases, MLOps, LLMOps, RAG
1mo
Save
Mark Applied
Hide
Senior AI Engineer
Morristown or Glendale or New York City
$140k-$190k/yr OnsiteFull Time
Coaction Specialty Insurance
Coaction Specialty Insurance: Provides specialty property and casualty insurance for commercial businesses.
5+ YOE5+ years building production systems; proficiency in Python/C#/Java; experience with LLMs, RAG, embeddings, vector DBs, ML/LLMOps; cloud experience (AWS/Azure); strong engineering hygiene and AI risk/security awareness.
Python, C#, Java, LLMs, ML APIs, RAG, embeddings, vector databases, REST, JSON, AWS, Azure, CI/CD, MLOps, LLMOps
2w
Save
Mark Applied
Hide
Senior AI Engineer 2026 - US
Atlanta or Sandy Springs or United States
RemoteFull Time
Aimpoint Digital
Aimpoint Digital: Provides data engineering and analytics consulting services to businesses.
3+ YOEBachelor's in CS/Engineering/Math or equivalent; 3+ years software engineering; 1+ year production AI/ML; programming in Python, Java, C#, Go, or TypeScript; experience with MLOps/LLMOps, Kubernetes, cloud platforms, and production deployment.
Python, Java, C#, Go, TypeScript, Claude Code, OpenAI Codex, Google Antigravity, Cursor, GitHub Copilot, FastAPI, Flask, Spring Boot, .NET, Express, AWS, Azure, GCP, Databricks, Snowflake, Kubernetes, MLOps, LLMOps
1w
Save
Mark Applied
Hide
Senior Data Engineer, GTM
Mountain View or Chicago or Irvine or New York City
$156k-$227k/yr OnsiteFull Time
Google
GoogleNASDAQ: GOOGL: Provides online search, advertising, cloud computing, and consumer electronics.
5+ YOEBachelor's degree or equivalent and 5+ years coding in Python and SQL, 5+ years MLOps/LLMOps and data pipeline design for unstructured text and ML workflows.
Python, SQL, Google Colaboratory (Colab), TensorFlow, Tensor Processing Units (TPUs)
3w
Save
Mark Applied
Hide
Staff AI Customer Engineer
United States
$130k-$230k/yr HybridFull Time
Cognizant
CognizantNASDAQ: CTSH: Provides IT consulting and technology services to global enterprises.
8+ YOE8+ years in AI/ML engineering, solution architecture, pre-sales, or technical consulting; production GenAI/LLM delivery; production coding in Python; multi-hyperscaler and agent/LLMOps experience; strong executive presence; US work authorization required.
Python, AWS Bedrock, Google Vertex AI, Azure AI Foundry, LangGraph, CrewAI, Microsoft Agent Framework, LangSmith, Langfuse, Arize Phoenix, Braintrust, NIST AI RMF, ISO 42001, EU AI Act