154 llmops engineer jobs at 99 companies in United States
3w
Save
Mark Applied
Hide
3w
LLMOps Engineer
McLean, Virginia, United States
OnsiteFull Time
Steampunk: Design-led federal technology consulting and innovation services firm.
2+ YOEAbility to hold a public trust; degree in CS/data engineering/ML or related; 2+ years in software/DevOps/MLOps or 3–5+ years depending on degree; Python, Docker, Kubernetes, cloud (AWS/Azure/GCP), LLM tooling experience.
Sedgwick: Provides global insurance claims management and risk services.
6+ YOE6+ years engineering experience; 3+ years in MLOps/LLMOps; proficient in AWS and Azure; strong Python/SQL/PySpark; containerization with Docker/Kubernetes; IaC with Terraform/CloudFormation; CI/CD/CT pipelines across cloud platforms.
Steampunk: Federal digital transformation and consulting services provider.
2+ YOEAbility to hold Public Trust. Degree in CS/Data/ML (BS or MS) plus multi-year experience; Python, LLM tool familiarity (Hugging Face Transformers, LangChain, LlamaIndex), Docker/Kubernetes, cloud (AWS/Azure/GCP), CI/CD, and MLOps/DevSecOps experience.
BSE Global: Operates professional sports franchises and premium entertainment venues.
3+ YOE3–6 years in DevOps/MLOps or infrastructure roles; strong AWS; production AI/ML experience; familiarity with Amazon Bedrock or similar LLM platforms; CI/CD pipelines; observability and monitoring.
Senior - MLOps/LLMOps Engineer, Development (51577)
United States
$155k-$195k/yrRemoteFull Time
Citrin Cooperman: Provides accounting, tax, and business advisory services for companies.
4+ YOEBS in CS/IT/Engineering; 4+ years in DevOps/MLOps/SRE; strong CI/CD and cloud infra; hands-on with LLMOps tools and frontend/backend integration.
Agentic Architecture and LLMOps Engineering - Senior Principal, VP III - State Street Investment Management
Boston or Quincy
$120k-$218k/yrOnsiteFull Time
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
15+ YOEMaster’s degree in Computer Science or related engineering; 15+ years in financial services; experience with multi-agent workflows, agentic AI, LLMOps, cloud platforms; strong communication; leadership.
Principal Engineer - Agentic AI Platform Engineering & Performance
Charlotte, North Carolina, United States
OnsiteFull Time
Bank of AmericaNYSE: BAC: Provides global banking, investing, and financial risk management services.
15+ YOE15+ years engineering experience leading enterprise platforms and developer tooling; deep expertise in agent orchestration, LLMOps, AI performance engineering, CI/CD, SDLC governance, and stakeholder influence. Bachelor’s required.
Dallas or St. Petersburg or Tampa or Atlanta or Columbus or Houston
$63k-$262k/yrHybridFull Time
AccentureNYSE: ACN: Global provider of management consulting and technology services.
5+ YOEExperience productionizing GenAI on Databricks and Lakehouse (Delta Lake, DLT, Unity Catalog), building RAG and multi-agent systems, strong Python/Java skills, MLOps/LLMOps and CI/CD experience, and 4–5+ years engineering experience.
Distinguished AI Engineer - Onsite in Jersey City, NJ
Jersey City, New Jersey, United States
$140k-$210k/yrOnsiteFull Time
NTT DATA: Global provider of IT and business consulting services.
10+ YOE10+ years in AI/ML systems or platform engineering; deep experience with LLMs, RAG, embeddings, model serving, LLMOps/MLOps, GPU/inference optimization, governance, and stakeholder engagement.
LLMs, LLMOps, MLOps, RAG, embeddings, AI gateways, model-serving, model hubs, agent frameworks, orchestration layers, GPU, evaluation frameworks, observability
ManTech: Provides technology solutions for defense and intelligence agencies.
7+ YOE7+ years AI/ML production engineering experience, strong Python, TensorFlow/PyTorch, MLOps/LLMOps, Kubernetes with GPU optimization, Azure ecosystem experience, and ability to obtain TS/SCI with polygraph.
Anaplan: Provider of cloud-native enterprise business planning and modeling software.
Extensive hands-on experience building and deploying ML and Generative AI systems, expertise with LLMs, prompt engineering, MLOps/LLMOps, Python, CI/CD, and production model monitoring and evaluation.
Capital Group: Providing active investment management and research-driven financial strategies
10+ YOE10+ years software engineering experience, strong Python, hands-on LLM/LLMOps and RAG production experience, system design, eval-driven development, security/privacy controls, and bachelor’s degree or equivalent.
Western Governors University: Offers accredited online competency-based bachelor's and master's degrees.
7+ YOE7+ years software/ML experience,5+ years building LLM/AI systems,Python proficiency,experience with LLMOps/MLOps,platform engineering,LLM fine-tuning and evaluation;Bachelor's required,Master's preferred.
ManulifeTSX: MFC: Provides insurance, wealth management, and investment services globally.
5+ YOE5+ years in AI/ML/ML engineering or related role; strong Python and SQL; experience deploying models to production, MLOps/LLMOps, cloud (preferably Microsoft Azure), Databricks, MLflow, and monitoring production models.
Python, Microsoft Azure, Microsoft Azure ML, Microsoft Azure OpenAI, Microsoft Azure AI Search, Databricks, MLflow, Docker, Kubernetes, Microsoft AKS, GitHub Actions, Microsoft Azure DevOps, SQL, Spark, Delta Lake, Elastic, Pinecone, FAISS, vector databases, MLOps, LLMOps, RAG
Coaction Specialty Insurance: Provides specialty property and casualty insurance for commercial businesses.
5+ YOE5+ years building production systems; proficiency in Python/C#/Java; experience with LLMs, RAG, embeddings, vector DBs, ML/LLMOps; cloud experience (AWS/Azure); strong engineering hygiene and AI risk/security awareness.
Aimpoint Digital: Provides data engineering and analytics consulting services to businesses.
3+ YOEBachelor's in CS/Engineering/Math or equivalent; 3+ years software engineering; 1+ year production AI/ML; programming in Python, Java, C#, Go, or TypeScript; experience with MLOps/LLMOps, Kubernetes, cloud platforms, and production deployment.
Python, Java, C#, Go, TypeScript, Claude Code, OpenAI Codex, Google Antigravity, Cursor, GitHub Copilot, FastAPI, Flask, Spring Boot, .NET, Express, AWS, Azure, GCP, Databricks, Snowflake, Kubernetes, MLOps, LLMOps
5+ YOEBachelor's degree or equivalent and 5+ years coding in Python and SQL, 5+ years MLOps/LLMOps and data pipeline design for unstructured text and ML workflows.
Python, SQL, Google Colaboratory (Colab), TensorFlow, Tensor Processing Units (TPUs)
CognizantNASDAQ: CTSH: Provides IT consulting and technology services to global enterprises.
8+ YOE8+ years in AI/ML engineering, solution architecture, pre-sales, or technical consulting; production GenAI/LLM delivery; production coding in Python; multi-hyperscaler and agent/LLMOps experience; strong executive presence; US work authorization required.
Python, AWS Bedrock, Google Vertex AI, Azure AI Foundry, LangGraph, CrewAI, Microsoft Agent Framework, LangSmith, Langfuse, Arize Phoenix, Braintrust, NIST AI RMF, ISO 42001, EU AI Act