HiringCafe
Join our community

28 llmops engineer jobs at 19 companies in New York

2mo
Save
Mark Applied
Hide
Senior AI Engineer
Morristown or Glendale or New York City
$140k-$190k/yr OnsiteFull Time
Coaction Specialty Insurance
Coaction Specialty Insurance: Provides specialty property and casualty insurance for commercial businesses.
5+ YOE5+ years building production systems; proficiency in Python/C#/Java; experience with LLMs, RAG, embeddings, vector DBs, ML/LLMOps; cloud experience (AWS/Azure); strong engineering hygiene and AI risk/security awareness.
Python, C#, Java, LLMs, ML APIs, RAG, embeddings, vector databases, REST, JSON, AWS, Azure, CI/CD, MLOps, LLMOps
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff AI Engineer
Miami or New York or San Francisco or Mexico City or United States
RemoteFull Time
Félix Pago
Félix Pago: Remittance platform for money transfers via WhatsApp messaging.
8+ YOE8+ years software engineering experience with infrastructure and systems development; 2+ years building production LLM/AI applications; strong Python, system architecture, containerization (Docker/Kubernetes), CI/CD, observability, RAG and agentic systems experience.
Python, Docker, Kubernetes, CI/CD, LLM APIs, LLMOps, RAG, vector databases, Open CLAW, Hermes, WhatsApp
Job PostingView all
2mo
Save
Mark Applied
Hide
AI Engineer - Forward Deployed Engineer · Snowflake · Reinvention Centers Associate Manager
Dallas or St. Petersburg or Tampa or Atlanta or Columbus or Houston or Cleveland or California or Colorado or District of Columbia or Illinois or Maine or Maryland or Massachusetts or Minnesota or New York or New Jersey or Virginia or Washington
$63k-$220k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global provider of management consulting and technology services.
4+ YOEMinimum 4 years Snowflake engineering and large-scale data experience, 4+ years Python/Java, production CI/CD and IaC experience, practical MLOps/LLMOps, 1+ year agentic AI production experience, strong communication and client-facing skills.
Snowflake AI Data Cloud, Snowflake, Snowpark, Dynamic Tables, Streams, Tasks, Snowsight, Snowsight UI, Cortex AI, Cortex Search, Cortex Analyst, Cortex LLM functions, SQL, Python, Java, Spark, Terraform, Helm, CI/CD, MLOps, LLMOps, OpenAI, Claude, Vertex AI
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior. Distinguished AI Engineer (Agentic AI Platform)
San Francisco or McLean or Cambridge or San Jose or New York
$343k-$392k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
8+ YOEMaster's + 8 years or Bachelor's + 10 years in AI/ML; deep software engineering skills; experience with agentic frameworks, LLMOps, cloud platforms, Kubernetes, and mentoring/architecting large-scale AI systems.
Python, Go, Golang, Scala, Java, C++, C#, LangGraph, AutoGen, Semantic Kernel (Microsoft), Semantic Kernel, LangChain, CrewAI, LlamaIndex, LLMOps, Google Cloud Vertex AI, Amazon SageMaker, Azure Machine Learning, AWS, Google Cloud, Azure, K8s, Helm, CRDs, CLI, SDK, VectorDBs
Job PostingView all
2w
Save
Mark Applied
Hide
Forward Deployed AI Engineer
New York City, New York, United States
$270k-$320k/yr RemoteFull Time
Cloudera
Cloudera: Provides hybrid data platforms for enterprise analytics and AI.
5+ YOE5+ years building and deploying production systems, 2–3 years with generative or agentic AI, experience with foundation models, RAG, LLMOps/MLOps, and scalable enterprise AI architectures; strong customer engagement and mentoring skills.
Retrieval-Augmented Generation (RAG), LLMOps, MLOps, AWS, Azure, GCP, Cloudera, Spark, Iceberg, NiFi, NVIDIA GPUs
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior. Distinguished AI Engineer - Agentic AI Platform (Remote Eligible)
San Francisco or McLean or New York City or San Jose or United States or Cambridge
$286k-$392k/yr RemoteFull Time
Capital One
Capital OneNYSE: COF: Provides credit card, banking, and auto loan services.
10+ YOEBachelor's degree plus 10 years or master's plus 8 years developing AI/ML technologies; 10 years programming; experience with scalable AI platforms, agentic frameworks, LLMOps, Kubernetes, and technical leadership.
Python, Go, Scala, Java, AWS, Google Cloud, Azure, LangGraph, AutoGen, Semantic Kernel, CrewAI, LlamaIndex, Google Cloud Vertex AI, Amazon SageMaker, Azure Machine Learning, C++, C#, Golang, Helm, Kubernetes, CRDs, LLM Inference, VectorDBs, K8s
Job PostingView all
2mo
Save
Mark Applied
Hide
Information Technology - Principal Platform Engineer, Enterprise AI Enablement
Vancouver or Seattle or Toronto or New York City or Los Angeles
OnsiteFull Time
Aritzia
AritziaToronto Stock Exchange: ATZ: Designs and sells everyday luxury women's clothing and accessories.
Deep enterprise AI and platform architecture experience, LLMOps/MLOps, AI guardrails and observability, vector DBs and data orchestration, vendor evaluation, and cross-functional leadership for enterprise AI enablement.
Azure AI Studio, AWS Bedrock, Google Cloud Vertex AI, LLMOps, MLOps, RAG
Job PostingView all
1d
Save
Mark Applied
Hide
AI Engineering & Platform Leadership Senior Manager - Utilities
Albany or Arlington or Atlanta or Austin or Beaverton or Bentonville or Boston or Carmel or Charlotte or Chicago or Cincinnati or Cleveland or Columbus or Culver City or Denver or Detroit or Hartford or Houston or Irving or Kirkland or Miami or Milwaukee or Minneapolis or Morristown or Mountain View or Nashville or New York City or Oklahoma City or Overland Park or Philadelphia or Pittsburgh or Raleigh or Sacramento or San Diego or San Francisco or Scottsdale or Seattle or St. Louis or St. Petersburg or Walnut Creek or United States
$113k-$338k/yr HybridFull Time
Accenture
AccentureNYSE: ACN: Global professional services firm providing consulting and technology solutions.
10+ YOE5+ MgmtRequires 10+ years in software or AI/ML engineering, 6+ years architecting enterprise AI platforms, leadership experience, multi-cloud and LLMOps expertise, utilities experience, and a bachelor's degree or equivalent.
OpenAI, Anthropic, AWS, Azure, Google, LLMOps, MLOps, FinOps
Job PostingView all
2w
Save
Mark Applied
Hide
Corporate Vice President - Senior Full-stack AI Engineer
New York, New York, United States
$148k-$211k/yr HybridFull Time
New York Life
New York Life: Provides life insurance, retirement income, and investment solutions.
Strong software engineering with Python and TypeScript/Java, experience building production AI platforms and cloud-native systems, generative AI/LLM expertise, GCP and Kubernetes experience, MLOps/LLMOps, and strong communication.
Python, TypeScript, Java, Google Cloud Platform, Kubernetes, Cursor, Claude Code, GitHub Copilot, Windsurf, Vertex AI, LangChain, Google ADK, CrewAI, AutoGen, MLflow, OpenTelemetry, GraphRAG, Ray, vLLM
Job PostingView all
3w
Save
Mark Applied
Hide
GenAI / Agentic AI Developer
New York City, New York, United States
$80k-$101k/yr OnsiteFull Time
Capgemini
CapgeminiEuronext Paris: CAP: Provides global IT consulting and digital transformation services.
Hands-on Python developer experienced building LLM, RAG and agentic AI solutions, vector search and retrieval pipelines, agent frameworks, REST APIs, containerized deployment, and LLMOps.
Python, FastAPI, Flask, REST APIs, LangGraph, LangChain, AutoGen, CrewAI, Semantic Kernel, LlamaIndex, OpenAI, Azure OpenAI, AWS Bedrock, Anthropic Claude, Gemini, Llama, Mistral, OpenSearch, Pinecone, FAISS, Chroma, Weaviate, Milvus, Azure AI Search, pgvector, Docker, Kubernetes, CI/CD, LangSmith, MLflow, Phoenix, Ragas, TruLens, Arize, OpenTelemetry, AWS SageMaker, GCP Vertex AI, Neo4j
Job PostingView all
4w
Save
Mark Applied
Hide
Senior. Distinguished AI Engineer - Agentic AI Platform (Remote Eligible)
San Francisco or McLean or New York City or San Jose or Cambridge or United States
$286k-$392k/yr RemoteFull Time
Capital One
Capital OneNYSE: COF: A diversified financial services providing banking and credit products.
10+ YOEBachelor's degree plus 10 years or master's degree plus 8 years in AI/ML, and 10 years programming with Python, Go, Scala, or Java; cloud AI, agentic frameworks, LLMOps, and ML platform experience preferred.
Python, Go, Scala, Java, AWS, Google Cloud, Azure, LangChain, CrewAI, Semantic Kernel, Microsoft, AutoGen, Google Cloud Vertex AI, Amazon SageMaker, Azure Machine Learning, C++, C#, Golang, Helm, K8s, LlamaIndex, LangGraph, LlamaIndex
Job PostingView all
1w
Save
Mark Applied
Hide
Senior AI Engineer - Agentic Systems
Dallas or Chicago or New York City
$144k-$268k/yr HybridFull Time
IBM
IBMNew York Stock Exchange: IBM: Global technology providing enterprise software, cloud, and consulting.
7+ YOE7+ years designing, developing, and deploying enterprise AI using LLMs, RAG, agentic workflows, LangChain/LangGraph, Azure, CI/CD, and MLOps; strong integration, security, and client-facing skills.
LangChain, LangGraph, AutoGen, Semantic Kernel, CrewAI, Azure AI Search, Pinecone, Weaviate, Azure ML, Azure AI Studio, Azure OpenAI, Model Context Protocol (MCP), CI/CD, LLMOps, MLOps
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Director, AI Engineering
South San Francisco or New York City or Princeton or Chicago or Bellevue
HybridFull Time
ZS
ZS: Global management consulting and technology firm for healthcare and life sciences.
15+ YOE5+ Mgmt15+ years software engineering with 5+ years in AI/ML/data engineering, 5+ years leading multiple scrum teams, experience with multi-agent/RAG systems, LangGraph/LangChain, AWS Bedrock/SageMaker, strong eval/LLMOps and enterprise SaaS experience.
LangGraph, LangChain, AWS Bedrock, SageMaker, LangSmith, AgentCore
Job PostingView all
2mo
Save
Mark Applied
Hide
Check out this job at Deloitte, Senior OpenAI Forward Deployed Engineer - GPS
New York, New York, United States
$156k-$307k/yr OnsiteFull Time
Deloitte
Deloitte: Provides professional audit, consulting, advisory, and tax services.
7+ YOEBachelor's in CS/DS/Engineering; US Secret clearance; 7+ years software/data/analytics; 1+ year GenAI/LLM; OpenAI tech experience; 1+ year leading projects; travel ~50%; eligible to work in the U.S.
OpenAI, GPT-4o, Assistants API, Responses API, OpenAI Agents SDK, Spark, Airflow, dbt, LLMOps, MLOps, APIs, Microservices
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior AI Engineering
Pasadena or New York City or Houston
$150k-$275k/yr OnsiteFull Time
East West Bank
East West BankNASDAQ: EWBC: Provides commercial and consumer banking services across US and Asia.
10+ YOE10+ years in software/AI engineering, experience delivering production LLM/AI solutions, strong Python and cloud (Azure) skills, experience with ML/LLM frameworks, and fintech/regulatory domain knowledge.
Python, FastAPI, Flask, Azure OpenAI, Azure ML, Databricks, ADLS, Azure AI Search, OpenAI ChatGPT, OpenAI Codex, Anthropic Claude, Google Gemini, Microsoft Copilot, AWS Bedrock, Llama, Mistral, LangChain, LlamaIndex, Semantic Kernel, vector databases, model registries, CI/CD, MLOps, LLMOps
Job PostingView all
3w
Save
Mark Applied
Hide
Senior Director, AI Platform Architecture
North Carolina or New York or Colorado or California or Maryland or Ohio or Virginia or New Jersey or Pennsylvania or Illinois or Georgia or Texas or Massachusetts or Florida or Connecticut
$168k-$278k/yr RemoteFull Time
Thermo Fisher Scientific
Thermo Fisher ScientificNYSE: TMO: Sells equipment and chemicals for scientific research and healthcare.
12+ YOEBachelor's required (advanced degree preferred),12+ years in software/data/AI platform leadership, experience building/scaling AI/ML platforms, MLOps/LLMOps, cloud and modern data architectures, regulated environments preferred, US work authorization required, background check.
Snowflake, Databricks, Open AI
Job PostingView all
2w
Save
Mark Applied
Hide
Senior AI Architect Gen AI & Agentic AI
New York, New York, United States
$150k-$170k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
8+ YOE8+ years experience designing and delivering enterprise AI/GenAI and Agentic AI solutions; hands-on with LLMs, RAG, agent frameworks, Python, cloud AI services, ML frameworks, and AI governance.
GPT, Gemini, Claude, Llama, RAG, LangGraph, LangChain, AutoGen, CrewAI, Semantic Kernel, Google ADK, Python, Java, FastAPI, REST APIs, Kafka, TensorFlow, PyTorch, Scikit-Learn, MLOps, LLMOps, Azure OpenAI, Google Vertex AI, AWS Bedrock, Kubernetes, Docker, GitHub, CI/CD, Terraform, Cloud Security
Job PostingView all
4w
Save
Mark Applied
Hide
Gen AI Enterprise Architect-AVP
New York City or United States
HybridFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
8+ YOE8+ years in software engineering/ML/AI with onshore consulting experience; expertise in NLP, Python, deep learning, cloud platforms, vector databases, observability, and LLMOps.
Python, PyTorch, TensorFlow, LangChain, Autogen, Datadog, Splunk, Prometheus, Pinecone, Milvus, AWS, Azure, GCP
Job PostingView all
2mo
Save
Mark Applied
Hide
Director, Data Engineering & AI
Chicago or Dallas or Los Angeles or Minneapolis or New York or San Francisco or Seattle or Washington, D.C.
$200k-$250k/yr HybridFull Time
West Monroe
West Monroe: Business and technology consultancy specializing in digital transformation.
10+ YOE10+ years in client-facing consulting; deep data platform expertise (Databricks, GCP, Snowflake); AI data engineering and scalable data architectures; travel 30-50%; hybrid work arrangement.
Databricks, GCP, Snowflake, AWS, Azure, MLOps, LLMOps
Job PostingView all
1d
Save
Mark Applied
Hide
Data Scientist, Principal - AI Product Engineering
Oakland or Washington or Ohio or District of Columbia or California or Long Beach or Arizona or Colorado or Connecticut or Florida or Georgia or Maryland or Minnesota or Nevada or Oregon or El Dorado Hills or San Diego or Woodland Hills or Alabama or Illinois or Virginia or Wisconsin or Texas or New York
$161k-$242k/yr HybridFull Time
Ascendiun
Ascendiun: Nonprofit parent overseeing health insurance and clinical service organizations.
10+ YOEBachelor's degree or equivalent practical experience and 10 years in data science, machine learning, AI/ML, software engineering, or advanced analytics. Requires Python, APIs, ML infrastructure, PyTorch, TensorFlow, LangChain, and LangGraph.
Python, PyTorch, TensorFlow, LangChain, LangGraph, Azure, Google Cloud, AWS, SQL, Spark, CI/CD, MLOps, LLMOps
Job PostingView all

Explore Jobs

Expand Your Job Search