HiringCafe
Join our community

31 llmops engineer jobs at 23 companies in Queens, NY

1d
Save
Mark Applied
Hide
12097 AI Engineer - Solutions & LLMOps
Newark, New Jersey, United States
$79k-$126k/yr HybridFull Time
Public Service Enterprise Group
Public Service Enterprise GroupNYSE: PEG: Providing energy, utility, and power generation services.
2+ YOEBachelor's in CS/Engineering or related,2+ years in software/cloud/AI engineering,experience with Python,cloud platforms,APIs,DevOps practices,and compliance with DOE 10 CFR 810.
Python, Git, Azure DevOps, GitHub, Docker, Kubernetes, Azure OpenAI, Azure AI Services, AWS Bedrock, ServiceNow, SAP, Salesforce
Job PostingView all
2w
Save
Mark Applied
Hide
AI Orchestration Engineer
Quincy or Berwyn or Princeton or Clifton
$90k-$158k/yr OnsiteFull Time
State Street
State StreetNYSE: STT: Provides investment servicing and management to institutional investors.
3+ YOEBachelor's degree and 3+ years in data/AI engineering or related fields; experience with Python, SQL, large-scale data pipelines, RAG, MLOps/LLMOps, and AI governance in regulated environments.
Python, SQL, LangGraph, Semantic Kernel, CrewAI, AutoGen, LangChain, Databricks, Snowflake, Spark, Kafka, Delta Lake, Iceberg, Airflow, APIs, MLOps, LLMOps, RAG
Job PostingView all
2mo
Save
Mark Applied
Hide
Senior AI Engineer
Morristown or Glendale or New York City
$140k-$190k/yr OnsiteFull Time
Coaction Specialty Insurance
Coaction Specialty Insurance: Provides specialty property and casualty insurance for commercial businesses.
5+ YOE5+ years building production systems; proficiency in Python/C#/Java; experience with LLMs, RAG, embeddings, vector DBs, ML/LLMOps; cloud experience (AWS/Azure); strong engineering hygiene and AI risk/security awareness.
Python, C#, Java, LLMs, ML APIs, RAG, embeddings, vector databases, REST, JSON, AWS, Azure, CI/CD, MLOps, LLMOps
Job PostingView all
1mo
Save
Mark Applied
Hide
Staff AI Engineer
Miami or New York or San Francisco or Mexico City or United States
RemoteFull Time
Félix Pago
Félix Pago: Remittance platform for money transfers via WhatsApp messaging.
8+ YOE8+ years software engineering experience with infrastructure and systems development; 2+ years building production LLM/AI applications; strong Python, system architecture, containerization (Docker/Kubernetes), CI/CD, observability, RAG and agentic systems experience.
Python, Docker, Kubernetes, CI/CD, LLM APIs, LLMOps, RAG, vector databases, Open CLAW, Hermes, WhatsApp
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior. Distinguished AI Engineer (Agentic AI Platform)
San Francisco or McLean or Cambridge or San Jose or New York
$343k-$392k/yr OnsiteFull Time
Capital One
Capital OneNYSE: COF: Financial services offering credit cards, banking, and loans.
8+ YOEMaster's + 8 years or Bachelor's + 10 years in AI/ML; deep software engineering skills; experience with agentic frameworks, LLMOps, cloud platforms, Kubernetes, and mentoring/architecting large-scale AI systems.
Python, Go, Golang, Scala, Java, C++, C#, LangGraph, AutoGen, Semantic Kernel (Microsoft), Semantic Kernel, LangChain, CrewAI, LlamaIndex, LLMOps, Google Cloud Vertex AI, Amazon SageMaker, Azure Machine Learning, AWS, Google Cloud, Azure, K8s, Helm, CRDs, CLI, SDK, VectorDBs
Job PostingView all
1mo
Save
Mark Applied
Hide
Information Technology - Principal Platform Engineer, Enterprise AI Enablement
Vancouver or Seattle or Toronto or New York City or Los Angeles
OnsiteFull Time
Aritzia
AritziaToronto Stock Exchange: ATZ: Designs and sells everyday luxury women's clothing and accessories.
Deep enterprise AI and platform architecture experience, LLMOps/MLOps, AI guardrails and observability, vector DBs and data orchestration, vendor evaluation, and cross-functional leadership for enterprise AI enablement.
Azure AI Studio, AWS Bedrock, Google Cloud Vertex AI, LLMOps, MLOps, RAG
Job PostingView all
1w
Save
Mark Applied
Hide
GenAI Developer
New York City, New York, United States
$72k-$97k/yr OnsiteFull Time
Capgemini
CapgeminiEuronext Paris: CAP: Provides global IT consulting and digital transformation services.
Hands-on Python developer experienced building LLM-powered apps, RAG, agentic workflows, vector search, cloud deployment, and LLMOps for enterprise use cases.
LangChain, LangGraph, AutoGen, CrewAI, Semantic Kernel, LlamaIndex, Python, FastAPI, Flask, REST APIs, OpenAI, Microsoft Azure OpenAI, AWS Bedrock, Anthropic Claude, Gemini, Llama, Mistral, OpenSearch, Pinecone, FAISS, Chroma, Weaviate, Milvus, Microsoft Azure AI Search, pgvector, Docker, Kubernetes, CI/CD, LangSmith, MLflow, Phoenix, Ragas, TruLens, Arize, OpenTelemetry, SageMaker, Vertex AI
Job PostingView all
8h
Save
Mark Applied
Hide
Corporate Vice President - Senior Full-stack AI Engineer
New York, New York, United States
$148k-$211k/yr HybridFull Time
New York Life Insurance
New York Life Insurance: Providing life insurance, annuities, and long-term investment solutions.
Strong software engineering with Python and TypeScript/Java, experience building production AI platforms, cloud-native systems, MLOps/LLMOps, multi-agent orchestration, retrieval/RAG, and enterprise governance.
Python, TypeScript, Java, Cursor, Claude Code, GitHub Copilot, Windsurf, Vertex AI, LangChain, Google ADK, CrewAI, AutoGen, MLflow, OpenTelemetry, GraphRAG, Ray, vLLM, Google Cloud Platform, Kubernetes, Infrastructure as Code, CI/CD
Job PostingView all
1d
Save
Mark Applied
Hide
Corporate Vice President - Senior Full-stack AI Engineer
New York, New York, United States
$148k-$211k/yr HybridFull Time
New York Life
New York Life: Provides life insurance, retirement income, and investment solutions.
Strong software engineering with Python and TypeScript/Java, experience building production AI platforms and cloud-native systems, generative AI/LLM expertise, GCP and Kubernetes experience, MLOps/LLMOps, and strong communication.
Python, TypeScript, Java, Google Cloud Platform, Kubernetes, Cursor, Claude Code, GitHub Copilot, Windsurf, Vertex AI, LangChain, Google ADK, CrewAI, AutoGen, MLflow, OpenTelemetry, GraphRAG, Ray, vLLM
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior Research Software Engineer
New York, New York, United States
$149k-$169k/yr HybridFull Time
New York University
New York University: A private research university providing undergraduate and graduate education.
5+ YOEMaster's degree or equivalent experience, 5+ years software engineering, proficiency in Python/Go/node.js, git/GitHub, Kubernetes, cloud and HPC environments, CI/CD, Linux, databases, web frontend/backend; strong communication.
Python, Go, node.js, PyPI, git, GitHub, Kubernetes, CI/CD, Linux, HPC, AWS, GCP, DevOps, MLOps, LLMOps
Job PostingView all
1mo
Save
Mark Applied
Hide
Senior AI Forward Deployed Engineer - VP
New York City or United States
$200k-$280k/yr HybridFull Time
EXL
EXLNASDAQ: EXLS: Provides data analytics and digital operations solutions to businesses.
10+ YOE5+ Mgmt10+ years in AI/ML/Data Science with 5+ years leadership; deep expertise in LLMs, GenAI/Agentic frameworks, MLOps/LLMOps, cloud deployments, Python, and production ML systems.
Python, LangChain, LangGraph, Scikit-learn, NumPy, Pandas, RLlib, AWS SageMaker, AWS Bedrock, Hugging Face Transformers, spaCy, NLTK, Cursor, Windsurf, Replit, GitHub Copilot, GPT, Llama, Mistral, Claude, LlamaIndex, Langfuse, AutoGen, CrewAI, Pinecone, Weaviate, Chroma, FAISS, Scale.ai, Mercor, Docker, Kubernetes, Terraform, FastAPI, PostgreSQL, ReactJS, Redis, GCP, Jenkins, GitHub Actions
Job PostingView all
2w
Save
Mark Applied
Hide
Senior Lead Software Engineer- Python Distributed Development and AI Modernization
Jersey City, New Jersey, United States
$171k-$260k/yr OnsiteFull Time
JPMorgan Chase
JPMorgan ChaseNYSE: JPM: Global financial services firm providing banking and investment solutions.
5+ YOE5+ years software engineering experience with Python, LLM-based applications, distributed systems, event-driven architectures, and cloud platforms; strong communicator with AI-assisted development tool experience.
Claude Code, Codex, GitHub Copilot, Cursor, Python, COBOL, JCL, DB2, Kotlin, AWS, EKS, ECS, Temporal, Airflow, Kafka, PostgreSQL, Kubernetes, RAG, LLMOps
Job PostingView all
1mo
Save
Mark Applied
Hide
Forward Deployed AI Engineer - Associate Director (Hoboken, NJ, US, 07030)
Hoboken, New Jersey, United States
$188k-$342k/yr HybridFull Time
EY
EY: Global firm providing audit, tax, and professional consulting services.
6+ YOE6+ years in software/data/AI engineering with experience delivering scalable AI/ML solutions; proficiency in Python, LangChain/LlamaIndex/AutoGen, cloud platforms (Azure, AWS, GCP), container orchestration, Terraform/Ansible, and CI/CD; consulting experience and mentoring ability.
Python, LangChain, LlamaIndex, AutoGen, Retrieval-Augmented Generation (RAG), Kubernetes, Docker, Azure, AWS, GCP, Terraform, Ansible, CI/CD, MLOps, LLMOps
Job PostingView all
2mo
Save
Mark Applied
Hide
Check out this job at Deloitte, Senior OpenAI Forward Deployed Engineer - GPS
New York, New York, United States
$156k-$307k/yr OnsiteFull Time
Deloitte
Deloitte: Provides professional audit, consulting, advisory, and tax services.
7+ YOEBachelor's in CS/DS/Engineering; US Secret clearance; 7+ years software/data/analytics; 1+ year GenAI/LLM; OpenAI tech experience; 1+ year leading projects; travel ~50%; eligible to work in the U.S.
OpenAI, GPT-4o, Assistants API, Responses API, OpenAI Agents SDK, Spark, Airflow, dbt, LLMOps, MLOps, APIs, Microservices
Job PostingView all
1d
Save
Mark Applied
Hide
Senior Director, AI Engineering
South San Francisco or New York City or Princeton or Chicago or Bellevue
HybridFull Time
ZS
ZS: Global management consulting and technology firm for healthcare and life sciences.
15+ YOE5+ Mgmt15+ years software engineering with 5+ years in AI/ML/data engineering, 5+ years leading multiple scrum teams, experience with multi-agent/RAG systems, LangGraph/LangChain, AWS Bedrock/SageMaker, strong eval/LLMOps and enterprise SaaS experience.
LangGraph, LangChain, AWS Bedrock, SageMaker, LangSmith, AgentCore
Job PostingView all
2d
Save
Mark Applied
Hide
Managing Director, Head of AI Operational Architecture & Integration
Iselin or Charlotte or Dallas or New York City
$232k-$290k/yr HybridFull Time
TIAA
TIAA: Provides retirement and financial services for academic and non-profit sectors.
10+ YOE10+ Mgmt10+ years technology leadership experience in distributed systems, platform engineering/SRE, and AI/ML systems; university degree preferred; strong product mindset and ability to influence federated teams.
AWS, Azure, GCP, MLOps, LLMOps, LLMs, API
Job PostingView all
1w
Save
Mark Applied
Hide
Sr AI Manager
Morris Plains, New Jersey, United States
$236k-$295k/yr OnsiteFull Time
Solstice Advanced Materials
Solstice Advanced MaterialsNASDAQ: SOLS: Provider of specialty materials for industrial and commercial applications.
10+ YOEMaster's or PhD in CS/Engineering/Applied Math,10+ years in AI & analytics,expert Python and SQL,experience with vector DBs and Azure AI Search,ability to lead enterprise AI programs and governance.
Python, SQL, Azure AI Search, Qdrant, Postgres Vector, Azure OpenAI, Databricks, MLOps, LLMOps, AI Gateway, AI Observability, Pytorch, Tensorflow, Scikit Learn, Langchain, Langgraph, CrewAI, OpenAI SDK, Semantic Kernel, Terraform, Bicep, Docker, Kubernetes, Spark, Scala, Rust, C#, Java, SAP, Salesforce
Job PostingView all
3d
Save
Mark Applied
Hide
Security / Compliance Engineering
Jersey City, New Jersey, United States
$105k-$182k/yr OnsiteFull Time
NTT DATA
NTT DATA: Global provider of IT and business consulting services.
5+ YOE5+ years cybersecurity/cloud security/DevSecOps experience, 3+ years AI/ML/GenAI risk experience, threat modeling, vulnerability management, Terraform/IaC and AWS security expertise.
AWS, Terraform, CI/CD, Kubernetes, MLOps, LLMOps, Power Platform, Copilot Studio, IaC
Job PostingView all
1d
Save
Mark Applied
Hide
Senior AI Architect Gen AI & Agentic AI
New York, New York, United States
$150k-$170k/yr OnsiteFull Time
Tata Consultancy Services
Tata Consultancy ServicesNational Stock Exchange of India: TCS: Global provider of IT services, consulting, and business solutions.
8+ YOE8+ years experience designing and delivering enterprise AI/GenAI and Agentic AI solutions; hands-on with LLMs, RAG, agent frameworks, Python, cloud AI services, ML frameworks, and AI governance.
GPT, Gemini, Claude, Llama, RAG, LangGraph, LangChain, AutoGen, CrewAI, Semantic Kernel, Google ADK, Python, Java, FastAPI, REST APIs, Kafka, TensorFlow, PyTorch, Scikit-Learn, MLOps, LLMOps, Azure OpenAI, Google Vertex AI, AWS Bedrock, Kubernetes, Docker, GitHub, CI/CD, Terraform, Cloud Security
Job PostingView all
2mo
Save
Mark Applied
Hide
Director, Data Engineering & AI
Chicago or Dallas or Los Angeles or Minneapolis or New York or San Francisco or Seattle or Washington, D.C.
$200k-$250k/yr HybridFull Time
West Monroe
West Monroe: Business and technology consultancy specializing in digital transformation.
10+ YOE10+ years in client-facing consulting; deep data platform expertise (Databricks, GCP, Snowflake); AI data engineering and scalable data architectures; travel 30-50%; hybrid work arrangement.
Databricks, GCP, Snowflake, AWS, Azure, MLOps, LLMOps
Job PostingView all

Explore Jobs

Expand Your Job Search